Duckietown Challenges Home Challenges Submissions

Submission 19396

Submission19396
Competingyes
Challengelx22-BV1
UserRon Saad
Date submitted
Last status update
Completecomplete
DetailsEvaluation is complete.
Sisters
Result💔
Jobssim-0of5: 141076 sim-1of5: 141078 sim-2of5: 141077 sim-3of5: 141074 sim-4of5: 141075
Next
User labelexercises_braitenberg
Admin priority50
Blessingn/a
User priority50

141078

Click the images to see detailed statistics about the episode.

d45

141077

Click the images to see detailed statistics about the episode.

d45

141076

Click the images to see detailed statistics about the episode.

d30

141074

Click the images to see detailed statistics about the episode.

d50

Evaluation jobs for this submission

See previous jobs for previous versions of challenges
Job IDstepstatusup to datedate starteddate completeddurationmessage
141078sim-1of5successyes0:05:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.939379893273921


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.939379893273921
distance-from-start_median5.939379893273921
distance-from-start_min5.939379893273921
driven_any_max6.258011366405526
driven_any_mean6.258011366405526
driven_any_median6.258011366405526
driven_any_min6.258011366405526
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max40.44999999999984
in-drivable-lane_mean40.44999999999984
in-drivable-lane_median40.44999999999984
in-drivable-lane_min40.44999999999984
per-episodes
details{"d45-ego0": {"driven_any": 6.258011366405526, "survival_time": 40.44999999999984, "driven_lanedir": 0.0, "in-drivable-lane": 40.44999999999984, "deviation-heading": 0.0, "distance-from-start": 5.939379893273921, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max40.44999999999984
survival_time_mean40.44999999999984
survival_time_median40.44999999999984
survival_time_min40.44999999999984
No reset possible
141077sim-2of5successyes0:08:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.158476192426712


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.158476192426712
distance-from-start_median6.158476192426712
distance-from-start_min6.158476192426712
driven_any_max6.256661651517057
driven_any_mean6.256661651517057
driven_any_median6.256661651517057
driven_any_min6.256661651517057
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max40.39999999999984
in-drivable-lane_mean40.39999999999984
in-drivable-lane_median40.39999999999984
in-drivable-lane_min40.39999999999984
per-episodes
details{"d45-ego0": {"driven_any": 6.256661651517057, "survival_time": 40.39999999999984, "driven_lanedir": 0.0, "in-drivable-lane": 40.39999999999984, "deviation-heading": 0.0, "distance-from-start": 6.158476192426712, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max40.39999999999984
survival_time_mean40.39999999999984
survival_time_median40.39999999999984
survival_time_min40.39999999999984
No reset possible
141076sim-0of5successyes0:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.165303806356202


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.165303806356202
distance-from-start_median5.165303806356202
distance-from-start_min5.165303806356202
driven_any_max5.350238267454256
driven_any_mean5.350238267454256
driven_any_median5.350238267454256
driven_any_min5.350238267454256
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max35.800000000000104
in-drivable-lane_mean35.800000000000104
in-drivable-lane_median35.800000000000104
in-drivable-lane_min35.800000000000104
per-episodes
details{"d30-ego0": {"driven_any": 5.350238267454256, "survival_time": 35.800000000000104, "driven_lanedir": 0.0, "in-drivable-lane": 35.800000000000104, "deviation-heading": 0.0, "distance-from-start": 5.165303806356202, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max35.800000000000104
survival_time_mean35.800000000000104
survival_time_median35.800000000000104
survival_time_min35.800000000000104
No reset possible
141075sim-4of5failedyes0:01:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 722, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 418, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 591, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/catkin_ws/src/braitenberg/packages/braitenberg_agent/agent.py", line 113, in on_received_get_commands
              ||     pwm_commands = PWMCommands(motor_left=pwm_left, motor_right=pwm_right)
              ||   File "<string>", line 5, in __init__
              ||   File "/usr/local/lib/python3.8/dist-packages/aido_schemas/schemas.py", line 78, in __post_init__
              ||     raise ValueError(msg)
              || ValueError: Expected values to be between -1 and 1. Obtained 1.45, 0.55
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
141074sim-3of5successyes0:05:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.687273785223484


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.687273785223484
distance-from-start_median5.687273785223484
distance-from-start_min5.687273785223484
driven_any_max5.998586149620492
driven_any_mean5.998586149620492
driven_any_median5.998586149620492
driven_any_min5.998586149620492
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max39.74999999999988
in-drivable-lane_mean39.74999999999988
in-drivable-lane_median39.74999999999988
in-drivable-lane_min39.74999999999988
per-episodes
details{"d50-ego0": {"driven_any": 5.998586149620492, "survival_time": 39.74999999999988, "driven_lanedir": 0.0, "in-drivable-lane": 39.74999999999988, "deviation-heading": 0.0, "distance-from-start": 5.687273785223484, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max39.74999999999988
survival_time_mean39.74999999999988
survival_time_median39.74999999999988
survival_time_min39.74999999999988
No reset possible