Duckietown Challenges Home Challenges Submissions

Evaluator 5756

ID5756
evaluatornoname
owneruser8393
machineloganwhite-virtual-machine
processnoname_loganwhite-virtual-machine-6.3.2
version6.3.2
first heard
last heard
statusinactive
# evaluating
# success4 185746
# timeout
# failed1 186966
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors8
Processor frequency (MHz)
Free % of processors100%
RAM total (MB)7.7 GB
RAM free (MB)6.3 GB
Disk (MB)77.7 GB
Disk available (MB)46.7 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
18698626479user8393exercises_braitenberglx22-BV1sim-0of5successyesnoname0:12:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.4210744150912715


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.4210744150912715
distance-from-start_median5.4210744150912715
distance-from-start_min5.4210744150912715
driven_any_max5.558377031657413
driven_any_mean5.558377031657413
driven_any_median5.558377031657413
driven_any_min5.558377031657413
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max41.749999999999766
in-drivable-lane_mean41.749999999999766
in-drivable-lane_median41.749999999999766
in-drivable-lane_min41.749999999999766
per-episodes
details{"d45-ego0": {"driven_any": 5.558377031657413, "survival_time": 41.749999999999766, "driven_lanedir": 0.0, "in-drivable-lane": 41.749999999999766, "deviation-heading": 0.0, "distance-from-start": 5.4210744150912715, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max41.749999999999766
survival_time_mean41.749999999999766
survival_time_median41.749999999999766
survival_time_min41.749999999999766
No reset possible
18696626475user8393exercises_braitenberglx22-BV1sim-0of5failedyesnoname0:02:24
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 722, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 418, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 591, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/catkin_ws/src/braitenberg/packages/braitenberg_agent/agent.py", line 111, in on_received_get_commands
              ||     pwm_left, pwm_right = self.compute_commands()
              ||   File "/code/catkin_ws/src/braitenberg/packages/braitenberg_agent/agent.py", line 104, in compute_commands
              ||     if pwm_left > self.speedCap and pwm_right > speedCap:
              || NameError: name 'speedCap' is not defined
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18695426428user8394exercises_braitenberglx22-BV1sim-0of5successyesnoname0:04:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.0218721765675107


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.0218721765675107
distance-from-start_median1.0218721765675107
distance-from-start_min1.0218721765675107
driven_any_max1.0351949203969202
driven_any_mean1.0351949203969202
driven_any_median1.0351949203969202
driven_any_min1.0351949203969202
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max4.94999999999999
in-drivable-lane_mean4.94999999999999
in-drivable-lane_median4.94999999999999
in-drivable-lane_min4.94999999999999
per-episodes
details{"d45-ego0": {"driven_any": 1.0351949203969202, "survival_time": 4.94999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 4.94999999999999, "deviation-heading": 0.0, "distance-from-start": 1.0218721765675107, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max4.94999999999999
survival_time_mean4.94999999999999
survival_time_median4.94999999999999
survival_time_min4.94999999999999
No reset possible
18684026465user8393exercises_braitenberglx22-BV1sim-0of5successyesnoname0:14:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean4.631087777772532


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max4.631087777772532
distance-from-start_median4.631087777772532
distance-from-start_min4.631087777772532
driven_any_max4.779372098069425
driven_any_mean4.779372098069425
driven_any_median4.779372098069425
driven_any_min4.779372098069425
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max47.99999999999941
in-drivable-lane_mean47.99999999999941
in-drivable-lane_median47.99999999999941
in-drivable-lane_min47.99999999999941
per-episodes
details{"d45-ego0": {"driven_any": 4.779372098069425, "survival_time": 47.99999999999941, "driven_lanedir": 0.0, "in-drivable-lane": 47.99999999999941, "deviation-heading": 0.0, "distance-from-start": 4.631087777772532, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max47.99999999999941
survival_time_mean47.99999999999941
survival_time_median47.99999999999941
survival_time_min47.99999999999941
No reset possible
18574626363user8393exercises_braitenberglx22-BV1sim-0of5successyesnoname0:04:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.48050920217160953


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.48050920217160953
distance-from-start_median0.48050920217160953
distance-from-start_min0.48050920217160953
driven_any_max0.4806485474666271
driven_any_mean0.4806485474666271
driven_any_median0.4806485474666271
driven_any_min0.4806485474666271
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.4499999999999993
in-drivable-lane_mean2.4499999999999993
in-drivable-lane_median2.4499999999999993
in-drivable-lane_min2.4499999999999993
per-episodes
details{"d60-ego0": {"driven_any": 0.4806485474666271, "survival_time": 2.4499999999999993, "driven_lanedir": 0.0, "in-drivable-lane": 2.4499999999999993, "deviation-heading": 0.0, "distance-from-start": 0.48050920217160953, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.4499999999999993
survival_time_mean2.4499999999999993
survival_time_median2.4499999999999993
survival_time_min2.4499999999999993
No reset possible