Duckietown Challenges Home Challenges Submissions

Evaluator 5793

ID5793
evaluatornoname
owneruser8687
machineam-HP-Laptop-15s-eq2xxx
processnoname_am-HP-Laptop-15s-eq2xxx-6.3.2
version6.3.2
first heard
last heard
statusinactive
# evaluating
# success6 188695
# timeout
# failed1 188856
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors16
Processor frequency (MHz)4.3 GHz
Free % of processors99%
RAM total (MB)7.1 GB
RAM free (MB)3.9 GB
Disk (MB)54.7 GB
Disk available (MB)20.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
18893727005user8687exercises_braitenberglx22-BV1sim-0of5successyesnoname0:02:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.4985873264692348


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.4985873264692348
distance-from-start_median0.4985873264692348
distance-from-start_min0.4985873264692348
driven_any_max0.4987926011745668
driven_any_mean0.4987926011745668
driven_any_median0.4987926011745668
driven_any_min0.4987926011745668
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max5.04999999999999
in-drivable-lane_mean5.04999999999999
in-drivable-lane_median5.04999999999999
in-drivable-lane_min5.04999999999999
per-episodes
details{"d60-ego0": {"driven_any": 0.4987926011745668, "survival_time": 5.04999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 5.04999999999999, "deviation-heading": 0.0, "distance-from-start": 0.4985873264692348, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max5.04999999999999
survival_time_mean5.04999999999999
survival_time_median5.04999999999999
survival_time_min5.04999999999999
No reset possible
18893027004user8687exercises_braitenberglx22-BV1sim-0of5successyesnoname0:02:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.4992552960809223


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.4992552960809223
distance-from-start_median0.4992552960809223
distance-from-start_min0.4992552960809223
driven_any_max0.4994838117720803
driven_any_mean0.4994838117720803
driven_any_median0.4994838117720803
driven_any_min0.4994838117720803
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max5.04999999999999
in-drivable-lane_mean5.04999999999999
in-drivable-lane_median5.04999999999999
in-drivable-lane_min5.04999999999999
per-episodes
details{"d60-ego0": {"driven_any": 0.4994838117720803, "survival_time": 5.04999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 5.04999999999999, "deviation-heading": 0.0, "distance-from-start": 0.4992552960809223, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max5.04999999999999
survival_time_mean5.04999999999999
survival_time_median5.04999999999999
survival_time_min5.04999999999999
No reset possible
18888727004user8687exercises_braitenberglx22-BV1sim-0of5successyesnoname0:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.4987352914410301


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.4987352914410301
distance-from-start_median0.4987352914410301
distance-from-start_min0.4987352914410301
driven_any_max0.4989447309224291
driven_any_mean0.4989447309224291
driven_any_median0.4989447309224291
driven_any_min0.4989447309224291
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max5.04999999999999
in-drivable-lane_mean5.04999999999999
in-drivable-lane_median5.04999999999999
in-drivable-lane_min5.04999999999999
per-episodes
details{"d60-ego0": {"driven_any": 0.4989447309224291, "survival_time": 5.04999999999999, "driven_lanedir": 0.0, "in-drivable-lane": 5.04999999999999, "deviation-heading": 0.0, "distance-from-start": 0.4987352914410301, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max5.04999999999999
survival_time_mean5.04999999999999
survival_time_median5.04999999999999
survival_time_min5.04999999999999
No reset possible
18886827003user8687exercises_braitenberglx22-BV1sim-0of5successyesnoname0:01:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.49765805517999456


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.49765805517999456
distance-from-start_median0.49765805517999456
distance-from-start_min0.49765805517999456
driven_any_max0.5190810521327356
driven_any_mean0.5190810521327356
driven_any_median0.5190810521327356
driven_any_min0.5190810521327356
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max3.8499999999999943
in-drivable-lane_mean3.8499999999999943
in-drivable-lane_median3.8499999999999943
in-drivable-lane_min3.8499999999999943
per-episodes
details{"d60-ego0": {"driven_any": 0.5190810521327356, "survival_time": 3.8499999999999943, "driven_lanedir": 0.0, "in-drivable-lane": 3.8499999999999943, "deviation-heading": 0.0, "distance-from-start": 0.49765805517999456, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max3.8499999999999943
survival_time_mean3.8499999999999943
survival_time_median3.8499999999999943
survival_time_min3.8499999999999943
No reset possible
18885627002user8687exercises_braitenberglx22-BV1sim-0of5failedyesnoname0:01:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 343, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 722, in run_episode
    msg = await loop.run_in_executor(executor, f)
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 243, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 333, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 360, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 418, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 591, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "/code/catkin_ws/src/braitenberg/packages/braitenberg_agent/agent.py", line 104, in on_received_get_commands
              ||     pwm_left, pwm_right = self.compute_commands()
              ||   File "/code/catkin_ws/src/braitenberg/packages/braitenberg_agent/agent.py", line 74, in compute_commands
              ||     self.left = get_motor_left_matrix(shape)
              ||   File "/code/catkin_ws/src/braitenberg/packages/solution/connections.py", line 29, in get_motor_left_matrix
              ||     left_matrix = np.zeros(shape)
              || NameError: name 'np' is not defined
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 423, in main
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: external protocol violation
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18871526994user8687exercises_braitenberglx22-BV1sim-0of5successyesnoname0:03:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.284055064264295


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.284055064264295
distance-from-start_median1.284055064264295
distance-from-start_min1.284055064264295
driven_any_max1.2902967345877518
driven_any_mean1.2902967345877518
driven_any_median1.2902967345877518
driven_any_min1.2902967345877518
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max10.550000000000017
in-drivable-lane_mean10.550000000000017
in-drivable-lane_median10.550000000000017
in-drivable-lane_min10.550000000000017
per-episodes
details{"d60-ego0": {"driven_any": 1.2902967345877518, "survival_time": 10.550000000000017, "driven_lanedir": 0.0, "in-drivable-lane": 10.550000000000017, "deviation-heading": 0.0, "distance-from-start": 1.284055064264295, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max10.550000000000017
survival_time_mean10.550000000000017
survival_time_median10.550000000000017
survival_time_min10.550000000000017
No reset possible
18869526992user8687exercises_braitenberglx22-BV1sim-0of5successyesnoname0:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.5017983838304162


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.5017983838304162
distance-from-start_median0.5017983838304162
distance-from-start_min0.5017983838304162
driven_any_max0.6936980643966006
driven_any_mean0.6936980643966006
driven_any_median0.6936980643966006
driven_any_min0.6936980643966006
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max3.5499999999999954
in-drivable-lane_mean3.5499999999999954
in-drivable-lane_median3.5499999999999954
in-drivable-lane_min3.5499999999999954
per-episodes
details{"d60-ego0": {"driven_any": 0.6936980643966006, "survival_time": 3.5499999999999954, "driven_lanedir": 0.0, "in-drivable-lane": 3.5499999999999954, "deviation-heading": 0.0, "distance-from-start": 0.5017983838304162, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max3.5499999999999954
survival_time_mean3.5499999999999954
survival_time_median3.5499999999999954
survival_time_min3.5499999999999954
No reset possible