Duckietown Challenges Home Challenges Submissions

Evaluator 5545

ID5545
evaluatornoname
ownerBea Baselines 🐤
machinedavinci
processnoname_davinci
version6.2.40
first heard
last heard
statusinactive
# evaluating
# success1 121049
# timeout
# failed2 121025
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)2.8 GHz
Free % of processors65%
RAM total (MB)251.6 GB
RAM free (MB)239.0 GB
Disk (MB)444.3 GB
Disk available (MB)421.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
12104917531Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4successyesnoname0:08:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-3.1487454804520696
survival_time_median59.99999999999873
deviation-center-line_median2.966070280156876
in-drivable-lane_median25.24999999999935


other stats
deviation-center-line_max2.966070280156876
deviation-center-line_mean2.966070280156876
deviation-center-line_min2.966070280156876
deviation-heading_max28.459585789678833
deviation-heading_mean28.459585789678833
deviation-heading_median28.459585789678833
deviation-heading_min28.459585789678833
distance-from-start_max0.1273347170354393
distance-from-start_mean0.1273347170354393
distance-from-start_median0.1273347170354393
distance-from-start_min0.1273347170354393
driven_any_max11.494276843372251
driven_any_mean11.494276843372251
driven_any_median11.494276843372251
driven_any_min11.494276843372251
driven_lanedir_consec_max-3.1487454804520696
driven_lanedir_consec_mean-3.1487454804520696
driven_lanedir_consec_min-3.1487454804520696
driven_lanedir_max-3.1487454804520696
driven_lanedir_mean-3.1487454804520696
driven_lanedir_median-3.1487454804520696
driven_lanedir_min-3.1487454804520696
in-drivable-lane_max25.24999999999935
in-drivable-lane_mean25.24999999999935
in-drivable-lane_min25.24999999999935
per-episodes
details{"autolab-000-ego0": {"driven_any": 11.494276843372251, "survival_time": 59.99999999999873, "driven_lanedir": -3.1487454804520696, "in-drivable-lane": 25.24999999999935, "deviation-heading": 28.459585789678833, "distance-from-start": 0.1273347170354393, "deviation-center-line": 2.966070280156876, "driven_lanedir_consec": -3.1487454804520696}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
12103117531Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4failedyesnoname0:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
12102517531Bea Baselines 🐤baseline-RL-sim-pytorchaido-LF-sim-testingsim-0of4failedyesnoname0:03:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 298, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 156, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper_outside.py", line 328, in read_reply
    raise RemoteNodeAborted(msg) from None
zuper_nodes.structures.RemoteNodeAborted: Remote node closed communication (None)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 307, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible