Duckietown Challenges Home Challenges Submissions

Evaluator 5770

ID5770
evaluatornoname
owneruser8285
machineQueensUbuntux64
processnoname_QueensUbuntux64-6.3.2
version6.3.2
first heard
last heard
statusinactive
# evaluating
# success3 186737
# timeout
# failed1 188040
# error
# aborted1 186749
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors4
Processor frequency (MHz)
Free % of processors96%
RAM total (MB)7.7 GB
RAM free (MB)4.3 GB
Disk (MB)58.3 GB
Disk available (MB)6.6 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
18804026741user8285objdet exerciselx22-objdetsimfailedyesnoname0:03:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges/cie_concrete.py", line 691, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_experiment_manager/code.py", line 243, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
18674926454user8285exercises_braitenberglx22-BV1sim-2of5abortedyesnoname0:01:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.33411703505557117


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.33411703505557117
distance-from-start_median0.33411703505557117
distance-from-start_min0.33411703505557117
driven_any_max0.3341424165714698
driven_any_mean0.3341424165714698
driven_any_median0.3341424165714698
driven_any_min0.3341424165714698
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.25
in-drivable-lane_mean2.25
in-drivable-lane_median2.25
in-drivable-lane_min2.25
per-episodes
details{"d40-ego0": {"driven_any": 0.3341424165714698, "survival_time": 2.25, "driven_lanedir": 0.0, "in-drivable-lane": 2.25, "deviation-heading": 0.0, "distance-from-start": 0.33411703505557117, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.25
survival_time_mean2.25
survival_time_median2.25
survival_time_min2.25
No reset possible
18674526454user8285exercises_braitenberglx22-BV1sim-2of5successyesnoname0:01:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.3322304193186002


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.3322304193186002
distance-from-start_median0.3322304193186002
distance-from-start_min0.3322304193186002
driven_any_max0.3323789090842453
driven_any_mean0.3323789090842453
driven_any_median0.3323789090842453
driven_any_min0.3323789090842453
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.25
in-drivable-lane_mean2.25
in-drivable-lane_median2.25
in-drivable-lane_min2.25
per-episodes
details{"d40-ego0": {"driven_any": 0.3323789090842453, "survival_time": 2.25, "driven_lanedir": 0.0, "in-drivable-lane": 2.25, "deviation-heading": 0.0, "distance-from-start": 0.3322304193186002, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.25
survival_time_mean2.25
survival_time_median2.25
survival_time_min2.25
No reset possible
18674226454user8285exercises_braitenberglx22-BV1sim-0of5successyesnoname0:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.46355175387752673


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.46355175387752673
distance-from-start_median0.46355175387752673
distance-from-start_min0.46355175387752673
driven_any_max0.46782555248566815
driven_any_mean0.46782555248566815
driven_any_median0.46782555248566815
driven_any_min0.46782555248566815
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.8999999999999977
in-drivable-lane_mean2.8999999999999977
in-drivable-lane_median2.8999999999999977
in-drivable-lane_min2.8999999999999977
per-episodes
details{"d60-ego0": {"driven_any": 0.46782555248566815, "survival_time": 2.8999999999999977, "driven_lanedir": 0.0, "in-drivable-lane": 2.8999999999999977, "deviation-heading": 0.0, "distance-from-start": 0.46355175387752673, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.8999999999999977
survival_time_mean2.8999999999999977
survival_time_median2.8999999999999977
survival_time_min2.8999999999999977
No reset possible
18673726454user8285exercises_braitenberglx22-BV1sim-0of5successyesnoname0:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.4892344436381352


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.4892344436381352
distance-from-start_median0.4892344436381352
distance-from-start_min0.4892344436381352
driven_any_max0.48928646127725334
driven_any_mean0.48928646127725334
driven_any_median0.48928646127725334
driven_any_min0.48928646127725334
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max2.7499999999999982
in-drivable-lane_mean2.7499999999999982
in-drivable-lane_median2.7499999999999982
in-drivable-lane_min2.7499999999999982
per-episodes
details{"d60-ego0": {"driven_any": 0.48928646127725334, "survival_time": 2.7499999999999982, "driven_lanedir": 0.0, "in-drivable-lane": 2.7499999999999982, "deviation-heading": 0.0, "distance-from-start": 0.4892344436381352, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max2.7499999999999982
survival_time_mean2.7499999999999982
survival_time_median2.7499999999999982
survival_time_min2.7499999999999982
No reset possible