Duckietown Challenges Home Challenges Submissions

Evaluator 5678

ID5678
evaluatornoname
ownerDavid Petriashvili
machinememoryhunter
processnoname_memoryhunter-6.3.1
version6.3.1
first heard
last heard
statusinactive
# evaluating
# success2 148582
# timeout1 148622
# failed
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors12
Processor frequency (MHz)2.2 GHz
Free % of processors99%
RAM total (MB)15.0 GB
RAM free (MB)11.0 GB
Disk (MB)97.9 GB
Disk available (MB)59.7 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
14862320119David Petriashvilistate estimation exerciselx22-state-estimationsimsuccessyesnoname0:36:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median12.024001016851976
survival_time_median59.99999999999873
deviation-center-line_median3.0540126179074365
in-drivable-lane_median1.1000000000000156


other stats
deviation-center-line_max3.3309615026146973
deviation-center-line_mean3.049396469217252
deviation-center-line_min2.763215287129621
deviation-heading_max9.828528596242505
deviation-heading_mean9.06753747548806
deviation-heading_median9.066566751383483
deviation-heading_min8.307517078838195
distance-from-start_max3.241730215097263
distance-from-start_mean3.007887110123042
distance-from-start_median3.0178192979284235
distance-from-start_min2.76411181734344
driven_any_max12.506879637582914
driven_any_mean12.499899394298202
driven_any_median12.506834462099102
driven_any_min12.485984083212587
driven_lanedir_consec_max12.0371175097094
driven_lanedir_consec_mean11.98451781805229
driven_lanedir_consec_min11.892434927595495
driven_lanedir_max12.0371175097094
driven_lanedir_mean11.98451781805229
driven_lanedir_median12.024001016851976
driven_lanedir_min11.892434927595495
in-drivable-lane_max1.7499999999999003
in-drivable-lane_mean1.2666666666666206
in-drivable-lane_min0.949999999999946
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 12.506834462099102, "survival_time": 59.99999999999873, "driven_lanedir": 12.0371175097094, "in-drivable-lane": 0.949999999999946, "deviation-heading": 9.828528596242505, "distance-from-start": 2.76411181734344, "deviation-center-line": 3.3309615026146973, "driven_lanedir_consec": 12.0371175097094}, "LF-zig-zag-001-ego0": {"driven_any": 12.506879637582914, "survival_time": 59.99999999999873, "driven_lanedir": 12.024001016851976, "in-drivable-lane": 1.1000000000000156, "deviation-heading": 9.066566751383483, "distance-from-start": 3.0178192979284235, "deviation-center-line": 3.0540126179074365, "driven_lanedir_consec": 12.024001016851976}, "LF-zig-zag-002-ego0": {"driven_any": 12.485984083212587, "survival_time": 59.99999999999873, "driven_lanedir": 11.892434927595495, "in-drivable-lane": 1.7499999999999003, "deviation-heading": 8.307517078838195, "distance-from-start": 3.241730215097263, "deviation-center-line": 2.763215287129621, "driven_lanedir_consec": 11.892434927595495}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
14862216047Waipot Ngamsaadtemplate-randomaido-hello-sim-validationsanity-checktimeoutyesnoname0:01:46
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14858220087David Petriashviliobjdet exerciselx22-objdetsimsuccessyesnoname0:10:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median4.536215622048652


other stats
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.472396817207702
distance-from-start_mean4.535988743305429
distance-from-start_median4.535988743305429
distance-from-start_min2.5995806694031565
driven_any_max6.472396817207702
driven_any_mean4.535988743305429
driven_any_median4.535988743305429
driven_any_min2.5995806694031565
driven_lanedir_consec_max6.472461494563258
driven_lanedir_consec_mean4.536215622048652
driven_lanedir_consec_min2.5999697495340457
driven_lanedir_max6.472461494563258
driven_lanedir_mean4.536215622048652
driven_lanedir_median4.536215622048652
driven_lanedir_min2.5999697495340457
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.472396817207702, "survival_time": 59.99999999999873, "driven_lanedir": 6.472461494563258, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 6.472396817207702, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 6.472461494563258}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.5995806694031565, "survival_time": 59.99999999999873, "driven_lanedir": 2.5999697495340457, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 2.5995806694031565, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 2.5999697495340457}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible