Duckietown Challenges Home Challenges Submissions

Evaluator 5829

ID5829
evaluatornoname
owneruser8998
machineduckietown
processnoname_duckietown-6.3.2
version6.3.2
first heard
last heard
statusinactive
# evaluating
# success6 191342
# timeout
# failed
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors8
Processor frequency (MHz)
Free % of processors99%
RAM total (MB)7.6 GB
RAM free (MB)3.9 GB
Disk (MB)77.9 GB
Disk available (MB)19.8 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
19151727868user8998collision-check-exerciselx22-collision-check-teststep1successyesnoname0:07:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.01
false_positive_rate0.0


other stats
nsamples200
No reset possible
19151627867user8998collision-check-exerciselx22-collision-check-valistep1successyesnoname0:07:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.03
false_positive_rate0.0


other stats
nsamples200
No reset possible
19134527815user8998objdet exerciselx22-objdetsimsuccessyesnoname0:14:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median4.494464504333255


other stats
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.444444336891529
distance-from-start_mean4.494060022831175
distance-from-start_median4.494060022831175
distance-from-start_min2.543675708770822
driven_any_max6.444444336891529
driven_any_mean4.494060022831175
driven_any_median4.494060022831175
driven_any_min2.543675708770822
driven_lanedir_consec_max6.444956840624859
driven_lanedir_consec_mean4.494464504333255
driven_lanedir_consec_min2.5439721680416505
driven_lanedir_max6.444956840624859
driven_lanedir_mean4.494464504333255
driven_lanedir_median4.494464504333255
driven_lanedir_min2.5439721680416505
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.444444336891529, "survival_time": 59.99999999999873, "driven_lanedir": 6.444956840624859, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 6.444444336891529, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 6.444956840624859}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.543675708770822, "survival_time": 59.99999999999873, "driven_lanedir": 2.5439721680416505, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 2.543675708770822, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 2.5439721680416505}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
19134427814user8998objdet exerciselx22-objdetsimsuccessyesnoname0:13:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median2.3969246697749145


other stats
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.4178895473480564
distance-from-start_mean2.396925187110931
distance-from-start_median2.396925187110931
distance-from-start_min2.375960826873806
driven_any_max2.4178895473480564
driven_any_mean2.396925187110931
driven_any_median2.396925187110931
driven_any_min2.375960826873806
driven_lanedir_consec_max2.4178668403985912
driven_lanedir_consec_mean2.3969246697749145
driven_lanedir_consec_min2.3759824991512377
driven_lanedir_max2.4178668403985912
driven_lanedir_mean2.3969246697749145
driven_lanedir_median2.3969246697749145
driven_lanedir_min2.3759824991512377
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 2.375960826873806, "survival_time": 59.99999999999873, "driven_lanedir": 2.3759824991512377, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 2.375960826873806, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 2.3759824991512377}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.4178895473480564, "survival_time": 59.99999999999873, "driven_lanedir": 2.4178668403985912, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 2.4178895473480564, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 2.4178668403985912}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
19134327813user8998objdet exerciselx22-objdetsimsuccessyesnoname0:11:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median42.624999999999474
driven_lanedir_consec_median4.690633826386313


other stats
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.7896996220946169
deviation-center-line_median0.7896996220946169
deviation-center-line_min0.1640160006284725
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.739343004227582
distance-from-start_mean4.6904261970524965
distance-from-start_median4.6904261970524965
distance-from-start_min2.6415093898774114
driven_any_max6.739343004227582
driven_any_mean4.6904261970524965
driven_any_median4.6904261970524965
driven_any_min2.6415093898774114
driven_lanedir_consec_max6.73941649453529
driven_lanedir_consec_mean4.690633826386313
driven_lanedir_consec_min2.6418511582373356
driven_lanedir_max6.73941649453529
driven_lanedir_mean4.690633826386313
driven_lanedir_median4.690633826386313
driven_lanedir_min2.6418511582373356
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.739343004227582, "survival_time": 25.250000000000224, "driven_lanedir": 6.73941649453529, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 6.739343004227582, "deviation-center-line": 0.1640160006284725, "driven_lanedir_consec": 6.73941649453529}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.6415093898774114, "survival_time": 59.99999999999873, "driven_lanedir": 2.6418511582373356, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 2.6415093898774114, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 2.6418511582373356}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean42.624999999999474
survival_time_min25.250000000000224
No reset possible
19134227812user8998state estimation exerciselx22-state-estimationsimsuccessyesnoname0:19:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.826840935780678
survival_time_median59.99999999999873
deviation-center-line_median1.4683207331918793
in-drivable-lane_median31.89999999999908


other stats
deviation-center-line_max1.646230085515883
deviation-center-line_mean1.43178247673845
deviation-center-line_min1.1807966115075883
deviation-heading_max6.220072675333752
deviation-heading_mean5.739073933379115
deviation-heading_median6.177188870926044
deviation-heading_min4.819960253877548
distance-from-start_max2.562709590889037
distance-from-start_mean2.216555101230256
distance-from-start_median2.2214254344743636
distance-from-start_min1.865530278327369
driven_any_max4.16909017455578
driven_any_mean4.166745364427681
driven_any_median4.169032386767963
driven_any_min4.1621135319592995
driven_lanedir_consec_max4.108006777271174
driven_lanedir_consec_mean2.583990254999584
driven_lanedir_consec_min1.8171230519469008
driven_lanedir_max4.108006777271174
driven_lanedir_mean2.583990254999584
driven_lanedir_median1.826840935780678
driven_lanedir_min1.8171230519469008
in-drivable-lane_max32.99999999999848
in-drivable-lane_mean21.63333333333252
in-drivable-lane_min0.0
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 4.169032386767963, "survival_time": 59.99999999999873, "driven_lanedir": 1.826840935780678, "in-drivable-lane": 31.89999999999908, "deviation-heading": 6.177188870926044, "distance-from-start": 2.2214254344743636, "deviation-center-line": 1.4683207331918793, "driven_lanedir_consec": 1.826840935780678}, "LF-zig-zag-001-ego0": {"driven_any": 4.16909017455578, "survival_time": 59.99999999999873, "driven_lanedir": 1.8171230519469008, "in-drivable-lane": 32.99999999999848, "deviation-heading": 4.819960253877548, "distance-from-start": 2.562709590889037, "deviation-center-line": 1.1807966115075883, "driven_lanedir_consec": 1.8171230519469008}, "LF-zig-zag-002-ego0": {"driven_any": 4.1621135319592995, "survival_time": 59.99999999999873, "driven_lanedir": 4.108006777271174, "in-drivable-lane": 0.0, "deviation-heading": 6.220072675333752, "distance-from-start": 1.865530278327369, "deviation-center-line": 1.646230085515883, "driven_lanedir_consec": 4.108006777271174}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible