Duckietown Challenges Home Challenges Submissions

Evaluator 5863

ID5863
evaluatornoname
owneruser9829
machinemingxuan-ASUS-TUF-Gaming-A17-FA706QM-FA706QM
processnoname_mingxuan-ASUS-TUF-Gaming-A17-FA706QM-FA706QM-6.3.2
version6.3.2
first heard
last heard
statusinactive
# evaluating
# success12 198316
# timeout
# failed
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors16
Processor frequency (MHz)3.1 GHz
Free % of processors90%
RAM total (MB)15.0 GB
RAM free (MB)2.2 GB
Disk (MB)131.6 GB
Disk available (MB)13.3 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
19854128648user9829collision-check-exerciselx22-collision-check-valistep1successyesnoname0:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.97
false_positive_rate0.0


other stats
nsamples200
No reset possible
19843928634user9829collision-check-exerciselx22-collision-check-valistep1successyesnoname0:00:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate1.0


other stats
nsamples200
No reset possible
19842928631user9829collision-check-exerciselx22-collision-check-valistep1successyesnoname0:01:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.49
false_positive_rate0.45


other stats
nsamples200
No reset possible
19842028627user9829state estimation exerciselx22-state-estimationsimsuccessyesnoname0:14:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.125439863238011
survival_time_median59.99999999999873
deviation-center-line_median2.3116849809943356
in-drivable-lane_median0.0


other stats
deviation-center-line_max2.5266694986449316
deviation-center-line_mean2.326962602759195
deviation-center-line_min2.1425333286383172
deviation-heading_max8.226536349721254
deviation-heading_mean6.447496670745994
deviation-heading_median5.943923493047623
deviation-heading_min5.172030169469103
distance-from-start_max2.666590539266433
distance-from-start_mean2.185240981410254
distance-from-start_median1.9467611848208972
distance-from-start_min1.9423712201434304
driven_any_max4.169100825634646
driven_any_mean4.148135257836363
driven_any_median4.169100685518301
driven_any_min4.10620426235614
driven_lanedir_consec_max4.13490520273496
driven_lanedir_consec_mean4.095678576531962
driven_lanedir_consec_min4.026690663622916
driven_lanedir_max4.13490520273496
driven_lanedir_mean4.095678576531962
driven_lanedir_median4.125439863238011
driven_lanedir_min4.026690663622916
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 4.169100685518301, "survival_time": 59.99999999999873, "driven_lanedir": 4.125439863238011, "in-drivable-lane": 0.0, "deviation-heading": 5.943923493047623, "distance-from-start": 2.666590539266433, "deviation-center-line": 2.1425333286383172, "driven_lanedir_consec": 4.125439863238011}, "LF-zig-zag-001-ego0": {"driven_any": 4.10620426235614, "survival_time": 59.99999999999873, "driven_lanedir": 4.026690663622916, "in-drivable-lane": 0.0, "deviation-heading": 8.226536349721254, "distance-from-start": 1.9423712201434304, "deviation-center-line": 2.3116849809943356, "driven_lanedir_consec": 4.026690663622916}, "LF-zig-zag-002-ego0": {"driven_any": 4.169100825634646, "survival_time": 59.99999999999873, "driven_lanedir": 4.13490520273496, "in-drivable-lane": 0.0, "deviation-heading": 5.172030169469103, "distance-from-start": 1.9467611848208972, "deviation-center-line": 2.5266694986449316, "driven_lanedir_consec": 4.13490520273496}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
19841928626user9829state estimation exerciselx22-state-estimationsimsuccessyesnoname0:13:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3362780002435053
survival_time_median59.99999999999873
deviation-center-line_median1.839447961964072
in-drivable-lane_median18.99999999999932


other stats
deviation-center-line_max2.5353227380890515
deviation-center-line_mean1.8717271341782808
deviation-center-line_min1.2404107024817186
deviation-heading_max21.760475735669065
deviation-heading_mean14.021244949557987
deviation-heading_median15.910551192347862
deviation-heading_min4.392707920657038
distance-from-start_max1.963062393676818
distance-from-start_mean1.276834059509525
distance-from-start_median1.5101494934136943
distance-from-start_min0.3572902914380632
driven_any_max4.169103197587859
driven_any_mean4.166133343903951
driven_any_median4.167970358266432
driven_any_min4.161326475857562
driven_lanedir_consec_max4.142931991736682
driven_lanedir_consec_mean2.664811463806434
driven_lanedir_consec_min1.5152243994391148
driven_lanedir_max4.142931991736682
driven_lanedir_mean2.664811463806434
driven_lanedir_median2.3362780002435053
driven_lanedir_min1.5152243994391148
in-drivable-lane_max27.949999999999314
in-drivable-lane_mean15.649999999999546
in-drivable-lane_min0.0
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 4.167970358266432, "survival_time": 59.99999999999873, "driven_lanedir": 1.5152243994391148, "in-drivable-lane": 27.949999999999314, "deviation-heading": 21.760475735669065, "distance-from-start": 0.3572902914380632, "deviation-center-line": 1.2404107024817186, "driven_lanedir_consec": 1.5152243994391148}, "LF-zig-zag-001-ego0": {"driven_any": 4.161326475857562, "survival_time": 59.99999999999873, "driven_lanedir": 2.3362780002435053, "in-drivable-lane": 18.99999999999932, "deviation-heading": 15.910551192347862, "distance-from-start": 1.5101494934136943, "deviation-center-line": 1.839447961964072, "driven_lanedir_consec": 2.3362780002435053}, "LF-zig-zag-002-ego0": {"driven_any": 4.169103197587859, "survival_time": 59.99999999999873, "driven_lanedir": 4.142931991736682, "in-drivable-lane": 0.0, "deviation-heading": 4.392707920657038, "distance-from-start": 1.963062393676818, "deviation-center-line": 2.5353227380890515, "driven_lanedir_consec": 4.142931991736682}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
19840928623user9829objdet exerciselx22-objdetsimsuccessyesnoname0:11:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median4.166342452851187


other stats
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.095038332939367
distance-from-start_mean4.1663171911240555
distance-from-start_median4.1663171911240555
distance-from-start_min2.2375960493087437
driven_any_max6.095038332939367
driven_any_mean4.1663171911240555
driven_any_median4.1663171911240555
driven_any_min2.2375960493087437
driven_lanedir_consec_max6.095056275366974
driven_lanedir_consec_mean4.166342452851187
driven_lanedir_consec_min2.2376286303353994
driven_lanedir_max6.095056275366974
driven_lanedir_mean4.166342452851187
driven_lanedir_median4.166342452851187
driven_lanedir_min2.2376286303353994
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.095038332939367, "survival_time": 59.99999999999873, "driven_lanedir": 6.095056275366974, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 6.095038332939367, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 6.095056275366974}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.2375960493087437, "survival_time": 59.99999999999873, "driven_lanedir": 2.2376286303353994, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 2.2375960493087437, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 2.2376286303353994}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
19840728622user9829objdet exerciselx22-objdetsimsuccessyesnoname0:05:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median18.275000000000126
driven_lanedir_consec_median4.810667622183282


other stats
deviation-center-line_max0.26774333024025004
deviation-center-line_mean0.2157172733545311
deviation-center-line_median0.2157172733545311
deviation-center-line_min0.16369121646881216
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.73934300422758
distance-from-start_mean4.810621862412029
distance-from-start_median4.810621862412029
distance-from-start_min2.8819007205964793
driven_any_max6.73934300422758
driven_any_mean4.810621862412029
driven_any_median4.810621862412029
driven_any_min2.8819007205964793
driven_lanedir_consec_max6.739416375324249
driven_lanedir_consec_mean4.810667622183282
driven_lanedir_consec_min2.8819188690423156
driven_lanedir_max6.739416375324249
driven_lanedir_mean4.810667622183282
driven_lanedir_median4.810667622183282
driven_lanedir_min2.8819188690423156
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.73934300422758, "survival_time": 25.200000000000223, "driven_lanedir": 6.739416375324249, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 6.73934300422758, "deviation-center-line": 0.16369121646881216, "driven_lanedir_consec": 6.739416375324249}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.8819007205964793, "survival_time": 11.350000000000026, "driven_lanedir": 2.8819188690423156, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 2.8819007205964793, "deviation-center-line": 0.26774333024025004, "driven_lanedir_consec": 2.8819188690423156}}
simulation-passed1
survival_time_max25.200000000000223
survival_time_mean18.275000000000126
survival_time_min11.350000000000026
No reset possible
19837528619user9829exercises_braitenberglx22-BV1sim-0of5successyesnoname0:02:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.388833995480979


other stats
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.388833995480979
distance-from-start_median1.388833995480979
distance-from-start_min1.388833995480979
driven_any_max2.225075353387986
driven_any_mean2.225075353387986
driven_any_median2.225075353387986
driven_any_min2.225075353387986
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
in-drivable-lane_max11.65000000000003
in-drivable-lane_mean11.65000000000003
in-drivable-lane_median11.65000000000003
in-drivable-lane_min11.65000000000003
per-episodes
details{"d30-ego0": {"driven_any": 2.225075353387986, "survival_time": 11.65000000000003, "driven_lanedir": 0.0, "in-drivable-lane": 11.65000000000003, "deviation-heading": 0.0, "distance-from-start": 1.388833995480979, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0}}
simulation-passed1
survival_time_max11.65000000000003
survival_time_mean11.65000000000003
survival_time_median11.65000000000003
survival_time_min11.65000000000003
No reset possible
19837128616user9829lx22-visservoinglx22-visservoingsimsuccessyesnoname0:07:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median0.0
deviation-center-line_median3.665553741837148
driven_lanedir_consec_median6.112052949166515
survival_time_median59.99999999999873


other stats
deviation-center-line_max5.214163109675126
deviation-center-line_mean3.665553741837148
deviation-center-line_min2.116944373999171
deviation-heading_max11.607374390387134
deviation-heading_mean10.03851550461143
deviation-heading_median10.03851550461143
deviation-heading_min8.469656618835726
distance-from-start_max1.4965880273200354
distance-from-start_mean1.2956668207116138
distance-from-start_median1.2956668207116138
distance-from-start_min1.0947456141031922
driven_any_max6.248366838393103
driven_any_mean6.245740737305237
driven_any_median6.245740737305237
driven_any_min6.24311463621737
driven_lanedir_consec_max6.148273791931597
driven_lanedir_consec_mean6.112052949166515
driven_lanedir_consec_min6.075832106401434
driven_lanedir_max6.148273791931597
driven_lanedir_mean6.112052949166515
driven_lanedir_median6.112052949166515
driven_lanedir_min6.075832106401434
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.248366838393103, "survival_time": 59.99999999999873, "driven_lanedir": 6.075832106401434, "in-drivable-lane": 0.0, "deviation-heading": 11.607374390387134, "distance-from-start": 1.0947456141031922, "deviation-center-line": 2.116944373999171, "driven_lanedir_consec": 6.075832106401434}, "LF-small-loop-001-ego0": {"driven_any": 6.24311463621737, "survival_time": 59.99999999999873, "driven_lanedir": 6.148273791931597, "in-drivable-lane": 0.0, "deviation-heading": 8.469656618835726, "distance-from-start": 1.4965880273200354, "deviation-center-line": 5.214163109675126, "driven_lanedir_consec": 6.148273791931597}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
19836928615user9829lx22-visservoinglx22-visservoingsimsuccessyesnoname0:07:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median8.100000000000115
deviation-center-line_median2.8594389037804406
driven_lanedir_consec_median3.5420113782487475
survival_time_median44.64999999999951


other stats
deviation-center-line_max5.001673616511715
deviation-center-line_mean2.8594389037804406
deviation-center-line_min0.7172041910491668
deviation-heading_max11.47687992223073
deviation-heading_mean8.161163777872185
deviation-heading_median8.161163777872185
deviation-heading_min4.845447633513639
distance-from-start_max1.0350045191978627
distance-from-start_mean0.9958559768539657
distance-from-start_median0.9958559768539657
distance-from-start_min0.9567074345100686
driven_any_max6.248345092284493
driven_any_mean4.600020554077489
driven_any_median4.600020554077489
driven_any_min2.951696015870486
driven_lanedir_consec_max6.08732682088449
driven_lanedir_consec_mean3.5420113782487475
driven_lanedir_consec_min0.9966959356130044
driven_lanedir_max6.08732682088449
driven_lanedir_mean3.629957257448703
driven_lanedir_median3.629957257448703
driven_lanedir_min1.1725876940129156
in-drivable-lane_max16.20000000000023
in-drivable-lane_mean8.100000000000115
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.248345092284493, "survival_time": 59.99999999999873, "driven_lanedir": 6.08732682088449, "in-drivable-lane": 0.0, "deviation-heading": 11.47687992223073, "distance-from-start": 1.0350045191978627, "deviation-center-line": 5.001673616511715, "driven_lanedir_consec": 6.08732682088449}, "LF-small-loop-001-ego0": {"driven_any": 2.951696015870486, "survival_time": 29.30000000000028, "driven_lanedir": 1.1725876940129156, "in-drivable-lane": 16.20000000000023, "deviation-heading": 4.845447633513639, "distance-from-start": 0.9567074345100686, "deviation-center-line": 0.7172041910491668, "driven_lanedir_consec": 0.9966959356130044}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean44.64999999999951
survival_time_min29.30000000000028
No reset possible
19836528610user9829lx22-visservoinglx22-visservoingsimsuccessyesnoname0:05:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median2.0999999999999783
deviation-center-line_median3.19960169879942
driven_lanedir_consec_median3.459905454115221
survival_time_median36.67499999999939


other stats
deviation-center-line_max6.005851905654872
deviation-center-line_mean3.19960169879942
deviation-center-line_min0.393351491943968
deviation-heading_max11.891038245370728
deviation-heading_mean7.005336962216228
deviation-heading_median7.005336962216228
deviation-heading_min2.1196356790617275
distance-from-start_max1.2215254085412512
distance-from-start_mean1.1256295667703968
distance-from-start_median1.1256295667703968
distance-from-start_min1.0297337249995424
driven_any_max6.2483600144097275
driven_any_mean3.7641133850972626
driven_any_median3.7641133850972626
driven_any_min1.2798667557847974
driven_lanedir_consec_max5.763125342385227
driven_lanedir_consec_mean3.459905454115221
driven_lanedir_consec_min1.1566855658452144
driven_lanedir_max5.763125342385227
driven_lanedir_mean3.459905454115221
driven_lanedir_median3.459905454115221
driven_lanedir_min1.1566855658452144
in-drivable-lane_max2.649999999999934
in-drivable-lane_mean2.0999999999999783
in-drivable-lane_min1.550000000000022
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.2483600144097275, "survival_time": 59.99999999999873, "driven_lanedir": 5.763125342385227, "in-drivable-lane": 2.649999999999934, "deviation-heading": 11.891038245370728, "distance-from-start": 1.0297337249995424, "deviation-center-line": 6.005851905654872, "driven_lanedir_consec": 5.763125342385227}, "LF-small-loop-001-ego0": {"driven_any": 1.2798667557847974, "survival_time": 13.350000000000056, "driven_lanedir": 1.1566855658452144, "in-drivable-lane": 1.550000000000022, "deviation-heading": 2.1196356790617275, "distance-from-start": 1.2215254085412512, "deviation-center-line": 0.393351491943968, "driven_lanedir_consec": 1.1566855658452144}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean36.67499999999939
survival_time_min13.350000000000056
No reset possible
19831628586user9829lx22-modconlx22-modconsimsuccessyesnoname0:13:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median8.925000000000033
deviation-center-line_median1.728025439585345
driven_lanedir_consec_median4.280365588601933
survival_time_median40.69999999999945


other stats
deviation-center-line_max2.4289375280877428
deviation-center-line_mean1.728025439585345
deviation-center-line_min1.027113351082947
deviation-heading_max5.280381374750565
deviation-heading_mean5.059002342303648
deviation-heading_median5.059002342303648
deviation-heading_min4.837623309856732
distance-from-start_max8.176715132926564
distance-from-start_mean5.330455162176817
distance-from-start_median5.330455162176817
distance-from-start_min2.4841951914270703
driven_any_max8.338217588544468
driven_any_mean5.588385803660343
driven_any_median5.588385803660343
driven_any_min2.8385540187762177
driven_lanedir_consec_max7.309028160091829
driven_lanedir_consec_mean4.280365588601933
driven_lanedir_consec_min1.251703017112038
driven_lanedir_max7.309028160091829
driven_lanedir_mean4.280365588601933
driven_lanedir_median4.280365588601933
driven_lanedir_min1.251703017112038
in-drivable-lane_max11.000000000000057
in-drivable-lane_mean8.925000000000033
in-drivable-lane_min6.85000000000001
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.338217588544468, "survival_time": 59.99999999999873, "driven_lanedir": 7.309028160091829, "in-drivable-lane": 6.85000000000001, "deviation-heading": 5.280381374750565, "distance-from-start": 8.176715132926564, "deviation-center-line": 2.4289375280877428, "driven_lanedir_consec": 7.309028160091829}, "LF-full-loop-001-ego0": {"driven_any": 2.8385540187762177, "survival_time": 21.40000000000017, "driven_lanedir": 1.251703017112038, "in-drivable-lane": 11.000000000000057, "deviation-heading": 4.837623309856732, "distance-from-start": 2.4841951914270703, "deviation-center-line": 1.027113351082947, "driven_lanedir_consec": 1.251703017112038}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean40.69999999999945
survival_time_min21.40000000000017
No reset possible