Duckietown Challenges Home Challenges Submissions

Evaluator 5641

ID5641
evaluatornoname
ownerRoberto de Nóbrega
machineDuckieTown
processnoname_DuckieTown-6.3.1
version6.3.1
first heard
last heard
statusinactive
# evaluating
# success9 141027
# timeout1 141050
# failed1 141043
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors8
Processor frequency (MHz)
Free % of processors99%
RAM total (MB)10.6 GB
RAM free (MB)5.3 GB
Disk (MB)97.4 GB
Disk available (MB)30.5 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
14116419440Roberto de Nóbregalx22-visservoinglx22-visservoingsimsuccessyesnoname0:09:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median29.224999999999365
deviation-center-line_median0.25144870365648264
driven_lanedir_consec_median0.20616201746222756
survival_time_median33.24999999999935


other stats
deviation-center-line_max0.282393231396397
deviation-center-line_mean0.25144870365648264
deviation-center-line_min0.22050417591656823
deviation-heading_max3.5015778091654224
deviation-heading_mean3.329334179858548
deviation-heading_median3.329334179858548
deviation-heading_min3.157090550551673
distance-from-start_max0.6814875636561368
distance-from-start_mean0.429650143557732
distance-from-start_median0.429650143557732
distance-from-start_min0.17781272345932703
driven_any_max6.247567226286819
driven_any_mean3.4046595701647586
driven_any_median3.4046595701647586
driven_any_min0.5617519140426981
driven_lanedir_consec_max0.2916475155001771
driven_lanedir_consec_mean0.20616201746222756
driven_lanedir_consec_min0.12067651942427804
driven_lanedir_max0.2916475155001771
driven_lanedir_mean0.20616201746222756
driven_lanedir_median0.20616201746222756
driven_lanedir_min0.12067651942427804
in-drivable-lane_max55.19999999999874
in-drivable-lane_mean29.224999999999365
in-drivable-lane_min3.2499999999999916
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.247567226286819, "survival_time": 59.99999999999873, "driven_lanedir": 0.2916475155001771, "in-drivable-lane": 55.19999999999874, "deviation-heading": 3.5015778091654224, "distance-from-start": 0.6814875636561368, "deviation-center-line": 0.282393231396397, "driven_lanedir_consec": 0.2916475155001771}, "LF-small-loop-001-ego0": {"driven_any": 0.5617519140426981, "survival_time": 6.499999999999985, "driven_lanedir": 0.12067651942427804, "in-drivable-lane": 3.2499999999999916, "deviation-heading": 3.157090550551673, "distance-from-start": 0.17781272345932703, "deviation-center-line": 0.22050417591656823, "driven_lanedir_consec": 0.12067651942427804}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean33.24999999999935
survival_time_min6.499999999999985
No reset possible
14113119415Roberto de Nóbregalx22-visservoinglx22-visservoingsimsuccessyesnoname0:08:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median8.425000000000052
deviation-center-line_median0.3230544206235703
driven_lanedir_consec_median0.2305428268688129
survival_time_median12.725000000000064


other stats
deviation-center-line_max0.3805140428517224
deviation-center-line_mean0.3230544206235703
deviation-center-line_min0.2655947983954182
deviation-heading_max3.714379837123174
deviation-heading_mean3.4652964728840767
deviation-heading_median3.4652964728840767
deviation-heading_min3.216213108644979
distance-from-start_max1.636867269980261
distance-from-start_mean1.0430322493584363
distance-from-start_median1.0430322493584363
distance-from-start_min0.4491972287366121
driven_any_max1.9245145454653343
driven_any_mean1.2195756121932089
driven_any_median1.2195756121932089
driven_any_min0.5146366789210837
driven_lanedir_consec_max0.30878844639290937
driven_lanedir_consec_mean0.2305428268688129
driven_lanedir_consec_min0.1522972073447164
driven_lanedir_max0.30878844639290937
driven_lanedir_mean0.2362960512764407
driven_lanedir_median0.2362960512764407
driven_lanedir_min0.16380365615997206
in-drivable-lane_max14.400000000000109
in-drivable-lane_mean8.425000000000052
in-drivable-lane_min2.449999999999995
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 0.5146366789210837, "survival_time": 5.999999999999987, "driven_lanedir": 0.16380365615997206, "in-drivable-lane": 2.449999999999995, "deviation-heading": 3.216213108644979, "distance-from-start": 0.4491972287366121, "deviation-center-line": 0.2655947983954182, "driven_lanedir_consec": 0.1522972073447164}, "LF-small-loop-001-ego0": {"driven_any": 1.9245145454653343, "survival_time": 19.45000000000014, "driven_lanedir": 0.30878844639290937, "in-drivable-lane": 14.400000000000109, "deviation-heading": 3.714379837123174, "distance-from-start": 1.636867269980261, "deviation-center-line": 0.3805140428517224, "driven_lanedir_consec": 0.30878844639290937}}
simulation-passed1
survival_time_max19.45000000000014
survival_time_mean12.725000000000064
survival_time_min5.999999999999987
No reset possible
14105219391Roberto de Nóbregalx22-modconlx22-modconsimsuccessyesnoname0:08:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median17.77500000000014
deviation-center-line_median0.3553000460505353
driven_lanedir_consec_median0.4623698526277863
survival_time_median21.50000000000017


other stats
deviation-center-line_max0.4856689346164741
deviation-center-line_mean0.3553000460505353
deviation-center-line_min0.22493115748459655
deviation-heading_max1.7020798075192811
deviation-heading_mean1.6524475041525246
deviation-heading_median1.6524475041525246
deviation-heading_min1.602815200785768
distance-from-start_max3.0141449473787376
distance-from-start_mean2.7314567188870917
distance-from-start_median2.7314567188870917
distance-from-start_min2.4487684903954454
driven_any_max3.2508700508052666
driven_any_mean2.8595367520190473
driven_any_median2.8595367520190473
driven_any_min2.468203453232828
driven_lanedir_consec_max0.6703896904619768
driven_lanedir_consec_mean0.4623698526277863
driven_lanedir_consec_min0.25435001479359576
driven_lanedir_max0.6703896904619768
driven_lanedir_mean0.4623698526277863
driven_lanedir_median0.4623698526277863
driven_lanedir_min0.25435001479359576
in-drivable-lane_max21.900000000000176
in-drivable-lane_mean17.77500000000014
in-drivable-lane_min13.650000000000109
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.468203453232828, "survival_time": 18.70000000000013, "driven_lanedir": 0.6703896904619768, "in-drivable-lane": 13.650000000000109, "deviation-heading": 1.602815200785768, "distance-from-start": 2.4487684903954454, "deviation-center-line": 0.4856689346164741, "driven_lanedir_consec": 0.6703896904619768}, "LF-full-loop-001-ego0": {"driven_any": 3.2508700508052666, "survival_time": 24.30000000000021, "driven_lanedir": 0.25435001479359576, "in-drivable-lane": 21.900000000000176, "deviation-heading": 1.7020798075192811, "distance-from-start": 3.0141449473787376, "deviation-center-line": 0.22493115748459655, "driven_lanedir_consec": 0.25435001479359576}}
simulation-passed1
survival_time_max24.30000000000021
survival_time_mean21.50000000000017
survival_time_min18.70000000000013
No reset possible
14105019391Roberto de Nóbregalx22-modconlx22-modconsimtimeoutyesnoname----No reset possible
14104619387Roberto de Nóbregalx22-modconlx22-modconsimsuccessyesnoname0:09:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median27.250000000000036
deviation-center-line_median0.5339096950698813
driven_lanedir_consec_median0.6458902411751325
survival_time_median32.875


other stats
deviation-center-line_max0.8557575577714073
deviation-center-line_mean0.5339096950698813
deviation-center-line_min0.21206183236835535
deviation-heading_max4.97250905523934
deviation-heading_mean3.35358800179082
deviation-heading_median3.35358800179082
deviation-heading_min1.7346669483423
distance-from-start_max5.240345938211832
distance-from-start_mean4.131197531886938
distance-from-start_median4.131197531886938
distance-from-start_min3.0220491255620447
driven_any_max5.633817506937874
driven_any_mean4.445837827884422
driven_any_median4.445837827884422
driven_any_min3.2578581488309704
driven_lanedir_consec_max1.0667487448167825
driven_lanedir_consec_mean0.6458902411751325
driven_lanedir_consec_min0.2250317375334827
driven_lanedir_max1.0667487448167825
driven_lanedir_mean0.6458902411751325
driven_lanedir_median0.6458902411751325
driven_lanedir_min0.2250317375334827
in-drivable-lane_max32.39999999999989
in-drivable-lane_mean27.250000000000036
in-drivable-lane_min22.10000000000018
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 5.633817506937874, "survival_time": 41.399999999999785, "driven_lanedir": 1.0667487448167825, "in-drivable-lane": 32.39999999999989, "deviation-heading": 4.97250905523934, "distance-from-start": 5.240345938211832, "deviation-center-line": 0.8557575577714073, "driven_lanedir_consec": 1.0667487448167825}, "LF-full-loop-001-ego0": {"driven_any": 3.2578581488309704, "survival_time": 24.35000000000021, "driven_lanedir": 0.2250317375334827, "in-drivable-lane": 22.10000000000018, "deviation-heading": 1.7346669483423, "distance-from-start": 3.0220491255620447, "deviation-center-line": 0.21206183236835535, "driven_lanedir_consec": 0.2250317375334827}}
simulation-passed1
survival_time_max41.399999999999785
survival_time_mean32.875
survival_time_min24.35000000000021
No reset possible
14104319386Roberto de Nóbregalx22-modconlx22-modconsimfailedyesnoname0:01:20
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
14104219385Roberto de Nóbregalx22-modconlx22-modconsimsuccessyesnoname0:09:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median26.350000000000097
deviation-center-line_median0.4973039202812599
driven_lanedir_consec_median0.5670303952922193
survival_time_median31.525000000000077


other stats
deviation-center-line_max0.7867039216256513
deviation-center-line_mean0.4973039202812599
deviation-center-line_min0.20790391893686855
deviation-heading_max5.073427392328447
deviation-heading_mean3.4151992307254027
deviation-heading_median3.4151992307254027
deviation-heading_min1.756971069122358
distance-from-start_max4.8098804593401665
distance-from-start_mean3.915034283858383
distance-from-start_median3.915034283858383
distance-from-start_min3.0201881083765993
driven_any_max5.24946996676678
driven_any_mean4.257157950897121
driven_any_median4.257157950897121
driven_any_min3.264845935027463
driven_lanedir_consec_max0.9205074635777546
driven_lanedir_consec_mean0.5670303952922193
driven_lanedir_consec_min0.21355332700668408
driven_lanedir_max0.9205074635777546
driven_lanedir_mean0.5670303952922193
driven_lanedir_median0.5670303952922193
driven_lanedir_min0.21355332700668408
in-drivable-lane_max30.50000000000001
in-drivable-lane_mean26.350000000000097
in-drivable-lane_min22.20000000000018
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 5.24946996676678, "survival_time": 38.64999999999994, "driven_lanedir": 0.9205074635777546, "in-drivable-lane": 30.50000000000001, "deviation-heading": 5.073427392328447, "distance-from-start": 4.8098804593401665, "deviation-center-line": 0.7867039216256513, "driven_lanedir_consec": 0.9205074635777546}, "LF-full-loop-001-ego0": {"driven_any": 3.264845935027463, "survival_time": 24.40000000000021, "driven_lanedir": 0.21355332700668408, "in-drivable-lane": 22.20000000000018, "deviation-heading": 1.756971069122358, "distance-from-start": 3.0201881083765993, "deviation-center-line": 0.20790391893686855, "driven_lanedir_consec": 0.21355332700668408}}
simulation-passed1
survival_time_max38.64999999999994
survival_time_mean31.525000000000077
survival_time_min24.40000000000021
No reset possible
14104119384Roberto de Nóbregalx22-modconlx22-modconsimsuccessyesnoname0:07:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median18.650000000000155
deviation-center-line_median0.411153341136714
driven_lanedir_consec_median0.3978829571037167
survival_time_median22.95000000000019


other stats
deviation-center-line_max0.6336511374788092
deviation-center-line_mean0.411153341136714
deviation-center-line_min0.18865554479461888
deviation-heading_max5.3747275927775
deviation-heading_mean3.5917635841437376
deviation-heading_median3.5917635841437376
deviation-heading_min1.808799575509975
distance-from-start_max3.657374566012313
distance-from-start_mean2.632708167649462
distance-from-start_median2.632708167649462
distance-from-start_min1.6080417692866114
driven_any_max4.306069419122753
driven_any_mean3.0586928825148876
driven_any_median3.0586928825148876
driven_any_min1.8113163459070225
driven_lanedir_consec_max0.6241877049763589
driven_lanedir_consec_mean0.3978829571037167
driven_lanedir_consec_min0.17157820923107447
driven_lanedir_max0.6241877049763589
driven_lanedir_mean0.3978829571037167
driven_lanedir_median0.3978829571037167
driven_lanedir_min0.17157820923107447
in-drivable-lane_max25.30000000000027
in-drivable-lane_mean18.650000000000155
in-drivable-lane_min12.000000000000036
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 4.306069419122753, "survival_time": 31.90000000000032, "driven_lanedir": 0.6241877049763589, "in-drivable-lane": 25.30000000000027, "deviation-heading": 5.3747275927775, "distance-from-start": 3.657374566012313, "deviation-center-line": 0.6336511374788092, "driven_lanedir_consec": 0.6241877049763589}, "LF-full-loop-001-ego0": {"driven_any": 1.8113163459070225, "survival_time": 14.000000000000064, "driven_lanedir": 0.17157820923107447, "in-drivable-lane": 12.000000000000036, "deviation-heading": 1.808799575509975, "distance-from-start": 1.6080417692866114, "deviation-center-line": 0.18865554479461888, "driven_lanedir_consec": 0.17157820923107447}}
simulation-passed1
survival_time_max31.90000000000032
survival_time_mean22.95000000000019
survival_time_min14.000000000000064
No reset possible
14103719381Roberto de Nóbregalx22-modconlx22-modconsimsuccessyesnoname0:08:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median22.625000000000185
deviation-center-line_median0.5704542387068001
driven_lanedir_consec_median0.7852928445314296
survival_time_median28.575000000000273


other stats
deviation-center-line_max0.8895847429086211
deviation-center-line_mean0.5704542387068001
deviation-center-line_min0.25132373450497913
deviation-heading_max1.699093643823314
deviation-heading_mean1.641241148931193
deviation-heading_median1.641241148931193
deviation-heading_min1.5833886540390725
distance-from-start_max3.6862546189579297
distance-from-start_mean3.676438951625567
distance-from-start_median3.676438951625567
distance-from-start_min3.666623284293205
driven_any_max3.9986015185265784
driven_any_mean3.844863281715356
driven_any_median3.844863281715356
driven_any_min3.691125044904134
driven_lanedir_consec_max1.2738487644644354
driven_lanedir_consec_mean0.7852928445314296
driven_lanedir_consec_min0.2967369245984237
driven_lanedir_max1.2738487644644354
driven_lanedir_mean0.7852928445314296
driven_lanedir_median0.7852928445314296
driven_lanedir_min0.2967369245984237
in-drivable-lane_max27.00000000000025
in-drivable-lane_mean22.625000000000185
in-drivable-lane_min18.250000000000124
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.691125044904134, "survival_time": 27.500000000000256, "driven_lanedir": 1.2738487644644354, "in-drivable-lane": 18.250000000000124, "deviation-heading": 1.5833886540390725, "distance-from-start": 3.6862546189579297, "deviation-center-line": 0.8895847429086211, "driven_lanedir_consec": 1.2738487644644354}, "LF-full-loop-001-ego0": {"driven_any": 3.9986015185265784, "survival_time": 29.650000000000286, "driven_lanedir": 0.2967369245984237, "in-drivable-lane": 27.00000000000025, "deviation-heading": 1.699093643823314, "distance-from-start": 3.666623284293205, "deviation-center-line": 0.25132373450497913, "driven_lanedir_consec": 0.2967369245984237}}
simulation-passed1
survival_time_max29.650000000000286
survival_time_mean28.575000000000273
survival_time_min27.500000000000256
No reset possible
14102819374Roberto de Nóbregalx22-modconlx22-modconsimsuccessyesnoname0:18:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median37.94999999999948
deviation-center-line_median0.3766087235360244
driven_lanedir_consec_median0.2143495068236294
survival_time_median41.72499999999946


other stats
deviation-center-line_max0.3771857974701457
deviation-center-line_mean0.3766087235360244
deviation-center-line_min0.376031649601903
deviation-heading_max4.604811999215867
deviation-heading_mean4.298288374332723
deviation-heading_median4.298288374332723
deviation-heading_min3.99176474944958
distance-from-start_max1.7750702940342835
distance-from-start_mean1.659502694974087
distance-from-start_median1.659502694974087
distance-from-start_min1.5439350959138904
driven_any_max8.337792713857704
driven_any_mean5.731419262544675
driven_any_median5.731419262544675
driven_any_min3.1250458112316455
driven_lanedir_consec_max0.2747734494869938
driven_lanedir_consec_mean0.2143495068236294
driven_lanedir_consec_min0.15392556416026504
driven_lanedir_max0.2747734494869938
driven_lanedir_mean0.2143495068236294
driven_lanedir_median0.2143495068236294
driven_lanedir_min0.15392556416026504
in-drivable-lane_max56.34999999999877
in-drivable-lane_mean37.94999999999948
in-drivable-lane_min19.550000000000185
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.1250458112316455, "survival_time": 23.4500000000002, "driven_lanedir": 0.2747734494869938, "in-drivable-lane": 19.550000000000185, "deviation-heading": 3.99176474944958, "distance-from-start": 1.7750702940342835, "deviation-center-line": 0.3771857974701457, "driven_lanedir_consec": 0.2747734494869938}, "LF-full-loop-001-ego0": {"driven_any": 8.337792713857704, "survival_time": 59.99999999999873, "driven_lanedir": 0.15392556416026504, "in-drivable-lane": 56.34999999999877, "deviation-heading": 4.604811999215867, "distance-from-start": 1.5439350959138904, "deviation-center-line": 0.376031649601903, "driven_lanedir_consec": 0.15392556416026504}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean41.72499999999946
survival_time_min23.4500000000002
No reset possible
14102719373Roberto de Nóbregalx22-modconlx22-modconsimsuccessyesnoname0:06:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median15.300000000000086
deviation-center-line_median0.4538953157553554
driven_lanedir_consec_median0.6170490198505751
survival_time_median20.075000000000152


other stats
deviation-center-line_max0.6753563396382778
deviation-center-line_mean0.4538953157553554
deviation-center-line_min0.23243429187243303
deviation-heading_max1.6766154774553574
deviation-heading_mean1.629900671031148
deviation-heading_median1.629900671031148
deviation-heading_min1.5831858646069388
distance-from-start_max2.622028464987919
distance-from-start_mean2.535026750506539
distance-from-start_median2.535026750506539
distance-from-start_min2.4480250360251588
driven_any_max2.8595375817388757
driven_any_mean2.656882652928064
driven_any_median2.656882652928064
driven_any_min2.454227724117252
driven_lanedir_consec_max0.9604809597027084
driven_lanedir_consec_mean0.6170490198505751
driven_lanedir_consec_min0.27361707999844187
driven_lanedir_max0.9604809597027084
driven_lanedir_mean0.6170490198505751
driven_lanedir_median0.6170490198505751
driven_lanedir_min0.27361707999844187
in-drivable-lane_max19.000000000000135
in-drivable-lane_mean15.300000000000086
in-drivable-lane_min11.600000000000035
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.454227724117252, "survival_time": 18.65000000000013, "driven_lanedir": 0.9604809597027084, "in-drivable-lane": 11.600000000000035, "deviation-heading": 1.5831858646069388, "distance-from-start": 2.4480250360251588, "deviation-center-line": 0.6753563396382778, "driven_lanedir_consec": 0.9604809597027084}, "LF-full-loop-001-ego0": {"driven_any": 2.8595375817388757, "survival_time": 21.50000000000017, "driven_lanedir": 0.27361707999844187, "in-drivable-lane": 19.000000000000135, "deviation-heading": 1.6766154774553574, "distance-from-start": 2.622028464987919, "deviation-center-line": 0.23243429187243303, "driven_lanedir_consec": 0.27361707999844187}}
simulation-passed1
survival_time_max21.50000000000017
survival_time_mean20.075000000000152
survival_time_min18.65000000000013
No reset possible