Duckietown Challenges Home Challenges Submissions

Evaluator 5524

ID5524
evaluatornoname
ownerSacha Morin
machinechu-G15
processnoname_chu-G15
version6.2.40
first heard
last heard
statusinactive
# evaluating
# success4 116776
# timeout1 117166
# failed
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors16
Processor frequency (MHz)4.5 GHz
Free % of processors96%
RAM total (MB)15.4 GB
RAM free (MB)6.8 GB
Disk (MB)479.6 GB
Disk available (MB)304.8 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
12037218271Sacha Morinv2mooc-state-estimationsimsuccessyesnoname0:10:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.215477486094982
survival_time_median59.99999999999873
deviation-center-line_median1.3206555506361697
in-drivable-lane_median26.89999999999847


other stats
deviation-center-line_max3.253121830969833
deviation-center-line_mean1.5814192585402065
deviation-center-line_min0.170480394014617
deviation-heading_max11.683886315295164
deviation-heading_mean6.501876155733563
deviation-heading_median6.686937446736283
deviation-heading_min1.134804705169246
distance-from-start_max3.399698355326317
distance-from-start_mean3.0816030286854303
distance-from-start_median3.183280652133352
distance-from-start_min2.661830078596622
driven_any_max7.92113844830262
driven_any_mean7.9166659555915375
driven_any_median7.921072047693286
driven_any_min7.907787370778706
driven_lanedir_consec_max6.441528713954571
driven_lanedir_consec_mean3.8014386471738457
driven_lanedir_consec_min0.7473097414719844
driven_lanedir_max6.441528713954571
driven_lanedir_mean3.8014386471738457
driven_lanedir_median4.215477486094982
driven_lanedir_min0.7473097414719844
in-drivable-lane_max53.74999999999874
in-drivable-lane_mean29.88333333333225
in-drivable-lane_min8.99999999999952
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 7.92113844830262, "survival_time": 59.99999999999873, "driven_lanedir": 0.7473097414719844, "in-drivable-lane": 53.74999999999874, "deviation-heading": 1.134804705169246, "distance-from-start": 3.183280652133352, "deviation-center-line": 0.170480394014617, "driven_lanedir_consec": 0.7473097414719844}, "LF-zig-zag-001-ego0": {"driven_any": 7.921072047693286, "survival_time": 59.99999999999873, "driven_lanedir": 4.215477486094982, "in-drivable-lane": 26.89999999999847, "deviation-heading": 6.686937446736283, "distance-from-start": 3.399698355326317, "deviation-center-line": 1.3206555506361697, "driven_lanedir_consec": 4.215477486094982}, "LF-zig-zag-002-ego0": {"driven_any": 7.907787370778706, "survival_time": 59.99999999999873, "driven_lanedir": 6.441528713954571, "in-drivable-lane": 8.99999999999952, "deviation-heading": 11.683886315295164, "distance-from-start": 2.661830078596622, "deviation-center-line": 3.253121830969833, "driven_lanedir_consec": 6.441528713954571}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11900118135Sacha Morinstate estimation exercisemooc-state-estimationsimsuccessyesnoname0:10:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.036870746184054
survival_time_median59.99999999999873
deviation-center-line_median1.3298953096992463
in-drivable-lane_median27.599999999998843


other stats
deviation-center-line_max2.380571638010459
deviation-center-line_mean1.4623260185180045
deviation-center-line_min0.6765111078443077
deviation-heading_max8.758358706291103
deviation-heading_mean6.034325439398306
deviation-heading_median6.811544538648117
deviation-heading_min2.533073073255699
distance-from-start_max3.4820912538062423
distance-from-start_mean3.196866690961356
distance-from-start_median3.0809944476556317
distance-from-start_min3.0275143714221944
driven_any_max7.92107690929151
driven_any_mean7.916647185031963
driven_any_median7.921001397859836
driven_any_min7.907863247944545
driven_lanedir_consec_max4.715498404682356
driven_lanedir_consec_mean3.2079183124820454
driven_lanedir_consec_min0.8713857865797275
driven_lanedir_max4.715498404682356
driven_lanedir_mean3.2079183124820454
driven_lanedir_median4.036870746184054
driven_lanedir_min0.8713857865797275
in-drivable-lane_max52.0999999999988
in-drivable-lane_mean34.04999999999883
in-drivable-lane_min22.44999999999886
per-episodes
details{"LF-zig-zag-000-ego0": {"driven_any": 7.92107690929151, "survival_time": 59.99999999999873, "driven_lanedir": 4.036870746184054, "in-drivable-lane": 27.599999999998843, "deviation-heading": 6.811544538648117, "distance-from-start": 3.0809944476556317, "deviation-center-line": 1.3298953096992463, "driven_lanedir_consec": 4.036870746184054}, "LF-zig-zag-001-ego0": {"driven_any": 7.921001397859836, "survival_time": 59.99999999999873, "driven_lanedir": 4.715498404682356, "in-drivable-lane": 22.44999999999886, "deviation-heading": 8.758358706291103, "distance-from-start": 3.4820912538062423, "deviation-center-line": 2.380571638010459, "driven_lanedir_consec": 4.715498404682356}, "LF-zig-zag-002-ego0": {"driven_any": 7.907863247944545, "survival_time": 59.99999999999873, "driven_lanedir": 0.8713857865797275, "in-drivable-lane": 52.0999999999988, "deviation-heading": 2.533073073255699, "distance-from-start": 3.0275143714221944, "deviation-center-line": 0.6765111078443077, "driven_lanedir_consec": 0.8713857865797275}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11716617967wei fansubmit_simmooc-objdetsimtimeoutyesnoname0:02:26
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
11714317966Sacha Morinobjdet exercisemooc-objdetsimsuccessyesnoname0:08:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median4.718183803235549


other stats
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.654087939262823
distance-from-start_mean4.717679865360543
distance-from-start_median4.717679865360543
distance-from-start_min2.7812717914582636
driven_any_max6.654087939262823
driven_any_mean4.717679865360543
driven_any_median4.717679865360543
driven_any_min2.7812717914582636
driven_lanedir_consec_max6.654757813624657
driven_lanedir_consec_mean4.718183803235549
driven_lanedir_consec_min2.781609792846442
driven_lanedir_max6.654757813624657
driven_lanedir_mean4.718183803235549
driven_lanedir_median4.718183803235549
driven_lanedir_min2.781609792846442
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.654087939262823, "survival_time": 59.99999999999873, "driven_lanedir": 6.654757813624657, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 6.654087939262823, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 6.654757813624657}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.7812717914582636, "survival_time": 59.99999999999873, "driven_lanedir": 2.781609792846442, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 2.7812717914582636, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 2.781609792846442}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
11677617932Sacha Morinobjdet exercisemooc-objdetsimsuccessyesnoname0:09:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
driven_lanedir_consec_median4.731936111135045


other stats
deviation-center-line_max1.4153832435607612
deviation-center-line_mean0.9025621175765756
deviation-center-line_median0.9025621175765756
deviation-center-line_min0.3897409915923899
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.682040419579005
distance-from-start_mean4.731656105518635
distance-from-start_median4.731656105518635
distance-from-start_min2.7812717914582636
driven_any_max6.682040419579005
driven_any_mean4.731656105518635
driven_any_median4.731656105518635
driven_any_min2.7812717914582636
driven_lanedir_consec_max6.682262429423649
driven_lanedir_consec_mean4.731936111135045
driven_lanedir_consec_min2.781609792846442
driven_lanedir_max6.682262429423649
driven_lanedir_mean4.731936111135045
driven_lanedir_median4.731936111135045
driven_lanedir_min2.781609792846442
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_median0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-long-loop-with-duckies-000-ego0": {"driven_any": 6.682040419579005, "survival_time": 59.99999999999873, "driven_lanedir": 6.682262429423649, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 6.682040419579005, "deviation-center-line": 0.3897409915923899, "driven_lanedir_consec": 6.682262429423649}, "LF-long-loop-with-duckies-001-ego0": {"driven_any": 2.7812717914582636, "survival_time": 59.99999999999873, "driven_lanedir": 2.781609792846442, "in-drivable-lane": 0.0, "deviation-heading": 0.0, "distance-from-start": 2.7812717914582636, "deviation-center-line": 1.4153832435607612, "driven_lanedir_consec": 2.781609792846442}}
simulation-passed1
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible