Duckietown Challenges Home Challenges Submissions

Evaluator 5442

ID5442
evaluatornoname
ownerQi Wen
machineqihomeDesktop
processnoname_qihomeDesktop
version6.2.20
first heard
last heard
statusinactive
# evaluating
# success3 81419
# timeout
# failed
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors16
Processor frequency (MHz)5.0 GHz
Free % of processors97%
RAM total (MB)15.5 GB
RAM free (MB)11.0 GB
Disk (MB)915.4 GB
Disk available (MB)789.6 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
8443716741Qi Wenbase-image-mlmooc-visservoingsimsuccessnononame1:10:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median0.0
deviation-center-line_median1.7877411701350692
driven_lanedir_consec_median6.098587656835438
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.006999208766355999
agent_compute-ego0_mean0.006057172889614185
agent_compute-ego0_median0.006057172889614185
agent_compute-ego0_min0.00511513701287237
complete-iteration_max0.1088477497196118
complete-iteration_mean0.10292481403366711
complete-iteration_median0.10292481403366711
complete-iteration_min0.09700187834772242
deviation-center-line_max2.0766150735256033
deviation-center-line_mean1.7877411701350692
deviation-center-line_min1.4988672667445353
deviation-heading_max11.965038393757752
deviation-heading_mean11.159883234297444
deviation-heading_median11.159883234297444
deviation-heading_min10.354728074837134
distance-from-start_max1.547818858565163
distance-from-start_mean1.3192514124736747
distance-from-start_median1.3192514124736747
distance-from-start_min1.090683966382186
driven_any_max6.248171700109075
driven_any_mean6.245572211446038
driven_any_median6.245572211446038
driven_any_min6.2429727227830005
driven_lanedir_consec_max6.108937469062367
driven_lanedir_consec_mean6.098587656835438
driven_lanedir_consec_min6.088237844608509
driven_lanedir_max6.108937469062367
driven_lanedir_mean6.098587656835438
driven_lanedir_median6.098587656835438
driven_lanedir_min6.088237844608509
get_duckie_state_max1.118046159450458e-06
get_duckie_state_mean1.0024101708354203e-06
get_duckie_state_median1.0024101708354203e-06
get_duckie_state_min8.867741822203828e-07
get_robot_state_max0.004252599141282106
get_robot_state_mean0.003647446930160332
get_robot_state_median0.003647446930160332
get_robot_state_min0.0030422947190385575
get_state_dump_max0.005122235176664506
get_state_dump_mean0.004483561531689443
get_state_dump_median0.004483561531689443
get_state_dump_min0.0038448878867143794
get_ui_image_max0.032467921310221526
get_ui_image_mean0.032084724587465106
get_ui_image_median0.032084724587465106
get_ui_image_min0.03170152786470869
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.248171700109075, "get_ui_image": 0.032467921310221526, "step_physics": 0.04315440700413484, "survival_time": 59.99999999999873, "driven_lanedir": 6.088237844608509, "get_state_dump": 0.0038448878867143794, "get_robot_state": 0.0030422947190385575, "sim_render-ego0": 0.0026340597773670256, "get_duckie_state": 8.867741822203828e-07, "in-drivable-lane": 0.0, "deviation-heading": 11.965038393757752, "agent_compute-ego0": 0.00511513701287237, "complete-iteration": 0.09700187834772242, "set_robot_commands": 0.0018989124663366464, "distance-from-start": 1.090683966382186, "deviation-center-line": 1.4988672667445353, "driven_lanedir_consec": 6.088237844608509, "sim_compute_sim_state": 0.0031745572769076103, "sim_compute_performance-ego0": 0.0016053838594867029}, "LF-small-loop-001-ego0": {"driven_any": 6.2429727227830005, "get_ui_image": 0.03170152786470869, "step_physics": 0.047696058001744555, "survival_time": 59.99999999999873, "driven_lanedir": 6.108937469062367, "get_state_dump": 0.005122235176664506, "get_robot_state": 0.004252599141282106, "sim_render-ego0": 0.003661627971957268, "get_duckie_state": 1.118046159450458e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.354728074837134, "agent_compute-ego0": 0.006999208766355999, "complete-iteration": 0.1088477497196118, "set_robot_commands": 0.002663935550940622, "distance-from-start": 1.547818858565163, "deviation-center-line": 2.0766150735256033, "driven_lanedir_consec": 6.108937469062367, "sim_compute_sim_state": 0.004429346715083825, "sim_compute_performance-ego0": 0.0022384060312568097}}
set_robot_commands_max0.002663935550940622
set_robot_commands_mean0.0022814240086386343
set_robot_commands_median0.0022814240086386343
set_robot_commands_min0.0018989124663366464
sim_compute_performance-ego0_max0.0022384060312568097
sim_compute_performance-ego0_mean0.0019218949453717563
sim_compute_performance-ego0_median0.0019218949453717563
sim_compute_performance-ego0_min0.0016053838594867029
sim_compute_sim_state_max0.004429346715083825
sim_compute_sim_state_mean0.003801951995995718
sim_compute_sim_state_median0.003801951995995718
sim_compute_sim_state_min0.0031745572769076103
sim_render-ego0_max0.003661627971957268
sim_render-ego0_mean0.0031478438746621465
sim_render-ego0_median0.0031478438746621465
sim_render-ego0_min0.0026340597773670256
simulation-passed1
step_physics_max0.047696058001744555
step_physics_mean0.0454252325029397
step_physics_median0.0454252325029397
step_physics_min0.04315440700413484
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8435616678Qi Wenbase-image-mlmooc-visservoingsimsuccessnononame0:50:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median31.37499999999978
deviation-center-line_median1.4873148756947467
driven_lanedir_consec_median1.1824047557930937
survival_time_median44.3249999999995


other stats
agent_compute-ego0_max0.0075980830847671085
agent_compute-ego0_mean0.006305324229155386
agent_compute-ego0_median0.006305324229155386
agent_compute-ego0_min0.005012565373543663
complete-iteration_max0.11270413549615382
complete-iteration_mean0.10433835543662132
complete-iteration_median0.10433835543662132
complete-iteration_min0.0959725753770888
deviation-center-line_max2.1065139899363703
deviation-center-line_mean1.4873148756947467
deviation-center-line_min0.8681157614531231
deviation-heading_max5.128631601317045
deviation-heading_mean4.710284342089159
deviation-heading_median4.710284342089159
deviation-heading_min4.291937082861273
distance-from-start_max1.4401178125952392
distance-from-start_mean1.3939926722928515
distance-from-start_median1.3939926722928515
distance-from-start_min1.347867531990464
driven_any_max6.242788099684066
driven_any_mean4.565761401238381
driven_any_median4.565761401238381
driven_any_min2.888734702792696
driven_lanedir_consec_max1.5770288761043958
driven_lanedir_consec_mean1.1824047557930937
driven_lanedir_consec_min0.787780635481791
driven_lanedir_max1.5770288761043958
driven_lanedir_mean1.1824047557930937
driven_lanedir_median1.1824047557930937
driven_lanedir_min0.787780635481791
get_duckie_state_max1.1724397403612224e-06
get_duckie_state_mean1.0107212427272956e-06
get_duckie_state_median1.0107212427272956e-06
get_duckie_state_min8.490027450933689e-07
get_robot_state_max0.004480551521942875
get_robot_state_mean0.0037240656884241366
get_robot_state_median0.0037240656884241366
get_robot_state_min0.0029675798549053975
get_state_dump_max0.005332377232877936
get_state_dump_mean0.004531208190421552
get_state_dump_median0.004531208190421552
get_state_dump_min0.003730039147965169
get_ui_image_max0.03192875111144594
get_ui_image_mean0.031815640544275194
get_ui_image_median0.031815640544275194
get_ui_image_min0.031702529977104446
in-drivable-lane_max43.39999999999935
in-drivable-lane_mean31.37499999999978
in-drivable-lane_min19.350000000000207
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 2.888734702792696, "get_ui_image": 0.03192875111144594, "step_physics": 0.04310689196769369, "survival_time": 28.650000000000272, "driven_lanedir": 0.787780635481791, "get_state_dump": 0.003730039147965169, "get_robot_state": 0.0029675798549053975, "sim_render-ego0": 0.002578667231968471, "get_duckie_state": 8.490027450933689e-07, "in-drivable-lane": 19.350000000000207, "deviation-heading": 4.291937082861273, "agent_compute-ego0": 0.005012565373543663, "complete-iteration": 0.0959725753770888, "set_robot_commands": 0.0018719787797030671, "distance-from-start": 1.347867531990464, "deviation-center-line": 0.8681157614531231, "driven_lanedir_consec": 0.787780635481791, "sim_compute_sim_state": 0.0031383020952603542, "sim_compute_performance-ego0": 0.0015761079688520795}, "LF-small-loop-001-ego0": {"driven_any": 6.242788099684066, "get_ui_image": 0.031702529977104446, "step_physics": 0.049642136253782554, "survival_time": 59.99999999999873, "driven_lanedir": 1.5770288761043958, "get_state_dump": 0.005332377232877936, "get_robot_state": 0.004480551521942875, "sim_render-ego0": 0.003932989010902169, "get_duckie_state": 1.1724397403612224e-06, "in-drivable-lane": 43.39999999999935, "deviation-heading": 5.128631601317045, "agent_compute-ego0": 0.0075980830847671085, "complete-iteration": 0.11270413549615382, "set_robot_commands": 0.0028131649357194606, "distance-from-start": 1.4401178125952392, "deviation-center-line": 2.1065139899363703, "driven_lanedir_consec": 1.5770288761043958, "sim_compute_sim_state": 0.004730867406509996, "sim_compute_performance-ego0": 0.0023855305432677765}}
set_robot_commands_max0.0028131649357194606
set_robot_commands_mean0.002342571857711264
set_robot_commands_median0.002342571857711264
set_robot_commands_min0.0018719787797030671
sim_compute_performance-ego0_max0.0023855305432677765
sim_compute_performance-ego0_mean0.001980819256059928
sim_compute_performance-ego0_median0.001980819256059928
sim_compute_performance-ego0_min0.0015761079688520795
sim_compute_sim_state_max0.004730867406509996
sim_compute_sim_state_mean0.003934584750885175
sim_compute_sim_state_median0.003934584750885175
sim_compute_sim_state_min0.0031383020952603542
sim_render-ego0_max0.003932989010902169
sim_render-ego0_mean0.00325582812143532
sim_render-ego0_median0.00325582812143532
sim_render-ego0_min0.002578667231968471
simulation-passed1
step_physics_max0.049642136253782554
step_physics_mean0.04637451411073812
step_physics_median0.04637451411073812
step_physics_min0.04310689196769369
survival_time_max59.99999999999873
survival_time_mean44.3249999999995
survival_time_min28.650000000000272
No reset possible
8141916448Qi Wentemplate-rosmooc-modconsimsuccessnononame1:06:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median15.424999999999836
deviation-center-line_median2.0449681262921784
driven_lanedir_consec_median4.717810763549979
survival_time_median50.12499999999929


other stats
agent_compute-ego0_max0.01528452457138938
agent_compute-ego0_mean0.010262971878878336
agent_compute-ego0_median0.010262971878878336
agent_compute-ego0_min0.00524141918636729
complete-iteration_max0.17348401572285446
complete-iteration_mean0.1728149676252594
complete-iteration_median0.1728149676252594
complete-iteration_min0.17214591952766437
deviation-center-line_max2.465646671127864
deviation-center-line_mean2.0449681262921784
deviation-center-line_min1.624289581456493
deviation-heading_max5.697299479330938
deviation-heading_mean5.078556970379108
deviation-heading_median5.078556970379108
deviation-heading_min4.459814461427277
distance-from-start_max8.185413320003763
distance-from-start_mean6.700124290476449
distance-from-start_median6.700124290476449
distance-from-start_min5.214835260949134
driven_any_max8.338217939360314
driven_any_mean6.902155492024132
driven_any_median6.902155492024132
driven_any_min5.466093044687949
driven_lanedir_consec_max7.365605783501117
driven_lanedir_consec_mean4.717810763549979
driven_lanedir_consec_min2.0700157435988413
driven_lanedir_max7.365605783501117
driven_lanedir_mean4.717810763549979
driven_lanedir_median4.717810763549979
driven_lanedir_min2.0700157435988413
get_duckie_state_max1.0595723949650083e-06
get_duckie_state_mean9.6493484476862e-07
get_duckie_state_median9.6493484476862e-07
get_duckie_state_min8.702972945722315e-07
get_robot_state_max0.004058690284085333
get_robot_state_mean0.003563801757188919
get_robot_state_median0.003563801757188919
get_robot_state_min0.003068913230292505
get_state_dump_max0.004877461097376518
get_state_dump_mean0.004364081074581598
get_state_dump_median0.004364081074581598
get_state_dump_min0.0038507010517866785
get_ui_image_max0.05596146238138038
get_ui_image_mean0.055945226146732766
get_ui_image_median0.055945226146732766
get_ui_image_min0.05592898991208514
in-drivable-lane_max24.399999999999665
in-drivable-lane_mean15.424999999999836
in-drivable-lane_min6.450000000000008
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.338217939360314, "get_ui_image": 0.05596146238138038, "step_physics": 0.06073712230622024, "survival_time": 59.99999999999873, "driven_lanedir": 7.365605783501117, "get_state_dump": 0.0038507010517866785, "get_robot_state": 0.003068913230292505, "sim_render-ego0": 0.002622722686081504, "get_duckie_state": 8.702972945722315e-07, "in-drivable-lane": 6.450000000000008, "deviation-heading": 5.697299479330938, "agent_compute-ego0": 0.01528452457138938, "complete-iteration": 0.17348401572285446, "set_robot_commands": 0.001919124049012806, "distance-from-start": 8.185413320003763, "deviation-center-line": 2.465646671127864, "driven_lanedir_consec": 7.365605783501117, "sim_compute_sim_state": 0.02844755377598746, "sim_compute_performance-ego0": 0.001520892166277451}, "LF-full-loop-001-ego0": {"driven_any": 5.466093044687949, "get_ui_image": 0.05592898991208514, "step_physics": 0.060687185812824715, "survival_time": 40.24999999999985, "driven_lanedir": 2.0700157435988413, "get_state_dump": 0.004877461097376518, "get_robot_state": 0.004058690284085333, "sim_render-ego0": 0.0027354452805246963, "get_duckie_state": 1.0595723949650083e-06, "in-drivable-lane": 24.399999999999665, "deviation-heading": 4.459814461427277, "agent_compute-ego0": 0.00524141918636729, "complete-iteration": 0.17214591952766437, "set_robot_commands": 0.00202315794327123, "distance-from-start": 5.214835260949134, "deviation-center-line": 1.624289581456493, "driven_lanedir_consec": 2.0700157435988413, "sim_compute_sim_state": 0.03490365646021538, "sim_compute_performance-ego0": 0.001613987290829642}}
set_robot_commands_max0.00202315794327123
set_robot_commands_mean0.001971140996142018
set_robot_commands_median0.001971140996142018
set_robot_commands_min0.001919124049012806
sim_compute_performance-ego0_max0.001613987290829642
sim_compute_performance-ego0_mean0.0015674397285535464
sim_compute_performance-ego0_median0.0015674397285535464
sim_compute_performance-ego0_min0.001520892166277451
sim_compute_sim_state_max0.03490365646021538
sim_compute_sim_state_mean0.03167560511810142
sim_compute_sim_state_median0.03167560511810142
sim_compute_sim_state_min0.02844755377598746
sim_render-ego0_max0.0027354452805246963
sim_render-ego0_mean0.0026790839833031
sim_render-ego0_median0.0026790839833031
sim_render-ego0_min0.002622722686081504
simulation-passed1
step_physics_max0.06073712230622024
step_physics_mean0.060712154059522475
step_physics_median0.060712154059522475
step_physics_min0.060687185812824715
survival_time_max59.99999999999873
survival_time_mean50.12499999999929
survival_time_min40.24999999999985
No reset possible