Duckietown Challenges Home Challenges Submissions

Evaluator 5378

ID5378
evaluatorreg04
ownerI don't have one 😀
machinearchimede_59d60bc2a21b
processreg04_59d60bc2a21b
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success1 79867
# timeout1 79883
# failed
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available1
Number of processors40
Processor frequency (MHz)2.1 GHz
Free % of processors83%
RAM total (MB)376.6 GB
RAM free (MB)243.1 GB
Disk (MB)74209.1 GB
Disk available (MB)57001.0 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7988316134Haydar Talibobjdet exercisemooc-objdetsimtimeoutnoreg04----No reset possible
7986716141khalil abdeddaimbase-image-mlmooc-visservoingsimsuccessnoreg040:16:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median25.4249999999994
deviation-center-line_median0.6201945182092702
driven_lanedir_consec_median0.3850573991367148
survival_time_median31.54999999999936


other stats
agent_compute-ego0_max0.05524566925931831
agent_compute-ego0_mean0.035825141437646424
agent_compute-ego0_median0.035825141437646424
agent_compute-ego0_min0.016404613615974548
complete-iteration_max0.23658874370374847
complete-iteration_mean0.21454078656626363
complete-iteration_median0.21454078656626363
complete-iteration_min0.19249282942877877
deviation-center-line_max1.132176550011933
deviation-center-line_mean0.6201945182092702
deviation-center-line_min0.1082124864066075
deviation-heading_max7.351972843360328
deviation-heading_mean4.440977118819103
deviation-heading_median4.440977118819103
deviation-heading_min1.5299813942778784
distance-from-start_max0.952945477824704
distance-from-start_mean0.5715621730907713
distance-from-start_median0.5715621730907713
distance-from-start_min0.19017886835683867
driven_any_max6.248068639552636
driven_any_mean3.226749311818757
driven_any_median3.226749311818757
driven_any_min0.20542998408487825
driven_lanedir_consec_max0.7084315492273132
driven_lanedir_consec_mean0.3850573991367148
driven_lanedir_consec_min0.06168324904611644
driven_lanedir_max0.7084315492273132
driven_lanedir_mean0.3850573991367148
driven_lanedir_median0.3850573991367148
driven_lanedir_min0.06168324904611644
get_duckie_state_max3.0138808225811173e-06
get_duckie_state_mean2.965835050078691e-06
get_duckie_state_median2.965835050078691e-06
get_duckie_state_min2.9177892775762647e-06
get_robot_state_max0.010260574625096254
get_robot_state_mean0.009403548655277968
get_robot_state_median0.009403548655277968
get_robot_state_min0.008546522685459681
get_state_dump_max0.012503046080234347
get_state_dump_mean0.012451936895412508
get_state_dump_median0.012451936895412508
get_state_dump_min0.012400827710590666
get_ui_image_max0.03906108120101179
get_ui_image_mean0.03872862145053186
get_ui_image_median0.03872862145053186
get_ui_image_min0.03839616170005193
in-drivable-lane_max49.59999999999881
in-drivable-lane_mean25.4249999999994
in-drivable-lane_min1.249999999999996
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.248068639552636, "get_ui_image": 0.03906108120101179, "step_physics": 0.08927287606772137, "survival_time": 59.99999999999873, "driven_lanedir": 0.7084315492273132, "get_state_dump": 0.012503046080234347, "get_robot_state": 0.010260574625096254, "sim_render-ego0": 0.008409496548769376, "get_duckie_state": 3.0138808225811173e-06, "in-drivable-lane": 49.59999999999881, "deviation-heading": 7.351972843360328, "agent_compute-ego0": 0.05524566925931831, "complete-iteration": 0.23658874370374847, "set_robot_commands": 0.006124562168994811, "distance-from-start": 0.952945477824704, "deviation-center-line": 1.132176550011933, "driven_lanedir_consec": 0.7084315492273132, "sim_compute_sim_state": 0.010092022416990663, "sim_compute_performance-ego0": 0.005419126061178266}, "LF-small-loop-001-ego0": {"driven_any": 0.20542998408487825, "get_ui_image": 0.03839616170005193, "step_physics": 0.08659584181649345, "survival_time": 3.099999999999997, "driven_lanedir": 0.06168324904611644, "get_state_dump": 0.012400827710590666, "get_robot_state": 0.008546522685459681, "sim_render-ego0": 0.007982288088117327, "get_duckie_state": 2.9177892775762647e-06, "in-drivable-lane": 1.249999999999996, "deviation-heading": 1.5299813942778784, "agent_compute-ego0": 0.016404613615974548, "complete-iteration": 0.19249282942877877, "set_robot_commands": 0.005562627126300145, "distance-from-start": 0.19017886835683867, "deviation-center-line": 0.1082124864066075, "driven_lanedir_consec": 0.06168324904611644, "sim_compute_sim_state": 0.011562771267361112, "sim_compute_performance-ego0": 0.004839719287932865}}
set_robot_commands_max0.006124562168994811
set_robot_commands_mean0.005843594647647478
set_robot_commands_median0.005843594647647478
set_robot_commands_min0.005562627126300145
sim_compute_performance-ego0_max0.005419126061178266
sim_compute_performance-ego0_mean0.005129422674555566
sim_compute_performance-ego0_median0.005129422674555566
sim_compute_performance-ego0_min0.004839719287932865
sim_compute_sim_state_max0.011562771267361112
sim_compute_sim_state_mean0.010827396842175888
sim_compute_sim_state_median0.010827396842175888
sim_compute_sim_state_min0.010092022416990663
sim_render-ego0_max0.008409496548769376
sim_render-ego0_mean0.008195892318443351
sim_render-ego0_median0.008195892318443351
sim_render-ego0_min0.007982288088117327
simulation-passed1
step_physics_max0.08927287606772137
step_physics_mean0.08793435894210741
step_physics_median0.08793435894210741
step_physics_min0.08659584181649345
survival_time_max59.99999999999873
survival_time_mean31.54999999999936
survival_time_min3.099999999999997
No reset possible