Duckietown Challenges Home Challenges Submissions

Evaluator 607

ID607
evaluatorp-96691
ownerAndrea Censi 🇨🇭
machinedorothy
processp-96691
versiond-c:4.0.12;d-c-r:4.0.15;d-s:4.0.13
first heard
last heard
statusinactive
# evaluating
# success1 17536
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
175362366Andrea Censi 🇨🇭random_agentaido2-LFVI-sim-testingstep1-simulationsuccess Note that this job is not up to date; the challenge has been changed. p-966910:07:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6896127428821732
survival_time_median1.1500000000000004
deviation-center-line_median0.05610305022565209
in-drivable-lane_median0.20000000000000007


other stats
agent_compute-ego_max0.19014455590929305
agent_compute-ego_mean0.11784438615506727
agent_compute-ego_median0.1021284642426864
agent_compute-ego_min0.08359559722568678
deviation-center-line_max0.07504669169058735
deviation-center-line_mean0.05629372528587068
deviation-center-line_min0.031337769455374115
deviation-heading_max0.4695314592890065
deviation-heading_mean0.28295632700130013
deviation-heading_median0.28969351082790473
deviation-heading_min0.13822734158708538
driven_any_max1.1972535692377095
driven_any_mean1.069550703128448
driven_any_median1.0381750331691957
driven_any_min1.0257183998178268
driven_lanedir_consec_max0.8123144800841251
driven_lanedir_consec_mean0.6312226729648216
driven_lanedir_consec_min0.4373052105850964
driven_lanedir_max0.9325407987545682
driven_lanedir_mean0.7224147694584564
driven_lanedir_median0.8123144800841251
driven_lanedir_min0.48318684247252186
in-drivable-lane_max0.6000000000000004
in-drivable-lane_mean0.3000000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1972535692377095, "sim_physics": 0.05649459362030029, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5600308085729072, "sim_render-ego": 0.10453613315309795, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.19014455590929305, "deviation-heading": 0.4695314592890065, "set_robot_commands": 0.11934678895132882, "deviation-center-line": 0.05610305022565209, "driven_lanedir_consec": 0.4373052105850964, "sim_compute_sim_state": 0.05113514832087925, "sim_compute_performance-ego": 0.0987937194960458, "sim_compute_robot_state-ego": 0.10090667860848564, "sim_compute_robot_state-npc0": 0.09774089711053031, "sim_compute_robot_state-npc1": 0.08587871279035296, "sim_compute_robot_state-npc2": 0.08715782846723284, "sim_compute_robot_state-npc3": 0.08028672422681536}, "udem1-1-0": {"driven_any": 1.036014073841825, "sim_physics": 0.03573553760846456, "survival_time": 1.2000000000000004, "driven_lanedir": 0.48318684247252186, "sim_render-ego": 0.06795251369476318, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.12696526447931925, "deviation-heading": 0.13822734158708538, "set_robot_commands": 0.08403172095616658, "deviation-center-line": 0.031337769455374115, "driven_lanedir_consec": 0.48318684247252186, "sim_compute_sim_state": 0.03843654195467631, "sim_compute_performance-ego": 0.06547626852989197, "sim_compute_robot_state-ego": 0.0675175388654073, "sim_compute_robot_state-npc0": 0.06790002187093098, "sim_compute_robot_state-npc1": 0.06346177061398824, "sim_compute_robot_state-npc2": 0.06349572539329529, "sim_compute_robot_state-npc3": 0.06272400418917339}, "udem1-2-0": {"driven_any": 1.0257183998178268, "sim_physics": 0.02329235491545304, "survival_time": 1.1500000000000004, "driven_lanedir": 0.9325407987545682, "sim_render-ego": 0.04339204663815706, "in-drivable-lane": 0, "agent_compute-ego": 0.08359559722568678, "deviation-heading": 0.28969351082790473, "set_robot_commands": 0.06346972092338231, "deviation-center-line": 0.07504669169058735, "driven_lanedir_consec": 0.6896127428821732, "sim_compute_sim_state": 0.025520925936491592, "sim_compute_performance-ego": 0.04236261740974758, "sim_compute_robot_state-ego": 0.04521489143371582, "sim_compute_robot_state-npc0": 0.04422686410986859, "sim_compute_robot_state-npc1": 0.044046090996783714, "sim_compute_robot_state-npc2": 0.04715865591297979, "sim_compute_robot_state-npc3": 0.044526919074680496}, "udem1-3-0": {"driven_any": 1.0505924395756825, "sim_physics": 0.026178857554560123, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8240009174081598, "sim_render-ego": 0.05326005686884341, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.1021284642426864, "deviation-heading": 0.19133902257839172, "set_robot_commands": 0.07707311796105426, "deviation-center-line": 0.04393905052607498, "driven_lanedir_consec": 0.7336940888001914, "sim_compute_sim_state": 0.03027783269467561, "sim_compute_performance-ego": 0.05570623149042544, "sim_compute_robot_state-ego": 0.05861590219580609, "sim_compute_robot_state-npc0": 0.05329366352247155, "sim_compute_robot_state-npc1": 0.05133955375007961, "sim_compute_robot_state-npc2": 0.050997993220453675, "sim_compute_robot_state-npc3": 0.04922817064368207}, "udem1-4-0": {"driven_any": 1.0381750331691957, "sim_physics": 0.021876615026722782, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8123144800841251, "sim_render-ego": 0.04257746364759362, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.08638804891835088, "deviation-heading": 0.32599030072411245, "set_robot_commands": 0.05939882734547491, "deviation-center-line": 0.07504206453166483, "driven_lanedir_consec": 0.8123144800841251, "sim_compute_sim_state": 0.02555031361787215, "sim_compute_performance-ego": 0.043904594753099525, "sim_compute_robot_state-ego": 0.044975726500801415, "sim_compute_robot_state-npc0": 0.043751612953517746, "sim_compute_robot_state-npc1": 0.043827419695646866, "sim_compute_robot_state-npc2": 0.04442921928737475, "sim_compute_robot_state-npc3": 0.04605233150979747}}
set_robot_commands_max0.11934678895132882
set_robot_commands_mean0.08066403522748138
set_robot_commands_median0.07707311796105426
set_robot_commands_min0.05939882734547491
sim_compute_performance-ego_max0.0987937194960458
sim_compute_performance-ego_mean0.06124868633584206
sim_compute_performance-ego_median0.05570623149042544
sim_compute_performance-ego_min0.04236261740974758
sim_compute_robot_state-ego_max0.10090667860848564
sim_compute_robot_state-ego_mean0.06344614752084325
sim_compute_robot_state-ego_median0.05861590219580609
sim_compute_robot_state-ego_min0.044975726500801415
sim_compute_robot_state-npc0_max0.09774089711053031
sim_compute_robot_state-npc0_mean0.06138261191346384
sim_compute_robot_state-npc0_median0.05329366352247155
sim_compute_robot_state-npc0_min0.043751612953517746
sim_compute_robot_state-npc1_max0.08587871279035296
sim_compute_robot_state-npc1_mean0.05771070956937028
sim_compute_robot_state-npc1_median0.05133955375007961
sim_compute_robot_state-npc1_min0.043827419695646866
sim_compute_robot_state-npc2_max0.08715782846723284
sim_compute_robot_state-npc2_mean0.05864788445626727
sim_compute_robot_state-npc2_median0.050997993220453675
sim_compute_robot_state-npc2_min0.04442921928737475
sim_compute_robot_state-npc3_max0.08028672422681536
sim_compute_robot_state-npc3_mean0.05656362992882976
sim_compute_robot_state-npc3_median0.04922817064368207
sim_compute_robot_state-npc3_min0.044526919074680496
sim_compute_sim_state_max0.05113514832087925
sim_compute_sim_state_mean0.034184152504918984
sim_compute_sim_state_median0.03027783269467561
sim_compute_sim_state_min0.025520925936491592
sim_physics_max0.05649459362030029
sim_physics_mean0.03271559174510016
sim_physics_median0.026178857554560123
sim_physics_min0.021876615026722782
sim_render-ego_max0.10453613315309795
sim_render-ego_mean0.06234364280049104
sim_render-ego_median0.05326005686884341
sim_render-ego_min0.04257746364759362
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.2100000000000004
survival_time_min1.1500000000000004
No reset possible