Duckietown Challenges Home Challenges Submissions

Evaluator 638

ID638
evaluatoridsc-rudolf-5891
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-5891
versiond-c:4.0.14;d-c-r:4.0.18;d-s:4.0.15
first heard
last heard
statusinactive
# evaluating
# success1 17599
# timeout
# failed
# error1 17613
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
176132410jiang pengBaseline solution using reinforcement learningaido2-LFV-sim-testingstep1-simulationerrornoidsc-rudolf-58910:20:56
Timeout: Waited 120 [...]
Timeout:

Waited 1203 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
175992425Andrea Censi 🇨🇭random_agentaido2-LFVI-sim-validationstep1-simulationsuccessnoidsc-rudolf-58910:05:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6896127428821732
survival_time_median1.1500000000000004
deviation-center-line_median0.05610305022565209
in-drivable-lane_median0.20000000000000007


other stats
agent_compute-ego_max0.13344968358675638
agent_compute-ego_mean0.1266096786559245
agent_compute-ego_median0.1251009021486555
agent_compute-ego_min0.11703393770300824
deviation-center-line_max0.07504669169058735
deviation-center-line_mean0.05629372528587068
deviation-center-line_min0.031337769455374115
deviation-heading_max0.4695314592890065
deviation-heading_mean0.28295632700130013
deviation-heading_median0.28969351082790473
deviation-heading_min0.13822734158708538
driven_any_max1.1972535692377095
driven_any_mean1.069550703128448
driven_any_median1.0381750331691957
driven_any_min1.0257183998178268
driven_lanedir_consec_max0.8123144800841251
driven_lanedir_consec_mean0.6312226729648216
driven_lanedir_consec_min0.4373052105850964
driven_lanedir_max0.9325407987545682
driven_lanedir_mean0.7224147694584564
driven_lanedir_median0.8123144800841251
driven_lanedir_min0.48318684247252186
in-drivable-lane_max0.6000000000000004
in-drivable-lane_mean0.3000000000000002
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 1.1972535692377095, "sim_physics": 0.02675330638885498, "survival_time": 1.4000000000000006, "driven_lanedir": 0.5600308085729072, "sim_render-ego": 0.05708449227469308, "in-drivable-lane": 0.5500000000000003, "agent_compute-ego": 0.1251009021486555, "deviation-heading": 0.4695314592890065, "set_robot_commands": 0.07622766494750977, "deviation-center-line": 0.05610305022565209, "driven_lanedir_consec": 0.4373052105850964, "sim_compute_sim_state": 0.03252278906958444, "sim_compute_performance-ego": 0.06028589180537632, "sim_compute_robot_state-ego": 0.06196064608437674, "sim_compute_robot_state-npc0": 0.06429088115692139, "sim_compute_robot_state-npc1": 0.058230110577174594, "sim_compute_robot_state-npc2": 0.05733808449336461, "sim_compute_robot_state-npc3": 0.05979618004390171}, "udem1-1-0": {"driven_any": 1.036014073841825, "sim_physics": 0.023858437935511272, "survival_time": 1.2000000000000004, "driven_lanedir": 0.48318684247252186, "sim_render-ego": 0.06367845336596172, "in-drivable-lane": 0.6000000000000004, "agent_compute-ego": 0.13344968358675638, "deviation-heading": 0.13822734158708538, "set_robot_commands": 0.07824938495953877, "deviation-center-line": 0.031337769455374115, "driven_lanedir_consec": 0.48318684247252186, "sim_compute_sim_state": 0.03245830535888672, "sim_compute_performance-ego": 0.06427447001139323, "sim_compute_robot_state-ego": 0.061655143896738686, "sim_compute_robot_state-npc0": 0.07154061396916707, "sim_compute_robot_state-npc1": 0.0630071759223938, "sim_compute_robot_state-npc2": 0.05921357870101929, "sim_compute_robot_state-npc3": 0.06117594242095947}, "udem1-2-0": {"driven_any": 1.0257183998178268, "sim_physics": 0.024458740068518597, "survival_time": 1.1500000000000004, "driven_lanedir": 0.9325407987545682, "sim_render-ego": 0.06074052271635636, "in-drivable-lane": 0, "agent_compute-ego": 0.11703393770300824, "deviation-heading": 0.28969351082790473, "set_robot_commands": 0.07355690002441406, "deviation-center-line": 0.07504669169058735, "driven_lanedir_consec": 0.6896127428821732, "sim_compute_sim_state": 0.031025119449781337, "sim_compute_performance-ego": 0.05710780102273692, "sim_compute_robot_state-ego": 0.0630824669547703, "sim_compute_robot_state-npc0": 0.06153951520505159, "sim_compute_robot_state-npc1": 0.0587184014527694, "sim_compute_robot_state-npc2": 0.05519061503203019, "sim_compute_robot_state-npc3": 0.055344581604003906}, "udem1-3-0": {"driven_any": 1.0505924395756825, "sim_physics": 0.0249621349832286, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8240009174081598, "sim_render-ego": 0.06313189216282057, "in-drivable-lane": 0.20000000000000007, "agent_compute-ego": 0.1248580269191576, "deviation-heading": 0.19133902257839172, "set_robot_commands": 0.07463469712630562, "deviation-center-line": 0.04393905052607498, "driven_lanedir_consec": 0.7336940888001914, "sim_compute_sim_state": 0.03413819230121115, "sim_compute_performance-ego": 0.05992675864178201, "sim_compute_robot_state-ego": 0.05971136300460152, "sim_compute_robot_state-npc0": 0.06576947543932044, "sim_compute_robot_state-npc1": 0.06025237622468368, "sim_compute_robot_state-npc2": 0.06285034055295198, "sim_compute_robot_state-npc3": 0.06296464671259341}, "udem1-4-0": {"driven_any": 1.0381750331691957, "sim_physics": 0.025530441947605297, "survival_time": 1.1500000000000004, "driven_lanedir": 0.8123144800841251, "sim_render-ego": 0.0594049536663553, "in-drivable-lane": 0.15000000000000013, "agent_compute-ego": 0.13260584292204483, "deviation-heading": 0.32599030072411245, "set_robot_commands": 0.08253164913343347, "deviation-center-line": 0.07504206453166483, "driven_lanedir_consec": 0.8123144800841251, "sim_compute_sim_state": 0.03473334727079972, "sim_compute_performance-ego": 0.05866654022880222, "sim_compute_robot_state-ego": 0.061521727105845574, "sim_compute_robot_state-npc0": 0.06485547190127165, "sim_compute_robot_state-npc1": 0.06341646028601605, "sim_compute_robot_state-npc2": 0.06318131737087083, "sim_compute_robot_state-npc3": 0.06227615605229917}}
set_robot_commands_max0.08253164913343347
set_robot_commands_mean0.07704005923824034
set_robot_commands_median0.07622766494750977
set_robot_commands_min0.07355690002441406
sim_compute_performance-ego_max0.06427447001139323
sim_compute_performance-ego_mean0.06005229234201814
sim_compute_performance-ego_median0.05992675864178201
sim_compute_performance-ego_min0.05710780102273692
sim_compute_robot_state-ego_max0.0630824669547703
sim_compute_robot_state-ego_mean0.06158626940926656
sim_compute_robot_state-ego_median0.061655143896738686
sim_compute_robot_state-ego_min0.05971136300460152
sim_compute_robot_state-npc0_max0.07154061396916707
sim_compute_robot_state-npc0_mean0.06559919153434643
sim_compute_robot_state-npc0_median0.06485547190127165
sim_compute_robot_state-npc0_min0.06153951520505159
sim_compute_robot_state-npc1_max0.06341646028601605
sim_compute_robot_state-npc1_mean0.06072490489260751
sim_compute_robot_state-npc1_median0.06025237622468368
sim_compute_robot_state-npc1_min0.058230110577174594
sim_compute_robot_state-npc2_max0.06318131737087083
sim_compute_robot_state-npc2_mean0.05955478723004738
sim_compute_robot_state-npc2_median0.05921357870101929
sim_compute_robot_state-npc2_min0.05519061503203019
sim_compute_robot_state-npc3_max0.06296464671259341
sim_compute_robot_state-npc3_mean0.06031150136675154
sim_compute_robot_state-npc3_median0.06117594242095947
sim_compute_robot_state-npc3_min0.055344581604003906
sim_compute_sim_state_max0.03473334727079972
sim_compute_sim_state_mean0.032975550690052674
sim_compute_sim_state_median0.03252278906958444
sim_compute_sim_state_min0.031025119449781337
sim_physics_max0.02675330638885498
sim_physics_mean0.02511261226474375
sim_physics_median0.0249621349832286
sim_physics_min0.023858437935511272
sim_render-ego_max0.06367845336596172
sim_render-ego_mean0.0608080628372374
sim_render-ego_median0.06074052271635636
sim_render-ego_min0.05708449227469308
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.2100000000000004
survival_time_min1.1500000000000004
No reset possible