Duckietown Challenges Home Challenges Submissions

Evaluator 532

ID532
evaluatordorothy-3134
ownerAndrea Censi 🇨🇭
machinedorothy
processdorothy-3134
versiond-c:4.0.7;d-c-r:4.0.9;d-s:4.0.10
first heard
last heard
statusinactive
# evaluating
# success2 17111
# timeout
# failed
# error
# aborted1 17114
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
171142317Julian ZillyBaseline solution using imitation learning from logsaido2_LFV_r1-v4step1-simulationabortednodorothy-31340:11:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.18482147694429377
survival_time_median1.3500000000000003
deviation-center-line_median0.0796215982274241
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16706280355100278
agent_compute-ego_mean0.15560732361840482
agent_compute-ego_median0.15651480356852213
agent_compute-ego_min0.14271969265407983
deviation-center-line_max0.08127908680916048
deviation-center-line_mean0.07980141288807245
deviation-center-line_min0.07849920247646419
deviation-heading_max0.7560020895565267
deviation-heading_mean0.7119795855353866
deviation-heading_median0.7041554170496334
deviation-heading_min0.6687909294577209
driven_any_max0.23591577156071009
driven_any_mean0.22870911445885897
driven_any_median0.22767271249920948
driven_any_min0.2212341045831002
driven_lanedir_consec_max0.19491247894377617
driven_lanedir_consec_mean0.18429832392459627
driven_lanedir_consec_min0.17277119420330234
driven_lanedir_max0.19491247894377617
driven_lanedir_mean0.18429832392459627
driven_lanedir_median0.18482147694429377
driven_lanedir_min0.17277119420330234
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.23437296062082905, "sim_physics": 0.003408973033611591, "survival_time": 1.3000000000000005, "driven_lanedir": 0.19153601376673013, "sim_render-ego": 0.043776823924137995, "in-drivable-lane": 0, "agent_compute-ego": 0.15180959151341364, "deviation-heading": 0.6687909294577209, "set_robot_commands": 0.06846432502453144, "deviation-center-line": 0.08030607046389075, "driven_lanedir_consec": 0.19153601376673013, "sim_compute_sim_state": 0.028615144582895137, "sim_compute_performance-ego": 0.04333861057574932, "sim_compute_robot_state-ego": 0.5806462673040537, "sim_compute_robot_state-npc0": 0.04916016872112568, "sim_compute_robot_state-npc1": 0.04425483483534593, "sim_compute_robot_state-npc2": 0.04578524369459886, "sim_compute_robot_state-npc3": 0.047156994159405045}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.23591577156071009, "sim_physics": 0.0031480874334062848, "survival_time": 1.4000000000000006, "driven_lanedir": 0.19491247894377617, "sim_render-ego": 0.04588382584708078, "in-drivable-lane": 0, "agent_compute-ego": 0.15992972680500575, "deviation-heading": 0.6876274557674634, "set_robot_commands": 0.07696305853979928, "deviation-center-line": 0.07849920247646419, "driven_lanedir_consec": 0.19491247894377617, "sim_compute_sim_state": 0.029581427574157715, "sim_compute_performance-ego": 0.048365609986441474, "sim_compute_robot_state-ego": 0.07513327257973808, "sim_compute_robot_state-npc0": 0.0500027026448931, "sim_compute_robot_state-npc1": 0.05029955080577305, "sim_compute_robot_state-npc2": 0.04904105833598545, "sim_compute_robot_state-npc3": 0.048904086862291606}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.22767271249920948, "sim_physics": 0.002580669191148546, "survival_time": 1.3500000000000003, "driven_lanedir": 0.18482147694429377, "sim_render-ego": 0.04247495863172743, "in-drivable-lane": 0, "agent_compute-ego": 0.15651480356852213, "deviation-heading": 0.7041554170496334, "set_robot_commands": 0.06557274747777868, "deviation-center-line": 0.07930110646342275, "driven_lanedir_consec": 0.18482147694429377, "sim_compute_sim_state": 0.02574024377045808, "sim_compute_performance-ego": 0.04405534708941424, "sim_compute_robot_state-ego": 0.06540315239517777, "sim_compute_robot_state-npc0": 0.045316590203179255, "sim_compute_robot_state-npc1": 0.04488615636472349, "sim_compute_robot_state-npc2": 0.04646355134469492, "sim_compute_robot_state-npc3": 0.04577188138608579}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2212341045831002, "sim_physics": 0.002451746552078812, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17277119420330234, "sim_render-ego": 0.04578067638255932, "in-drivable-lane": 0, "agent_compute-ego": 0.14271969265407983, "deviation-heading": 0.7560020895565267, "set_robot_commands": 0.06670519157692238, "deviation-center-line": 0.0796215982274241, "driven_lanedir_consec": 0.17277119420330234, "sim_compute_sim_state": 0.02426601339269567, "sim_compute_performance-ego": 0.04066569716842086, "sim_compute_robot_state-ego": 0.06585536179719148, "sim_compute_robot_state-npc0": 0.04586331049601237, "sim_compute_robot_state-npc1": 0.04596991892214174, "sim_compute_robot_state-npc2": 0.0447084108988444, "sim_compute_robot_state-npc3": 0.04345544179280599}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.22435002303044604, "sim_physics": 0.0026004579332139757, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17745045576487894, "sim_render-ego": 0.05140530621563947, "in-drivable-lane": 0, "agent_compute-ego": 0.16706280355100278, "deviation-heading": 0.7433220358455889, "set_robot_commands": 0.06440073472482187, "deviation-center-line": 0.08127908680916048, "driven_lanedir_consec": 0.17745045576487894, "sim_compute_sim_state": 0.024916101385045936, "sim_compute_performance-ego": 0.04968300572148076, "sim_compute_robot_state-ego": 0.07022032031306515, "sim_compute_robot_state-npc0": 0.04918347464667426, "sim_compute_robot_state-npc1": 0.04873308429011592, "sim_compute_robot_state-npc2": 0.046278450224134654, "sim_compute_robot_state-npc3": 0.04616794762787996}}
set_robot_commands_max0.07696305853979928
set_robot_commands_mean0.06842121146877074
set_robot_commands_median0.06670519157692238
set_robot_commands_min0.06440073472482187
sim_compute_performance-ego_max0.04968300572148076
sim_compute_performance-ego_mean0.04522165410830133
sim_compute_performance-ego_median0.04405534708941424
sim_compute_performance-ego_min0.04066569716842086
sim_compute_robot_state-ego_max0.5806462673040537
sim_compute_robot_state-ego_mean0.17145167487784524
sim_compute_robot_state-ego_median0.07022032031306515
sim_compute_robot_state-ego_min0.06540315239517777
sim_compute_robot_state-npc0_max0.0500027026448931
sim_compute_robot_state-npc0_mean0.04790524934237693
sim_compute_robot_state-npc0_median0.04916016872112568
sim_compute_robot_state-npc0_min0.045316590203179255
sim_compute_robot_state-npc1_max0.05029955080577305
sim_compute_robot_state-npc1_mean0.04682870904362003
sim_compute_robot_state-npc1_median0.04596991892214174
sim_compute_robot_state-npc1_min0.04425483483534593
sim_compute_robot_state-npc2_max0.04904105833598545
sim_compute_robot_state-npc2_mean0.046455342899651655
sim_compute_robot_state-npc2_median0.046278450224134654
sim_compute_robot_state-npc2_min0.0447084108988444
sim_compute_robot_state-npc3_max0.048904086862291606
sim_compute_robot_state-npc3_mean0.04629127036569368
sim_compute_robot_state-npc3_median0.04616794762787996
sim_compute_robot_state-npc3_min0.04345544179280599
sim_compute_sim_state_max0.029581427574157715
sim_compute_sim_state_mean0.026623786141050508
sim_compute_sim_state_median0.02574024377045808
sim_compute_sim_state_min0.02426601339269567
sim_physics_max0.003408973033611591
sim_physics_mean0.002837986828691842
sim_physics_median0.0026004579332139757
sim_physics_min0.002451746552078812
sim_render-ego_max0.05140530621563947
sim_render-ego_mean0.045864318200228994
sim_render-ego_median0.04578067638255932
sim_render-ego_min0.04247495863172743
simulation-passed1
survival_time_max1.4000000000000006
survival_time_mean1.3500000000000003
survival_time_min1.3000000000000005
No reset possible
171122314Andrea Censi 🇨🇭Minimal agentaido2_LF_r_prihw-evaluationsuccessyesdorothy-31340:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median12
survival_time_median12


other stats
01_start
details{"1_01attemptDate": {"name": "1_01attemptDate", "output": "2019-04-08", "readable_string": "Attempt date"}, "1_03autolabName": {"name": "1_03autolabName", "output": "ETHZ", "readable_string": "Autolab"}, "1_04operatorName": {"name": "1_04operatorName", "output": "", "readable_string": "Operator's name"}, "1_02attemptNumber": {"name": "1_02attemptNumber", "output": "1", "readable_string": "Attempt number"}, "1_05operatorEmail": {"name": "1_05operatorEmail", "output": "", "readable_string": "Operator's email"}}
No reset possible
171112315Andrea Censi 🇨🇭Minimal agentaido2_LF_r_pubhw-evaluationsuccessyesdorothy-31340:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median12
survival_time_median12


other stats
01_start
details{"1_01attemptDate": {"name": "1_01attemptDate", "output": "2019-04-08", "readable_string": "Attempt date"}, "1_03autolabName": {"name": "1_03autolabName", "output": "ETHZ", "readable_string": "Autolab"}, "1_04operatorName": {"name": "1_04operatorName", "output": "", "readable_string": "Operator's name"}, "1_02attemptNumber": {"name": "1_02attemptNumber", "output": "1", "readable_string": "Attempt number"}, "1_05operatorEmail": {"name": "1_05operatorEmail", "output": "", "readable_string": "Operator's email"}}
No reset possible