Duckietown Challenges Home Challenges Submissions

Evaluator 2009

ID2009
evaluatorreg11-4b6cf928702f-1
ownerI don't have one 😀
machinearchimede
processreg11-4b6cf928702f-1
versiond-c:6.1.8;d-c-r:6.0.33
first heard
last heard
statusinactive
# evaluating
# success1 34875
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
348759392Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccess Note that this job is not up to date; the challenge has been changed. reg11-4b6cf928702f-10:33:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.520015472430314
survival_time_median14.950000000000076
deviation-center-line_median0.2571766652089321
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.06983692248662313
agent_compute-ego_mean0.04032933990160624
agent_compute-ego_median0.02986687978108724
agent_compute-ego_min0.029360759258270263
complete-iteration_max0.44072084108988446
complete-iteration_mean0.3629593763351441
complete-iteration_median0.35042354027430217
complete-iteration_min0.3287467877070109
deviation-center-line_max0.7239779843526386
deviation-center-line_mean0.3342852404317624
deviation-center-line_min0.19589564171652596
deviation-heading_max2.687547512129499
deviation-heading_mean1.572644838559821
deviation-heading_median1.319556204743185
deviation-heading_min0.8615621936637005
driven_any_max1.5315739664924746
driven_any_mean1.5305197578572112
driven_any_median1.5315698604306158
driven_any_min1.5210928158735464
driven_lanedir_consec_max1.526560609977225
driven_lanedir_consec_mean1.4653522077546266
driven_lanedir_consec_min1.2539600977438623
driven_lanedir_max1.526560609977225
driven_lanedir_mean1.4653522077546266
driven_lanedir_median1.520015472430314
driven_lanedir_min1.2539600977438623
get_state_dump_max0.017309293746948243
get_state_dump_mean0.016567638397216793
get_state_dump_median0.016458970308303834
get_state_dump_min0.016198687553405762
get_ui_image_max0.09144659678141276
get_ui_image_mean0.07646961085001627
get_ui_image_median0.07489866574605306
get_ui_image_min0.0701648195584615
in-drivable-lane_max2.250000000000032
in-drivable-lane_mean0.420000000000006
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.5210928158735464, "get_ui_image": 0.07619476397832235, "step_physics": 0.15986406882603962, "survival_time": 14.950000000000076, "driven_lanedir": 1.2539600977438623, "get_state_dump": 0.016837178071339925, "sim_render-ego": 0.009066785176595052, "in-drivable-lane": 2.250000000000032, "agent_compute-ego": 0.029369421799977626, "deviation-heading": 1.6780933727191647, "complete-iteration": 0.3474725921948751, "set_robot_commands": 0.00636977752049764, "deviation-center-line": 0.2746494312882254, "driven_lanedir_consec": 1.2539600977438623, "sim_compute_sim_state": 0.022374440828959147, "sim_compute_performance-ego": 0.006167934735616048, "sim_compute_robot_state-ego": 0.010666671593983969, "sim_compute_robot_state-parked0": 0.010369247595469156}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.5315700673531556, "get_ui_image": 0.07391098181406656, "step_physics": 0.15738311449686687, "survival_time": 14.950000000000076, "driven_lanedir": 1.2885335800537678, "get_state_dump": 0.01636251449584961, "sim_render-ego": 0.008743894894917807, "in-drivable-lane": 1.9500000000000275, "agent_compute-ego": 0.0299157977104187, "deviation-heading": 2.233687093569116, "complete-iteration": 0.3419028663635254, "set_robot_commands": 0.0065567668279012045, "deviation-center-line": 0.3364433798275855, "driven_lanedir_consec": 1.2885335800537678, "sim_compute_sim_state": 0.022200198968251542, "sim_compute_performance-ego": 0.006253511905670166, "sim_compute_robot_state-ego": 0.010556326707204184, "sim_compute_robot_state-parked0": 0.009834163188934326}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.5315734881548944, "get_ui_image": 0.0719955563545227, "step_physics": 0.1486408805847168, "survival_time": 14.950000000000076, "driven_lanedir": 1.526560609977225, "get_state_dump": 0.01654428005218506, "sim_render-ego": 0.009180262088775634, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029360759258270263, "deviation-heading": 0.8615621936637005, "complete-iteration": 0.3287467877070109, "set_robot_commands": 0.00657577912012736, "deviation-center-line": 0.2107130607910025, "driven_lanedir_consec": 1.526560609977225, "sim_compute_sim_state": 0.019640335241953532, "sim_compute_performance-ego": 0.0060988744099934895, "sim_compute_robot_state-ego": 0.01068880558013916, "sim_compute_robot_state-parked0": 0.0098233167330424}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.5315696535080765, "get_ui_image": 0.07588634967803955, "step_physics": 0.15934977134068806, "survival_time": 14.950000000000076, "driven_lanedir": 1.5240000389637338, "get_state_dump": 0.016958791414896646, "sim_render-ego": 0.009682550430297853, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029540340900421146, "deviation-heading": 1.2421399533504824, "complete-iteration": 0.34644685983657836, "set_robot_commands": 0.006634774208068847, "deviation-center-line": 0.21067888719740743, "driven_lanedir_consec": 1.5240000389637338, "sim_compute_sim_state": 0.020293890635172528, "sim_compute_performance-ego": 0.00641064723332723, "sim_compute_robot_state-ego": 0.010774681568145752, "sim_compute_robot_state-parked0": 0.010727062225341796}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.5315536899035107, "get_ui_image": 0.07286312818527221, "step_physics": 0.1682025210062663, "survival_time": 14.950000000000076, "driven_lanedir": 1.4873506692849003, "get_state_dump": 0.016419315338134767, "sim_render-ego": 0.00940121332804362, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029817961851755777, "deviation-heading": 2.6809286076269805, "complete-iteration": 0.3465091284116109, "set_robot_commands": 0.006442452271779378, "deviation-center-line": 0.7239779843526386, "driven_lanedir_consec": 1.4873506692849003, "sim_compute_sim_state": 0.015955464045206705, "sim_compute_performance-ego": 0.006155619621276856, "sim_compute_robot_state-ego": 0.01037930965423584, "sim_compute_robot_state-parked0": 0.010683175722757976}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.5315545562686128, "get_ui_image": 0.07351870616277059, "step_physics": 0.17388185898462932, "survival_time": 14.950000000000076, "driven_lanedir": 1.480382635844156, "get_state_dump": 0.0164986252784729, "sim_render-ego": 0.009362781047821045, "in-drivable-lane": 0.0, "agent_compute-ego": 0.031045137246449788, "deviation-heading": 2.687547512129499, "complete-iteration": 0.35337448835372925, "set_robot_commands": 0.0064635324478149415, "deviation-center-line": 0.6621073550267881, "driven_lanedir_consec": 1.480382635844156, "sim_compute_sim_state": 0.015383690198262532, "sim_compute_performance-ego": 0.006184227466583252, "sim_compute_robot_state-ego": 0.010523808797200522, "sim_compute_robot_state-parked0": 0.010319045384724937}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.5315739664924746, "get_ui_image": 0.07863321622212728, "step_physics": 0.17461079597473145, "survival_time": 14.950000000000076, "driven_lanedir": 1.5265452026029962, "get_state_dump": 0.016288660367329916, "sim_render-ego": 0.00884872277577718, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029678002993265788, "deviation-heading": 0.9700682588383364, "complete-iteration": 0.36144654512405394, "set_robot_commands": 0.006688356399536133, "deviation-center-line": 0.25527089471182396, "driven_lanedir_consec": 1.5265452026029962, "sim_compute_sim_state": 0.019863381385803226, "sim_compute_performance-ego": 0.006188316345214844, "sim_compute_robot_state-ego": 0.010226994355519612, "sim_compute_robot_state-parked0": 0.010220761299133302}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.5315652928213008, "get_ui_image": 0.0701648195584615, "step_physics": 0.16632574478785198, "survival_time": 14.950000000000076, "driven_lanedir": 1.5160309058968942, "get_state_dump": 0.016259037653605143, "sim_render-ego": 0.008498247464497883, "in-drivable-lane": 0.0, "agent_compute-ego": 0.05913334210713705, "deviation-heading": 1.3969724561358878, "complete-iteration": 0.3737522673606872, "set_robot_commands": 0.007714617252349854, "deviation-center-line": 0.25908243570604034, "driven_lanedir_consec": 1.5160309058968942, "sim_compute_sim_state": 0.019168252150217693, "sim_compute_performance-ego": 0.006099915504455567, "sim_compute_robot_state-ego": 0.010251967906951903, "sim_compute_robot_state-parked0": 0.009944584369659424}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.5315716135333608, "get_ui_image": 0.08008198976516724, "step_physics": 0.1655827744801839, "survival_time": 14.950000000000076, "driven_lanedir": 1.524661922679796, "get_state_dump": 0.016198687553405762, "sim_render-ego": 0.00907990058263143, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06559571266174316, "deviation-heading": 0.9784039237222618, "complete-iteration": 0.3892213869094849, "set_robot_commands": 0.006359873612721761, "deviation-center-line": 0.21403333369958577, "driven_lanedir_consec": 1.524661922679796, "sim_compute_sim_state": 0.019625058174133302, "sim_compute_performance-ego": 0.0061108533541361495, "sim_compute_robot_state-ego": 0.010686782995859782, "sim_compute_robot_state-parked0": 0.009710212548573812}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.5315724346631807, "get_ui_image": 0.09144659678141276, "step_physics": 0.1959836045900981, "survival_time": 14.950000000000076, "driven_lanedir": 1.5254964144989371, "get_state_dump": 0.017309293746948243, "sim_render-ego": 0.0102528715133667, "in-drivable-lane": 0.0, "agent_compute-ego": 0.06983692248662313, "deviation-heading": 0.9970450138427828, "complete-iteration": 0.44072084108988446, "set_robot_commands": 0.006343682607014974, "deviation-center-line": 0.19589564171652596, "driven_lanedir_consec": 1.5254964144989371, "sim_compute_sim_state": 0.020829020341237382, "sim_compute_performance-ego": 0.0071243031819661455, "sim_compute_robot_state-ego": 0.010748090744018555, "sim_compute_robot_state-parked0": 0.010660256544748942}}
set_robot_commands_max0.007714617252349854
set_robot_commands_mean0.006614961226781209
set_robot_commands_median0.0065101496378580734
set_robot_commands_min0.006343682607014974
sim_compute_performance-ego_max0.0071243031819661455
sim_compute_performance-ego_mean0.006279420375823974
sim_compute_performance-ego_median0.006176081101099649
sim_compute_performance-ego_min0.0060988744099934895
sim_compute_robot_state-ego_max0.010774681568145752
sim_compute_robot_state-ego_mean0.010550343990325927
sim_compute_robot_state-ego_median0.010611499150594075
sim_compute_robot_state-ego_min0.010226994355519612
sim_compute_robot_state-parked0_max0.010727062225341796
sim_compute_robot_state-parked0_mean0.010229182561238606
sim_compute_robot_state-parked0_median0.010269903341929116
sim_compute_robot_state-parked0_min0.009710212548573812
sim_compute_sim_state_max0.022374440828959147
sim_compute_sim_state_mean0.01953337319691976
sim_compute_sim_state_median0.01975185831387838
sim_compute_sim_state_min0.015383690198262532
sim_render-ego_max0.0102528715133667
sim_render-ego_mean0.00921172293027242
sim_render-ego_median0.009130081335703533
sim_render-ego_min0.008498247464497883
simulation-passed1
step_physics_max0.1959836045900981
step_physics_mean0.16698251350720722
step_physics_median0.16595425963401794
step_physics_min0.1486408805847168
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible