Duckietown Challenges Home Challenges Submissions

Evaluator 2003

ID2003
evaluatorreg08-057e23823e07-1
ownerI don't have one 😀
machinearchimede
processreg08-057e23823e07-1
versiond-c:6.1.8;d-c-r:6.0.33
first heard
last heard
statusinactive
# evaluating
# success1 34874
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
348749391Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccess Note that this job is not up to date; the challenge has been changed. reg08-057e23823e07-10:32:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5203936887826366
survival_time_median14.950000000000076
deviation-center-line_median0.25639113724036416
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.03217448155085246
agent_compute-ego_mean0.02990490627693762
agent_compute-ego_median0.029623640581618906
agent_compute-ego_min0.02831174691518148
complete-iteration_max0.4070265698432922
complete-iteration_mean0.3574398719604065
complete-iteration_median0.35274032347211226
complete-iteration_min0.33955270210901894
deviation-center-line_max0.8297911825682645
deviation-center-line_mean0.3219854189053211
deviation-center-line_min0.17669556562842115
deviation-heading_max2.2970547815097886
deviation-heading_mean1.4864769895162762
deviation-heading_median1.368840568773975
deviation-heading_min0.8179144998414309
driven_any_max1.5315749055707275
driven_any_mean1.4922601650523066
driven_any_median1.5315674420395091
driven_any_min1.3166829200348162
driven_lanedir_consec_max1.5273348012381922
driven_lanedir_consec_mean1.4507559421965364
driven_lanedir_consec_min1.173260716526476
driven_lanedir_max1.5273348012381922
driven_lanedir_mean1.4507559421965364
driven_lanedir_median1.5203936887826366
driven_lanedir_min1.173260716526476
get_state_dump_max0.01798699378967285
get_state_dump_mean0.016781705420665777
get_state_dump_median0.01677733475847762
get_state_dump_min0.016197020212809245
get_ui_image_max0.0902534826596578
get_ui_image_mean0.0760845131067519
get_ui_image_median0.07494086168533148
get_ui_image_min0.07091947873433431
in-drivable-lane_max1.200000000000017
in-drivable-lane_mean0.2050000000000029
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.35337737110124, "get_ui_image": 0.07599008753058616, "step_physics": 0.16209547260727328, "survival_time": 13.350000000000056, "driven_lanedir": 1.1911763887759652, "get_state_dump": 0.016963627454493375, "sim_render-ego": 0.009128977743427405, "in-drivable-lane": 1.200000000000017, "agent_compute-ego": 0.029835437567492996, "deviation-heading": 1.715662811152524, "complete-iteration": 0.3506626636347967, "set_robot_commands": 0.00669110223148646, "deviation-center-line": 0.28352102285232034, "driven_lanedir_consec": 1.1911763887759652, "sim_compute_sim_state": 0.02246680866912956, "sim_compute_performance-ego": 0.006676277417815134, "sim_compute_robot_state-ego": 0.0103704295354836, "sim_compute_robot_state-parked0": 0.010261923186341474}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.3166829200348162, "get_ui_image": 0.07580723965814871, "step_physics": 0.16151964664459229, "survival_time": 12.900000000000048, "driven_lanedir": 1.173260716526476, "get_state_dump": 0.016736180283302485, "sim_render-ego": 0.009447736333506975, "in-drivable-lane": 0.8500000000000121, "agent_compute-ego": 0.029800014902454937, "deviation-heading": 2.076832295652905, "complete-iteration": 0.3491096856982209, "set_robot_commands": 0.006702087646306947, "deviation-center-line": 0.2695869963034125, "driven_lanedir_consec": 1.173260716526476, "sim_compute_sim_state": 0.02180452217427335, "sim_compute_performance-ego": 0.006115613057631855, "sim_compute_robot_state-ego": 0.010744123495826426, "sim_compute_robot_state-parked0": 0.010231286056281983}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 1.5315709110066371, "get_ui_image": 0.07266530513763428, "step_physics": 0.15846453428268434, "survival_time": 14.950000000000076, "driven_lanedir": 1.5253778254812458, "get_state_dump": 0.016371948719024657, "sim_render-ego": 0.008780208428700765, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029280142784118657, "deviation-heading": 1.1251685352835608, "complete-iteration": 0.33955270210901894, "set_robot_commands": 0.006609795093536377, "deviation-center-line": 0.1993380323424361, "driven_lanedir_consec": 1.5253778254812458, "sim_compute_sim_state": 0.020690293312072755, "sim_compute_performance-ego": 0.005799603462219238, "sim_compute_robot_state-ego": 0.010644835631052651, "sim_compute_robot_state-parked0": 0.010059348742167157}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 1.5315696115831314, "get_ui_image": 0.07732185204823812, "step_physics": 0.16726550817489624, "survival_time": 14.950000000000076, "driven_lanedir": 1.523133805670527, "get_state_dump": 0.016818489233652752, "sim_render-ego": 0.00953875462214152, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029135209719340006, "deviation-heading": 1.1892609207193985, "complete-iteration": 0.3548179833094279, "set_robot_commands": 0.006248181660970052, "deviation-center-line": 0.24319527817731584, "driven_lanedir_consec": 1.523133805670527, "sim_compute_sim_state": 0.021536064942677815, "sim_compute_performance-ego": 0.006024305025736491, "sim_compute_robot_state-ego": 0.010511210759480794, "sim_compute_robot_state-parked0": 0.010225491523742676}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 1.53155772328991, "get_ui_image": 0.07407448371251424, "step_physics": 0.1758405876159668, "survival_time": 14.950000000000076, "driven_lanedir": 1.4968225353855962, "get_state_dump": 0.016448708375295003, "sim_render-ego": 0.008862925370534262, "in-drivable-lane": 0.0, "agent_compute-ego": 0.0303937037785848, "deviation-heading": 2.2454685894376794, "complete-iteration": 0.35639869610468544, "set_robot_commands": 0.006532103220621745, "deviation-center-line": 0.8297911825682645, "driven_lanedir_consec": 1.4968225353855962, "sim_compute_sim_state": 0.01656631310780843, "sim_compute_performance-ego": 0.0059214266141255694, "sim_compute_robot_state-ego": 0.010650956630706788, "sim_compute_robot_state-parked0": 0.0109214448928833}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 1.5315546676078375, "get_ui_image": 0.07384785175323487, "step_physics": 0.178416911760966, "survival_time": 14.950000000000076, "driven_lanedir": 1.4995361289968945, "get_state_dump": 0.016471308867136637, "sim_render-ego": 0.009318589369455971, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03138943672180176, "deviation-heading": 2.2970547815097886, "complete-iteration": 0.35961453517278036, "set_robot_commands": 0.006554359594980875, "deviation-center-line": 0.4821384909093422, "driven_lanedir_consec": 1.4995361289968945, "sim_compute_sim_state": 0.01636699358622233, "sim_compute_performance-ego": 0.006218141714731853, "sim_compute_robot_state-ego": 0.010684625307718913, "sim_compute_robot_state-parked0": 0.010153475602467855}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 1.531574848324528, "get_ui_image": 0.07624808311462403, "step_physics": 0.18158681631088255, "survival_time": 14.950000000000076, "driven_lanedir": 1.5273348012381922, "get_state_dump": 0.01686079819997152, "sim_render-ego": 0.008896505037943522, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02944726626078288, "deviation-heading": 0.902310964574372, "complete-iteration": 0.3671641008059184, "set_robot_commands": 0.006735178629557291, "deviation-center-line": 0.2221407281732828, "driven_lanedir_consec": 1.5273348012381922, "sim_compute_sim_state": 0.01975722869237264, "sim_compute_performance-ego": 0.006073660055796306, "sim_compute_robot_state-ego": 0.010768940448760986, "sim_compute_robot_state-parked0": 0.010598626136779784}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 1.5315734195083512, "get_ui_image": 0.07091947873433431, "step_physics": 0.17114569028218587, "survival_time": 14.950000000000076, "driven_lanedir": 1.5262123996869723, "get_state_dump": 0.016961979071299236, "sim_render-ego": 0.008783739407857259, "in-drivable-lane": 0.0, "agent_compute-ego": 0.02831174691518148, "deviation-heading": 0.9466762801625528, "complete-iteration": 0.3492880376180013, "set_robot_commands": 0.006455017725626628, "deviation-center-line": 0.23166962709382685, "driven_lanedir_consec": 1.5262123996869723, "sim_compute_sim_state": 0.01956356287002563, "sim_compute_performance-ego": 0.006112205982208252, "sim_compute_robot_state-ego": 0.010707945028940836, "sim_compute_robot_state-parked0": 0.010130345026652018}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 1.5315749055707275, "get_ui_image": 0.07371726671854655, "step_physics": 0.15868521769841512, "survival_time": 14.950000000000076, "driven_lanedir": 1.5270512483087488, "get_state_dump": 0.016197020212809245, "sim_render-ego": 0.009298982620239258, "in-drivable-lane": 0.0, "agent_compute-ego": 0.029281622568766277, "deviation-heading": 0.8179144998414309, "complete-iteration": 0.34076374530792236, "set_robot_commands": 0.0066363199551900225, "deviation-center-line": 0.17669556562842115, "driven_lanedir_consec": 1.5270512483087488, "sim_compute_sim_state": 0.01983144760131836, "sim_compute_performance-ego": 0.006356945832570394, "sim_compute_robot_state-ego": 0.010420217514038084, "sim_compute_robot_state-parked0": 0.01014903704325358}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 1.5315652724958868, "get_ui_image": 0.0902534826596578, "step_physics": 0.1986306651433309, "survival_time": 14.950000000000076, "driven_lanedir": 1.517653571894746, "get_state_dump": 0.01798699378967285, "sim_render-ego": 0.010100473562876385, "in-drivable-lane": 0.0, "agent_compute-ego": 0.03217448155085246, "deviation-heading": 1.5484202168285517, "complete-iteration": 0.4070265698432922, "set_robot_commands": 0.007060840129852295, "deviation-center-line": 0.2817772650045888, "driven_lanedir_consec": 1.517653571894746, "sim_compute_sim_state": 0.02145095666249593, "sim_compute_performance-ego": 0.006794941425323486, "sim_compute_robot_state-ego": 0.012001651128133138, "sim_compute_robot_state-parked0": 0.01039164384206136}}
set_robot_commands_max0.007060840129852295
set_robot_commands_mean0.006622498588812869
set_robot_commands_median0.0066230575243632
set_robot_commands_min0.006248181660970052
sim_compute_performance-ego_max0.006794941425323486
sim_compute_performance-ego_mean0.0062093120588158565
sim_compute_performance-ego_median0.006113909519920054
sim_compute_performance-ego_min0.005799603462219238
sim_compute_robot_state-ego_max0.012001651128133138
sim_compute_robot_state-ego_mean0.01075049354801422
sim_compute_robot_state-ego_median0.010667790969212849
sim_compute_robot_state-ego_min0.0103704295354836
sim_compute_robot_state-parked0_max0.0109214448928833
sim_compute_robot_state-parked0_mean0.010312262205263118
sim_compute_robot_state-parked0_median0.010228388790012331
sim_compute_robot_state-parked0_min0.010059348742167157
sim_compute_sim_state_max0.02246680866912956
sim_compute_sim_state_mean0.02000341916183968
sim_compute_sim_state_median0.020260870456695557
sim_compute_sim_state_min0.01636699358622233
sim_render-ego_max0.010100473562876385
sim_render-ego_mean0.009215689249668332
sim_render-ego_median0.009213980181833331
sim_render-ego_min0.008780208428700765
simulation-passed1
step_physics_max0.1986306651433309
step_physics_mean0.17136510505211933
step_physics_median0.16920559922854106
step_physics_min0.15846453428268434
survival_time_max14.950000000000076
survival_time_mean14.585000000000074
survival_time_min12.900000000000048
No reset possible