Duckietown Challenges Home Challenges Submissions

Evaluator 2007

ID2007
evaluatorreg12-61915b567a4b-1
ownerI don't have one 😀
machinearchimede
processreg12-61915b567a4b-1
versiond-c:6.1.8;d-c-r:6.0.33
first heard
last heard
statusinactive
# evaluating
# success1 34878
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
348789394Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccess Note that this job is not up to date; the challenge has been changed. reg12-61915b567a4b-10:32:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9607806100734173
survival_time_median14.950000000000076
deviation-center-line_median0.42163963320584774
in-drivable-lane_median5.65000000000008


other stats
agent_compute-ego_max0.0678754711151123
agent_compute-ego_mean0.04203219478628477
agent_compute-ego_median0.031217532952626543
agent_compute-ego_min0.029384186267852785
complete-iteration_max0.4507250841458639
complete-iteration_mean0.3700406942626337
complete-iteration_median0.3660833458190269
complete-iteration_min0.3377162090937297
deviation-center-line_max0.781683205196873
deviation-center-line_mean0.417124800065744
deviation-center-line_min0.21627251846996945
deviation-heading_max2.8230197948568807
deviation-heading_mean1.4555911689284675
deviation-heading_median1.2792917322686832
deviation-heading_min0.9489668494042384
driven_any_max3.600798763887599
driven_any_mean2.832182468449602
driven_any_median2.836618233562281
driven_any_min1.9340913663166817
driven_lanedir_consec_max3.4246774302448992
driven_lanedir_consec_mean2.038846574320124
driven_lanedir_consec_min1.3093071477345444
driven_lanedir_max3.4246774302448992
driven_lanedir_mean2.038846574320124
driven_lanedir_median1.9607806100734173
driven_lanedir_min1.3093071477345444
get_state_dump_max0.01713156779607137
get_state_dump_mean0.01651876814341966
get_state_dump_median0.01649027109146118
get_state_dump_min0.016046470801035564
get_ui_image_max0.09298968156178793
get_ui_image_mean0.07669288760734273
get_ui_image_median0.07536447922388712
get_ui_image_min0.07003470420837403
in-drivable-lane_max8.400000000000093
in-drivable-lane_mean4.930000000000062
in-drivable-lane_min0.30000000000000426
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 2.456755065410012, "get_ui_image": 0.07892401695251465, "step_physics": 0.1705070972442627, "survival_time": 14.950000000000076, "driven_lanedir": 1.3524555938139131, "get_state_dump": 0.01713156779607137, "sim_render-ego": 0.009027113914489746, "in-drivable-lane": 8.400000000000093, "agent_compute-ego": 0.029823831717173257, "deviation-heading": 1.3277758892117075, "complete-iteration": 0.36420520782470706, "set_robot_commands": 0.0065236481030782065, "deviation-center-line": 0.29804985976217585, "driven_lanedir_consec": 1.3524555938139131, "sim_compute_sim_state": 0.02490893761316935, "sim_compute_performance-ego": 0.00607340415318807, "sim_compute_robot_state-ego": 0.010838122367858886, "sim_compute_robot_state-parked0": 0.010230031808217369}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 1.9340913663166817, "get_ui_image": 0.0812754838362984, "step_physics": 0.17484832698514002, "survival_time": 8.04999999999998, "driven_lanedir": 1.3093071477345444, "get_state_dump": 0.016738112668813386, "sim_render-ego": 0.008906053460162619, "in-drivable-lane": 2.4499999999999913, "agent_compute-ego": 0.030789597434286744, "deviation-heading": 0.9489668494042384, "complete-iteration": 0.3707793484563413, "set_robot_commands": 0.006326205982184558, "deviation-center-line": 0.21627251846996945, "driven_lanedir_consec": 1.3093071477345444, "sim_compute_sim_state": 0.02432673466131554, "sim_compute_performance-ego": 0.006199869309893306, "sim_compute_robot_state-ego": 0.01056770656419837, "sim_compute_robot_state-parked0": 0.010615365105386106}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 3.600798763887599, "get_ui_image": 0.07006345907847086, "step_physics": 0.15511233965555826, "survival_time": 14.950000000000076, "driven_lanedir": 3.4246774302448992, "get_state_dump": 0.01650324583053589, "sim_render-ego": 0.009394857883453367, "in-drivable-lane": 0.30000000000000426, "agent_compute-ego": 0.030057396094004315, "deviation-heading": 2.8230197948568807, "complete-iteration": 0.3377162090937297, "set_robot_commands": 0.006465020974477132, "deviation-center-line": 0.781683205196873, "driven_lanedir_consec": 3.4246774302448992, "sim_compute_sim_state": 0.022846593856811523, "sim_compute_performance-ego": 0.006251218318939209, "sim_compute_robot_state-ego": 0.010415008068084717, "sim_compute_robot_state-parked0": 0.010415779749552408}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 2.983938929663324, "get_ui_image": 0.07733796199162801, "step_physics": 0.17149250984191894, "survival_time": 14.950000000000076, "driven_lanedir": 2.0701604658289683, "get_state_dump": 0.01694046417872111, "sim_render-ego": 0.009314423402150471, "in-drivable-lane": 5.050000000000072, "agent_compute-ego": 0.029384186267852785, "deviation-heading": 1.612181254321934, "complete-iteration": 0.3615380144119263, "set_robot_commands": 0.006302597522735595, "deviation-center-line": 0.5648026141895052, "driven_lanedir_consec": 2.0701604658289683, "sim_compute_sim_state": 0.023226197560628256, "sim_compute_performance-ego": 0.006355046431223551, "sim_compute_robot_state-ego": 0.010681730111440024, "sim_compute_robot_state-parked0": 0.01030289093653361}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 2.5678207086694034, "get_ui_image": 0.07521444082260131, "step_physics": 0.169306960105896, "survival_time": 14.950000000000076, "driven_lanedir": 1.646800103908607, "get_state_dump": 0.016768155892690022, "sim_render-ego": 0.00911774476369222, "in-drivable-lane": 6.700000000000095, "agent_compute-ego": 0.031037940979003906, "deviation-heading": 1.9601089763621824, "complete-iteration": 0.3534669431050618, "set_robot_commands": 0.006619767347971598, "deviation-center-line": 0.4392391385199581, "driven_lanedir_consec": 1.646800103908607, "sim_compute_sim_state": 0.018923099835713705, "sim_compute_performance-ego": 0.005895984172821045, "sim_compute_robot_state-ego": 0.010500422318776449, "sim_compute_robot_state-parked0": 0.00989437182744344}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 2.726368937253162, "get_ui_image": 0.07394130150477092, "step_physics": 0.17314901192982993, "survival_time": 14.950000000000076, "driven_lanedir": 1.6124784368451133, "get_state_dump": 0.016137301921844482, "sim_render-ego": 0.009353150526682535, "in-drivable-lane": 7.200000000000097, "agent_compute-ego": 0.03139712492624919, "deviation-heading": 1.0126038086598472, "complete-iteration": 0.35587030013402304, "set_robot_commands": 0.006254501342773437, "deviation-center-line": 0.22370315026374088, "driven_lanedir_consec": 1.6124784368451133, "sim_compute_sim_state": 0.01887791951497396, "sim_compute_performance-ego": 0.006303539276123047, "sim_compute_robot_state-ego": 0.010318930943806964, "sim_compute_robot_state-parked0": 0.009947190284729004}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.9468675298714, "get_ui_image": 0.07551451762517293, "step_physics": 0.16219688177108765, "survival_time": 14.950000000000076, "driven_lanedir": 1.993760245559976, "get_state_dump": 0.016300665537516277, "sim_render-ego": 0.009075929323832194, "in-drivable-lane": 6.250000000000089, "agent_compute-ego": 0.049445732434590654, "deviation-heading": 1.1535521592469768, "complete-iteration": 0.3684845121701558, "set_robot_commands": 0.006329238414764404, "deviation-center-line": 0.4324296220980532, "driven_lanedir_consec": 1.993760245559976, "sim_compute_sim_state": 0.02280314683914185, "sim_compute_performance-ego": 0.006306556065877279, "sim_compute_robot_state-ego": 0.010572834014892578, "sim_compute_robot_state-parked0": 0.009741265773773194}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 2.6920051148947843, "get_ui_image": 0.07003470420837403, "step_physics": 0.1598705760637919, "survival_time": 14.950000000000076, "driven_lanedir": 1.9278009745868587, "get_state_dump": 0.016046470801035564, "sim_render-ego": 0.008949835300445557, "in-drivable-lane": 6.250000000000089, "agent_compute-ego": 0.06030343691507975, "deviation-heading": 1.2308075753256589, "complete-iteration": 0.3696598394711813, "set_robot_commands": 0.006274944146474203, "deviation-center-line": 0.4108496443136423, "driven_lanedir_consec": 1.9278009745868587, "sim_compute_sim_state": 0.0219315505027771, "sim_compute_performance-ego": 0.005949630737304688, "sim_compute_robot_state-ego": 0.010328729152679444, "sim_compute_robot_state-parked0": 0.009772613048553466}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 3.1253251334882397, "get_ui_image": 0.07163330849180831, "step_physics": 0.15826446654948784, "survival_time": 11.750000000000032, "driven_lanedir": 2.5041277289261226, "get_state_dump": 0.016144400454582052, "sim_render-ego": 0.008915354343170815, "in-drivable-lane": 2.10000000000003, "agent_compute-ego": 0.060207229979494785, "deviation-heading": 1.0218929081275197, "complete-iteration": 0.3679614838133467, "set_robot_commands": 0.006300471691375083, "deviation-center-line": 0.3501381443037586, "driven_lanedir_consec": 2.5041277289261226, "sim_compute_sim_state": 0.02035162499610414, "sim_compute_performance-ego": 0.005934311481232339, "sim_compute_robot_state-ego": 0.010183587987372216, "sim_compute_robot_state-parked0": 0.009837133326429002}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 3.2878531350414177, "get_ui_image": 0.09298968156178793, "step_physics": 0.20384310642878217, "survival_time": 14.950000000000076, "driven_lanedir": 2.546897615752232, "get_state_dump": 0.016477296352386473, "sim_render-ego": 0.010153470039367675, "in-drivable-lane": 4.600000000000065, "agent_compute-ego": 0.0678754711151123, "deviation-heading": 1.465002473767731, "complete-iteration": 0.4507250841458639, "set_robot_commands": 0.006332960923512777, "deviation-center-line": 0.4540801035397628, "driven_lanedir_consec": 2.546897615752232, "sim_compute_sim_state": 0.02410462697347005, "sim_compute_performance-ego": 0.006992167631785075, "sim_compute_robot_state-ego": 0.011751545270284018, "sim_compute_robot_state-parked0": 0.010027304490407308}}
set_robot_commands_max0.006619767347971598
set_robot_commands_mean0.006372935644934699
set_robot_commands_median0.006327722198474481
set_robot_commands_min0.006254501342773437
sim_compute_performance-ego_max0.006992167631785075
sim_compute_performance-ego_mean0.006226172757838761
sim_compute_performance-ego_median0.006225543814416257
sim_compute_performance-ego_min0.005895984172821045
sim_compute_robot_state-ego_max0.011751545270284018
sim_compute_robot_state-ego_mean0.010615861679939368
sim_compute_robot_state-ego_median0.010534064441487408
sim_compute_robot_state-ego_min0.010183587987372216
sim_compute_robot_state-parked0_max0.010615365105386106
sim_compute_robot_state-parked0_mean0.010078394635102492
sim_compute_robot_state-parked0_median0.009987247387568156
sim_compute_robot_state-parked0_min0.009741265773773194
sim_compute_sim_state_max0.02490893761316935
sim_compute_sim_state_mean0.022230043235410543
sim_compute_sim_state_median0.02282487034797669
sim_compute_sim_state_min0.01887791951497396
sim_render-ego_max0.010153470039367675
sim_render-ego_mean0.00922079329574472
sim_render-ego_median0.009096837043762206
sim_render-ego_min0.008906053460162619
simulation-passed1
step_physics_max0.20384310642878217
step_physics_mean0.16985912765757555
step_physics_median0.16990702867507934
step_physics_min0.15511233965555826
survival_time_max14.950000000000076
survival_time_mean13.940000000000063
survival_time_min8.04999999999998
No reset possible