Duckietown Challenges Home Challenges Submissions

Evaluator 1074

ID1074
evaluatorip-172-31-42-167-7194
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7194
versiond-c:4.0.30;d-c-r:4.0.41;d-s:4.0.21
first heard
last heard
statusinactive
# evaluating
# success1 22104
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
221043443Bea Baselines 🐤rotationaido2-LF-sim-testingstep1-simulationsuccess Note that this job is not up to date; the challenge has been changed. ip-172-31-42-167-71940:35:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.0014713911579301575
survival_time_median14.950000000000076
deviation-center-line_median0.3550429130563084
in-drivable-lane_median7.600000000000043


other stats
agent_compute-ego_max0.08834320863087972
agent_compute-ego_mean0.08646368614832561
agent_compute-ego_median0.08650646209716797
agent_compute-ego_min0.08515400091807047
deviation-center-line_max0.6007136359417561
deviation-center-line_mean0.3394558693803663
deviation-center-line_min0.017558302483544185
deviation-heading_max5.876680788839771
deviation-heading_mean5.668498743453998
deviation-heading_median5.709677935349317
deviation-heading_min5.445457843647878
driven_any_max0.026478672834056367
driven_any_mean0.02338944237901273
driven_any_median0.023285267728313904
driven_any_min0.0197794984093383
driven_lanedir_consec_max0.0021599934447711355
driven_lanedir_consec_mean-0.0011081890688229216
driven_lanedir_consec_min-0.004544743757038283
driven_lanedir_max0.0021599934447711355
driven_lanedir_mean-0.0011081890688229216
driven_lanedir_median-0.0014713911579301575
driven_lanedir_min-0.004544743757038283
in-drivable-lane_max7.700000000000042
in-drivable-lane_mean7.596666666666709
in-drivable-lane_min7.500000000000043
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.026478672834056367, "sim_physics": 0.058132688204447426, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021599934447711355, "sim_render-ego": 0.03684644063313802, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.08834320863087972, "deviation-heading": 5.657649106857695, "set_robot_commands": 0.05542106072107951, "deviation-center-line": 0.5610133203215761, "driven_lanedir_consec": 0.0021599934447711355, "sim_compute_sim_state": 0.02366138299306234, "sim_compute_performance-ego": 0.04054725885391235, "sim_compute_robot_state-ego": 0.04122018814086914}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.02593019554121306, "sim_physics": 0.05464164813359578, "survival_time": 14.950000000000076, "driven_lanedir": -0.003361806018059577, "sim_render-ego": 0.035704467296600345, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.08747945864995321, "deviation-heading": 5.445457843647878, "set_robot_commands": 0.05400610049565633, "deviation-center-line": 0.13860669343031343, "driven_lanedir_consec": -0.003361806018059577, "sim_compute_sim_state": 0.02309789975484212, "sim_compute_performance-ego": 0.03866426944732666, "sim_compute_robot_state-ego": 0.04065970659255982}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.023804404672438047, "sim_physics": 0.05578792254130045, "survival_time": 14.950000000000076, "driven_lanedir": 0.0021181059556472093, "sim_render-ego": 0.035878928502400716, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.08660011450449626, "deviation-heading": 5.876680788839771, "set_robot_commands": 0.05447417736053467, "deviation-center-line": 0.4784517475259532, "driven_lanedir_consec": 0.0021181059556472093, "sim_compute_sim_state": 0.023628182411193847, "sim_compute_performance-ego": 0.03937423706054687, "sim_compute_robot_state-ego": 0.04056052128473918}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.022165452661374756, "sim_physics": 0.05661970933278402, "survival_time": 14.950000000000076, "driven_lanedir": -0.002690854798440334, "sim_render-ego": 0.03547631184260051, "in-drivable-lane": 7.700000000000042, "agent_compute-ego": 0.08658820470174154, "deviation-heading": 5.721005148732661, "set_robot_commands": 0.05438991149266561, "deviation-center-line": 0.44901648578509457, "driven_lanedir_consec": -0.002690854798440334, "sim_compute_sim_state": 0.022930135726928712, "sim_compute_performance-ego": 0.03894821564356486, "sim_compute_robot_state-ego": 0.04052612622578939}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.025942472252175396, "sim_physics": 0.05595416784286499, "survival_time": 14.950000000000076, "driven_lanedir": -0.0005547867508171045, "sim_render-ego": 0.035560096899668374, "in-drivable-lane": 7.650000000000044, "agent_compute-ego": 0.08650646209716797, "deviation-heading": 5.453097843541612, "set_robot_commands": 0.05441012382507325, "deviation-center-line": 0.28665447981951625, "driven_lanedir_consec": -0.0005547867508171045, "sim_compute_sim_state": 0.022929344177246097, "sim_compute_performance-ego": 0.03829615116119385, "sim_compute_robot_state-ego": 0.04019706964492798}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.026249880775217276, "sim_physics": 0.05641598463058472, "survival_time": 14.950000000000076, "driven_lanedir": -0.0017675599932500674, "sim_render-ego": 0.035588738123575846, "in-drivable-lane": 7.650000000000041, "agent_compute-ego": 0.08645851294199626, "deviation-heading": 5.813994332249986, "set_robot_commands": 0.05422246694564819, "deviation-center-line": 0.6007136359417561, "driven_lanedir_consec": -0.0017675599932500674, "sim_compute_sim_state": 0.02260571797688802, "sim_compute_performance-ego": 0.03793468316396077, "sim_compute_robot_state-ego": 0.04002286990483602}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.023285267728313904, "sim_physics": 0.05410882870356242, "survival_time": 14.950000000000076, "driven_lanedir": -0.00391925832851836, "sim_render-ego": 0.03488625208536784, "in-drivable-lane": 7.600000000000044, "agent_compute-ego": 0.08584331671396891, "deviation-heading": 5.466476436400955, "set_robot_commands": 0.05387724796930949, "deviation-center-line": 0.3550429130563084, "driven_lanedir_consec": -0.00391925832851836, "sim_compute_sim_state": 0.022223428090413413, "sim_compute_performance-ego": 0.03746919314066569, "sim_compute_robot_state-ego": 0.03994138161341349}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.023561644755163248, "sim_physics": 0.052137494881947834, "survival_time": 14.950000000000076, "driven_lanedir": 0.002049277100081514, "sim_render-ego": 0.034507946968078615, "in-drivable-lane": 7.550000000000042, "agent_compute-ego": 0.0860131049156189, "deviation-heading": 5.854958069383543, "set_robot_commands": 0.055296648343404135, "deviation-center-line": 0.41169203827872664, "driven_lanedir_consec": 0.002049277100081514, "sim_compute_sim_state": 0.02222464164098104, "sim_compute_performance-ego": 0.03798879782358806, "sim_compute_robot_state-ego": 0.039463990529378254}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.02419197298360903, "sim_physics": 0.05441154559453328, "survival_time": 14.950000000000076, "driven_lanedir": 0.0002979654230168549, "sim_render-ego": 0.03450071255366007, "in-drivable-lane": 7.600000000000043, "agent_compute-ego": 0.08515400091807047, "deviation-heading": 5.709677935349317, "set_robot_commands": 0.054011032581329346, "deviation-center-line": 0.017558302483544185, "driven_lanedir_consec": 0.0002979654230168549, "sim_compute_sim_state": 0.02237696647644043, "sim_compute_performance-ego": 0.037985845406850176, "sim_compute_robot_state-ego": 0.0397852357228597}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.021258166206925968, "sim_physics": 0.05594459056854248, "survival_time": 14.950000000000076, "driven_lanedir": -4.181733071773053e-05, "sim_render-ego": 0.0349039896329244, "in-drivable-lane": 7.500000000000043, "agent_compute-ego": 0.08692520300547282, "deviation-heading": 5.783324089492346, "set_robot_commands": 0.05310889641443888, "deviation-center-line": 0.2514968415228165, "driven_lanedir_consec": -4.181733071773053e-05, "sim_compute_sim_state": 0.02290864070256551, "sim_compute_performance-ego": 0.03770191510518392, "sim_compute_robot_state-ego": 0.03965084155400594}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.021434292120195386, "sim_physics": 0.0525149671236674, "survival_time": 14.950000000000076, "driven_lanedir": 0.000713963463023104, "sim_render-ego": 0.036350131034851074, "in-drivable-lane": 7.600000000000045, "agent_compute-ego": 0.08706388632456462, "deviation-heading": 5.526728061201507, "set_robot_commands": 0.05317760785420736, "deviation-center-line": 0.46282395191752784, "driven_lanedir_consec": 0.000713963463023104, "sim_compute_sim_state": 0.02214012384414673, "sim_compute_performance-ego": 0.03855316559473673, "sim_compute_robot_state-ego": 0.03959160486857096}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.0197794984093383, "sim_physics": 0.05471729914347331, "survival_time": 14.950000000000076, "driven_lanedir": -0.0014713911579301575, "sim_render-ego": 0.034779183864593506, "in-drivable-lane": 7.550000000000041, "agent_compute-ego": 0.08746500889460246, "deviation-heading": 5.8066732640248135, "set_robot_commands": 0.05386898835500081, "deviation-center-line": 0.16800033110632376, "driven_lanedir_consec": -0.0014713911579301575, "sim_compute_sim_state": 0.02234598477681478, "sim_compute_performance-ego": 0.037636468410491945, "sim_compute_robot_state-ego": 0.03962694962819417}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.020981564902326583, "sim_physics": 0.0556213100751241, "survival_time": 14.950000000000076, "driven_lanedir": -0.001808663823426926, "sim_render-ego": 0.03505765279134115, "in-drivable-lane": 7.650000000000043, "agent_compute-ego": 0.08531557559967042, "deviation-heading": 5.5154737798413205, "set_robot_commands": 0.053471186955769856, "deviation-center-line": 0.3169911817232478, "driven_lanedir_consec": -0.001808663823426926, "sim_compute_sim_state": 0.022494279543558756, "sim_compute_performance-ego": 0.03761474927266439, "sim_compute_robot_state-ego": 0.04011052211125691}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.022551048035819046, "sim_physics": 0.05125517288843791, "survival_time": 14.950000000000076, "driven_lanedir": -0.004544743757038283, "sim_render-ego": 0.03576191425323486, "in-drivable-lane": 7.600000000000042, "agent_compute-ego": 0.08536622921625774, "deviation-heading": 5.790764092245773, "set_robot_commands": 0.05542680978775025, "deviation-center-line": 0.03881032426772201, "driven_lanedir_consec": -0.004544743757038283, "sim_compute_sim_state": 0.02224847952524821, "sim_compute_performance-ego": 0.0376047682762146, "sim_compute_robot_state-ego": 0.040438255469004314}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.023227101807024583, "sim_physics": 0.05291558345158895, "survival_time": 14.950000000000076, "driven_lanedir": -0.0038012594606851025, "sim_render-ego": 0.03451405763626099, "in-drivable-lane": 7.550000000000044, "agent_compute-ego": 0.08583300511042277, "deviation-heading": 5.605520360000814, "set_robot_commands": 0.05442775805791219, "deviation-center-line": 0.5549657935250676, "driven_lanedir_consec": -0.0038012594606851025, "sim_compute_sim_state": 0.022274295488993328, "sim_compute_performance-ego": 0.03801936149597168, "sim_compute_robot_state-ego": 0.039477832317352295}}
set_robot_commands_max0.05542680978775025
set_robot_commands_mean0.05423933447731865
set_robot_commands_median0.05422246694564819
set_robot_commands_min0.05310889641443888
sim_compute_performance-ego_max0.04054725885391235
sim_compute_performance-ego_mean0.038289271990458174
sim_compute_performance-ego_median0.03798879782358806
sim_compute_performance-ego_min0.03746919314066569
sim_compute_robot_state-ego_max0.04122018814086914
sim_compute_robot_state-ego_mean0.04008487304051717
sim_compute_robot_state-ego_median0.04002286990483602
sim_compute_robot_state-ego_min0.039463990529378254
sim_compute_sim_state_max0.02366138299306234
sim_compute_sim_state_mean0.02267263354195489
sim_compute_sim_state_median0.022494279543558756
sim_compute_sim_state_min0.02214012384414673
sim_physics_max0.058132688204447426
sim_physics_mean0.05474526087443034
sim_physics_median0.05471729914347331
sim_physics_min0.05125517288843791
sim_render-ego_max0.03684644063313802
sim_render-ego_mean0.035354454941219755
sim_render-ego_median0.03547631184260051
sim_render-ego_min0.03450071255366007
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible