Duckietown Challenges Home Challenges Submissions

Evaluator 1125

ID1125
evaluatorip-172-31-42-167-7194
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7194
versiond-c:4.0.30;d-c-r:4.0.43;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success2 22181
# timeout
# failed
# error1 22179
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
222183507Bea Baselines 🐤challenge-aido_LF-template-pytorchaido2-LF-sim-validationstep1-simulationsuccessnoip-172-31-42-167-71940:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.20009666205439647
survival_time_median1.5500000000000007
deviation-center-line_median0.08618975180814352
in-drivable-lane_median0


other stats
agent_compute-ego_max0.1857827827334404
agent_compute-ego_mean0.1612850230474859
agent_compute-ego_median0.15336491844870828
agent_compute-ego_min0.14546637381276778
deviation-center-line_max0.10721487451456292
deviation-center-line_mean0.08787723479256716
deviation-center-line_min0.06738877594343179
deviation-heading_max0.8271187220503866
deviation-heading_mean0.6789275542795618
deviation-heading_median0.693599883646009
deviation-heading_min0.4412711700844085
driven_any_max0.26691263128056275
driven_any_mean0.23787055342228008
driven_any_median0.2553310928361962
driven_any_min0.17031013518262075
driven_lanedir_consec_max0.21834730403960945
driven_lanedir_consec_mean0.1855818396356799
driven_lanedir_consec_min0.13795262444528067
driven_lanedir_max0.21834730403960945
driven_lanedir_mean0.1855818396356799
driven_lanedir_median0.20009666205439647
driven_lanedir_min0.13795262444528067
in-drivable-lane_max0.05000000000000005
in-drivable-lane_mean0.010000000000000007
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.26691263128056275, "sim_physics": 0.12334047257900238, "survival_time": 1.6000000000000008, "driven_lanedir": 0.20101032329352364, "sim_render-ego": 0.06344166398048401, "in-drivable-lane": 0, "agent_compute-ego": 0.1857827827334404, "deviation-heading": 0.807360499793877, "set_robot_commands": 0.09827006608247756, "deviation-center-line": 0.10721487451456292, "driven_lanedir_consec": 0.20101032329352364, "sim_compute_sim_state": 0.042319223284721375, "sim_compute_performance-ego": 0.07410142570734024, "sim_compute_robot_state-ego": 0.07922431081533432}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.26417352777122477, "sim_physics": 0.10759151366449173, "survival_time": 1.5500000000000007, "driven_lanedir": 0.21834730403960945, "sim_render-ego": 0.06147832255209646, "in-drivable-lane": 0, "agent_compute-ego": 0.1698136329650879, "deviation-heading": 0.6252874958231274, "set_robot_commands": 0.10049339263669906, "deviation-center-line": 0.06738877594343179, "driven_lanedir_consec": 0.21834730403960945, "sim_compute_sim_state": 0.04071276418624386, "sim_compute_performance-ego": 0.0676443499903525, "sim_compute_robot_state-ego": 0.07279999025406377}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.17031013518262075, "sim_physics": 0.10580836642872204, "survival_time": 1.1000000000000003, "driven_lanedir": 0.13795262444528067, "sim_render-ego": 0.055897094986655495, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.15336491844870828, "deviation-heading": 0.4412711700844085, "set_robot_commands": 0.08479294993660667, "deviation-center-line": 0.10008473180711776, "driven_lanedir_consec": 0.13795262444528067, "sim_compute_sim_state": 0.03713160211389715, "sim_compute_performance-ego": 0.06241065805608576, "sim_compute_robot_state-ego": 0.0658975297754461}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.2326253800407959, "sim_physics": 0.11114445439091436, "survival_time": 1.3500000000000003, "driven_lanedir": 0.17050228434558923, "sim_render-ego": 0.05880104170905219, "in-drivable-lane": 0, "agent_compute-ego": 0.15199740727742514, "deviation-heading": 0.8271187220503866, "set_robot_commands": 0.08836177543357566, "deviation-center-line": 0.08618975180814352, "driven_lanedir_consec": 0.17050228434558923, "sim_compute_sim_state": 0.03868102144311975, "sim_compute_performance-ego": 0.059832255045572914, "sim_compute_robot_state-ego": 0.0657809575398763}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2553310928361962, "sim_physics": 0.11581114799745622, "survival_time": 1.5500000000000007, "driven_lanedir": 0.20009666205439647, "sim_render-ego": 0.05568478953453802, "in-drivable-lane": 0, "agent_compute-ego": 0.14546637381276778, "deviation-heading": 0.693599883646009, "set_robot_commands": 0.08005409086904218, "deviation-center-line": 0.07850803988957983, "driven_lanedir_consec": 0.20009666205439647, "sim_compute_sim_state": 0.033674747713150516, "sim_compute_performance-ego": 0.05952210580149005, "sim_compute_robot_state-ego": 0.06278850955347862}}
set_robot_commands_max0.10049339263669906
set_robot_commands_mean0.09039445499168022
set_robot_commands_median0.08836177543357566
set_robot_commands_min0.08005409086904218
sim_compute_performance-ego_max0.07410142570734024
sim_compute_performance-ego_mean0.0647021589201683
sim_compute_performance-ego_median0.06241065805608576
sim_compute_performance-ego_min0.05952210580149005
sim_compute_robot_state-ego_max0.07922431081533432
sim_compute_robot_state-ego_mean0.06929825958763983
sim_compute_robot_state-ego_median0.0658975297754461
sim_compute_robot_state-ego_min0.06278850955347862
sim_compute_sim_state_max0.042319223284721375
sim_compute_sim_state_mean0.03850387174822653
sim_compute_sim_state_median0.03868102144311975
sim_compute_sim_state_min0.033674747713150516
sim_physics_max0.12334047257900238
sim_physics_mean0.11273919101211734
sim_physics_median0.11114445439091436
sim_physics_min0.10580836642872204
sim_render-ego_max0.06344166398048401
sim_render-ego_mean0.05906058255256523
sim_render-ego_median0.05880104170905219
sim_render-ego_min0.05568478953453802
simulation-passed1
survival_time_max1.6000000000000008
survival_time_mean1.4300000000000006
survival_time_min1.1000000000000003
No reset possible
221813491Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-42-167-71940:36:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6906057395968523
survival_time_median14.950000000000076
deviation-center-line_median0.7255042092330726
in-drivable-lane_median0


other stats
agent_compute-ego_max0.12335401713648768
agent_compute-ego_mean0.12051278147688858
agent_compute-ego_median0.1203237009048462
agent_compute-ego_min0.11888297239939372
deviation-center-line_max1.3520157435182647
deviation-center-line_mean0.7918967558875143
deviation-center-line_min0.42061463814363814
deviation-heading_max2.848314949708479
deviation-heading_mean1.8141909534892984
deviation-heading_median1.7415563254363262
deviation-heading_min0.5869635301683654
driven_any_max0.993790161349184
driven_any_mean0.856784919013119
driven_any_median0.9029131606022592
driven_any_min0.5009954274487234
driven_lanedir_consec_max0.9894711432708632
driven_lanedir_consec_mean0.7137767395196523
driven_lanedir_consec_min0.3100397698820001
driven_lanedir_max0.9894711432708632
driven_lanedir_mean0.7137767395196523
driven_lanedir_median0.6906057395968523
driven_lanedir_min0.3100397698820001
in-drivable-lane_max7.10000000000008
in-drivable-lane_mean2.150000000000025
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.8802882570663503, "sim_physics": 0.05372568766276042, "survival_time": 14.950000000000076, "driven_lanedir": 0.6906057395968523, "sim_render-ego": 0.03506436189015706, "in-drivable-lane": 2.80000000000004, "agent_compute-ego": 0.12036862532297772, "deviation-heading": 1.6282402246694203, "set_robot_commands": 0.05440945545832316, "deviation-center-line": 0.9621311095951852, "driven_lanedir_consec": 0.6906057395968523, "sim_compute_sim_state": 0.022225604057312012, "sim_compute_performance-ego": 0.0376853609085083, "sim_compute_robot_state-ego": 0.03955593506495158}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9411436944125612, "sim_physics": 0.05338487466176351, "survival_time": 14.950000000000076, "driven_lanedir": 0.4486977869327078, "sim_render-ego": 0.034346554279327396, "in-drivable-lane": 7.10000000000008, "agent_compute-ego": 0.12186745484670004, "deviation-heading": 2.31833749949764, "set_robot_commands": 0.054226059118906655, "deviation-center-line": 0.8044337381918936, "driven_lanedir_consec": 0.4486977869327078, "sim_compute_sim_state": 0.023712589740753173, "sim_compute_performance-ego": 0.037565027872721354, "sim_compute_robot_state-ego": 0.03925374348958333}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.8553917248468014, "sim_physics": 0.05287928501764933, "survival_time": 14.950000000000076, "driven_lanedir": 0.6334935559857033, "sim_render-ego": 0.034834808508555096, "in-drivable-lane": 3.7000000000000526, "agent_compute-ego": 0.12085652351379396, "deviation-heading": 2.848314949708479, "set_robot_commands": 0.05455364465713501, "deviation-center-line": 0.7255042092330726, "driven_lanedir_consec": 0.6334935559857033, "sim_compute_sim_state": 0.022240370909372965, "sim_compute_performance-ego": 0.037590146859486896, "sim_compute_robot_state-ego": 0.040266652107238766}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.9029131606022592, "sim_physics": 0.05313485383987427, "survival_time": 14.950000000000076, "driven_lanedir": 0.8931061628917032, "sim_render-ego": 0.034453625679016116, "in-drivable-lane": 0, "agent_compute-ego": 0.12000654935836792, "deviation-heading": 1.6204836209580038, "set_robot_commands": 0.05407156308492025, "deviation-center-line": 0.9103985222264994, "driven_lanedir_consec": 0.8931061628917032, "sim_compute_sim_state": 0.021982471148173015, "sim_compute_performance-ego": 0.03740007321039836, "sim_compute_robot_state-ego": 0.040757482846577965}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.667653164517356, "sim_physics": 0.054148544699458755, "survival_time": 11.800000000000033, "driven_lanedir": 0.3100397698820001, "sim_render-ego": 0.0341495730109134, "in-drivable-lane": 6.050000000000045, "agent_compute-ego": 0.12036502563347252, "deviation-heading": 1.5257559047055524, "set_robot_commands": 0.05468568155321024, "deviation-center-line": 0.5277852886728324, "driven_lanedir_consec": 0.3100397698820001, "sim_compute_sim_state": 0.022267477997278764, "sim_compute_performance-ego": 0.03744743436069812, "sim_compute_robot_state-ego": 0.03902448334936368}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.9819985124972552, "sim_physics": 0.053826539516448973, "survival_time": 14.950000000000076, "driven_lanedir": 0.9649978185770522, "sim_render-ego": 0.03439799626668294, "in-drivable-lane": 0, "agent_compute-ego": 0.1203237009048462, "deviation-heading": 2.3499623239614036, "set_robot_commands": 0.053485199610392255, "deviation-center-line": 0.9380287165963848, "driven_lanedir_consec": 0.9649978185770522, "sim_compute_sim_state": 0.022495773633321125, "sim_compute_performance-ego": 0.03800660212834677, "sim_compute_robot_state-ego": 0.03974404811859131}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.6227480118357093, "sim_physics": 0.05334942852525406, "survival_time": 10.95000000000002, "driven_lanedir": 0.32180654475931236, "sim_render-ego": 0.03677833679059869, "in-drivable-lane": 4.600000000000035, "agent_compute-ego": 0.11947375454314768, "deviation-heading": 2.552673933729411, "set_robot_commands": 0.054590258968475205, "deviation-center-line": 0.42061463814363814, "driven_lanedir_consec": 0.32180654475931236, "sim_compute_sim_state": 0.021959473553313513, "sim_compute_performance-ego": 0.03729739145601177, "sim_compute_robot_state-ego": 0.03920140984940202}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.993790161349184, "sim_physics": 0.05899969498316447, "survival_time": 14.950000000000076, "driven_lanedir": 0.9829880224882372, "sim_render-ego": 0.0352618408203125, "in-drivable-lane": 0, "agent_compute-ego": 0.11888297239939372, "deviation-heading": 1.88142878507186, "set_robot_commands": 0.053281060854593915, "deviation-center-line": 1.3520157435182647, "driven_lanedir_consec": 0.9829880224882372, "sim_compute_sim_state": 0.021910483837127685, "sim_compute_performance-ego": 0.03777928272883097, "sim_compute_robot_state-ego": 0.03919934749603272}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.9937298652002856, "sim_physics": 0.049569243590037025, "survival_time": 14.950000000000076, "driven_lanedir": 0.9894711432708632, "sim_render-ego": 0.03423039356867472, "in-drivable-lane": 0, "agent_compute-ego": 0.11952425400416056, "deviation-heading": 1.0603002105051578, "set_robot_commands": 0.05351117293039958, "deviation-center-line": 1.1561608549654876, "driven_lanedir_consec": 0.9894711432708632, "sim_compute_sim_state": 0.02203641891479492, "sim_compute_performance-ego": 0.03766539812088013, "sim_compute_robot_state-ego": 0.038745272954305014}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.8732460268480504, "sim_physics": 0.05307358980178833, "survival_time": 14.950000000000076, "driven_lanedir": 0.6595321699768026, "sim_render-ego": 0.034379227956136064, "in-drivable-lane": 3.250000000000046, "agent_compute-ego": 0.11969520409901936, "deviation-heading": 2.376125035950778, "set_robot_commands": 0.0535548464457194, "deviation-center-line": 0.5271430989387006, "driven_lanedir_consec": 0.6595321699768026, "sim_compute_sim_state": 0.02190740982691447, "sim_compute_performance-ego": 0.037227675914764405, "sim_compute_robot_state-ego": 0.03956743240356445}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.9148601538081396, "sim_physics": 0.055623425642649334, "survival_time": 14.950000000000076, "driven_lanedir": 0.9120366910755004, "sim_render-ego": 0.0348859961827596, "in-drivable-lane": 0, "agent_compute-ego": 0.11969124396642047, "deviation-heading": 1.0339746536407264, "set_robot_commands": 0.05408330758412679, "deviation-center-line": 0.4290011464804442, "driven_lanedir_consec": 0.9120366910755004, "sim_compute_sim_state": 0.021928119659423827, "sim_compute_performance-ego": 0.038623321851094565, "sim_compute_robot_state-ego": 0.039319149653116864}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.5009954274487234, "sim_physics": 0.05415521010509512, "survival_time": 9.049999999999994, "driven_lanedir": 0.4929732429714155, "sim_render-ego": 0.03474432855679844, "in-drivable-lane": 0, "agent_compute-ego": 0.1197991081364247, "deviation-heading": 1.3936117855807015, "set_robot_commands": 0.05380697671879721, "deviation-center-line": 0.6384786726853099, "driven_lanedir_consec": 0.4929732429714155, "sim_compute_sim_state": 0.02207423046807558, "sim_compute_performance-ego": 0.03741954176465451, "sim_compute_robot_state-ego": 0.03885196585681557}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.9401498578087168, "sim_physics": 0.05901450077692667, "survival_time": 14.950000000000076, "driven_lanedir": 0.926396467568086, "sim_render-ego": 0.03538111527760823, "in-drivable-lane": 0, "agent_compute-ego": 0.1230586576461792, "deviation-heading": 1.7415563254363262, "set_robot_commands": 0.05426647742589315, "deviation-center-line": 0.6847517914097643, "driven_lanedir_consec": 0.926396467568086, "sim_compute_sim_state": 0.02290613094965617, "sim_compute_performance-ego": 0.03896031538645427, "sim_compute_robot_state-ego": 0.0410041069984436}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.8746644918032388, "sim_physics": 0.059293910412485384, "survival_time": 14.950000000000076, "driven_lanedir": 0.5736484274659386, "sim_render-ego": 0.03615064365807983, "in-drivable-lane": 4.7500000000000675, "agent_compute-ego": 0.12335401713648768, "deviation-heading": 2.2951355187556466, "set_robot_commands": 0.05589445937038664, "deviation-center-line": 0.47440619804031187, "driven_lanedir_consec": 0.5736484274659386, "sim_compute_sim_state": 0.02318028462770392, "sim_compute_performance-ego": 0.038664651156269186, "sim_compute_robot_state-ego": 0.04038630919312952}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.9082012751521528, "sim_physics": 0.05302828709284464, "survival_time": 14.950000000000076, "driven_lanedir": 0.9068575493526084, "sim_render-ego": 0.03447329600652059, "in-drivable-lane": 0, "agent_compute-ego": 0.12042463064193726, "deviation-heading": 0.5869635301683654, "set_robot_commands": 0.053833523591359456, "deviation-center-line": 1.327597609614927, "driven_lanedir_consec": 0.9068575493526084, "sim_compute_sim_state": 0.02225010633468628, "sim_compute_performance-ego": 0.03776101509730021, "sim_compute_robot_state-ego": 0.0390374485651652}}
set_robot_commands_max0.05589445937038664
set_robot_commands_mean0.0541502458248426
set_robot_commands_median0.05408330758412679
set_robot_commands_min0.053281060854593915
sim_compute_performance-ego_max0.03896031538645427
sim_compute_performance-ego_mean0.037806215921094656
sim_compute_performance-ego_median0.03766539812088013
sim_compute_performance-ego_min0.037227675914764405
sim_compute_robot_state-ego_max0.0410041069984436
sim_compute_robot_state-ego_mean0.03959431919641877
sim_compute_robot_state-ego_median0.039319149653116864
sim_compute_robot_state-ego_min0.038745272954305014
sim_compute_sim_state_max0.023712589740753173
sim_compute_sim_state_mean0.022338463043860494
sim_compute_sim_state_median0.022225604057312012
sim_compute_sim_state_min0.02190740982691447
sim_physics_max0.059293910412485384
sim_physics_mean0.05448047175521336
sim_physics_median0.05372568766276042
sim_physics_min0.049569243590037025
sim_render-ego_max0.03677833679059869
sim_render-ego_mean0.03490213989680938
sim_render-ego_median0.03474432855679844
sim_render-ego_min0.0341495730109134
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean14.080000000000064
survival_time_min9.049999999999994
No reset possible
221793500Julian ZillyBaseline-IL-logs-tensorflowaido2-LFVI-sim-validationstep1-simulationerrornoip-172-31-42-167-71940:19:43
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible