Duckietown Challenges Home Challenges Submissions

Evaluator 1126

ID1126
evaluatorip-172-31-25-98-2348
ownerI don't have one 😀
machineip-172-31-25-98
processip-172-31-25-98-2348
versiond-c:4.0.30;d-c-r:4.0.43;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success1 22172
# timeout2 22195
# failed
# error1 22177
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
222153506Bea Baselines 🐤challenge-aido_LF-template-pytorchaido2-LF-sim-testingstep1-simulationtimeoutnoip-172-31-25-98-23481:05:57
I can see how the jo [...]
I can see how the job 22215 is timeout because passed 3957 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
221953501Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LF-sim-validationstep1-simulationtimeoutnoip-172-31-25-98-23480:08:26
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
221773496Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationerrornoip-172-31-25-98-23480:22:05
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
221723486Eric LuTesting the RL solutionaido2-LF-sim-testingstep1-simulationsuccessnoip-172-31-25-98-23480:11:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.07145416669754967
survival_time_median1.5000000000000009
deviation-center-line_median0.05737241353497678
in-drivable-lane_median0.4500000000000004


other stats
agent_compute-ego_max0.2056249976158142
agent_compute-ego_mean0.1716438843279353
agent_compute-ego_median0.17460318873910344
agent_compute-ego_min0.12372433798653738
deviation-center-line_max0.1514048711594804
deviation-center-line_mean0.06807332708264416
deviation-center-line_min0.02342982347810686
deviation-heading_max1.861591190837513
deviation-heading_mean0.7479561570330955
deviation-heading_median0.6790490360228747
deviation-heading_min0.4663953645878885
driven_any_max0.6092368543831471
driven_any_mean0.18065725228998333
driven_any_median0.14631599659371566
driven_any_min0.0906427602109546
driven_lanedir_consec_max0.1330310659302567
driven_lanedir_consec_mean0.06931099416369017
driven_lanedir_consec_min0.02706466861226753
driven_lanedir_max0.1330310659302567
driven_lanedir_mean0.06931099416369017
driven_lanedir_median0.07145416669754967
driven_lanedir_min0.02706466861226753
in-drivable-lane_max2.4999999999999956
in-drivable-lane_mean0.45
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.19697474059671893, "sim_physics": 0.13595434497384465, "survival_time": 1.7000000000000008, "driven_lanedir": 0.050889366894883103, "sim_render-ego": 0.06538381997276754, "in-drivable-lane": 0.6500000000000006, "agent_compute-ego": 0.17460318873910344, "deviation-heading": 0.658707366438032, "set_robot_commands": 0.1015090872259701, "deviation-center-line": 0.05737241353497678, "driven_lanedir_consec": 0.050889366894883103, "sim_compute_sim_state": 0.039243095061358285, "sim_compute_performance-ego": 0.0726465337416705, "sim_compute_robot_state-ego": 0.08121943473815918}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.18936069755993537, "sim_physics": 0.1242449213476742, "survival_time": 1.7000000000000008, "driven_lanedir": 0.07533236575783464, "sim_render-ego": 0.05849557764389936, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.17161154747009277, "deviation-heading": 0.7072826262807453, "set_robot_commands": 0.0970386967939489, "deviation-center-line": 0.03328045808219188, "driven_lanedir_consec": 0.07533236575783464, "sim_compute_sim_state": 0.04016719144933364, "sim_compute_performance-ego": 0.06783366203308105, "sim_compute_robot_state-ego": 0.07804643406587489}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.0906427602109546, "sim_physics": 0.13737089633941652, "survival_time": 1.0000000000000002, "driven_lanedir": 0.052205459562848056, "sim_render-ego": 0.07165352106094361, "in-drivable-lane": 0, "agent_compute-ego": 0.2056249976158142, "deviation-heading": 0.6790490360228747, "set_robot_commands": 0.10041592121124268, "deviation-center-line": 0.08880336219985316, "driven_lanedir_consec": 0.052205459562848056, "sim_compute_sim_state": 0.03967430591583252, "sim_compute_performance-ego": 0.07737587690353394, "sim_compute_robot_state-ego": 0.08488681316375732}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.20417969534127267, "sim_physics": 0.13588479906320572, "survival_time": 1.6000000000000008, "driven_lanedir": 0.07487842055791782, "sim_render-ego": 0.06806432455778122, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.17995573580265045, "deviation-heading": 0.7822252883431541, "set_robot_commands": 0.10059578716754912, "deviation-center-line": 0.04724032160616681, "driven_lanedir_consec": 0.07487842055791782, "sim_compute_sim_state": 0.04092223197221756, "sim_compute_performance-ego": 0.07614748924970627, "sim_compute_robot_state-ego": 0.08593282103538513}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.20893542705425047, "sim_physics": 0.13794245719909667, "survival_time": 1.7500000000000009, "driven_lanedir": 0.08793963819660533, "sim_render-ego": 0.0707552364894322, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.20311260904584613, "deviation-heading": 0.6770195697393842, "set_robot_commands": 0.10644855499267578, "deviation-center-line": 0.04265219444139913, "driven_lanedir_consec": 0.08793963819660533, "sim_compute_sim_state": 0.043222481863839285, "sim_compute_performance-ego": 0.0759413378579276, "sim_compute_robot_state-ego": 0.08462153162275042}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 0.6092368543831471, "sim_physics": 0.12734362267956292, "survival_time": 4.849999999999991, "driven_lanedir": 0.1330310659302567, "sim_render-ego": 0.06282128746976558, "in-drivable-lane": 2.4999999999999956, "agent_compute-ego": 0.17405343055725098, "deviation-heading": 1.861591190837513, "set_robot_commands": 0.09944561338916268, "deviation-center-line": 0.1514048711594804, "driven_lanedir_consec": 0.1330310659302567, "sim_compute_sim_state": 0.04012135623656597, "sim_compute_performance-ego": 0.07066983537575633, "sim_compute_robot_state-ego": 0.07713472966066341}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.14498335701010123, "sim_physics": 0.13068264722824097, "survival_time": 1.4000000000000006, "driven_lanedir": 0.09637292113606576, "sim_render-ego": 0.06851370845522199, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.1998793908527919, "deviation-heading": 0.7063054711865482, "set_robot_commands": 0.10505846568516322, "deviation-center-line": 0.09435088763517369, "driven_lanedir_consec": 0.09637292113606576, "sim_compute_sim_state": 0.041165871279580254, "sim_compute_performance-ego": 0.07871661867414202, "sim_compute_robot_state-ego": 0.08473847593579974}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 0.0942192754723097, "sim_physics": 0.1295236349105835, "survival_time": 1.1000000000000003, "driven_lanedir": 0.05030385364251888, "sim_render-ego": 0.06676142865961249, "in-drivable-lane": 0, "agent_compute-ego": 0.19022599133578216, "deviation-heading": 0.787840796128095, "set_robot_commands": 0.1002590764652599, "deviation-center-line": 0.09586119494752152, "driven_lanedir_consec": 0.05030385364251888, "sim_compute_sim_state": 0.0417557412927801, "sim_compute_performance-ego": 0.07523874803022905, "sim_compute_robot_state-ego": 0.078311410817233}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 0.14631599659371566, "sim_physics": 0.11783583236463142, "survival_time": 1.6500000000000008, "driven_lanedir": 0.04543172415020047, "sim_render-ego": 0.07021198128208969, "in-drivable-lane": 0.6000000000000005, "agent_compute-ego": 0.19453357927726975, "deviation-heading": 0.6648426487742866, "set_robot_commands": 0.11632066784483014, "deviation-center-line": 0.023549017889419675, "driven_lanedir_consec": 0.04543172415020047, "sim_compute_sim_state": 0.04343822508147269, "sim_compute_performance-ego": 0.07963588743498831, "sim_compute_robot_state-ego": 0.08860010089296283}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 0.11435124542483475, "sim_physics": 0.15427370693372644, "survival_time": 1.1500000000000004, "driven_lanedir": 0.06701304913181438, "sim_render-ego": 0.07365100280098293, "in-drivable-lane": 0, "agent_compute-ego": 0.20118567217951236, "deviation-heading": 0.684658155318171, "set_robot_commands": 0.11122360436812692, "deviation-center-line": 0.07751839086505545, "driven_lanedir_consec": 0.06701304913181438, "sim_compute_sim_state": 0.044907569885253906, "sim_compute_performance-ego": 0.07705089320307193, "sim_compute_robot_state-ego": 0.0849026286083719}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 0.12005511397303022, "sim_physics": 0.10614660511846127, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08278116845913164, "sim_render-ego": 0.05537564858146336, "in-drivable-lane": 0, "agent_compute-ego": 0.14418922299924103, "deviation-heading": 0.5633367177497764, "set_robot_commands": 0.08181699462558913, "deviation-center-line": 0.10002208208254458, "driven_lanedir_consec": 0.08278116845913164, "sim_compute_sim_state": 0.03445602499920389, "sim_compute_performance-ego": 0.05846028742582902, "sim_compute_robot_state-ego": 0.06060831443123195}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 0.12784094628636064, "sim_physics": 0.09682523352759224, "survival_time": 1.4000000000000006, "driven_lanedir": 0.02706466861226753, "sim_render-ego": 0.05843128476824079, "in-drivable-lane": 0.4500000000000003, "agent_compute-ego": 0.13970510448728288, "deviation-heading": 0.6171534354002799, "set_robot_commands": 0.07716939279011317, "deviation-center-line": 0.03703703756408782, "driven_lanedir_consec": 0.02706466861226753, "sim_compute_sim_state": 0.029405500207628523, "sim_compute_performance-ego": 0.0562437857900347, "sim_compute_robot_state-ego": 0.06071580307824271}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 0.212484942981729, "sim_physics": 0.08861150060381208, "survival_time": 1.7500000000000009, "driven_lanedir": 0.0831912276106549, "sim_render-ego": 0.045696585518973216, "in-drivable-lane": 0.5500000000000005, "agent_compute-ego": 0.12372433798653738, "deviation-heading": 0.6789325766001478, "set_robot_commands": 0.07119588170732771, "deviation-center-line": 0.046459134533844336, "driven_lanedir_consec": 0.0831912276106549, "sim_compute_sim_state": 0.03138839176722935, "sim_compute_performance-ego": 0.053108351571219306, "sim_compute_robot_state-ego": 0.056031445094517296}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 0.1521918440954359, "sim_physics": 0.09515479405721028, "survival_time": 1.5000000000000009, "driven_lanedir": 0.04177581611480363, "sim_render-ego": 0.04899452527364095, "in-drivable-lane": 0.5000000000000004, "agent_compute-ego": 0.1355080604553223, "deviation-heading": 0.6840021120895354, "set_robot_commands": 0.07291339238484701, "deviation-center-line": 0.02342982347810686, "driven_lanedir_consec": 0.04177581611480363, "sim_compute_sim_state": 0.03139924208323161, "sim_compute_performance-ego": 0.0593782901763916, "sim_compute_robot_state-ego": 0.06571266651153565}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 0.09808588736595354, "sim_physics": 0.0881920996166411, "survival_time": 1.0500000000000005, "driven_lanedir": 0.07145416669754967, "sim_render-ego": 0.051172279176257905, "in-drivable-lane": 0, "agent_compute-ego": 0.136745396114531, "deviation-heading": 0.4663953645878885, "set_robot_commands": 0.07329375403267997, "deviation-center-line": 0.10211871621984044, "driven_lanedir_consec": 0.07145416669754967, "sim_compute_sim_state": 0.0314989998227074, "sim_compute_performance-ego": 0.0565885929834275, "sim_compute_robot_state-ego": 0.06265541485377721}}
set_robot_commands_max0.11632066784483014
set_robot_commands_mean0.09431365937896576
set_robot_commands_median0.1002590764652599
set_robot_commands_min0.07119588170732771
sim_compute_performance-ego_max0.07963588743498831
sim_compute_performance-ego_mean0.06900241269673393
sim_compute_performance-ego_median0.0726465337416705
sim_compute_performance-ego_min0.053108351571219306
sim_compute_robot_state-ego_max0.08860010089296283
sim_compute_robot_state-ego_mean0.0756078683006842
sim_compute_robot_state-ego_median0.078311410817233
sim_compute_robot_state-ego_min0.056031445094517296
sim_compute_sim_state_max0.044907569885253906
sim_compute_sim_state_mean0.03818441526121566
sim_compute_sim_state_median0.04012135623656597
sim_compute_sim_state_min0.029405500207628523
sim_physics_max0.15427370693372644
sim_physics_mean0.12039913973091336
sim_physics_median0.12734362267956292
sim_physics_min0.0881920996166411
sim_render-ego_max0.07365100280098293
sim_render-ego_mean0.06239881411407153
sim_render-ego_median0.06538381997276754
sim_render-ego_min0.045696585518973216
simulation-passed1
survival_time_max4.849999999999991
survival_time_mean1.65
survival_time_min1.0000000000000002
No reset possible