Duckietown Challenges Home Challenges Submissions

Evaluator 1123

ID1123
evaluatorip-172-31-42-167-7357
ownerI don't have one 😀
machineip-172-31-42-167
processip-172-31-42-167-7357
versiond-c:4.0.30;d-c-r:4.0.43;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success1 22216
# timeout
# failed
# error2 22178
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
222163512Bea Baselines 🐤challenge-aido_LF-template-pytorchaido2-LFVI-sim-testingstep1-simulationsuccessnoip-172-31-42-167-73570:11:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.10459988817779076
survival_time_median1.2500000000000004
deviation-center-line_median0.08198617130296416
in-drivable-lane_median0


other stats
agent_compute-ego_max0.16370738253873937
agent_compute-ego_mean0.11604000483200227
agent_compute-ego_median0.09686367988586424
agent_compute-ego_min0.09506011892248084
deviation-center-line_max0.10924155286368437
deviation-center-line_mean0.08097401153066475
deviation-center-line_min0.05221246870209155
deviation-heading_max1.0220526071494855
deviation-heading_mean0.7246109387930207
deviation-heading_median0.791329220604182
deviation-heading_min0.4715558520806974
driven_any_max0.3066041009992666
driven_any_mean0.17968201663748087
driven_any_median0.14853420880808135
driven_any_min0.10520680074175248
driven_lanedir_consec_max0.21054584860017211
driven_lanedir_consec_mean0.11294200023854344
driven_lanedir_consec_min0.03858853777353888
driven_lanedir_max0.21054584860017211
driven_lanedir_mean0.11294200023854344
driven_lanedir_median0.10459988817779076
driven_lanedir_min0.03858853777353888
in-drivable-lane_max0.7000000000000006
in-drivable-lane_mean0.10333333333333344
in-drivable-lane_min0
per-episodes
details{"udem1-0-0": {"driven_any": 0.2061393356043111, "sim_physics": 0.1968306097491034, "survival_time": 1.4500000000000006, "driven_lanedir": 0.1093933243045948, "sim_render-ego": 0.056772149842360925, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16249622969791808, "deviation-heading": 0.8916266179265397, "set_robot_commands": 0.09083792258953226, "deviation-center-line": 0.08198617130296416, "driven_lanedir_consec": 0.1093933243045948, "sim_compute_sim_state": 0.03499797294879782, "sim_compute_performance-ego": 0.0704524434846023, "sim_compute_robot_state-ego": 0.06768213469406655, "sim_compute_robot_state-npc0": 0.06710213628308527, "sim_compute_robot_state-npc1": 0.06774491277234308, "sim_compute_robot_state-npc2": 0.06539933434848128, "sim_compute_robot_state-npc3": 0.06235907817709035}, "udem1-1-0": {"driven_any": 0.19064466843891112, "sim_physics": 0.2118392271154067, "survival_time": 1.7000000000000008, "driven_lanedir": 0.03858853777353888, "sim_render-ego": 0.06213804553536808, "in-drivable-lane": 0.7000000000000006, "agent_compute-ego": 0.16370738253873937, "deviation-heading": 0.7985730003447992, "set_robot_commands": 0.090080226168913, "deviation-center-line": 0.05560696590176263, "driven_lanedir_consec": 0.03858853777353888, "sim_compute_sim_state": 0.06709611415863037, "sim_compute_performance-ego": 0.06825363636016846, "sim_compute_robot_state-ego": 0.07312987131230972, "sim_compute_robot_state-npc0": 0.06812849465538473, "sim_compute_robot_state-npc1": 0.06728273279526654, "sim_compute_robot_state-npc2": 0.06957721710205078, "sim_compute_robot_state-npc3": 0.06653613202712115}, "udem1-2-0": {"driven_any": 0.12571709780656612, "sim_physics": 0.25328631834550336, "survival_time": 1.1000000000000003, "driven_lanedir": 0.09639064578074176, "sim_render-ego": 0.05807252363725142, "in-drivable-lane": 0, "agent_compute-ego": 0.16351374712857333, "deviation-heading": 0.4715558520806974, "set_robot_commands": 0.09389431910081344, "deviation-center-line": 0.09518322121562102, "driven_lanedir_consec": 0.09639064578074176, "sim_compute_sim_state": 0.03720692071047696, "sim_compute_performance-ego": 0.06003708189184016, "sim_compute_robot_state-ego": 0.06785321235656738, "sim_compute_robot_state-npc0": 0.06299257278442383, "sim_compute_robot_state-npc1": 0.06421742656014183, "sim_compute_robot_state-npc2": 0.06792634183710272, "sim_compute_robot_state-npc3": 0.0658578330820257}, "udem1-3-0": {"driven_any": 0.13677662370031196, "sim_physics": 0.20073100794916568, "survival_time": 1.1500000000000004, "driven_lanedir": 0.10459988817779076, "sim_render-ego": 0.13220925953077234, "in-drivable-lane": 0, "agent_compute-ego": 0.1471183092697807, "deviation-heading": 0.4978218244758663, "set_robot_commands": 0.08329360381416652, "deviation-center-line": 0.09367424682551397, "driven_lanedir_consec": 0.10459988817779076, "sim_compute_sim_state": 0.04392160540041716, "sim_compute_performance-ego": 0.06326196504675824, "sim_compute_robot_state-ego": 0.06836293054663617, "sim_compute_robot_state-npc0": 0.06237699674523395, "sim_compute_robot_state-npc1": 0.06260078886280888, "sim_compute_robot_state-npc2": 0.062106298363727074, "sim_compute_robot_state-npc3": 0.061935227850209114}, "udem1-4-0": {"driven_any": 0.1386373235393724, "sim_physics": 0.13690119204313858, "survival_time": 1.1500000000000004, "driven_lanedir": 0.08307872313563958, "sim_render-ego": 0.045955170755800995, "in-drivable-lane": 0, "agent_compute-ego": 0.13737734504367993, "deviation-heading": 0.791329220604182, "set_robot_commands": 0.06887766589289127, "deviation-center-line": 0.05549852098321259, "driven_lanedir_consec": 0.08307872313563958, "sim_compute_sim_state": 0.02844544078992761, "sim_compute_performance-ego": 0.04835522693136464, "sim_compute_robot_state-ego": 0.05004354145215905, "sim_compute_robot_state-npc0": 0.05121587670367697, "sim_compute_robot_state-npc1": 0.05127066114674444, "sim_compute_robot_state-npc2": 0.05277021034904148, "sim_compute_robot_state-npc3": 0.050281586854354195}, "udem1-5-0": {"driven_any": 0.3066041009992666, "sim_physics": 0.11045256639138246, "survival_time": 1.950000000000001, "driven_lanedir": 0.21054584860017211, "sim_render-ego": 0.03665595176892403, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.1016077078305758, "deviation-heading": 1.0220526071494855, "set_robot_commands": 0.05549081166585287, "deviation-center-line": 0.10557570697308108, "driven_lanedir_consec": 0.21054584860017211, "sim_compute_sim_state": 0.0277251585935935, "sim_compute_performance-ego": 0.03971253297267816, "sim_compute_robot_state-ego": 0.04244260910229805, "sim_compute_robot_state-npc0": 0.042809174611018255, "sim_compute_robot_state-npc1": 0.04208117876297388, "sim_compute_robot_state-npc2": 0.04121910608731783, "sim_compute_robot_state-npc3": 0.041460177837274015}, "udem1-6-0": {"driven_any": 0.1336290106659497, "sim_physics": 0.12040694900180984, "survival_time": 1.1500000000000004, "driven_lanedir": 0.09459524912578, "sim_render-ego": 0.03502090080924656, "in-drivable-lane": 0, "agent_compute-ego": 0.09634263619132664, "deviation-heading": 0.6080160842239891, "set_robot_commands": 0.05353987735250722, "deviation-center-line": 0.08627661341925878, "driven_lanedir_consec": 0.09459524912578, "sim_compute_sim_state": 0.023686139479927395, "sim_compute_performance-ego": 0.037613816883253014, "sim_compute_robot_state-ego": 0.040066584296848465, "sim_compute_robot_state-npc0": 0.03914246351822563, "sim_compute_robot_state-npc1": 0.03844743189604386, "sim_compute_robot_state-npc2": 0.03838353571684464, "sim_compute_robot_state-npc3": 0.03872401817985203}, "udem1-7-0": {"driven_any": 0.20526442280458831, "sim_physics": 0.1082356387171252, "survival_time": 1.4500000000000006, "driven_lanedir": 0.16925620362922578, "sim_render-ego": 0.03601861000061035, "in-drivable-lane": 0, "agent_compute-ego": 0.09598901354033372, "deviation-heading": 0.6131482554883307, "set_robot_commands": 0.05408333087789601, "deviation-center-line": 0.10924155286368437, "driven_lanedir_consec": 0.16925620362922578, "sim_compute_sim_state": 0.022222708011495656, "sim_compute_performance-ego": 0.03773129397425158, "sim_compute_robot_state-ego": 0.03988269279743063, "sim_compute_robot_state-npc0": 0.03914659598778034, "sim_compute_robot_state-npc1": 0.03864407539367676, "sim_compute_robot_state-npc2": 0.038614486825877224, "sim_compute_robot_state-npc3": 0.03851539513160442}, "udem1-8-0": {"driven_any": 0.2491522066420832, "sim_physics": 0.1011769338087602, "survival_time": 1.6500000000000008, "driven_lanedir": 0.18576964178963884, "sim_render-ego": 0.035328041423450814, "in-drivable-lane": 0, "agent_compute-ego": 0.09513912056431624, "deviation-heading": 0.8417427538133422, "set_robot_commands": 0.05380343668388598, "deviation-center-line": 0.07442432845839116, "driven_lanedir_consec": 0.18576964178963884, "sim_compute_sim_state": 0.02229848774996671, "sim_compute_performance-ego": 0.03803271235841693, "sim_compute_robot_state-ego": 0.040042602654659386, "sim_compute_robot_state-npc0": 0.03956034689238577, "sim_compute_robot_state-npc1": 0.03892258441809452, "sim_compute_robot_state-npc2": 0.03883471633448745, "sim_compute_robot_state-npc3": 0.0390111966566606}, "udem1-9-0": {"driven_any": 0.14818387349299253, "sim_physics": 0.1212612533569336, "survival_time": 1.2500000000000004, "driven_lanedir": 0.0652874022210912, "sim_render-ego": 0.03710165023803711, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.09686367988586424, "deviation-heading": 0.8828440166126279, "set_robot_commands": 0.053651256561279295, "deviation-center-line": 0.05221246870209155, "driven_lanedir_consec": 0.0652874022210912, "sim_compute_sim_state": 0.022196569442749024, "sim_compute_performance-ego": 0.044720821380615235, "sim_compute_robot_state-ego": 0.04043967247009277, "sim_compute_robot_state-npc0": 0.0397842788696289, "sim_compute_robot_state-npc1": 0.03895364761352539, "sim_compute_robot_state-npc2": 0.03872625350952148, "sim_compute_robot_state-npc3": 0.03866581916809082}, "udem1-10-0": {"driven_any": 0.14611961644586574, "sim_physics": 0.11031455579011336, "survival_time": 1.1500000000000004, "driven_lanedir": 0.0764743864893862, "sim_render-ego": 0.03719612826471743, "in-drivable-lane": 0, "agent_compute-ego": 0.09760505220164424, "deviation-heading": 0.8875897246933527, "set_robot_commands": 0.05404853820800781, "deviation-center-line": 0.054339593565446744, "driven_lanedir_consec": 0.0764743864893862, "sim_compute_sim_state": 0.022580810215162193, "sim_compute_performance-ego": 0.03841917411140774, "sim_compute_robot_state-ego": 0.04066026729086171, "sim_compute_robot_state-npc0": 0.04025438557500425, "sim_compute_robot_state-npc1": 0.03961553780928902, "sim_compute_robot_state-npc2": 0.03916769442350968, "sim_compute_robot_state-npc3": 0.03915441554525624}, "udem1-11-0": {"driven_any": 0.14853420880808135, "sim_physics": 0.10541398958726364, "survival_time": 1.1000000000000003, "driven_lanedir": 0.11826771554807536, "sim_render-ego": 0.036323038014498626, "in-drivable-lane": 0, "agent_compute-ego": 0.09572942690415816, "deviation-heading": 0.5156614416415153, "set_robot_commands": 0.05387236855246804, "deviation-center-line": 0.10402030256814708, "driven_lanedir_consec": 0.11826771554807536, "sim_compute_sim_state": 0.0221902457150546, "sim_compute_performance-ego": 0.03774409944360906, "sim_compute_robot_state-ego": 0.04020903327248313, "sim_compute_robot_state-npc0": 0.03925997560674494, "sim_compute_robot_state-npc1": 0.03866324641487815, "sim_compute_robot_state-npc2": 0.038489829410206185, "sim_compute_robot_state-npc3": 0.03886168653314764}, "udem1-12-0": {"driven_any": 0.2694371893723746, "sim_physics": 0.11339358906996876, "survival_time": 1.900000000000001, "driven_lanedir": 0.13650648921776898, "sim_render-ego": 0.03640200589832507, "in-drivable-lane": 0.4500000000000004, "agent_compute-ego": 0.09618673199101498, "deviation-heading": 0.7979194472141691, "set_robot_commands": 0.0573881237130416, "deviation-center-line": 0.07752656468341859, "driven_lanedir_consec": 0.13650648921776898, "sim_compute_sim_state": 0.02205230687793933, "sim_compute_performance-ego": 0.03763634907571893, "sim_compute_robot_state-ego": 0.04022147780970523, "sim_compute_robot_state-npc0": 0.03911257417578446, "sim_compute_robot_state-npc1": 0.03856789438348067, "sim_compute_robot_state-npc2": 0.03842452952736303, "sim_compute_robot_state-npc3": 0.038325686203806025}, "udem1-13-0": {"driven_any": 0.10520680074175248, "sim_physics": 0.11299814780553182, "survival_time": 1.2000000000000004, "driven_lanedir": 0.05731553298705094, "sim_render-ego": 0.03636536995569865, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.09586357076962788, "deviation-heading": 0.6200372253449831, "set_robot_commands": 0.053735315799713135, "deviation-center-line": 0.07774652251308359, "driven_lanedir_consec": 0.05731553298705094, "sim_compute_sim_state": 0.02192748586336772, "sim_compute_performance-ego": 0.03780160347620646, "sim_compute_robot_state-ego": 0.03995202978452047, "sim_compute_robot_state-npc0": 0.04044029116630554, "sim_compute_robot_state-npc1": 0.03858985503514608, "sim_compute_robot_state-npc2": 0.03839914997418722, "sim_compute_robot_state-npc3": 0.038494100173314415}, "udem1-14-0": {"driven_any": 0.18518377049978615, "sim_physics": 0.10678602147985387, "survival_time": 1.3500000000000003, "driven_lanedir": 0.1480604147976563, "sim_render-ego": 0.035269207424587674, "in-drivable-lane": 0, "agent_compute-ego": 0.09506011892248084, "deviation-heading": 0.62924601028143, "set_robot_commands": 0.05379860489456742, "deviation-center-line": 0.09129739298429394, "driven_lanedir_consec": 0.1480604147976563, "sim_compute_sim_state": 0.022288013387609412, "sim_compute_performance-ego": 0.037929932276407875, "sim_compute_robot_state-ego": 0.04020660011856644, "sim_compute_robot_state-npc0": 0.03976143731011285, "sim_compute_robot_state-npc1": 0.03866586861787019, "sim_compute_robot_state-npc2": 0.03854772779676649, "sim_compute_robot_state-npc3": 0.038789042720088256}}
set_robot_commands_max0.09389431910081344
set_robot_commands_mean0.06469302679170238
set_robot_commands_median0.05408333087789601
set_robot_commands_min0.05353987735250722
sim_compute_performance-ego_max0.0704524434846023
sim_compute_performance-ego_mean0.046513512644486575
sim_compute_performance-ego_median0.03841917411140774
sim_compute_performance-ego_min0.037613816883253014
sim_compute_robot_state-ego_max0.07312987131230972
sim_compute_robot_state-ego_mean0.048746350663947016
sim_compute_robot_state-ego_median0.04043967247009277
sim_compute_robot_state-ego_min0.03988269279743063
sim_compute_robot_state-npc0_max0.06812849465538473
sim_compute_robot_state-npc0_mean0.04740584005898638
sim_compute_robot_state-npc0_median0.04025438557500425
sim_compute_robot_state-npc0_min0.03911257417578446
sim_compute_robot_state-npc1_max0.06774491277234308
sim_compute_robot_state-npc1_mean0.0469511894988189
sim_compute_robot_state-npc1_median0.03895364761352539
sim_compute_robot_state-npc1_min0.03844743189604386
sim_compute_robot_state-npc2_max0.06957721710205078
sim_compute_robot_state-npc2_mean0.04710576210709897
sim_compute_robot_state-npc2_median0.03883471633448745
sim_compute_robot_state-npc2_min0.03838353571684464
sim_compute_robot_state-npc3_max0.06653613202712115
sim_compute_robot_state-npc3_mean0.04646475974265966
sim_compute_robot_state-npc3_median0.0390111966566606
sim_compute_robot_state-npc3_min0.038325686203806025
sim_compute_sim_state_max0.06709611415863037
sim_compute_sim_state_mean0.029389065289674363
sim_compute_sim_state_median0.022580810215162193
sim_compute_sim_state_min0.02192748586336772
sim_physics_max0.25328631834550336
sim_physics_mean0.14066853334740406
sim_physics_median0.11339358906996876
sim_physics_min0.1011769338087602
sim_render-ego_max0.13220925953077234
sim_render-ego_mean0.04778853687331001
sim_render-ego_median0.03665595176892403
sim_render-ego_min0.03502090080924656
simulation-passed1
survival_time_max1.950000000000001
survival_time_mean1.3800000000000006
survival_time_min1.1000000000000003
No reset possible
221973504jiang pengFourth test - THaido2-LF-sim-testingstep1-simulationerrornoip-172-31-42-167-73570:18:02
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
221783492Julian ZillyBaseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationerrornoip-172-31-42-167-73570:21:14
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible