Duckietown Challenges Home Challenges Submissions

Evaluator 810

ID810
evaluatoridsc-rudolf-11810
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-11810
versiond-c:4.0.18;d-c-r:4.0.28;d-s:4.0.18
first heard
last heard
statusinactive
# evaluating
# success2 20648
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
206593075Julian ZillyBaseline-IL-logs-tensorflowaido2-LFV-sim-validationstep1-simulationsuccessnoidsc-rudolf-118100:21:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.62825365434436
survival_time_median10.90000000000002
deviation-center-line_median0.5383496962749421
in-drivable-lane_median3.6500000000000377


other stats
agent_compute-ego_max0.21835227886835737
agent_compute-ego_mean0.20982794345676709
agent_compute-ego_median0.20713894591372237
agent_compute-ego_min0.19948284341654648
deviation-center-line_max0.610536052348644
deviation-center-line_mean0.532022942195918
deviation-center-line_min0.4265911055808853
deviation-heading_max1.6572896225144285
deviation-heading_mean1.3813957362611615
deviation-heading_median1.5531518937036917
deviation-heading_min1.0303319227322478
driven_any_max1.3765018953118209
driven_any_mean0.9552524629604058
driven_any_median0.9928431655679152
driven_any_min0.5125069003185156
driven_lanedir_consec_max0.8160152537926844
driven_lanedir_consec_mean0.650049914599654
driven_lanedir_consec_min0.4987776919144906
driven_lanedir_max0.8160152537926844
driven_lanedir_mean0.650049914599654
driven_lanedir_median0.62825365434436
driven_lanedir_min0.4987776919144906
in-drivable-lane_max5.9500000000000846
in-drivable-lane_mean3.080000000000041
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9928431655679152, "sim_physics": 0.09666339082455416, "survival_time": 10.90000000000002, "driven_lanedir": 0.62825365434436, "sim_render-ego": 0.06077380792810282, "in-drivable-lane": 3.6500000000000377, "agent_compute-ego": 0.19948284341654648, "deviation-heading": 1.0303319227322478, "set_robot_commands": 0.07902377461074689, "deviation-center-line": 0.5383496962749421, "driven_lanedir_consec": 0.62825365434436, "sim_compute_sim_state": 0.03609483832613044, "sim_compute_performance-ego": 0.06320520387877018, "sim_compute_robot_state-ego": 0.06310408268499812, "sim_compute_robot_state-npc0": 0.07331418881722547, "sim_compute_robot_state-npc1": 0.06650391303071189, "sim_compute_robot_state-npc2": 0.06444855895611125, "sim_compute_robot_state-npc3": 0.06458430662067659}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.5192316224192188, "sim_physics": 0.10064364294720513, "survival_time": 5.849999999999987, "driven_lanedir": 0.4987776919144906, "sim_render-ego": 0.06200823213300134, "in-drivable-lane": 0, "agent_compute-ego": 0.20713894591372237, "deviation-heading": 1.6572896225144285, "set_robot_commands": 0.0791976859426906, "deviation-center-line": 0.4265911055808853, "driven_lanedir_consec": 0.4987776919144906, "sim_compute_sim_state": 0.03811859676980565, "sim_compute_performance-ego": 0.06504947507483327, "sim_compute_robot_state-ego": 0.06697264288225745, "sim_compute_robot_state-npc0": 0.07608886050362872, "sim_compute_robot_state-npc1": 0.07148971720638438, "sim_compute_robot_state-npc2": 0.06994393748095912, "sim_compute_robot_state-npc3": 0.06990700705438598}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.3751787311845587, "sim_physics": 0.10493722120920818, "survival_time": 14.950000000000076, "driven_lanedir": 0.8160152537926844, "sim_render-ego": 0.06242331345876058, "in-drivable-lane": 5.800000000000082, "agent_compute-ego": 0.20632354497909547, "deviation-heading": 1.5847484454377836, "set_robot_commands": 0.08021897713343303, "deviation-center-line": 0.610536052348644, "driven_lanedir_consec": 0.8160152537926844, "sim_compute_sim_state": 0.03746363957722982, "sim_compute_performance-ego": 0.06615347226460774, "sim_compute_robot_state-ego": 0.06540518601735433, "sim_compute_robot_state-npc0": 0.07441074848175049, "sim_compute_robot_state-npc1": 0.06934692939122518, "sim_compute_robot_state-npc2": 0.06691924095153809, "sim_compute_robot_state-npc3": 0.06701240460077922}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.3765018953118209, "sim_physics": 0.10700823783874512, "survival_time": 14.950000000000076, "driven_lanedir": 0.8034968651903132, "sim_render-ego": 0.06638237158457438, "in-drivable-lane": 5.9500000000000846, "agent_compute-ego": 0.21835227886835737, "deviation-heading": 1.5531518937036917, "set_robot_commands": 0.0804934827486674, "deviation-center-line": 0.5976505477178015, "driven_lanedir_consec": 0.8034968651903132, "sim_compute_sim_state": 0.03981062332789103, "sim_compute_performance-ego": 0.06876101970672607, "sim_compute_robot_state-ego": 0.06673359870910645, "sim_compute_robot_state-npc0": 0.0772067681948344, "sim_compute_robot_state-npc1": 0.07271943251291911, "sim_compute_robot_state-npc2": 0.07261386156082153, "sim_compute_robot_state-npc3": 0.07173490444819132}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.5125069003185156, "sim_physics": 0.0919457612366512, "survival_time": 5.799999999999987, "driven_lanedir": 0.5037061077564218, "sim_render-ego": 0.06623248396248653, "in-drivable-lane": 0, "agent_compute-ego": 0.21784210410611385, "deviation-heading": 1.0814567969176556, "set_robot_commands": 0.07929034274199913, "deviation-center-line": 0.4869873090573166, "driven_lanedir_consec": 0.5037061077564218, "sim_compute_sim_state": 0.040244252517305575, "sim_compute_performance-ego": 0.06706355563525496, "sim_compute_robot_state-ego": 0.06661369677247672, "sim_compute_robot_state-npc0": 0.07819120020701967, "sim_compute_robot_state-npc1": 0.07235702358443162, "sim_compute_robot_state-npc2": 0.07099690930596714, "sim_compute_robot_state-npc3": 0.06999239633823263}}
set_robot_commands_max0.0804934827486674
set_robot_commands_mean0.07964485263550741
set_robot_commands_median0.07929034274199913
set_robot_commands_min0.07902377461074689
sim_compute_performance-ego_max0.06876101970672607
sim_compute_performance-ego_mean0.06604654531203845
sim_compute_performance-ego_median0.06615347226460774
sim_compute_performance-ego_min0.06320520387877018
sim_compute_robot_state-ego_max0.06697264288225745
sim_compute_robot_state-ego_mean0.06576584141323863
sim_compute_robot_state-ego_median0.06661369677247672
sim_compute_robot_state-ego_min0.06310408268499812
sim_compute_robot_state-npc0_max0.07819120020701967
sim_compute_robot_state-npc0_mean0.07584235324089175
sim_compute_robot_state-npc0_median0.07608886050362872
sim_compute_robot_state-npc0_min0.07331418881722547
sim_compute_robot_state-npc1_max0.07271943251291911
sim_compute_robot_state-npc1_mean0.07048340314513443
sim_compute_robot_state-npc1_median0.07148971720638438
sim_compute_robot_state-npc1_min0.06650391303071189
sim_compute_robot_state-npc2_max0.07261386156082153
sim_compute_robot_state-npc2_mean0.06898450165107942
sim_compute_robot_state-npc2_median0.06994393748095912
sim_compute_robot_state-npc2_min0.06444855895611125
sim_compute_robot_state-npc3_max0.07173490444819132
sim_compute_robot_state-npc3_mean0.06864620381245315
sim_compute_robot_state-npc3_median0.06990700705438598
sim_compute_robot_state-npc3_min0.06458430662067659
sim_compute_sim_state_max0.040244252517305575
sim_compute_sim_state_mean0.0383463901036725
sim_compute_sim_state_median0.03811859676980565
sim_compute_sim_state_min0.03609483832613044
sim_physics_max0.10700823783874512
sim_physics_mean0.10023965081127276
sim_physics_median0.10064364294720513
sim_physics_min0.0919457612366512
sim_render-ego_max0.06638237158457438
sim_render-ego_mean0.06356404181338512
sim_render-ego_median0.06242331345876058
sim_render-ego_min0.06077380792810282
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.49000000000003
survival_time_min5.799999999999987
No reset possible
206483065Angel Woo 🇭🇰Baseline-IL-logs-tensorflowaido2-LF-sim-validationstep1-simulationsuccessnoidsc-rudolf-118100:15:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6623749762212874
survival_time_median12.750000000000046
deviation-center-line_median0.5788750360184303
in-drivable-lane_median0


other stats
agent_compute-ego_max0.20900447745072215
agent_compute-ego_mean0.20275907053338857
agent_compute-ego_median0.2054780391084046
agent_compute-ego_min0.19300666730850935
deviation-center-line_max0.9239127276613286
deviation-center-line_mean0.6213378988325248
deviation-center-line_min0.4193869889866216
deviation-heading_max3.765426729681934
deviation-heading_mean2.301179798304013
deviation-heading_median1.8225408827426393
deviation-heading_min0.8428756741421708
driven_any_max1.2015076002730527
driven_any_mean0.7899787868062503
driven_any_median0.9959595714153124
driven_any_min0.2778629397321094
driven_lanedir_consec_max1.176784079644766
driven_lanedir_consec_mean0.6775635573377883
driven_lanedir_consec_min0.2709337447301774
driven_lanedir_max1.176784079644766
driven_lanedir_mean0.6775635573377883
driven_lanedir_median0.6623749762212874
driven_lanedir_min0.2709337447301774
in-drivable-lane_max3.2000000000000455
in-drivable-lane_mean0.8700000000000123
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0154356183950053, "sim_physics": 0.059852433390915394, "survival_time": 12.800000000000049, "driven_lanedir": 0.6623749762212874, "sim_render-ego": 0.05849688407033682, "in-drivable-lane": 3.2000000000000455, "agent_compute-ego": 0.19300666730850935, "deviation-heading": 3.765426729681934, "set_robot_commands": 0.0769646568223834, "deviation-center-line": 0.5788750360184303, "driven_lanedir_consec": 0.6623749762212874, "sim_compute_sim_state": 0.04050634428858757, "sim_compute_performance-ego": 0.06252545304596424, "sim_compute_robot_state-ego": 0.06214663106948137}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.9959595714153124, "sim_physics": 0.060721539516074986, "survival_time": 12.750000000000046, "driven_lanedir": 0.8400191161964898, "sim_render-ego": 0.05794808537352319, "in-drivable-lane": 1.1500000000000163, "agent_compute-ego": 0.19852222180834003, "deviation-heading": 3.2579686676560446, "set_robot_commands": 0.07798485849417892, "deviation-center-line": 0.9239127276613286, "driven_lanedir_consec": 0.8400191161964898, "sim_compute_sim_state": 0.04113006778791839, "sim_compute_performance-ego": 0.06270426488390156, "sim_compute_robot_state-ego": 0.06256399248160568}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.2778629397321094, "sim_physics": 0.0519793661017167, "survival_time": 3.7999999999999945, "driven_lanedir": 0.2709337447301774, "sim_render-ego": 0.06151763702693738, "in-drivable-lane": 0, "agent_compute-ego": 0.20900447745072215, "deviation-heading": 0.8428756741421708, "set_robot_commands": 0.08383670292402569, "deviation-center-line": 0.4193869889866216, "driven_lanedir_consec": 0.2709337447301774, "sim_compute_sim_state": 0.04326695517489785, "sim_compute_performance-ego": 0.06388886037625764, "sim_compute_robot_state-ego": 0.06690643335643567}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.45912820421577255, "sim_physics": 0.059263932604749665, "survival_time": 5.949999999999987, "driven_lanedir": 0.4377058698962206, "sim_render-ego": 0.06007902161413882, "in-drivable-lane": 0, "agent_compute-ego": 0.2054780391084046, "deviation-heading": 1.817087037297275, "set_robot_commands": 0.0788849722437498, "deviation-center-line": 0.4414992567500641, "driven_lanedir_consec": 0.4377058698962206, "sim_compute_sim_state": 0.04164769268837296, "sim_compute_performance-ego": 0.06332101541406968, "sim_compute_robot_state-ego": 0.06537546229963544}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.2015076002730527, "sim_physics": 0.06574804147084554, "survival_time": 14.950000000000076, "driven_lanedir": 1.176784079644766, "sim_render-ego": 0.05953415314356486, "in-drivable-lane": 0, "agent_compute-ego": 0.2077839469909668, "deviation-heading": 1.8225408827426393, "set_robot_commands": 0.07810805797576904, "deviation-center-line": 0.7430154847461793, "driven_lanedir_consec": 1.176784079644766, "sim_compute_sim_state": 0.0419665265083313, "sim_compute_performance-ego": 0.06405635674794515, "sim_compute_robot_state-ego": 0.06396676143010457}}
set_robot_commands_max0.08383670292402569
set_robot_commands_mean0.07915584969202136
set_robot_commands_median0.07810805797576904
set_robot_commands_min0.0769646568223834
sim_compute_performance-ego_max0.06405635674794515
sim_compute_performance-ego_mean0.06329919009362764
sim_compute_performance-ego_median0.06332101541406968
sim_compute_performance-ego_min0.06252545304596424
sim_compute_robot_state-ego_max0.06690643335643567
sim_compute_robot_state-ego_mean0.06419185612745255
sim_compute_robot_state-ego_median0.06396676143010457
sim_compute_robot_state-ego_min0.06214663106948137
sim_compute_sim_state_max0.04326695517489785
sim_compute_sim_state_mean0.041703517289621614
sim_compute_sim_state_median0.04164769268837296
sim_compute_sim_state_min0.04050634428858757
sim_physics_max0.06574804147084554
sim_physics_mean0.05951306261686044
sim_physics_median0.059852433390915394
sim_physics_min0.0519793661017167
sim_render-ego_max0.06151763702693738
sim_render-ego_mean0.05951515624570022
sim_render-ego_median0.05953415314356486
sim_render-ego_min0.05794808537352319
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean10.050000000000033
survival_time_min3.7999999999999945
No reset possible