Duckietown Challenges Home Challenges Submissions

Evaluator 1285

ID1285
evaluatoridsc-rudolf-22552
ownerAndrea Censi 🇨🇭
machineidsc-rudolf
processidsc-rudolf-22552
versiond-c:4.0.30;d-c-r:4.0.46;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success2 23296
# timeout
# failed
# error1 23177
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
233963630Nicky Eichmannaido2-LFV-sim-validationstep1-simulationsuccessyesidsc-rudolf-225520:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6697553564194623
survival_time_median3.349999999999996
deviation-center-line_median0.11803708647411268
in-drivable-lane_median0.9499999999999966


other stats
agent_compute-ego_max0.18058767318725585
agent_compute-ego_mean0.17490564622046953
agent_compute-ego_median0.17275383255698465
agent_compute-ego_min0.17224939545588708
deviation-center-line_max0.7050997986369949
deviation-center-line_mean0.21990920326959337
deviation-center-line_min0.06073337098493198
deviation-heading_max3.5583342715823916
deviation-heading_mean1.2071728976369187
deviation-heading_median0.3681641735309621
deviation-heading_min0.2638670899443274
driven_any_max1.9917929436501016
driven_any_mean1.103290804811177
driven_any_median1.071164067556717
driven_any_min0.400811386017316
driven_lanedir_consec_max1.2187176370157662
driven_lanedir_consec_mean0.7849129191719297
driven_lanedir_consec_min0.3869401393359331
driven_lanedir_max1.717299130581738
driven_lanedir_mean0.8918589022564589
driven_lanedir_median0.7059037782761359
driven_lanedir_min0.3869401393359331
in-drivable-lane_max1.4999999999999964
in-drivable-lane_mean0.7899999999999976
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.071164067556717, "sim_physics": 0.09442999958992004, "survival_time": 3.999999999999994, "driven_lanedir": 0.7059037782761359, "sim_render-ego": 0.0684639871120453, "in-drivable-lane": 1.4999999999999964, "agent_compute-ego": 0.1726982682943344, "deviation-heading": 1.5594336712201176, "set_robot_commands": 0.07820298969745636, "deviation-center-line": 0.13841141672710003, "driven_lanedir_consec": 0.6697553564194623, "sim_compute_sim_state": 0.04076630175113678, "sim_compute_performance-ego": 0.06917069554328918, "sim_compute_robot_state-ego": 0.06365440487861633, "sim_compute_robot_state-npc0": 0.07706875205039979, "sim_compute_robot_state-npc1": 0.07266047000885009, "sim_compute_robot_state-npc2": 0.07267039716243744, "sim_compute_robot_state-npc3": 0.07219386398792267}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4560705346067643, "sim_physics": 0.11325806921178644, "survival_time": 1.1000000000000003, "driven_lanedir": 0.4307715748231389, "sim_render-ego": 0.06847664442929355, "in-drivable-lane": 0, "agent_compute-ego": 0.17275383255698465, "deviation-heading": 0.3681641735309621, "set_robot_commands": 0.08853862502358177, "deviation-center-line": 0.07726434352482706, "driven_lanedir_consec": 0.4307715748231389, "sim_compute_sim_state": 0.04029524326324463, "sim_compute_performance-ego": 0.06834247979250821, "sim_compute_robot_state-ego": 0.06454446099021217, "sim_compute_robot_state-npc0": 0.08106755126606334, "sim_compute_robot_state-npc1": 0.07491458546031605, "sim_compute_robot_state-npc2": 0.07470127669247714, "sim_compute_robot_state-npc3": 0.0700051025910811}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5966150922249869, "sim_physics": 0.1071081517347649, "survival_time": 3.349999999999996, "driven_lanedir": 1.2183798882653485, "sim_render-ego": 0.070001901085697, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.17224939545588708, "deviation-heading": 0.28606528190679475, "set_robot_commands": 0.0793721818212253, "deviation-center-line": 0.11803708647411268, "driven_lanedir_consec": 1.2183798882653485, "sim_compute_sim_state": 0.04044235286427968, "sim_compute_performance-ego": 0.07198707025442551, "sim_compute_robot_state-ego": 0.0660894806705304, "sim_compute_robot_state-npc0": 0.08009220237162576, "sim_compute_robot_state-npc1": 0.0733889074467901, "sim_compute_robot_state-npc2": 0.07113947441328818, "sim_compute_robot_state-npc3": 0.06991042307953337}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.9917929436501016, "sim_physics": 0.09453286317290452, "survival_time": 9.45, "driven_lanedir": 1.717299130581738, "sim_render-ego": 0.0671016362609056, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.1762390616078856, "deviation-heading": 3.5583342715823916, "set_robot_commands": 0.07894541599132397, "deviation-center-line": 0.7050997986369949, "driven_lanedir_consec": 1.2187176370157662, "sim_compute_sim_state": 0.04100445086363132, "sim_compute_performance-ego": 0.06737674859465745, "sim_compute_robot_state-ego": 0.062496838746247466, "sim_compute_robot_state-npc0": 0.07587062618719838, "sim_compute_robot_state-npc1": 0.07204622944826802, "sim_compute_robot_state-npc2": 0.07331231031468306, "sim_compute_robot_state-npc3": 0.07180718265513264}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.400811386017316, "sim_physics": 0.09928131103515624, "survival_time": 1.0000000000000002, "driven_lanedir": 0.3869401393359331, "sim_render-ego": 0.07099443674087524, "in-drivable-lane": 0, "agent_compute-ego": 0.18058767318725585, "deviation-heading": 0.2638670899443274, "set_robot_commands": 0.08510829210281372, "deviation-center-line": 0.06073337098493198, "driven_lanedir_consec": 0.3869401393359331, "sim_compute_sim_state": 0.03882021903991699, "sim_compute_performance-ego": 0.0675205945968628, "sim_compute_robot_state-ego": 0.06500306129455566, "sim_compute_robot_state-npc0": 0.07853162288665771, "sim_compute_robot_state-npc1": 0.07182884216308594, "sim_compute_robot_state-npc2": 0.07141469717025757, "sim_compute_robot_state-npc3": 0.06684480905532837}}
set_robot_commands_max0.08853862502358177
set_robot_commands_mean0.08203350092728022
set_robot_commands_median0.0793721818212253
set_robot_commands_min0.07820298969745636
sim_compute_performance-ego_max0.07198707025442551
sim_compute_performance-ego_mean0.06887951775634862
sim_compute_performance-ego_median0.06834247979250821
sim_compute_performance-ego_min0.06737674859465745
sim_compute_robot_state-ego_max0.0660894806705304
sim_compute_robot_state-ego_mean0.06435764931603241
sim_compute_robot_state-ego_median0.06454446099021217
sim_compute_robot_state-ego_min0.062496838746247466
sim_compute_robot_state-npc0_max0.08106755126606334
sim_compute_robot_state-npc0_mean0.07852615095238899
sim_compute_robot_state-npc0_median0.07853162288665771
sim_compute_robot_state-npc0_min0.07587062618719838
sim_compute_robot_state-npc1_max0.07491458546031605
sim_compute_robot_state-npc1_mean0.07296780690546205
sim_compute_robot_state-npc1_median0.07266047000885009
sim_compute_robot_state-npc1_min0.07182884216308594
sim_compute_robot_state-npc2_max0.07470127669247714
sim_compute_robot_state-npc2_mean0.07264763115062867
sim_compute_robot_state-npc2_median0.07267039716243744
sim_compute_robot_state-npc2_min0.07113947441328818
sim_compute_robot_state-npc3_max0.07219386398792267
sim_compute_robot_state-npc3_mean0.07015227627379964
sim_compute_robot_state-npc3_median0.0700051025910811
sim_compute_robot_state-npc3_min0.06684480905532837
sim_compute_sim_state_max0.04100445086363132
sim_compute_sim_state_mean0.04026571355644189
sim_compute_sim_state_median0.04044235286427968
sim_compute_sim_state_min0.03882021903991699
sim_physics_max0.11325806921178644
sim_physics_mean0.10172207894890643
sim_physics_median0.09928131103515624
sim_physics_min0.09442999958992004
sim_render-ego_max0.07099443674087524
sim_render-ego_mean0.06900772112576334
sim_render-ego_median0.06847664442929355
sim_render-ego_min0.0671016362609056
simulation-passed1
survival_time_max9.45
survival_time_mean3.7799999999999985
survival_time_min1.0000000000000002
No reset possible
232963517Bea Baselines 🐤Straight maxaido2-LF-sim-validationstep1-simulationsuccessyesidsc-rudolf-225520:04:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6618324868125249
survival_time_median2.1000000000000005
deviation-center-line_median0.09250602665006584
in-drivable-lane_median0.09999999999999964


other stats
agent_compute-ego_max0.15860958894093832
agent_compute-ego_mean0.15174907196848314
agent_compute-ego_median0.15651166054510302
agent_compute-ego_min0.14084854012443906
deviation-center-line_max0.21439068356235536
deviation-center-line_mean0.12258369343422797
deviation-center-line_min0.0744010530149505
deviation-heading_max0.5686442582449269
deviation-heading_mean0.3103675930817716
deviation-heading_median0.25395078679676
deviation-heading_min0.17582209342949345
driven_any_max1.575892401948956
driven_any_mean0.8642098067399473
driven_any_median1.0038564958116647
driven_any_min0.26972689326339405
driven_lanedir_consec_max1.1723086623342591
driven_lanedir_consec_mean0.6830346826605466
driven_lanedir_consec_min0.2605911739016977
driven_lanedir_max1.1723086623342591
driven_lanedir_mean0.6830346826605466
driven_lanedir_median0.6618324868125249
driven_lanedir_min0.2605911739016977
in-drivable-lane_max0.6999999999999975
in-drivable-lane_mean0.2699999999999994
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0038564958116647, "sim_physics": 0.06039912360055106, "survival_time": 2.1000000000000005, "driven_lanedir": 0.6618324868125249, "sim_render-ego": 0.05620306446438744, "in-drivable-lane": 0.5499999999999998, "agent_compute-ego": 0.14084854012443906, "deviation-heading": 0.25395078679676, "set_robot_commands": 0.07673980508531843, "deviation-center-line": 0.09250602665006584, "driven_lanedir_consec": 0.6618324868125249, "sim_compute_sim_state": 0.03908932776678176, "sim_compute_performance-ego": 0.06151383263724191, "sim_compute_robot_state-ego": 0.06442335673740932}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 1.0061450567009285, "sim_physics": 0.06321352436428979, "survival_time": 2.1000000000000005, "driven_lanedir": 0.8764382022560809, "sim_render-ego": 0.06597480319795154, "in-drivable-lane": 0.09999999999999964, "agent_compute-ego": 0.15860958894093832, "deviation-heading": 0.5686442582449269, "set_robot_commands": 0.07984721660614014, "deviation-center-line": 0.1563855108175075, "driven_lanedir_consec": 0.8764382022560809, "sim_compute_sim_state": 0.04314823377700079, "sim_compute_performance-ego": 0.0717055740810576, "sim_compute_robot_state-ego": 0.06645831607636951}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.26972689326339405, "sim_physics": 0.06561347842216492, "survival_time": 0.8000000000000002, "driven_lanedir": 0.2605911739016977, "sim_render-ego": 0.06617455184459686, "in-drivable-lane": 0, "agent_compute-ego": 0.15858446061611176, "deviation-heading": 0.20274263769041717, "set_robot_commands": 0.08154873549938202, "deviation-center-line": 0.07523519312626054, "driven_lanedir_consec": 0.2605911739016977, "sim_compute_sim_state": 0.04395724833011627, "sim_compute_performance-ego": 0.07415281236171722, "sim_compute_robot_state-ego": 0.06549710035324097}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.4654281859747942, "sim_physics": 0.0636920514314071, "survival_time": 1.1500000000000004, "driven_lanedir": 0.4440028879981699, "sim_render-ego": 0.06113665000252102, "in-drivable-lane": 0, "agent_compute-ego": 0.1441911096158235, "deviation-heading": 0.3506781892472603, "set_robot_commands": 0.0774407905081044, "deviation-center-line": 0.0744010530149505, "driven_lanedir_consec": 0.4440028879981699, "sim_compute_sim_state": 0.03983344202456267, "sim_compute_performance-ego": 0.06415785913882048, "sim_compute_robot_state-ego": 0.06371092796325684}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.575892401948956, "sim_physics": 0.06214915167900824, "survival_time": 3.099999999999997, "driven_lanedir": 1.1723086623342591, "sim_render-ego": 0.06665011375181136, "in-drivable-lane": 0.6999999999999975, "agent_compute-ego": 0.15651166054510302, "deviation-heading": 0.17582209342949345, "set_robot_commands": 0.07991344313467702, "deviation-center-line": 0.21439068356235536, "driven_lanedir_consec": 1.1723086623342591, "sim_compute_sim_state": 0.04356543479427215, "sim_compute_performance-ego": 0.07000688968166228, "sim_compute_robot_state-ego": 0.06710800047843687}}
set_robot_commands_max0.08154873549938202
set_robot_commands_mean0.07909799816672439
set_robot_commands_median0.07984721660614014
set_robot_commands_min0.07673980508531843
sim_compute_performance-ego_max0.07415281236171722
sim_compute_performance-ego_mean0.0683073935800999
sim_compute_performance-ego_median0.07000688968166228
sim_compute_performance-ego_min0.06151383263724191
sim_compute_robot_state-ego_max0.06710800047843687
sim_compute_robot_state-ego_mean0.0654395403217427
sim_compute_robot_state-ego_median0.06549710035324097
sim_compute_robot_state-ego_min0.06371092796325684
sim_compute_sim_state_max0.04395724833011627
sim_compute_sim_state_mean0.04191873733854673
sim_compute_sim_state_median0.04314823377700079
sim_compute_sim_state_min0.03908932776678176
sim_physics_max0.06561347842216492
sim_physics_mean0.06301346589948423
sim_physics_median0.06321352436428979
sim_physics_min0.06039912360055106
sim_render-ego_max0.06665011375181136
sim_render-ego_mean0.06322783665225365
sim_render-ego_median0.06597480319795154
sim_render-ego_min0.05620306446438744
simulation-passed1
survival_time_max3.099999999999997
survival_time_mean1.8499999999999996
survival_time_min0.8000000000000002
No reset possible
231773576Bhairav Mehtachallenge-aido_LF-template-pytorchaido2-LFVI-sim-validationstep1-simulationerroryesidsc-rudolf-225520:00:50
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible