Duckietown Challenges Home Challenges Submissions

Evaluator 1186

ID1186
evaluatorduckietown8-15759
ownerMerlin Hosner 🇨🇭
machineduckietown8
processduckietown8-15759
versiond-c:4.0.30;d-c-r:4.0.44;d-s:4.0.22
first heard
last heard
statusinactive
# evaluating
# success2 22283
# timeout1 22300
# failed
# error1 22298
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
223003432jiang pengRL-TH-shiaido2-LFV-sim-testingstep1-simulationtimeoutyesduckietown8-157591:05:19
I can see how the jo [...]
I can see how the job 22300 is timeout because passed 3919 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
222983435jiang pengRL - TH -hhkaido2-LFV-sim-validationstep1-simulationerroryesduckietown8-157590:00:39
The container "solut [...]
The container "solution" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
222913440jiang pengRL-TH-HHKaido2-LFV-sim-validationstep1-simulationsuccessyesduckietown8-157590:10:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.213581474327012
survival_time_median4.199999999999993
deviation-center-line_median0.2212214159268125
in-drivable-lane_median1.149999999999996


other stats
agent_compute-ego_max0.08729323075742138
agent_compute-ego_mean0.08576013259300079
agent_compute-ego_median0.0855875015258789
agent_compute-ego_min0.0845805449451474
deviation-center-line_max1.1563679141778311
deviation-center-line_mean0.3908693364247616
deviation-center-line_min0.1200892648670204
deviation-heading_max4.682935013433236
deviation-heading_mean1.5275018244371137
deviation-heading_median0.6389061495485021
deviation-heading_min0.4909391431294219
driven_any_max4.1570985210032685
driven_any_mean1.9653956646330364
driven_any_median1.5830457032422869
driven_any_min1.0017788844774846
driven_lanedir_consec_max3.874265157041772
driven_lanedir_consec_mean1.6322814352380308
driven_lanedir_consec_min0.6692125674725906
driven_lanedir_max3.874265157041772
driven_lanedir_mean1.6406425317935132
driven_lanedir_median1.2197124202562306
driven_lanedir_min0.6692125674725906
in-drivable-lane_max2.9499999999999895
in-drivable-lane_mean1.409999999999998
in-drivable-lane_min0.6999999999999984
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 1.0017788844774846, "sim_physics": 0.05980594790711695, "survival_time": 2.4499999999999993, "driven_lanedir": 0.6692125674725906, "sim_render-ego": 0.03423647977867905, "in-drivable-lane": 0.6999999999999984, "agent_compute-ego": 0.08729323075742138, "deviation-heading": 0.4909391431294219, "set_robot_commands": 0.05194089364032356, "deviation-center-line": 0.1200892648670204, "driven_lanedir_consec": 0.6692125674725906, "sim_compute_sim_state": 0.02138974228683783, "sim_compute_performance-ego": 0.03706628449109136, "sim_compute_robot_state-ego": 0.038754667554582865, "sim_compute_robot_state-npc0": 0.038154631244892975, "sim_compute_robot_state-npc1": 0.038267286456361106, "sim_compute_robot_state-npc2": 0.03774339812142508, "sim_compute_robot_state-npc3": 0.03790279797145298}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 4.1570985210032685, "sim_physics": 0.061126569112141926, "survival_time": 14.950000000000076, "driven_lanedir": 3.874265157041772, "sim_render-ego": 0.03311473290125529, "in-drivable-lane": 1.15000000000001, "agent_compute-ego": 0.08550948063532511, "deviation-heading": 4.682935013433236, "set_robot_commands": 0.05105496327082316, "deviation-center-line": 1.1563679141778311, "driven_lanedir_consec": 3.874265157041772, "sim_compute_sim_state": 0.020921545028686525, "sim_compute_performance-ego": 0.035987282594045, "sim_compute_robot_state-ego": 0.03766167004903158, "sim_compute_robot_state-npc0": 0.03736667156219482, "sim_compute_robot_state-npc1": 0.03740831295649211, "sim_compute_robot_state-npc2": 0.037254201571146645, "sim_compute_robot_state-npc3": 0.037302698294321694}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.5844971994231345, "sim_physics": 0.06456215123096144, "survival_time": 4.149999999999993, "driven_lanedir": 1.2197124202562306, "sim_render-ego": 0.03299518378384142, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.0855875015258789, "deviation-heading": 0.6389061495485021, "set_robot_commands": 0.05104677361178111, "deviation-center-line": 0.2212214159268125, "driven_lanedir_consec": 1.2197124202562306, "sim_compute_sim_state": 0.02104071823947401, "sim_compute_performance-ego": 0.036174110619418595, "sim_compute_robot_state-ego": 0.03778143675930529, "sim_compute_robot_state-npc0": 0.03750283746834261, "sim_compute_robot_state-npc1": 0.03725274212389107, "sim_compute_robot_state-npc2": 0.03707101833389466, "sim_compute_robot_state-npc3": 0.03745044570371329}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5830457032422869, "sim_physics": 0.06507529247374762, "survival_time": 4.199999999999993, "driven_lanedir": 1.213581474327012, "sim_render-ego": 0.03313259567533221, "in-drivable-lane": 1.149999999999996, "agent_compute-ego": 0.08582990510123116, "deviation-heading": 0.6142648858949371, "set_robot_commands": 0.05162917432330903, "deviation-center-line": 0.2122098198401324, "driven_lanedir_consec": 1.213581474327012, "sim_compute_sim_state": 0.021159594967251737, "sim_compute_performance-ego": 0.036350102651686894, "sim_compute_robot_state-ego": 0.03921857334318615, "sim_compute_robot_state-npc0": 0.03766916479383196, "sim_compute_robot_state-npc1": 0.037524359566824775, "sim_compute_robot_state-npc2": 0.03720548323222569, "sim_compute_robot_state-npc3": 0.03739015545163836}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.5005580150190063, "sim_physics": 0.05795242460511571, "survival_time": 6.949999999999983, "driven_lanedir": 1.22644103986996, "sim_render-ego": 0.03254376383994123, "in-drivable-lane": 2.9499999999999895, "agent_compute-ego": 0.0845805449451474, "deviation-heading": 1.2104639301794693, "set_robot_commands": 0.05042506979523803, "deviation-center-line": 0.24445826731201203, "driven_lanedir_consec": 1.1846355570925484, "sim_compute_sim_state": 0.02045830548238411, "sim_compute_performance-ego": 0.035529899940216284, "sim_compute_robot_state-ego": 0.03710314352735341, "sim_compute_robot_state-npc0": 0.036634160460328025, "sim_compute_robot_state-npc1": 0.03654543615931229, "sim_compute_robot_state-npc2": 0.03637492570945685, "sim_compute_robot_state-npc3": 0.03649235800873461}}
set_robot_commands_max0.05194089364032356
set_robot_commands_mean0.05121937492829498
set_robot_commands_median0.05105496327082316
set_robot_commands_min0.05042506979523803
sim_compute_performance-ego_max0.03706628449109136
sim_compute_performance-ego_mean0.036221536059291626
sim_compute_performance-ego_median0.036174110619418595
sim_compute_performance-ego_min0.035529899940216284
sim_compute_robot_state-ego_max0.03921857334318615
sim_compute_robot_state-ego_mean0.03810389824669186
sim_compute_robot_state-ego_median0.03778143675930529
sim_compute_robot_state-ego_min0.03710314352735341
sim_compute_robot_state-npc0_max0.038154631244892975
sim_compute_robot_state-npc0_mean0.03746549310591808
sim_compute_robot_state-npc0_median0.03750283746834261
sim_compute_robot_state-npc0_min0.036634160460328025
sim_compute_robot_state-npc1_max0.038267286456361106
sim_compute_robot_state-npc1_mean0.03739962745257627
sim_compute_robot_state-npc1_median0.03740831295649211
sim_compute_robot_state-npc1_min0.03654543615931229
sim_compute_robot_state-npc2_max0.03774339812142508
sim_compute_robot_state-npc2_mean0.03712980539362978
sim_compute_robot_state-npc2_median0.03720548323222569
sim_compute_robot_state-npc2_min0.03637492570945685
sim_compute_robot_state-npc3_max0.03790279797145298
sim_compute_robot_state-npc3_mean0.03730769108597219
sim_compute_robot_state-npc3_median0.03739015545163836
sim_compute_robot_state-npc3_min0.03649235800873461
sim_compute_sim_state_max0.02138974228683783
sim_compute_sim_state_mean0.020993981200926843
sim_compute_sim_state_median0.02104071823947401
sim_compute_sim_state_min0.02045830548238411
sim_physics_max0.06507529247374762
sim_physics_mean0.06170447706581672
sim_physics_median0.061126569112141926
sim_physics_min0.05795242460511571
sim_render-ego_max0.03423647977867905
sim_render-ego_mean0.03320455119580984
sim_render-ego_median0.03311473290125529
sim_render-ego_min0.03254376383994123
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean6.540000000000009
survival_time_min2.4499999999999993
No reset possible
222833448Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido2-LF-sim-validationstep1-simulationsuccessyesduckietown8-157591 day, 3:42:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1054767918804727
survival_time_median14.950000000000076
deviation-center-line_median0.6368700797510509
in-drivable-lane_median0


other stats
agent_compute-ego_max0.17128475983937583
agent_compute-ego_mean0.10684907937897108
agent_compute-ego_median0.09591128691187444
agent_compute-ego_min0.09514841000239056
deviation-center-line_max1.1725801557350437
deviation-center-line_mean0.6247127650112592
deviation-center-line_min0.24037006310525605
deviation-heading_max3.083514773352064
deviation-heading_mean1.7011223903346706
deviation-heading_median1.885095710028569
deviation-heading_min0.526847085529488
driven_any_max3.429899438304978
driven_any_mean2.8411416720908154
driven_any_median3.157020300772783
driven_any_min0.5499703561706337
driven_lanedir_consec_max3.409573278006486
driven_lanedir_consec_mean2.801410317086225
driven_lanedir_consec_min0.5391501556323677
driven_lanedir_max3.409573278006486
driven_lanedir_mean2.801410317086225
driven_lanedir_median3.1054767918804727
driven_lanedir_min0.5391501556323677
in-drivable-lane_max0
in-drivable-lane_mean0
in-drivable-lane_min0
per-episodes
details{"ETHZ_autolab_technical_track-0-0": {"driven_any": 2.946989784013802, "sim_physics": 0.1274096934000651, "survival_time": 14.950000000000076, "driven_lanedir": 2.8573393405881293, "sim_render-ego": 0.06752412796020507, "in-drivable-lane": 0, "agent_compute-ego": 0.16690353711446126, "deviation-heading": 3.083514773352064, "set_robot_commands": 0.1023535680770874, "deviation-center-line": 1.1725801557350437, "driven_lanedir_consec": 2.8573393405881293, "sim_compute_sim_state": 0.042724469502766926, "sim_compute_performance-ego": 0.07509642759958902, "sim_compute_robot_state-ego": 0.07974256197611491}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 3.4214864327530448, "sim_physics": 0.12428930521011353, "survival_time": 14.950000000000076, "driven_lanedir": 3.405684981625878, "sim_render-ego": 0.06745935360590617, "in-drivable-lane": 0, "agent_compute-ego": 0.17128475983937583, "deviation-heading": 1.010173240804668, "set_robot_commands": 0.10439166148503622, "deviation-center-line": 0.43584578368260574, "driven_lanedir_consec": 3.405684981625878, "sim_compute_sim_state": 0.04180120309193929, "sim_compute_performance-ego": 0.07449536879857381, "sim_compute_robot_state-ego": 0.08116747617721558}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 3.2014127292682173, "sim_physics": 0.07716922283172607, "survival_time": 14.950000000000076, "driven_lanedir": 3.157026572725775, "sim_render-ego": 0.04716493368148804, "in-drivable-lane": 0, "agent_compute-ego": 0.11592944701512654, "deviation-heading": 1.885095710028569, "set_robot_commands": 0.06976659615834555, "deviation-center-line": 0.7062382124099905, "driven_lanedir_consec": 3.157026572725775, "sim_compute_sim_state": 0.03055707772572835, "sim_compute_performance-ego": 0.051611227989196776, "sim_compute_robot_state-ego": 0.05457792441050212}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 3.048875935460903, "sim_physics": 0.0611607559521993, "survival_time": 14.950000000000076, "driven_lanedir": 2.993080340570904, "sim_render-ego": 0.04048048098882039, "in-drivable-lane": 0, "agent_compute-ego": 0.09611120780309042, "deviation-heading": 2.415223571587466, "set_robot_commands": 0.05786315441131592, "deviation-center-line": 0.8784493315170965, "driven_lanedir_consec": 2.993080340570904, "sim_compute_sim_state": 0.02571134885152181, "sim_compute_performance-ego": 0.04370256741841634, "sim_compute_robot_state-ego": 0.04490844249725342}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 1.1367495208895286, "sim_physics": 0.0618686743502347, "survival_time": 5.299999999999989, "driven_lanedir": 1.124425193641727, "sim_render-ego": 0.03977611829649727, "in-drivable-lane": 0, "agent_compute-ego": 0.09591128691187444, "deviation-heading": 0.6197289013477634, "set_robot_commands": 0.05918571409189476, "deviation-center-line": 0.2987466691413625, "driven_lanedir_consec": 1.124425193641727, "sim_compute_sim_state": 0.02632957359529891, "sim_compute_performance-ego": 0.04287507623996375, "sim_compute_robot_state-ego": 0.04485066881719625}, "ETHZ_autolab_technical_track-5-0": {"driven_any": 3.164169707973641, "sim_physics": 0.0587759002049764, "survival_time": 14.950000000000076, "driven_lanedir": 3.1175678845163604, "sim_render-ego": 0.03928969303766886, "in-drivable-lane": 0, "agent_compute-ego": 0.09514841000239056, "deviation-heading": 2.1767995655090093, "set_robot_commands": 0.05817336638768514, "deviation-center-line": 0.5887498553410936, "driven_lanedir_consec": 3.1175678845163604, "sim_compute_sim_state": 0.02585083802541097, "sim_compute_performance-ego": 0.043118093808492026, "sim_compute_robot_state-ego": 0.044756767749786375}, "ETHZ_autolab_technical_track-6-0": {"driven_any": 0.5499703561706337, "sim_physics": 0.061675449212392174, "survival_time": 2.9999999999999973, "driven_lanedir": 0.5391501556323677, "sim_render-ego": 0.039519290129343666, "in-drivable-lane": 0, "agent_compute-ego": 0.09547667900721232, "deviation-heading": 0.526847085529488, "set_robot_commands": 0.05853833357493083, "deviation-center-line": 0.24037006310525605, "driven_lanedir_consec": 0.5391501556323677, "sim_compute_sim_state": 0.025682965914408367, "sim_compute_performance-ego": 0.04254041910171509, "sim_compute_robot_state-ego": 0.04413243929545085}, "ETHZ_autolab_technical_track-7-0": {"driven_any": 2.890515998132187, "sim_physics": 0.06453575293223063, "survival_time": 14.950000000000076, "driven_lanedir": 2.80731713727596, "sim_render-ego": 0.04022880554199219, "in-drivable-lane": 0, "agent_compute-ego": 0.09607118050257366, "deviation-heading": 3.0253987561070375, "set_robot_commands": 0.060079754988352455, "deviation-center-line": 0.7269365376998013, "driven_lanedir_consec": 2.80731713727596, "sim_compute_sim_state": 0.025759557882944744, "sim_compute_performance-ego": 0.04306537389755249, "sim_compute_robot_state-ego": 0.04484654664993286}, "ETHZ_autolab_technical_track-8-0": {"driven_any": 3.429899438304978, "sim_physics": 0.06009437719980876, "survival_time": 14.950000000000076, "driven_lanedir": 3.409573278006486, "sim_render-ego": 0.03962947050730387, "in-drivable-lane": 0, "agent_compute-ego": 0.09552997430165608, "deviation-heading": 1.0604809258350585, "set_robot_commands": 0.05841925144195557, "deviation-center-line": 0.5324348530925754, "driven_lanedir_consec": 3.409573278006486, "sim_compute_sim_state": 0.025874354044596353, "sim_compute_performance-ego": 0.04331104914347331, "sim_compute_robot_state-ego": 0.04485904534657796}, "ETHZ_autolab_technical_track-9-0": {"driven_any": 2.5499415630960263, "sim_physics": 0.05939065576090244, "survival_time": 12.150000000000038, "driven_lanedir": 2.4967602621434706, "sim_render-ego": 0.0396499300199281, "in-drivable-lane": 0, "agent_compute-ego": 0.09519679654282306, "deviation-heading": 1.931756137512324, "set_robot_commands": 0.057710852642608765, "deviation-center-line": 0.6368700797510509, "driven_lanedir_consec": 2.4967602621434706, "sim_compute_sim_state": 0.0256942181920809, "sim_compute_performance-ego": 0.04317865352081173, "sim_compute_robot_state-ego": 0.04469170099423255}, "ETHZ_autolab_technical_track-10-0": {"driven_any": 3.157020300772783, "sim_physics": 0.06301899035771688, "survival_time": 14.950000000000076, "driven_lanedir": 3.1054767918804727, "sim_render-ego": 0.03950116952260335, "in-drivable-lane": 0, "agent_compute-ego": 0.09543752908706664, "deviation-heading": 2.031333721583158, "set_robot_commands": 0.05845202684402466, "deviation-center-line": 0.8283781239526454, "driven_lanedir_consec": 3.1054767918804727, "sim_compute_sim_state": 0.025891847610473633, "sim_compute_performance-ego": 0.043355374336242675, "sim_compute_robot_state-ego": 0.04513093471527099}, "ETHZ_autolab_technical_track-11-0": {"driven_any": 2.909701024979874, "sim_physics": 0.06337373812993367, "survival_time": 14.950000000000076, "driven_lanedir": 2.8538661972434713, "sim_render-ego": 0.040884753863016765, "in-drivable-lane": 0, "agent_compute-ego": 0.09623003880182902, "deviation-heading": 2.447757362424258, "set_robot_commands": 0.05812087138493856, "deviation-center-line": 0.9002133281087871, "driven_lanedir_consec": 2.8538661972434713, "sim_compute_sim_state": 0.026127827962239582, "sim_compute_performance-ego": 0.04591467459996541, "sim_compute_robot_state-ego": 0.04528462966283162}, "ETHZ_autolab_technical_track-12-0": {"driven_any": 3.410171810380965, "sim_physics": 0.06444537242253622, "survival_time": 14.950000000000076, "driven_lanedir": 3.392071475566552, "sim_render-ego": 0.03982738653818766, "in-drivable-lane": 0, "agent_compute-ego": 0.09537845849990843, "deviation-heading": 1.0411190575129576, "set_robot_commands": 0.05754936933517456, "deviation-center-line": 0.4906636064235661, "driven_lanedir_consec": 3.392071475566552, "sim_compute_sim_state": 0.0260644006729126, "sim_compute_performance-ego": 0.04355477809906006, "sim_compute_robot_state-ego": 0.044606568018595374}, "ETHZ_autolab_technical_track-13-0": {"driven_any": 3.378626550165139, "sim_physics": 0.06057475725809733, "survival_time": 14.950000000000076, "driven_lanedir": 3.3603532881872353, "sim_render-ego": 0.04061487197875977, "in-drivable-lane": 0, "agent_compute-ego": 0.09649069627126058, "deviation-heading": 1.1286948755381812, "set_robot_commands": 0.05803788423538208, "deviation-center-line": 0.28338048309757197, "driven_lanedir_consec": 3.3603532881872353, "sim_compute_sim_state": 0.02625463088353475, "sim_compute_performance-ego": 0.0445382301012675, "sim_compute_robot_state-ego": 0.0454819122950236}, "ETHZ_autolab_technical_track-14-0": {"driven_any": 3.4215939290005077, "sim_physics": 0.06366650104522704, "survival_time": 14.950000000000076, "driven_lanedir": 3.401461856688594, "sim_render-ego": 0.040263587633768715, "in-drivable-lane": 0, "agent_compute-ego": 0.09563618898391724, "deviation-heading": 1.1329121703480571, "set_robot_commands": 0.05871462106704712, "deviation-center-line": 0.6508343921104421, "driven_lanedir_consec": 3.401461856688594, "sim_compute_sim_state": 0.026481758753458658, "sim_compute_performance-ego": 0.04351771116256714, "sim_compute_robot_state-ego": 0.04545921723047893}}
set_robot_commands_max0.10439166148503622
set_robot_commands_mean0.06515713507505197
set_robot_commands_median0.05845202684402466
set_robot_commands_min0.05754936933517456
sim_compute_performance-ego_max0.07509642759958902
sim_compute_performance-ego_mean0.04825833505445914
sim_compute_performance-ego_median0.04351771116256714
sim_compute_performance-ego_min0.04254041910171509
sim_compute_robot_state-ego_max0.08116747617721558
sim_compute_robot_state-ego_mean0.05029978905576424
sim_compute_robot_state-ego_median0.04490844249725342
sim_compute_robot_state-ego_min0.04413243929545085
sim_compute_sim_state_max0.042724469502766926
sim_compute_sim_state_mean0.02845373818062106
sim_compute_sim_state_median0.0260644006729126
sim_compute_sim_state_min0.025682965914408367
sim_physics_max0.1274096934000651
sim_physics_mean0.07142994308454402
sim_physics_median0.06301899035771688
sim_physics_min0.0587759002049764
sim_render-ego_max0.06752412796020507
sim_render-ego_mean0.044120931553699325
sim_render-ego_median0.04022880554199219
sim_render-ego_min0.03928969303766886
simulation-passed1
survival_time_max14.950000000000076
survival_time_mean13.323333333333396
survival_time_min2.9999999999999973
No reset possible