Duckietown Challenges Home Challenges Submissions

Evaluator 2001

ID2001
evaluatorreg02-837a84a03856-1
ownerI don't have one πŸ˜€
machinearchimede
processreg02-837a84a03856-1
versiond-c:6.1.8;d-c-r:6.0.33
first heard
last heard
statusinactive
# evaluating
# success1 34877
# timeout1 34888
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
348889381Himanshu AroraΒ πŸ‡¨πŸ‡¦exercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutnoreg02-837a84a03856-11:05:49
I can see how the jo [...]
I can see how the job 34888 is timeout because passed 3949 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
348779395Jean-SΓ©bastien GrondinΒ πŸ‡¨πŸ‡¦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg02-837a84a03856-10:28:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8679990695985471
survival_time_median13.125000000000052
deviation-center-line_median0.39965267824303274
in-drivable-lane_median7.100000000000065


other stats
agent_compute-ego_max0.031285139822190805
agent_compute-ego_mean0.02994294386212608
agent_compute-ego_median0.030026570850727605
agent_compute-ego_min0.028682991436549597
complete-iteration_max0.33851543068885803
complete-iteration_mean0.3222608139524545
complete-iteration_median0.32524376781620945
complete-iteration_min0.30204798718716236
deviation-center-line_max0.5033500780306597
deviation-center-line_mean0.3683255135900486
deviation-center-line_min0.1784656052180912
deviation-heading_max3.303881743782677
deviation-heading_mean1.3050174694903065
deviation-heading_median0.9703839676806248
deviation-heading_min0.7685411153336741
driven_any_max3.855615359508263
driven_any_mean3.0008401837573997
driven_any_median3.14701347248001
driven_any_min1.730445729685241
driven_lanedir_consec_max2.5418836175658517
driven_lanedir_consec_mean1.7858000542752213
driven_lanedir_consec_min0.9820053745928222
driven_lanedir_max2.5418836175658517
driven_lanedir_mean1.7858000542752213
driven_lanedir_median1.8679990695985471
driven_lanedir_min0.9820053745928222
get_state_dump_max0.017352657933388988
get_state_dump_mean0.016836149979581928
get_state_dump_median0.01682801842689514
get_state_dump_min0.016345488516640323
get_ui_image_max0.07074242809362578
get_ui_image_mean0.06768427686650616
get_ui_image_median0.06894551118214926
get_ui_image_min0.06123653371283348
in-drivable-lane_max11.150000000000064
in-drivable-lane_mean5.705000000000048
in-drivable-lane_min0.7499999999999973
per-episodes
details{"ETHZ_autolab_technical_track-0-0-ego": {"driven_any": 1.730445729685241, "get_ui_image": 0.06977135327554518, "step_physics": 0.1459702407160113, "survival_time": 6.199999999999986, "driven_lanedir": 1.331566297688659, "get_state_dump": 0.017352657933388988, "sim_render-ego": 0.008953817429081086, "in-drivable-lane": 1.499999999999995, "agent_compute-ego": 0.031285139822190805, "deviation-heading": 0.8007699894844825, "complete-iteration": 0.3319324485717281, "set_robot_commands": 0.007041131296465474, "deviation-center-line": 0.1784656052180912, "driven_lanedir_consec": 1.331566297688659, "sim_compute_sim_state": 0.022863849516837828, "sim_compute_performance-ego": 0.006352232348534369, "sim_compute_robot_state-ego": 0.011494077021075834, "sim_compute_robot_state-parked0": 0.0106372102614372}, "ETHZ_autolab_technical_track-0-1-ego": {"driven_any": 2.618999060228688, "get_ui_image": 0.0630127021244594, "step_physics": 0.13073569901135504, "survival_time": 12.25000000000004, "driven_lanedir": 1.3718524867964017, "get_state_dump": 0.017322368037943937, "sim_render-ego": 0.009722889686117366, "in-drivable-lane": 7.05000000000005, "agent_compute-ego": 0.030574291579577383, "deviation-heading": 0.9796979143428092, "complete-iteration": 0.3103895936693464, "set_robot_commands": 0.006942043499070771, "deviation-center-line": 0.2519184041179318, "driven_lanedir_consec": 1.3718524867964017, "sim_compute_sim_state": 0.023004912356941062, "sim_compute_performance-ego": 0.006714383923277563, "sim_compute_robot_state-ego": 0.011010492091276207, "sim_compute_robot_state-parked0": 0.01113679263056541}, "ETHZ_autolab_technical_track-1-0-ego": {"driven_any": 2.89334178395861, "get_ui_image": 0.06716240559305464, "step_physics": 0.13652136240686688, "survival_time": 14.000000000000064, "driven_lanedir": 1.8925258505593008, "get_state_dump": 0.01646162101200649, "sim_render-ego": 0.009012181418282646, "in-drivable-lane": 7.15000000000008, "agent_compute-ego": 0.028682991436549597, "deviation-heading": 1.6374265125349554, "complete-iteration": 0.3131912248475211, "set_robot_commands": 0.006748907906668527, "deviation-center-line": 0.49033407557745146, "driven_lanedir_consec": 1.8925258505593008, "sim_compute_sim_state": 0.02165549567767552, "sim_compute_performance-ego": 0.006034010648727417, "sim_compute_robot_state-ego": 0.010408632244382586, "sim_compute_robot_state-parked0": 0.010291229827063424}, "ETHZ_autolab_technical_track-1-1-ego": {"driven_any": 2.898868978639255, "get_ui_image": 0.07074242809362578, "step_physics": 0.1455649919677199, "survival_time": 14.250000000000068, "driven_lanedir": 1.9003904426450369, "get_state_dump": 0.01638146534300687, "sim_render-ego": 0.00898416837056478, "in-drivable-lane": 7.2000000000000846, "agent_compute-ego": 0.028902945602149295, "deviation-heading": 1.6097744503740383, "complete-iteration": 0.3257153268446002, "set_robot_commands": 0.006297984039574339, "deviation-center-line": 0.47392687945202144, "driven_lanedir_consec": 1.9003904426450369, "sim_compute_sim_state": 0.02193684076008044, "sim_compute_performance-ego": 0.0059335114663107355, "sim_compute_robot_state-ego": 0.010972576810602557, "sim_compute_robot_state-parked0": 0.009791776590179978}, "ETHZ_autolab_technical_track-2-0-ego": {"driven_any": 3.855615359508263, "get_ui_image": 0.06761746486028035, "step_physics": 0.1511648956934611, "survival_time": 14.950000000000076, "driven_lanedir": 0.9820053745928222, "get_state_dump": 0.016718487739562988, "sim_render-ego": 0.008965360323588053, "in-drivable-lane": 11.150000000000064, "agent_compute-ego": 0.03049894730250041, "deviation-heading": 1.1676667988000249, "complete-iteration": 0.3278852152824402, "set_robot_commands": 0.006958463986714681, "deviation-center-line": 0.21578646205876084, "driven_lanedir_consec": 0.9820053745928222, "sim_compute_sim_state": 0.018792019685109455, "sim_compute_performance-ego": 0.006268616517384847, "sim_compute_robot_state-ego": 0.010312787691752116, "sim_compute_robot_state-parked0": 0.010384910901387531}, "ETHZ_autolab_technical_track-2-1-ego": {"driven_any": 3.518848104468749, "get_ui_image": 0.06960627476374308, "step_physics": 0.1488865327835083, "survival_time": 14.950000000000076, "driven_lanedir": 1.588387672363499, "get_state_dump": 0.016839990615844725, "sim_render-ego": 0.00913381576538086, "in-drivable-lane": 7.350000000000041, "agent_compute-ego": 0.030537071228027343, "deviation-heading": 3.303881743782677, "complete-iteration": 0.3267540899912516, "set_robot_commands": 0.006517046292622884, "deviation-center-line": 0.4813824689171572, "driven_lanedir_consec": 1.588387672363499, "sim_compute_sim_state": 0.01827898184458415, "sim_compute_performance-ego": 0.006050252119700114, "sim_compute_robot_state-ego": 0.010524510542551676, "sim_compute_robot_state-parked0": 0.010149041016896563}, "ETHZ_autolab_technical_track-3-0-ego": {"driven_any": 2.0932796838821193, "get_ui_image": 0.06965029765577878, "step_physics": 0.15560379098443425, "survival_time": 6.799999999999984, "driven_lanedir": 1.8434722886377937, "get_state_dump": 0.01714882780523861, "sim_render-ego": 0.009471677681979013, "in-drivable-lane": 0.7499999999999973, "agent_compute-ego": 0.029930035857593313, "deviation-heading": 0.7685411153336741, "complete-iteration": 0.33851543068885803, "set_robot_commands": 0.006785696043687708, "deviation-center-line": 0.28878580604234766, "driven_lanedir_consec": 1.8434722886377937, "sim_compute_sim_state": 0.02120112145648283, "sim_compute_performance-ego": 0.006467110970441033, "sim_compute_robot_state-ego": 0.011537283658981323, "sim_compute_robot_state-parked0": 0.010509441880618824}, "ETHZ_autolab_technical_track-3-1-ego": {"driven_any": 3.3951579663207654, "get_ui_image": 0.06828474760055542, "step_physics": 0.1420913855234782, "survival_time": 14.950000000000076, "driven_lanedir": 1.922834260893896, "get_state_dump": 0.016816046237945557, "sim_render-ego": 0.009058767954508464, "in-drivable-lane": 8.350000000000094, "agent_compute-ego": 0.030123105843861894, "deviation-heading": 0.8679397470616113, "complete-iteration": 0.3214046136538188, "set_robot_commands": 0.0065222024917602536, "deviation-center-line": 0.32650168472957775, "driven_lanedir_consec": 1.922834260893896, "sim_compute_sim_state": 0.021735050678253175, "sim_compute_performance-ego": 0.005949215888977051, "sim_compute_robot_state-ego": 0.01018438498179118, "sim_compute_robot_state-parked0": 0.010422112147013348}, "ETHZ_autolab_technical_track-4-0-ego": {"driven_any": 3.491069643046903, "get_ui_image": 0.06123653371283348, "step_physics": 0.1288050722568593, "survival_time": 11.750000000000032, "driven_lanedir": 2.5418836175658517, "get_state_dump": 0.016974546554240775, "sim_render-ego": 0.008884703859369805, "in-drivable-lane": 3.650000000000052, "agent_compute-ego": 0.029437591674480033, "deviation-heading": 0.9610700210184404, "complete-iteration": 0.30204798718716236, "set_robot_commands": 0.008789858919508915, "deviation-center-line": 0.47280367175648774, "driven_lanedir_consec": 2.5418836175658517, "sim_compute_sim_state": 0.02057755957258509, "sim_compute_performance-ego": 0.0059511509347469245, "sim_compute_robot_state-ego": 0.010799276067855511, "sim_compute_robot_state-parked0": 0.01036358691276388}, "ETHZ_autolab_technical_track-4-1-ego": {"driven_any": 3.512775527835402, "get_ui_image": 0.06975856098518553, "step_physics": 0.14567201284435688, "survival_time": 10.550000000000017, "driven_lanedir": 2.4830822510089505, "get_state_dump": 0.016345488516640323, "sim_render-ego": 0.008941366774210998, "in-drivable-lane": 2.900000000000034, "agent_compute-ego": 0.029457318274330752, "deviation-heading": 0.9534064021703512, "complete-iteration": 0.32477220878781865, "set_robot_commands": 0.006529179794528473, "deviation-center-line": 0.5033500780306597, "driven_lanedir_consec": 2.4830822510089505, "sim_compute_sim_state": 0.02128965707751812, "sim_compute_performance-ego": 0.0059175547830301435, "sim_compute_robot_state-ego": 0.01059828211345944, "sim_compute_robot_state-parked0": 0.01004115326144684}}
set_robot_commands_max0.008789858919508915
set_robot_commands_mean0.006913251427060202
set_robot_commands_median0.006767301975178117
set_robot_commands_min0.006297984039574339
sim_compute_performance-ego_max0.006714383923277563
sim_compute_performance-ego_mean0.006163803960113019
sim_compute_performance-ego_median0.006042131384213766
sim_compute_performance-ego_min0.0059175547830301435
sim_compute_robot_state-ego_max0.011537283658981323
sim_compute_robot_state-ego_mean0.010784230322372844
sim_compute_robot_state-ego_median0.010698779090657477
sim_compute_robot_state-ego_min0.01018438498179118
sim_compute_robot_state-parked0_max0.01113679263056541
sim_compute_robot_state-parked0_mean0.0103727255429373
sim_compute_robot_state-parked0_median0.010374248907075704
sim_compute_robot_state-parked0_min0.009791776590179978
sim_compute_sim_state_max0.023004912356941062
sim_compute_sim_state_mean0.02113354886260677
sim_compute_sim_state_median0.021472576377596825
sim_compute_sim_state_min0.01827898184458415
sim_render-ego_max0.009722889686117366
sim_render-ego_mean0.009112874926308306
sim_render-ego_median0.008998174894423713
sim_render-ego_min0.008884703859369805
simulation-passed1
step_physics_max0.15560379098443425
step_physics_mean0.14310159841880513
step_physics_median0.1456185024060384
step_physics_min0.1288050722568593
survival_time_max14.950000000000076
survival_time_mean12.065000000000042
survival_time_min6.199999999999986
No reset possible