Duckietown Challenges Home Challenges Submissions

Evaluator 2129

ID2129
evaluatorreg05-7d9c5d9f1ec5-1
ownerI don't have one 😀
machinearchimede
processreg05-7d9c5d9f1ec5-1
versiond-c:6.1.19;d-c-r:6.0.48
first heard
last heard
statusinactive
# evaluating
# success3 36598
# timeout
# failed
# error
# aborted1 36607
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job ID
submission
user
user label
challenge
step
status
up to date
evaluator
date started
date completed
duration
message
3660710070Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simabortednoreg05-7d9c5d9f1ec5-11:05:09
I can see how the jo [...]
I can see how the job 36607 is timeout because passed 3909 seconds and the timeout is 3600.0.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3660510068Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:07:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5401566734749028
survival_time_median7.774999999999988
deviation-center-line_median0.17505480074998286
in-drivable-lane_median2.275


other stats
agent_compute-ego_max0.030294862123999265
agent_compute-ego_mean0.02953513876623242
agent_compute-ego_median0.02952362592437858
agent_compute-ego_min0.02879844109217326
complete-iteration_max0.26574349536576086
complete-iteration_mean0.26245303164489325
complete-iteration_median0.26465363474962345
complete-iteration_min0.25476136171456537
deviation-center-line_max0.1981192188755881
deviation-center-line_mean0.175687457709551
deviation-center-line_min0.1545210104626502
deviation-heading_max1.9442716806711475
deviation-heading_mean1.0411916304714437
deviation-heading_median0.7969149372146536
deviation-heading_min0.6266649667853205
driven_any_max2.461170967898272
driven_any_mean1.94594133645685
driven_any_median1.9341015088278843
driven_any_min1.4543913602733587
driven_lanedir_consec_max1.95418082743537
driven_lanedir_consec_mean1.3814975516005663
driven_lanedir_consec_min0.4914960320170894
driven_lanedir_max1.95418082743537
driven_lanedir_mean1.3814975516005663
driven_lanedir_median1.5401566734749028
driven_lanedir_min0.4914960320170894
get_state_dump_max0.020144021156990884
get_state_dump_mean0.019236245351768735
get_state_dump_median0.01910827773182813
get_state_dump_min0.018584404786427818
get_ui_image_max0.04719053300399354
get_ui_image_mean0.04615769599886128
get_ui_image_median0.04638018181221713
get_ui_image_min0.04467988736701734
in-drivable-lane_max11.45000000000008
in-drivable-lane_mean4.225000000000019
in-drivable-lane_min0.8999999999999968
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.4543913602733587, "get_ui_image": 0.0460847014247781, "step_physics": 0.0974372637153852, "survival_time": 5.04999999999999, "driven_lanedir": 1.225848071831245, "get_state_dump": 0.020144021156990884, "sim_render-ego": 0.009765015970362296, "in-drivable-lane": 0.8999999999999968, "agent_compute-ego": 0.030294862123999265, "deviation-heading": 0.6266649667853205, "complete-iteration": 0.2655381117716874, "set_robot_commands": 0.00860253891142288, "deviation-center-line": 0.1545210104626502, "driven_lanedir_consec": 1.225848071831245, "sim_compute_sim_state": 0.021077632904052734, "sim_compute_performance-ego": 0.0068981151769656945, "sim_compute_robot_state-ego": 0.012785366266080648, "sim_compute_robot_state-parked0": 0.012206077575683594}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 2.461170967898272, "get_ui_image": 0.04719053300399354, "step_physics": 0.10014113633992286, "survival_time": 8.949999999999992, "driven_lanedir": 1.95418082743537, "get_state_dump": 0.019210747500371668, "sim_render-ego": 0.009538213633958188, "in-drivable-lane": 3.4500000000000037, "agent_compute-ego": 0.029307039090374996, "deviation-heading": 0.695716716220106, "complete-iteration": 0.26574349536576086, "set_robot_commands": 0.008003633115544665, "deviation-center-line": 0.16550666369538505, "driven_lanedir_consec": 1.95418082743537, "sim_compute_sim_state": 0.021278100306761333, "sim_compute_performance-ego": 0.0067202951655041575, "sim_compute_robot_state-ego": 0.012179717005298124, "sim_compute_robot_state-parked0": 0.011939782670090318}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 1.7654197472374928, "get_ui_image": 0.046675662199656166, "step_physics": 0.1055172570546468, "survival_time": 14.950000000000076, "driven_lanedir": 0.4914960320170894, "get_state_dump": 0.018584404786427818, "sim_render-ego": 0.009621522426605224, "in-drivable-lane": 11.45000000000008, "agent_compute-ego": 0.02974021275838216, "deviation-heading": 1.9442716806711475, "complete-iteration": 0.26376915772755943, "set_robot_commands": 0.0075935777028401695, "deviation-center-line": 0.1981192188755881, "driven_lanedir_consec": 0.4914960320170894, "sim_compute_sim_state": 0.016165221532185872, "sim_compute_performance-ego": 0.006511882940928141, "sim_compute_robot_state-ego": 0.011644496122996012, "sim_compute_robot_state-parked0": 0.011485856374104816}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.102783270418276, "get_ui_image": 0.04467988736701734, "step_physics": 0.0969388647512956, "survival_time": 6.5999999999999845, "driven_lanedir": 1.8544652751185609, "get_state_dump": 0.01900580796328458, "sim_render-ego": 0.009179725791468763, "in-drivable-lane": 1.099999999999996, "agent_compute-ego": 0.02879844109217326, "deviation-heading": 0.898113158209201, "complete-iteration": 0.25476136171456537, "set_robot_commands": 0.007110281424088912, "deviation-center-line": 0.18460293780458073, "driven_lanedir_consec": 1.8544652751185609, "sim_compute_sim_state": 0.02033428531704527, "sim_compute_performance-ego": 0.00618592898050944, "sim_compute_robot_state-ego": 0.011039222731734768, "sim_compute_robot_state-parked0": 0.011253400282426312}}
set_robot_commands_max0.00860253891142288
set_robot_commands_mean0.007827507788474157
set_robot_commands_median0.007798605409192418
set_robot_commands_min0.007110281424088912
sim_compute_performance-ego_max0.0068981151769656945
sim_compute_performance-ego_mean0.006579055565976859
sim_compute_performance-ego_median0.006616089053216149
sim_compute_performance-ego_min0.00618592898050944
sim_compute_robot_state-ego_max0.012785366266080648
sim_compute_robot_state-ego_mean0.01191220053152739
sim_compute_robot_state-ego_median0.011912106564147068
sim_compute_robot_state-ego_min0.011039222731734768
sim_compute_robot_state-parked0_max0.012206077575683594
sim_compute_robot_state-parked0_mean0.011721279225576262
sim_compute_robot_state-parked0_median0.011712819522097568
sim_compute_robot_state-parked0_min0.011253400282426312
sim_compute_sim_state_max0.021278100306761333
sim_compute_sim_state_mean0.019713810015011303
sim_compute_sim_state_median0.020705959110549003
sim_compute_sim_state_min0.016165221532185872
sim_render-ego_max0.009765015970362296
sim_render-ego_mean0.009526119455598616
sim_render-ego_median0.009579868030281706
sim_render-ego_min0.009179725791468763
simulation-passed1
step_physics_max0.1055172570546468
step_physics_mean0.10000863046531262
step_physics_median0.09878920002765404
step_physics_min0.0969388647512956
survival_time_max14.950000000000076
survival_time_mean8.887500000000012
survival_time_min5.04999999999999
No reset possible
3660310067Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:06:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3201041170781167
survival_time_median6.999999999999987
deviation-center-line_median0.18124515302744704
in-drivable-lane_median1.849999999999997


other stats
agent_compute-ego_max0.030189741452534995
agent_compute-ego_mean0.029557323679395484
agent_compute-ego_median0.029981057395672733
agent_compute-ego_min0.028077438473701477
complete-iteration_max0.26759843431280916
complete-iteration_mean0.25820559457800774
complete-iteration_median0.25978735030234396
complete-iteration_min0.24564924339453376
deviation-center-line_max0.3113700084462948
deviation-center-line_mean0.19835458141608792
deviation-center-line_min0.11955801116316286
deviation-heading_max2.1471453582917923
deviation-heading_mean0.9580226683612956
deviation-heading_median0.6455730672589013
deviation-heading_min0.3937991806355874
driven_any_max5.105156858680236
driven_any_mean2.6159252944241733
driven_any_median2.319165190569241
driven_any_min0.7202139378779755
driven_lanedir_consec_max1.977350384011632
driven_lanedir_consec_mean1.2610403789606706
driven_lanedir_consec_min0.426602897674817
driven_lanedir_max1.977350384011632
driven_lanedir_mean1.2646287784154635
driven_lanedir_median1.3272809159877033
driven_lanedir_min0.426602897674817
get_state_dump_max0.02025361533637519
get_state_dump_mean0.01930653801756129
get_state_dump_median0.01934677277561241
get_state_dump_min0.01827899118264516
get_ui_image_max0.0455292559958793
get_ui_image_mean0.04492314971340408
get_ui_image_median0.04484671500542695
get_ui_image_min0.04446991284688314
in-drivable-lane_max9.950000000000038
in-drivable-lane_mean3.612500000000008
in-drivable-lane_min0.7999999999999987
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.8042135600243256, "get_ui_image": 0.0455292559958793, "step_physics": 0.09415628673794034, "survival_time": 5.549999999999988, "driven_lanedir": 1.2982714225729937, "get_state_dump": 0.02025361533637519, "sim_render-ego": 0.00973740783897606, "in-drivable-lane": 1.3499999999999952, "agent_compute-ego": 0.030007658778010187, "deviation-heading": 0.5544058641780637, "complete-iteration": 0.2602064716923344, "set_robot_commands": 0.007969280620952984, "deviation-center-line": 0.12922955043815046, "driven_lanedir_consec": 1.2982714225729937, "sim_compute_sim_state": 0.021372290344925614, "sim_compute_performance-ego": 0.006876958383096231, "sim_compute_robot_state-ego": 0.012372622618804108, "sim_compute_robot_state-parked0": 0.011689280604456996}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.7202139378779755, "get_ui_image": 0.04446991284688314, "step_physics": 0.09424730638662976, "survival_time": 2.3999999999999995, "driven_lanedir": 0.426602897674817, "get_state_dump": 0.01827899118264516, "sim_render-ego": 0.009286954998970032, "in-drivable-lane": 0.7999999999999987, "agent_compute-ego": 0.028077438473701477, "deviation-heading": 0.3937991806355874, "complete-iteration": 0.24564924339453376, "set_robot_commands": 0.006509636839230855, "deviation-center-line": 0.11955801116316286, "driven_lanedir_consec": 0.426602897674817, "sim_compute_sim_state": 0.0176332692305247, "sim_compute_performance-ego": 0.00601223607858022, "sim_compute_robot_state-ego": 0.010046372810999552, "sim_compute_robot_state-parked0": 0.010857199629147848}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 5.105156858680236, "get_ui_image": 0.044610570271809896, "step_physics": 0.09827264149983723, "survival_time": 14.950000000000076, "driven_lanedir": 1.3562904094024129, "get_state_dump": 0.018870815436045327, "sim_render-ego": 0.009440622329711911, "in-drivable-lane": 9.950000000000038, "agent_compute-ego": 0.030189741452534995, "deviation-heading": 2.1471453582917923, "complete-iteration": 0.2593682289123535, "set_robot_commands": 0.007648693720499675, "deviation-center-line": 0.3113700084462948, "driven_lanedir_consec": 1.3419368115832395, "sim_compute_sim_state": 0.01991595983505249, "sim_compute_performance-ego": 0.006460481484731038, "sim_compute_robot_state-ego": 0.012105937004089356, "sim_compute_robot_state-parked0": 0.011619447867075602}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8341168211141565, "get_ui_image": 0.04508285973904401, "step_physics": 0.1051441776681934, "survival_time": 8.449999999999985, "driven_lanedir": 1.977350384011632, "get_state_dump": 0.01982273011517948, "sim_render-ego": 0.009506205835285976, "in-drivable-lane": 2.3499999999999988, "agent_compute-ego": 0.02995445601333528, "deviation-heading": 0.736740270339739, "complete-iteration": 0.26759843431280916, "set_robot_commands": 0.007258272735324837, "deviation-center-line": 0.23326075561674364, "driven_lanedir_consec": 1.977350384011632, "sim_compute_sim_state": 0.021321425071129434, "sim_compute_performance-ego": 0.0064098891421888, "sim_compute_robot_state-ego": 0.01139107540514342, "sim_compute_robot_state-parked0": 0.011462725125826322}}
set_robot_commands_max0.007969280620952984
set_robot_commands_mean0.007346470979002088
set_robot_commands_median0.007453483227912255
set_robot_commands_min0.006509636839230855
sim_compute_performance-ego_max0.006876958383096231
sim_compute_performance-ego_mean0.006439891272149072
sim_compute_performance-ego_median0.006435185313459919
sim_compute_performance-ego_min0.00601223607858022
sim_compute_robot_state-ego_max0.012372622618804108
sim_compute_robot_state-ego_mean0.011479001959759108
sim_compute_robot_state-ego_median0.011748506204616389
sim_compute_robot_state-ego_min0.010046372810999552
sim_compute_robot_state-parked0_max0.011689280604456996
sim_compute_robot_state-parked0_mean0.011407163306626692
sim_compute_robot_state-parked0_median0.011541086496450964
sim_compute_robot_state-parked0_min0.010857199629147848
sim_compute_sim_state_max0.021372290344925614
sim_compute_sim_state_mean0.02006073612040806
sim_compute_sim_state_median0.02061869245309096
sim_compute_sim_state_min0.0176332692305247
sim_render-ego_max0.00973740783897606
sim_render-ego_mean0.009492797750735997
sim_render-ego_median0.009473414082498945
sim_render-ego_min0.009286954998970032
simulation-passed1
step_physics_max0.1051441776681934
step_physics_mean0.09795510307315018
step_physics_median0.09625997394323348
step_physics_min0.09415628673794034
survival_time_max14.950000000000076
survival_time_mean7.837500000000013
survival_time_min2.3999999999999995
No reset possible
3659810064Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg05-7d9c5d9f1ec5-10:10:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2520551569686083
survival_time_median14.950000000000076
deviation-center-line_median0.35999322616783147
in-drivable-lane_median4.775000000000068


other stats
agent_compute-ego_max0.02992616891860962
agent_compute-ego_mean0.028561083475748695
agent_compute-ego_median0.028608987331390383
agent_compute-ego_min0.02710019032160441
complete-iteration_max0.2701600249608358
complete-iteration_mean0.2628622223933538
complete-iteration_median0.26212354222933454
complete-iteration_min0.2570417801539103
deviation-center-line_max0.5523281462857199
deviation-center-line_mean0.3826337600464558
deviation-center-line_min0.25822044156444013
deviation-heading_max2.8454396258201076
deviation-heading_mean2.3303575564820695
deviation-heading_median2.364824040713779
deviation-heading_min1.746342518680613
driven_any_max3.3789250887583275
driven_any_mean2.912163457878922
driven_any_median2.9712157999178506
driven_any_min2.327297142921659
driven_lanedir_consec_max3.128172477473175
driven_lanedir_consec_mean2.287018153724377
driven_lanedir_consec_min1.515789823487114
driven_lanedir_max3.128172477473175
driven_lanedir_mean2.287018153724377
driven_lanedir_median2.2520551569686083
driven_lanedir_min1.515789823487114
get_state_dump_max0.020394959449768067
get_state_dump_mean0.018757250905036927
get_state_dump_median0.01864101568857829
get_state_dump_min0.017352012793223064
get_ui_image_max0.049354649384816485
get_ui_image_mean0.04679197748502095
get_ui_image_median0.04619349996248881
get_ui_image_min0.04542626063028971
in-drivable-lane_max7.800000000000095
in-drivable-lane_mean4.45000000000006
in-drivable-lane_min0.4500000000000064
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 3.3789250887583275, "get_ui_image": 0.049354649384816485, "step_physics": 0.09639221668243408, "survival_time": 14.950000000000076, "driven_lanedir": 3.128172477473175, "get_state_dump": 0.020394959449768067, "sim_render-ego": 0.009947126706441245, "in-drivable-lane": 0.4500000000000064, "agent_compute-ego": 0.02992616891860962, "deviation-heading": 2.6434686021719753, "complete-iteration": 0.2701600249608358, "set_robot_commands": 0.00818759282430013, "deviation-center-line": 0.5523281462857199, "driven_lanedir_consec": 3.128172477473175, "sim_compute_sim_state": 0.023300028642018637, "sim_compute_performance-ego": 0.007214867273966472, "sim_compute_robot_state-ego": 0.0128314471244812, "sim_compute_robot_state-parked0": 0.01238193194071452}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.2355961006703393, "get_ui_image": 0.046188859939575194, "step_physics": 0.09773031870524088, "survival_time": 14.950000000000076, "driven_lanedir": 2.7333761777051864, "get_state_dump": 0.019170791308085123, "sim_render-ego": 0.01059094826380412, "in-drivable-lane": 2.750000000000039, "agent_compute-ego": 0.028890101114908855, "deviation-heading": 2.8454396258201076, "complete-iteration": 0.2619336406389872, "set_robot_commands": 0.00801947275797526, "deviation-center-line": 0.35323068735586916, "driven_lanedir_consec": 2.7333761777051864, "sim_compute_sim_state": 0.020917126337687175, "sim_compute_performance-ego": 0.006578398545583089, "sim_compute_robot_state-ego": 0.011966922283172608, "sim_compute_robot_state-parked0": 0.011666336854298909}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.327297142921659, "get_ui_image": 0.046198139985402426, "step_physics": 0.10743346611658731, "survival_time": 14.950000000000076, "driven_lanedir": 1.515789823487114, "get_state_dump": 0.01811124006907145, "sim_render-ego": 0.00906696081161499, "in-drivable-lane": 6.800000000000097, "agent_compute-ego": 0.028327873547871908, "deviation-heading": 2.086179479255583, "complete-iteration": 0.2623134438196818, "set_robot_commands": 0.007327164014180501, "deviation-center-line": 0.3667557649797938, "driven_lanedir_consec": 1.515789823487114, "sim_compute_sim_state": 0.016761844952901204, "sim_compute_performance-ego": 0.006265763441721598, "sim_compute_robot_state-ego": 0.011460383733113607, "sim_compute_robot_state-parked0": 0.01115756670633952}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.706835499165362, "get_ui_image": 0.04542626063028971, "step_physics": 0.10218833843866984, "survival_time": 14.950000000000076, "driven_lanedir": 1.7707341362320304, "get_state_dump": 0.017352012793223064, "sim_render-ego": 0.00907675822575887, "in-drivable-lane": 7.800000000000095, "agent_compute-ego": 0.02710019032160441, "deviation-heading": 1.746342518680613, "complete-iteration": 0.2570417801539103, "set_robot_commands": 0.007088798681894938, "deviation-center-line": 0.25822044156444013, "driven_lanedir_consec": 1.7707341362320304, "sim_compute_sim_state": 0.02055149555206299, "sim_compute_performance-ego": 0.006121715704600016, "sim_compute_robot_state-ego": 0.010993207295735675, "sim_compute_robot_state-parked0": 0.010945289134979249}}
set_robot_commands_max0.00818759282430013
set_robot_commands_mean0.007655757069587708
set_robot_commands_median0.007673318386077881
set_robot_commands_min0.007088798681894938
sim_compute_performance-ego_max0.007214867273966472
sim_compute_performance-ego_mean0.006545186241467794
sim_compute_performance-ego_median0.006422080993652344
sim_compute_performance-ego_min0.006121715704600016
sim_compute_robot_state-ego_max0.0128314471244812
sim_compute_robot_state-ego_mean0.011812990109125772
sim_compute_robot_state-ego_median0.011713653008143109
sim_compute_robot_state-ego_min0.010993207295735675
sim_compute_robot_state-parked0_max0.01238193194071452
sim_compute_robot_state-parked0_mean0.01153778115908305
sim_compute_robot_state-parked0_median0.011411951780319214
sim_compute_robot_state-parked0_min0.010945289134979249
sim_compute_sim_state_max0.023300028642018637
sim_compute_sim_state_mean0.020382623871167505
sim_compute_sim_state_median0.02073431094487508
sim_compute_sim_state_min0.016761844952901204
sim_render-ego_max0.01059094826380412
sim_render-ego_mean0.009670448501904804
sim_render-ego_median0.009511942466100057
sim_render-ego_min0.00906696081161499
simulation-passed1
step_physics_max0.10743346611658731
step_physics_mean0.10093608498573305
step_physics_median0.09995932857195536
step_physics_min0.09639221668243408
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible