Duckietown Challenges Home Challenges Submissions

Evaluator 2306

ID2306
evaluatorafdaniele03-579cc80b68e8-1
ownerI don't have one πŸ˜€
machinebox0
processafdaniele03-579cc80b68e8-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success3 42428
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4246511460Peter-Newman Messantemplate-rosaido5-LF-sim-validationLFv-simsuccessnoafdaniele03-579cc80b68e8-10:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5170945109144324
survival_time_median6.100000000000007
deviation-center-line_median0.14014381440054702
in-drivable-lane_median3.525000000000035


other stats
agent_compute-ego_max0.010011084413758798
agent_compute-ego_mean0.009594884592392211
agent_compute-ego_median0.009537838717811128
agent_compute-ego_min0.00929277652018779
complete-iteration_max0.12492192113721692
complete-iteration_mean0.12082052186236387
complete-iteration_median0.1198360961150698
complete-iteration_min0.11868797408209908
deviation-center-line_max0.6800688035927646
deviation-center-line_mean0.26419154492306113
deviation-center-line_min0.09640974729838576
deviation-heading_max3.1875373715899284
deviation-heading_mean1.2160467183444237
deviation-heading_median0.6849933680352909
deviation-heading_min0.3066627657171838
driven_any_max4.2953859894865385
driven_any_mean2.037321926566275
driven_any_median1.7142428270961032
driven_any_min0.4254160625863552
driven_lanedir_consec_max1.895082495998728
driven_lanedir_consec_mean0.8107956165476761
driven_lanedir_consec_min0.31391094836311195
driven_lanedir_max1.9346087490464616
driven_lanedir_mean0.8206771798096096
driven_lanedir_median0.5170945109144324
driven_lanedir_min0.31391094836311195
get_duckie_state_max1.3738970294046562e-06
get_duckie_state_mean1.3022265252805818e-06
get_duckie_state_median1.2827956158181897e-06
get_duckie_state_min1.2694178400812925e-06
get_robot_state_max0.00802807070782795
get_robot_state_mean0.008009284116781305
get_robot_state_median0.008008892021849004
get_robot_state_min0.007991281715599267
get_state_dump_max0.006733463870154487
get_state_dump_mean0.006712875189690388
get_state_dump_median0.006711898685544476
get_state_dump_min0.00669423951751811
get_ui_image_max0.02222572202267854
get_ui_image_mean0.022106654716723087
get_ui_image_median0.02212202638477177
get_ui_image_min0.021956844074670287
in-drivable-lane_max7.350000000000015
in-drivable-lane_mean3.650000000000021
in-drivable-lane_min0.20000000000000015
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 4.2953859894865385, "get_ui_image": 0.021956844074670287, "step_physics": 0.051168568556922735, "survival_time": 14.950000000000076, "driven_lanedir": 1.9346087490464616, "get_state_dump": 0.00669423951751811, "sim_render-ego": 0.003582619504386366, "get_robot_state": 0.008005787297634775, "get_duckie_state": 1.3738970294046562e-06, "in-drivable-lane": 6.65000000000007, "agent_compute-ego": 0.009781929162832407, "deviation-heading": 3.1875373715899284, "complete-iteration": 0.12017199745943714, "set_robot_commands": 0.0024679807516244743, "deviation-center-line": 0.6800688035927646, "driven_lanedir_consec": 1.895082495998728, "sim_compute_sim_state": 0.01413885566303164, "sim_compute_performance-ego": 0.002304500560696707}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.4254160625863552, "get_ui_image": 0.022192544407314725, "step_physics": 0.052340944608052574, "survival_time": 1.800000000000001, "driven_lanedir": 0.3239059226309231, "get_state_dump": 0.006733463870154487, "sim_render-ego": 0.0035339726342095267, "get_robot_state": 0.008011996746063232, "get_duckie_state": 1.284811231825087e-06, "in-drivable-lane": 0.20000000000000015, "agent_compute-ego": 0.009293748272789847, "deviation-heading": 0.47476926932745733, "complete-iteration": 0.11868797408209908, "set_robot_commands": 0.002459492948320177, "deviation-center-line": 0.09640974729838576, "driven_lanedir_consec": 0.3239059226309231, "sim_compute_sim_state": 0.011751956409878202, "sim_compute_performance-ego": 0.002296480867597792}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.998700056453162, "get_ui_image": 0.02222572202267854, "step_physics": 0.05104535098237116, "survival_time": 10.350000000000012, "driven_lanedir": 0.7102830991979416, "get_state_dump": 0.006718287721348269, "sim_render-ego": 0.0036126507653130423, "get_robot_state": 0.00802807070782795, "get_duckie_state": 1.2807799998112922e-06, "in-drivable-lane": 7.350000000000015, "agent_compute-ego": 0.010011084413758798, "deviation-heading": 0.8952174667431244, "complete-iteration": 0.11950019477070242, "set_robot_commands": 0.0024593797858786467, "deviation-center-line": 0.16038189059616698, "driven_lanedir_consec": 0.7102830991979416, "sim_compute_sim_state": 0.013024952100670856, "sim_compute_performance-ego": 0.002302492298365791}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 0.4297855977390444, "get_ui_image": 0.022051508362228807, "step_physics": 0.056005851642505544, "survival_time": 1.850000000000001, "driven_lanedir": 0.31391094836311195, "get_state_dump": 0.006705509649740683, "sim_render-ego": 0.003582264925982501, "get_robot_state": 0.007991281715599267, "get_duckie_state": 1.2694178400812925e-06, "in-drivable-lane": 0.4000000000000003, "agent_compute-ego": 0.00929277652018779, "deviation-heading": 0.3066627657171838, "complete-iteration": 0.12492192113721692, "set_robot_commands": 0.0024463808214342272, "deviation-center-line": 0.11990573820492707, "driven_lanedir_consec": 0.31391094836311195, "sim_compute_sim_state": 0.014472239726298564, "sim_compute_performance-ego": 0.0023018411687902502}}
set_robot_commands_max0.0024679807516244743
set_robot_commands_mean0.002458308576814381
set_robot_commands_median0.002459436367099412
set_robot_commands_min0.0024463808214342272
sim_compute_performance-ego_max0.002304500560696707
sim_compute_performance-ego_mean0.0023013287238626353
sim_compute_performance-ego_median0.002302166733578021
sim_compute_performance-ego_min0.002296480867597792
sim_compute_sim_state_max0.014472239726298564
sim_compute_sim_state_mean0.013347000974969814
sim_compute_sim_state_median0.013581903881851248
sim_compute_sim_state_min0.011751956409878202
sim_render-ego_max0.0036126507653130423
sim_render-ego_mean0.003577876957472859
sim_render-ego_median0.0035824422151844336
sim_render-ego_min0.0035339726342095267
simulation-passed1
step_physics_max0.056005851642505544
step_physics_mean0.05264017894746301
step_physics_median0.051754756582487654
step_physics_min0.05104535098237116
survival_time_max14.950000000000076
survival_time_mean7.237500000000023
survival_time_min1.800000000000001
No reset possible
4246211459Peter-Newman MessanPredictorLastaido2-PREDstep1-simulationsuccessyesafdaniele03-579cc80b68e8-10:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
error_L10.10498522237480296
error_L20.018529310610777176


No reset possible
4242811448Cliff ChandlerΒ πŸ‡ΊπŸ‡Έtemplate-randomaido5-LF-sim-validationLFv-simsuccessnoafdaniele03-579cc80b68e8-10:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6440373265804349
survival_time_median4.7749999999999915
deviation-center-line_median0.10361109150784235
in-drivable-lane_median2.5499999999999914


other stats
agent_compute-ego_max0.009376016713805118
agent_compute-ego_mean0.0091247964382531
agent_compute-ego_median0.009139617070993398
agent_compute-ego_min0.008843934897220495
complete-iteration_max0.12645820596001364
complete-iteration_mean0.12056226437971136
complete-iteration_median0.11891107626553982
complete-iteration_min0.11796869902775206
deviation-center-line_max0.15583868303837567
deviation-center-line_mean0.10879855071843549
deviation-center-line_min0.07213333681968147
deviation-heading_max0.976837469261332
deviation-heading_mean0.4922932418762878
deviation-heading_median0.3609623398756611
deviation-heading_min0.27041081849249704
driven_any_max2.8894611145876925
driven_any_mean1.8510551780477624
driven_any_median1.998666635086524
driven_any_min0.5174263274303096
driven_lanedir_consec_max0.8904446665936326
driven_lanedir_consec_mean0.6302364342579737
driven_lanedir_consec_min0.3424264172773923
driven_lanedir_max0.8904446665936326
driven_lanedir_mean0.6302364342579737
driven_lanedir_median0.6440373265804349
driven_lanedir_min0.3424264172773923
get_duckie_state_max1.139559988248146e-06
get_duckie_state_mean1.1128482008303044e-06
get_duckie_state_median1.1216821839941457e-06
get_duckie_state_min1.0684684470847802e-06
get_robot_state_max0.008141400450367039
get_robot_state_mean0.008030842572070197
get_robot_state_median0.007995162824851966
get_robot_state_min0.007991644188209817
get_state_dump_max0.006854109844918978
get_state_dump_mean0.00673306624793362
get_state_dump_median0.006712953841300095
get_state_dump_min0.006652247464215314
get_ui_image_max0.022173030288131147
get_ui_image_mean0.022043639076508935
get_ui_image_median0.02204242287707705
get_ui_image_min0.02191668026375048
in-drivable-lane_max4.699999999999983
in-drivable-lane_mean2.5374999999999917
in-drivable-lane_min0.3500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.1619321797959306, "get_ui_image": 0.022087048676054356, "step_physics": 0.05099542666289766, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.006854109844918978, "sim_render-ego": 0.003599381042739092, "get_robot_state": 0.008141400450367039, "get_duckie_state": 1.139559988248146e-06, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.009376016713805118, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.1188772532899501, "set_robot_commands": 0.0025448677903514797, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.012866965794967392, "sim_compute_performance-ego": 0.0023385548995713055}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.5174263274303096, "get_ui_image": 0.021997797078099745, "step_physics": 0.05129777974095838, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3424264172773923, "get_state_dump": 0.006750369894093481, "sim_render-ego": 0.003520217435113315, "get_robot_state": 0.007997331948115909, "get_duckie_state": 1.1181009226831896e-06, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.00918119529197956, "deviation-heading": 0.3106738984320317, "complete-iteration": 0.11796869902775206, "set_robot_commands": 0.002449216513798155, "deviation-center-line": 0.07213333681968147, "driven_lanedir_consec": 0.3424264172773923, "sim_compute_sim_state": 0.012408166096128269, "sim_compute_performance-ego": 0.002290750371998754}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8354010903771174, "get_ui_image": 0.022173030288131147, "step_physics": 0.051699096185189704, "survival_time": 6.749999999999984, "driven_lanedir": 0.6794864726921884, "get_state_dump": 0.006652247464215314, "sim_render-ego": 0.0035928372983579284, "get_robot_state": 0.007991644188209817, "get_duckie_state": 1.0684684470847802e-06, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.009098038850007234, "deviation-heading": 0.41125078131929055, "complete-iteration": 0.11894489924112955, "set_robot_commands": 0.002467171351114909, "deviation-center-line": 0.08258355868343131, "driven_lanedir_consec": 0.6794864726921884, "sim_compute_sim_state": 0.012912450013337313, "sim_compute_performance-ego": 0.002282215047765661}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8894611145876925, "get_ui_image": 0.02191668026375048, "step_physics": 0.056706843954144104, "survival_time": 6.5999999999999845, "driven_lanedir": 0.8904446665936326, "get_state_dump": 0.00667553778850671, "sim_render-ego": 0.0035621036182750354, "get_robot_state": 0.007992993701588024, "get_duckie_state": 1.1252634453051018e-06, "in-drivable-lane": 3.899999999999986, "agent_compute-ego": 0.008843934897220495, "deviation-heading": 0.976837469261332, "complete-iteration": 0.12645820596001364, "set_robot_commands": 0.0024603551084345036, "deviation-center-line": 0.15583868303837567, "driven_lanedir_consec": 0.8904446665936326, "sim_compute_sim_state": 0.01593769680369984, "sim_compute_performance-ego": 0.002285693631027684}}
set_robot_commands_max0.0025448677903514797
set_robot_commands_mean0.002480402690924762
set_robot_commands_median0.002463763229774706
set_robot_commands_min0.002449216513798155
sim_compute_performance-ego_max0.0023385548995713055
sim_compute_performance-ego_mean0.0022993034875908513
sim_compute_performance-ego_median0.002288222001513219
sim_compute_performance-ego_min0.002282215047765661
sim_compute_sim_state_max0.01593769680369984
sim_compute_sim_state_mean0.013531319677033204
sim_compute_sim_state_median0.012889707904152352
sim_compute_sim_state_min0.012408166096128269
sim_render-ego_max0.003599381042739092
sim_render-ego_mean0.0035686348486213427
sim_render-ego_median0.003577470458316482
sim_render-ego_min0.003520217435113315
simulation-passed1
step_physics_max0.056706843954144104
step_physics_mean0.05267478663579746
step_physics_median0.051498437963074045
step_physics_min0.05099542666289766
survival_time_max6.749999999999984
survival_time_mean4.437499999999992
survival_time_min1.4500000000000006
No reset possible