Duckietown Challenges Home Challenges Submissions

Evaluator 2300

ID2300
evaluatorreg01-ed49617f538f-1
ownerI don't have one 😀
machineChudeQian-Sager-Duckietown
processreg01-ed49617f538f-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success3 42382
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4241811446Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg01-ed49617f538f-10:06:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.777427240610313
survival_time_median14.950000000000076
deviation-center-line_median0.36019378975111555
in-drivable-lane_median5.150000000000073


other stats
agent_compute-ego_max0.012320460652458598
agent_compute-ego_mean0.012044255180942
agent_compute-ego_median0.012074827750523886
agent_compute-ego_min0.011706904570261635
complete-iteration_max0.15286363124847413
complete-iteration_mean0.14952763766932065
complete-iteration_median0.15064131122604155
complete-iteration_min0.14396429697672525
deviation-center-line_max0.5336597523544971
deviation-center-line_mean0.3618605527925518
deviation-center-line_min0.19339487931347907
deviation-heading_max2.039329896341185
deviation-heading_mean1.3600112692593314
deviation-heading_median1.3924208420635216
deviation-heading_min0.6158734965690965
driven_any_max3.172672883918368
driven_any_mean2.931997345863212
driven_any_median3.092052502606098
driven_any_min2.371211494322286
driven_lanedir_consec_max2.3462657513467047
driven_lanedir_consec_mean1.6944637782754637
driven_lanedir_consec_min0.8767348805345233
driven_lanedir_max2.3462657513467047
driven_lanedir_mean1.6944637782754637
driven_lanedir_median1.777427240610313
driven_lanedir_min0.8767348805345233
get_duckie_state_max1.3077752830008784e-06
get_duckie_state_mean1.15862729751617e-06
get_duckie_state_median1.1416276295979815e-06
get_duckie_state_min1.0434786478678386e-06
get_robot_state_max0.010260229280009072
get_robot_state_mean0.009690368416511566
get_robot_state_median0.009574203888575236
get_robot_state_min0.00935283660888672
get_state_dump_max0.00888046005068446
get_state_dump_mean0.008417735245571099
get_state_dump_median0.008383111953735351
get_state_dump_min0.008024257024129232
get_ui_image_max0.02490913656336316
get_ui_image_mean0.024171669748878105
get_ui_image_median0.024014025529225668
get_ui_image_min0.023749491373697917
in-drivable-lane_max10.250000000000062
in-drivable-lane_mean6.0500000000000504
in-drivable-lane_min3.649999999999994
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.371211494322286, "get_ui_image": 0.02490913656336316, "step_physics": 0.061803302821323014, "survival_time": 8.449999999999985, "driven_lanedir": 1.2976923804942366, "get_state_dump": 0.00888046005068446, "sim_render-ego": 0.004769790807419275, "get_robot_state": 0.010260229280009072, "get_duckie_state": 1.3077752830008784e-06, "in-drivable-lane": 3.649999999999994, "agent_compute-ego": 0.012320460652458598, "deviation-heading": 0.6158734965690965, "complete-iteration": 0.15059465769479966, "set_robot_commands": 0.0039213423192853755, "deviation-center-line": 0.19339487931347907, "driven_lanedir_consec": 1.2976923804942366, "sim_compute_sim_state": 0.020483825333725066, "sim_compute_performance-ego": 0.003156767794366419}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.172672883918368, "get_ui_image": 0.023749491373697917, "step_physics": 0.0603323777516683, "survival_time": 14.950000000000076, "driven_lanedir": 2.2571621007263896, "get_state_dump": 0.00822199026743571, "sim_render-ego": 0.0045174153645833335, "get_robot_state": 0.009537604649861654, "get_duckie_state": 1.159509023030599e-06, "in-drivable-lane": 5.300000000000075, "agent_compute-ego": 0.011706904570261635, "deviation-heading": 1.361322136988782, "complete-iteration": 0.14396429697672525, "set_robot_commands": 0.003583199977874756, "deviation-center-line": 0.5336597523544971, "driven_lanedir_consec": 2.2571621007263896, "sim_compute_sim_state": 0.019256828625996907, "sim_compute_performance-ego": 0.002973051865895589}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.1599358476451447, "get_ui_image": 0.023959830602010092, "step_physics": 0.06635649681091309, "survival_time": 14.950000000000076, "driven_lanedir": 0.8767348805345233, "get_state_dump": 0.008544233640034994, "sim_render-ego": 0.004475971857706706, "get_robot_state": 0.009610803127288818, "get_duckie_state": 1.0434786478678386e-06, "in-drivable-lane": 10.250000000000062, "agent_compute-ego": 0.012255741755167644, "deviation-heading": 2.039329896341185, "complete-iteration": 0.15068796475728352, "set_robot_commands": 0.0036479934056599934, "deviation-center-line": 0.3020179646688014, "driven_lanedir_consec": 0.8767348805345233, "sim_compute_sim_state": 0.01882527987162272, "sim_compute_performance-ego": 0.0029245861371358234}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.02416915756705, "get_ui_image": 0.024068220456441244, "step_physics": 0.06608527183532714, "survival_time": 14.950000000000076, "driven_lanedir": 2.3462657513467047, "get_state_dump": 0.008024257024129232, "sim_render-ego": 0.004503917694091797, "get_robot_state": 0.00935283660888672, "get_duckie_state": 1.1237462361653645e-06, "in-drivable-lane": 5.000000000000071, "agent_compute-ego": 0.011893913745880128, "deviation-heading": 1.4235195471382611, "complete-iteration": 0.15286363124847413, "set_robot_commands": 0.0037465675671895346, "deviation-center-line": 0.4183696148334297, "driven_lanedir_consec": 2.3462657513467047, "sim_compute_sim_state": 0.022120474179585774, "sim_compute_performance-ego": 0.0029824010531107584}}
set_robot_commands_max0.0039213423192853755
set_robot_commands_mean0.0037247758175024143
set_robot_commands_median0.003697280486424764
set_robot_commands_min0.003583199977874756
sim_compute_performance-ego_max0.003156767794366419
sim_compute_performance-ego_mean0.0030092017126271474
sim_compute_performance-ego_median0.0029777264595031738
sim_compute_performance-ego_min0.0029245861371358234
sim_compute_sim_state_max0.022120474179585774
sim_compute_sim_state_mean0.020171602002732616
sim_compute_sim_state_median0.019870326979860985
sim_compute_sim_state_min0.01882527987162272
sim_render-ego_max0.004769790807419275
sim_render-ego_mean0.004566773930950278
sim_render-ego_median0.004510666529337565
sim_render-ego_min0.004475971857706706
simulation-passed1
step_physics_max0.06635649681091309
step_physics_mean0.06364436230480788
step_physics_median0.06394428732832508
step_physics_min0.0603323777516683
survival_time_max14.950000000000076
survival_time_mean13.325000000000053
survival_time_min8.449999999999985
No reset possible
4239111442Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessnoreg01-ed49617f538f-10:07:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8305172365474385
survival_time_median14.325000000000069
deviation-center-line_median0.35187176769001943
in-drivable-lane_median5.225000000000074


other stats
agent_compute-ego_max0.015322999159495036
agent_compute-ego_mean0.015094493852507752
agent_compute-ego_median0.015105626884748176
agent_compute-ego_min0.014843722481039628
complete-iteration_max0.18520619869232177
complete-iteration_mean0.180410147023672
complete-iteration_median0.17986221096811503
complete-iteration_min0.17670996746613613
deviation-center-line_max0.5251046299573574
deviation-center-line_mean0.35394076616771364
deviation-center-line_min0.1869148993334583
deviation-heading_max1.4273719756605154
deviation-heading_mean1.2375693617075183
deviation-heading_median1.2549313887176554
deviation-heading_min1.0130426937342478
driven_any_max3.1535923707966385
driven_any_mean2.921369452677186
driven_any_median3.1107456412102072
driven_any_min2.3103941574916913
driven_lanedir_consec_max2.256576151566015
driven_lanedir_consec_mean1.653309342353369
driven_lanedir_consec_min0.6956267447525827
driven_lanedir_max2.256576151566015
driven_lanedir_mean1.653309342353369
driven_lanedir_median1.8305172365474385
driven_lanedir_min0.6956267447525827
get_duckie_state_max2.1910667419433593e-06
get_duckie_state_mean2.0691653839464855e-06
get_duckie_state_median2.054724380047652e-06
get_duckie_state_min1.976146033747279e-06
get_robot_state_max0.011835737228393556
get_robot_state_mean0.011388790677128592
get_robot_state_median0.011296931638624837
get_robot_state_min0.011125562202871142
get_state_dump_max0.010900198523677997
get_state_dump_mean0.009959493566084068
get_state_dump_median0.009714869260787963
get_state_dump_min0.009508037219082352
get_ui_image_max0.030096261501312255
get_ui_image_mean0.029253939969323968
get_ui_image_median0.02924110946963675
get_ui_image_min0.02843727943671011
in-drivable-lane_max11.450000000000074
in-drivable-lane_mean6.450000000000061
in-drivable-lane_min3.9000000000000217
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 2.3103941574916913, "get_ui_image": 0.029521314658928863, "step_physics": 0.07473364042405466, "survival_time": 10.050000000000008, "driven_lanedir": 1.5061929905012073, "get_state_dump": 0.010900198523677997, "sim_render-ego": 0.005371965579132536, "get_robot_state": 0.011125562202871142, "get_duckie_state": 1.976146033747279e-06, "in-drivable-lane": 3.9000000000000217, "agent_compute-ego": 0.014843722481039628, "deviation-heading": 1.0130426937342478, "complete-iteration": 0.17670996746613613, "set_robot_commands": 0.004560413645274604, "deviation-center-line": 0.24063492794173927, "driven_lanedir_consec": 1.5061929905012073, "sim_compute_sim_state": 0.022039100305357977, "sim_compute_performance-ego": 0.0035142518987703085}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 3.1303136766503976, "get_ui_image": 0.02896090428034465, "step_physics": 0.07429194927215577, "survival_time": 14.950000000000076, "driven_lanedir": 2.256576151566015, "get_state_dump": 0.009839345614115397, "sim_render-ego": 0.0054886182149251304, "get_robot_state": 0.011835737228393556, "get_duckie_state": 2.1910667419433593e-06, "in-drivable-lane": 5.300000000000075, "agent_compute-ego": 0.015158809026082356, "deviation-heading": 1.4273719756605154, "complete-iteration": 0.17781563520431518, "set_robot_commands": 0.004609715143839518, "deviation-center-line": 0.5251046299573574, "driven_lanedir_consec": 2.256576151566015, "sim_compute_sim_state": 0.02380095958709717, "sim_compute_performance-ego": 0.0037240401903788248}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 3.0911776057700173, "get_ui_image": 0.030096261501312255, "step_physics": 0.08193934202194214, "survival_time": 14.950000000000076, "driven_lanedir": 0.6956267447525827, "get_state_dump": 0.00959039290746053, "sim_render-ego": 0.00556965430577596, "get_robot_state": 0.011380566755930582, "get_duckie_state": 2.028942108154297e-06, "in-drivable-lane": 11.450000000000074, "agent_compute-ego": 0.015322999159495036, "deviation-heading": 1.3272257984530385, "complete-iteration": 0.18520619869232177, "set_robot_commands": 0.004659545421600342, "deviation-center-line": 0.1869148993334583, "driven_lanedir_consec": 0.6956267447525827, "sim_compute_sim_state": 0.02288067102432251, "sim_compute_performance-ego": 0.003660471439361572}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 3.1535923707966385, "get_ui_image": 0.02843727943671011, "step_physics": 0.07730462516311311, "survival_time": 13.70000000000006, "driven_lanedir": 2.1548414825936693, "get_state_dump": 0.009508037219082352, "sim_render-ego": 0.005538279122679773, "get_robot_state": 0.01121329652131909, "get_duckie_state": 2.080506651941007e-06, "in-drivable-lane": 5.150000000000073, "agent_compute-ego": 0.015052444743413995, "deviation-heading": 1.1826369789822722, "complete-iteration": 0.18190878673191488, "set_robot_commands": 0.004713625803481053, "deviation-center-line": 0.4631086074382996, "driven_lanedir_consec": 2.1548414825936693, "sim_compute_sim_state": 0.026343198588294703, "sim_compute_performance-ego": 0.0036924468339794743}}
set_robot_commands_max0.004713625803481053
set_robot_commands_mean0.00463582500354888
set_robot_commands_median0.00463463028271993
set_robot_commands_min0.004560413645274604
sim_compute_performance-ego_max0.0037240401903788248
sim_compute_performance-ego_mean0.0036478025906225447
sim_compute_performance-ego_median0.003676459136670523
sim_compute_performance-ego_min0.0035142518987703085
sim_compute_sim_state_max0.026343198588294703
sim_compute_sim_state_mean0.02376598237626809
sim_compute_sim_state_median0.02334081530570984
sim_compute_sim_state_min0.022039100305357977
sim_render-ego_max0.00556965430577596
sim_render-ego_mean0.00549212930562835
sim_render-ego_median0.005513448668802452
sim_render-ego_min0.005371965579132536
simulation-passed1
step_physics_max0.08193934202194214
step_physics_mean0.07706738922031642
step_physics_median0.07601913279358388
step_physics_min0.07429194927215577
survival_time_max14.950000000000076
survival_time_mean13.412500000000056
survival_time_min10.050000000000008
No reset possible
4238211441Riccardo Tresa 🇮🇹template-randomaido5-LF-sim-validationLFv-simsuccessnoreg01-ed49617f538f-10:03:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6440373265804349
survival_time_median4.7749999999999915
deviation-center-line_median0.10361109150784235
in-drivable-lane_median2.5499999999999914


other stats
agent_compute-ego_max0.011656736505442652
agent_compute-ego_mean0.011371526703158932
agent_compute-ego_median0.01137776766942869
agent_compute-ego_min0.0110738349683357
complete-iteration_max0.1527437712206985
complete-iteration_mean0.14559900906416445
complete-iteration_median0.1453305838817533
complete-iteration_min0.13899109727245265
deviation-center-line_max0.15583868303837567
deviation-center-line_mean0.10879855071843549
deviation-center-line_min0.07213333681968147
deviation-heading_max0.976837469261332
deviation-heading_mean0.4922932418762878
deviation-heading_median0.3609623398756611
deviation-heading_min0.27041081849249704
driven_any_max2.8894611145876925
driven_any_mean1.8510551780477624
driven_any_median1.998666635086524
driven_any_min0.5174263274303096
driven_lanedir_consec_max0.8904446665936326
driven_lanedir_consec_mean0.6302364342579737
driven_lanedir_consec_min0.3424264172773923
driven_lanedir_max0.8904446665936326
driven_lanedir_mean0.6302364342579737
driven_lanedir_median0.6440373265804349
driven_lanedir_min0.3424264172773923
get_duckie_state_max1.6526742414994673e-06
get_duckie_state_mean1.5618871002708176e-06
get_duckie_state_median1.5478329031251248e-06
get_duckie_state_min1.499208353333554e-06
get_robot_state_max0.010504095843344025
get_robot_state_mean0.009700806346363711
get_robot_state_median0.009497183827757074
get_robot_state_min0.00930476188659668
get_state_dump_max0.008938285437497225
get_state_dump_mean0.008377605161902967
get_state_dump_median0.008256682490937098
get_state_dump_min0.008058770228240449
get_ui_image_max0.024680266556916415
get_ui_image_mean0.02391184222391912
get_ui_image_median0.023766494345390937
get_ui_image_min0.023434113647978184
in-drivable-lane_max4.699999999999983
in-drivable-lane_mean2.5374999999999917
in-drivable-lane_min0.3500000000000003
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 1.1619321797959306, "get_ui_image": 0.023434113647978184, "step_physics": 0.058019480462801656, "survival_time": 2.9499999999999975, "driven_lanedir": 0.6085881804686812, "get_state_dump": 0.008058770228240449, "sim_render-ego": 0.004578008490093684, "get_robot_state": 0.00930476188659668, "get_duckie_state": 1.499208353333554e-06, "in-drivable-lane": 1.1999999999999966, "agent_compute-ego": 0.011318226992073703, "deviation-heading": 0.27041081849249704, "complete-iteration": 0.13899109727245265, "set_robot_commands": 0.003466775861837096, "deviation-center-line": 0.1246386243322534, "driven_lanedir_consec": 0.6085881804686812, "sim_compute_sim_state": 0.01769561282658981, "sim_compute_performance-ego": 0.0030353513814635196}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.5174263274303096, "get_ui_image": 0.023591551287420864, "step_physics": 0.06287996522311506, "survival_time": 1.4500000000000006, "driven_lanedir": 0.3424264172773923, "get_state_dump": 0.008186225233406856, "sim_render-ego": 0.004742721031452048, "get_robot_state": 0.009435735899826577, "get_duckie_state": 1.5291674383755388e-06, "in-drivable-lane": 0.3500000000000003, "agent_compute-ego": 0.011656736505442652, "deviation-heading": 0.3106738984320317, "complete-iteration": 0.1458106205381196, "set_robot_commands": 0.0031874837546513, "deviation-center-line": 0.07213333681968147, "driven_lanedir_consec": 0.3424264172773923, "sim_compute_sim_state": 0.018930410516673123, "sim_compute_performance-ego": 0.0031202826006659144}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.8354010903771174, "get_ui_image": 0.024680266556916415, "step_physics": 0.06105621655782064, "survival_time": 6.749999999999984, "driven_lanedir": 0.6794864726921884, "get_state_dump": 0.00832713974846734, "sim_render-ego": 0.004645805005674009, "get_robot_state": 0.009558631755687571, "get_duckie_state": 1.5664983678747109e-06, "in-drivable-lane": 4.699999999999983, "agent_compute-ego": 0.011437308346783671, "deviation-heading": 0.41125078131929055, "complete-iteration": 0.144850547225387, "set_robot_commands": 0.003392155965169271, "deviation-center-line": 0.08258355868343131, "driven_lanedir_consec": 0.6794864726921884, "sim_compute_sim_state": 0.018628950472231263, "sim_compute_performance-ego": 0.003039338853624132}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.8894611145876925, "get_ui_image": 0.023941437403361004, "step_physics": 0.06487792730331421, "survival_time": 6.5999999999999845, "driven_lanedir": 0.8904446665936326, "get_state_dump": 0.008938285437497225, "sim_render-ego": 0.004503978021217115, "get_robot_state": 0.010504095843344025, "get_duckie_state": 1.6526742414994673e-06, "in-drivable-lane": 3.899999999999986, "agent_compute-ego": 0.0110738349683357, "deviation-heading": 0.976837469261332, "complete-iteration": 0.1527437712206985, "set_robot_commands": 0.003292464848720666, "deviation-center-line": 0.15583868303837567, "driven_lanedir_consec": 0.8904446665936326, "sim_compute_sim_state": 0.022555614962722317, "sim_compute_performance-ego": 0.0029715137048201127}}
set_robot_commands_max0.003466775861837096
set_robot_commands_mean0.0033347201075945828
set_robot_commands_median0.0033423104069449684
set_robot_commands_min0.0031874837546513
sim_compute_performance-ego_max0.0031202826006659144
sim_compute_performance-ego_mean0.0030416216351434196
sim_compute_performance-ego_median0.0030373451175438257
sim_compute_performance-ego_min0.0029715137048201127
sim_compute_sim_state_max0.022555614962722317
sim_compute_sim_state_mean0.01945264719455413
sim_compute_sim_state_median0.01877968049445219
sim_compute_sim_state_min0.01769561282658981
sim_render-ego_max0.004742721031452048
sim_render-ego_mean0.004617628137109214
sim_render-ego_median0.004611906747883847
sim_render-ego_min0.004503978021217115
simulation-passed1
step_physics_max0.06487792730331421
step_physics_mean0.06170839738676289
step_physics_median0.061968090890467856
step_physics_min0.058019480462801656
survival_time_max6.749999999999984
survival_time_mean4.437499999999992
survival_time_min1.4500000000000006
No reset possible