Duckietown Challenges Home Challenges Submissions

Evaluator 2228

ID2228
evaluatorreg03-f45ca34b70a1-1
ownerI don't have one 😀
machinearchimede
processreg03-f45ca34b70a1-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 39929
# timeout
# failed
# error
# aborted2 39913
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3992910400Bea Baselines 🐤straightaido5-LFV-sim-validationLFVv-simsuccessnoreg03-f45ca34b70a1-10:28:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.663944993135225
survival_time_median9.400000000000029
deviation-center-line_median0.34702104295221003
in-drivable-lane_median4.9000000000000234


other stats
agent_compute-ego_max0.02059337615966797
agent_compute-ego_mean0.020142168541893324
agent_compute-ego_median0.020179510674020636
agent_compute-ego_min0.01961627665986406
agent_compute-npc0_max0.0772937815240089
agent_compute-npc0_mean0.07112906453197144
agent_compute-npc0_median0.07180155985744288
agent_compute-npc0_min0.06361935688899113
agent_compute-npc1_max0.07546065546942095
agent_compute-npc1_mean0.06797294504012018
agent_compute-npc1_median0.06604005548125463
agent_compute-npc1_min0.0643510137285505
agent_compute-npc2_max0.07418996413548787
agent_compute-npc2_mean0.06933332625507388
agent_compute-npc2_median0.06961521654264302
agent_compute-npc2_min0.06391290779952165
agent_compute-npc3_max0.07496717804712606
agent_compute-npc3_mean0.06975305146656685
agent_compute-npc3_median0.07064488137021978
agent_compute-npc3_min0.06275526507870181
complete-iteration_max1.684629687468211
complete-iteration_mean1.6231126402429386
complete-iteration_median1.6330728507749883
complete-iteration_min1.5416751719535666
deviation-center-line_max0.4513697173657512
deviation-center-line_mean0.32192679681636155
deviation-center-line_min0.14229538399527497
deviation-heading_max2.2466652553473376
deviation-heading_mean1.154680829931011
deviation-heading_median1.126064733276421
deviation-heading_min0.11992859782386368
driven_any_max2.4120543386243765
driven_any_mean1.526164370603078
driven_any_median1.4996280355628615
driven_any_min0.6933470726622118
driven_lanedir_consec_max0.7187118392311596
driven_lanedir_consec_mean0.6363049781990597
driven_lanedir_consec_min0.49861808729462953
driven_lanedir_max0.7187118392311596
driven_lanedir_mean0.6363049781990597
driven_lanedir_median0.663944993135225
driven_lanedir_min0.49861808729462953
get_duckie_state_max4.021676032097785e-06
get_duckie_state_mean3.72238894447646e-06
get_duckie_state_median3.7054051744176983e-06
get_duckie_state_min3.457069396972656e-06
get_robot_state_max0.061727862831548595
get_robot_state_mean0.06007436788437028
get_robot_state_median0.060760792345354406
get_robot_state_min0.05704802401522373
get_state_dump_max0.03526003479112125
get_state_dump_mean0.034401989161861386
get_state_dump_median0.03425936138376277
get_state_dump_min0.03382919908879877
get_ui_image_max0.09823335992529038
get_ui_image_mean0.0934217767780582
get_ui_image_median0.09420306942141649
get_ui_image_min0.0870476083441095
in-drivable-lane_max10.150000000000077
in-drivable-lane_mean4.987500000000031
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 0.7233042781247007, "get_ui_image": 0.09823335992529038, "step_physics": 0.9954696969783052, "survival_time": 4.699999999999991, "driven_lanedir": 0.7187118392311596, "get_state_dump": 0.034090014214211324, "sim_render-ego": 0.00807915596251792, "get_robot_state": 0.05704802401522373, "sim_render-npc0": 0.007957199786571747, "sim_render-npc1": 0.008062093815904982, "sim_render-npc2": 0.008128894136307087, "sim_render-npc3": 0.008177107953010722, "get_duckie_state": 3.457069396972656e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.01961627665986406, "deviation-heading": 0.5272680007558433, "agent_compute-npc0": 0.06772809332989632, "agent_compute-npc1": 0.0669982078227591, "agent_compute-npc2": 0.0664625624392895, "agent_compute-npc3": 0.06688573766261974, "complete-iteration": 1.6475759161279555, "set_robot_commands": 0.006157266332748088, "deviation-center-line": 0.3660354566930221, "driven_lanedir_consec": 0.7187118392311596, "sim_compute_sim_state": 0.07608863140674348, "sim_compute_performance-ego": 0.005507611213846409, "sim_compute_performance-npc0": 0.005256967341646235, "sim_compute_performance-npc1": 0.005307623680601729, "sim_compute_performance-npc2": 0.0054221711260207155, "sim_compute_performance-npc3": 0.005497278051173433}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 0.6933470726622118, "get_ui_image": 0.0870476083441095, "step_physics": 0.979669735981868, "survival_time": 4.549999999999992, "driven_lanedir": 0.6930967234667, "get_state_dump": 0.03382919908879877, "sim_render-ego": 0.008694171905517578, "get_robot_state": 0.06105277826497843, "sim_render-npc0": 0.00856804323720408, "sim_render-npc1": 0.008504406436459049, "sim_render-npc2": 0.008610948101504819, "sim_render-npc3": 0.008696702810434194, "get_duckie_state": 4.021676032097785e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.020261958405211732, "deviation-heading": 0.11992859782386368, "agent_compute-npc0": 0.06361935688899113, "agent_compute-npc1": 0.0643510137285505, "agent_compute-npc2": 0.06391290779952165, "agent_compute-npc3": 0.06275526507870181, "complete-iteration": 1.6185697854220211, "set_robot_commands": 0.005999457705151904, "deviation-center-line": 0.14229538399527497, "driven_lanedir_consec": 0.6930967234667, "sim_compute_sim_state": 0.0776494806939429, "sim_compute_performance-ego": 0.005872983198899489, "sim_compute_performance-npc0": 0.005708217620849609, "sim_compute_performance-npc1": 0.00546373901786385, "sim_compute_performance-npc2": 0.005739586693899972, "sim_compute_performance-npc3": 0.00630049915104122}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.2759517930010227, "get_ui_image": 0.0942404473081548, "step_physics": 0.8469789214168034, "survival_time": 14.100000000000064, "driven_lanedir": 0.49861808729462953, "get_state_dump": 0.03526003479112125, "sim_render-ego": 0.009057546338291034, "get_robot_state": 0.061727862831548595, "sim_render-npc0": 0.009048115277121254, "sim_render-npc1": 0.00850485402641567, "sim_render-npc2": 0.008348460738540541, "sim_render-npc3": 0.008641531281437435, "get_duckie_state": 3.668433385537871e-06, "in-drivable-lane": 9.800000000000049, "agent_compute-ego": 0.02009706294282954, "deviation-heading": 2.2466652553473376, "agent_compute-npc0": 0.0772937815240089, "agent_compute-npc1": 0.07546065546942095, "agent_compute-npc2": 0.07276787064599653, "agent_compute-npc3": 0.07496717804712606, "complete-iteration": 1.5416751719535666, "set_robot_commands": 0.006399420136255576, "deviation-center-line": 0.4513697173657512, "driven_lanedir_consec": 0.49861808729462953, "sim_compute_sim_state": 0.07744345174613573, "sim_compute_performance-ego": 0.0056355312360939405, "sim_compute_performance-npc0": 0.0064650410456014865, "sim_compute_performance-npc1": 0.005681775140424146, "sim_compute_performance-npc2": 0.00587824304053124, "sim_compute_performance-npc3": 0.005435841303345159}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 2.4120543386243765, "get_ui_image": 0.09416569153467814, "step_physics": 0.9889959931373596, "survival_time": 14.950000000000076, "driven_lanedir": 0.6347932628037499, "get_state_dump": 0.03442870855331421, "sim_render-ego": 0.008708358605702718, "get_robot_state": 0.06046880642573039, "sim_render-npc0": 0.008746683597564697, "sim_render-npc1": 0.0084198792775472, "sim_render-npc2": 0.00851312796274821, "sim_render-npc3": 0.008355908393859864, "get_duckie_state": 3.742376963297526e-06, "in-drivable-lane": 10.150000000000077, "agent_compute-ego": 0.02059337615966797, "deviation-heading": 1.7248614657969994, "agent_compute-npc0": 0.07587502638498943, "agent_compute-npc1": 0.06508190313975017, "agent_compute-npc2": 0.07418996413548787, "agent_compute-npc3": 0.07440402507781982, "complete-iteration": 1.684629687468211, "set_robot_commands": 0.006187962690989176, "deviation-center-line": 0.32800662921139795, "driven_lanedir_consec": 0.6347932628037499, "sim_compute_sim_state": 0.09511029561360676, "sim_compute_performance-ego": 0.005610389709472656, "sim_compute_performance-npc0": 0.005522765318552653, "sim_compute_performance-npc1": 0.005336228211720784, "sim_compute_performance-npc2": 0.005470569928487142, "sim_compute_performance-npc3": 0.0053903436660766605}}
set_robot_commands_max0.006399420136255576
set_robot_commands_mean0.0061860267162861865
set_robot_commands_median0.006172614511868632
set_robot_commands_min0.005999457705151904
sim_compute_performance-ego_max0.005872983198899489
sim_compute_performance-ego_mean0.005656628839578123
sim_compute_performance-ego_median0.005622960472783298
sim_compute_performance-ego_min0.005507611213846409
sim_compute_performance-npc0_max0.0064650410456014865
sim_compute_performance-npc0_mean0.005738247831662496
sim_compute_performance-npc0_median0.005615491469701131
sim_compute_performance-npc0_min0.005256967341646235
sim_compute_performance-npc1_max0.005681775140424146
sim_compute_performance-npc1_mean0.0054473415126526275
sim_compute_performance-npc1_median0.005399983614792317
sim_compute_performance-npc1_min0.005307623680601729
sim_compute_performance-npc2_max0.00587824304053124
sim_compute_performance-npc2_mean0.005627642697234768
sim_compute_performance-npc2_median0.0056050783111935565
sim_compute_performance-npc2_min0.0054221711260207155
sim_compute_performance-npc3_max0.00630049915104122
sim_compute_performance-npc3_mean0.005655990542909118
sim_compute_performance-npc3_median0.0054665596772592966
sim_compute_performance-npc3_min0.0053903436660766605
sim_compute_sim_state_max0.09511029561360676
sim_compute_sim_state_mean0.08157296486510722
sim_compute_sim_state_median0.07754646622003931
sim_compute_sim_state_min0.07608863140674348
sim_render-ego_max0.009057546338291034
sim_render-ego_mean0.008634808203007313
sim_render-ego_median0.008701265255610147
sim_render-ego_min0.00807915596251792
sim_render-npc0_max0.009048115277121254
sim_render-npc0_mean0.008580010474615445
sim_render-npc0_median0.008657363417384389
sim_render-npc0_min0.007957199786571747
sim_render-npc1_max0.00850485402641567
sim_render-npc1_mean0.008372808389081724
sim_render-npc1_median0.008462142857003124
sim_render-npc1_min0.008062093815904982
sim_render-npc2_max0.008610948101504819
sim_render-npc2_mean0.008400357734775165
sim_render-npc2_median0.008430794350644377
sim_render-npc2_min0.008128894136307087
sim_render-npc3_max0.008696702810434194
sim_render-npc3_mean0.008467812609685554
sim_render-npc3_median0.00849871983764865
sim_render-npc3_min0.008177107953010722
simulation-passed1
step_physics_max0.9954696969783052
step_physics_mean0.952778586878584
step_physics_median0.9843328645596138
step_physics_min0.8469789214168034
survival_time_max14.950000000000076
survival_time_mean9.575000000000031
survival_time_min4.549999999999992
No reset possible
3992210906Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoreg03-f45ca34b70a1-10:01:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
3991310910Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simabortednoreg03-f45ca34b70a1-10:09:35
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1127, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 531, in heartbeat
    raise KeyboardInterrupt(msg)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible