Duckietown Challenges Home Challenges Submissions

Evaluator 2303

ID2303
evaluatorafdaniele04-b953b5d8021c-1
ownerI don't have one 😀
machinebox0
processafdaniele04-b953b5d8021c-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success1 42452
# timeout
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4245211457Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccess Note that this job is not up to date; the challenge has been changed. afdaniele04-b953b5d8021c-10:10:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.408987556638533
survival_time_median14.950000000000076
deviation-center-line_median0.986098982566044
in-drivable-lane_median0.25000000000000355


other stats
agent_compute-ego_max0.09345897992451986
agent_compute-ego_mean0.0927804086605708
agent_compute-ego_median0.09267104188601176
agent_compute-ego_min0.09232057094573974
complete-iteration_max0.20994274457295736
complete-iteration_mean0.20657031655311583
complete-iteration_median0.205790433883667
complete-iteration_min0.20475765387217204
deviation-center-line_max1.033630481682584
deviation-center-line_mean0.955477043249958
deviation-center-line_min0.8160797261851602
deviation-heading_max2.858936233109147
deviation-heading_mean2.205589810594154
deviation-heading_median2.371531039436893
deviation-heading_min1.2203609303936824
driven_any_max5.876098759836881
driven_any_mean5.0173423139672355
driven_any_median5.614140597265392
driven_any_min2.964989301501276
driven_lanedir_consec_max5.779964486114681
driven_lanedir_consec_mean4.832505439303445
driven_lanedir_consec_min2.7320821578220307
driven_lanedir_max5.779964486114681
driven_lanedir_mean4.832505439303445
driven_lanedir_median5.408987556638533
driven_lanedir_min2.7320821578220307
get_duckie_state_max1.0363260904947917e-06
get_duckie_state_mean9.936094284057618e-07
get_duckie_state_median9.934107462565105e-07
get_duckie_state_min9.512901306152344e-07
get_robot_state_max0.008103068669637043
get_robot_state_mean0.008067977627118427
get_robot_state_median0.008070094982783
get_robot_state_min0.00802865187327067
get_state_dump_max0.00670914888381958
get_state_dump_mean0.006689131061236064
get_state_dump_median0.006685929695765177
get_state_dump_min0.00667551596959432
get_ui_image_max0.022214821179707845
get_ui_image_mean0.02194811761379242
get_ui_image_median0.02188948591550191
get_ui_image_min0.021798677444458008
in-drivable-lane_max6.700000000000085
in-drivable-lane_mean1.8000000000000231
in-drivable-lane_min0.0
per-episodes
details{"ETHZ_autolab_technical_track-sc0-0-ego": {"driven_any": 5.876098759836881, "get_ui_image": 0.02185111999511719, "step_physics": 0.053027075131734214, "survival_time": 14.950000000000076, "driven_lanedir": 5.779964486114681, "get_state_dump": 0.006678713162740072, "sim_render-ego": 0.0036262830098470057, "get_robot_state": 0.008040712674458822, "get_duckie_state": 1.0363260904947917e-06, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09237958272298176, "deviation-heading": 1.9610031839541875, "complete-iteration": 0.2054551935195923, "set_robot_commands": 0.0032016523679097493, "deviation-center-line": 1.033630481682584, "driven_lanedir_consec": 5.779964486114681, "sim_compute_sim_state": 0.014249531428019206, "sim_compute_performance-ego": 0.0023267197608947752}, "ETHZ_autolab_technical_track-sc1-0-ego": {"driven_any": 5.546494542335026, "get_ui_image": 0.021798677444458008, "step_physics": 0.05145538409550985, "survival_time": 14.950000000000076, "driven_lanedir": 5.291675889695733, "get_state_dump": 0.006693146228790283, "sim_render-ego": 0.00361551841100057, "get_robot_state": 0.008103068669637043, "get_duckie_state": 1.0236104329427085e-06, "in-drivable-lane": 0.5000000000000071, "agent_compute-ego": 0.09345897992451986, "deviation-heading": 2.858936233109147, "complete-iteration": 0.20475765387217204, "set_robot_commands": 0.0031606554985046387, "deviation-center-line": 0.966352539320597, "driven_lanedir_consec": 5.291675889695733, "sim_compute_sim_state": 0.014069795608520508, "sim_compute_performance-ego": 0.0023271656036376953}, "ETHZ_autolab_technical_track-sc2-0-ego": {"driven_any": 2.964989301501276, "get_ui_image": 0.021927851835886636, "step_physics": 0.0533405065536499, "survival_time": 14.950000000000076, "driven_lanedir": 2.7320821578220307, "get_state_dump": 0.00667551596959432, "sim_render-ego": 0.0036695241928100582, "get_robot_state": 0.00802865187327067, "get_duckie_state": 9.632110595703123e-07, "in-drivable-lane": 6.700000000000085, "agent_compute-ego": 0.09232057094573974, "deviation-heading": 1.2203609303936824, "complete-iteration": 0.2061256742477417, "set_robot_commands": 0.003274856408437093, "deviation-center-line": 0.8160797261851602, "driven_lanedir_consec": 2.7320821578220307, "sim_compute_sim_state": 0.01448262929916382, "sim_compute_performance-ego": 0.002329974174499512}, "ETHZ_autolab_technical_track-sc3-0-ego": {"driven_any": 5.6817866521957585, "get_ui_image": 0.022214821179707845, "step_physics": 0.05375287135442098, "survival_time": 14.950000000000076, "driven_lanedir": 5.526299223581334, "get_state_dump": 0.00670914888381958, "sim_render-ego": 0.0036225207646687825, "get_robot_state": 0.008099477291107177, "get_duckie_state": 9.512901306152344e-07, "in-drivable-lane": 0.0, "agent_compute-ego": 0.09296250104904176, "deviation-heading": 2.7820588949195986, "complete-iteration": 0.20994274457295736, "set_robot_commands": 0.0033026893933614096, "deviation-center-line": 1.005845425811491, "driven_lanedir_consec": 5.526299223581334, "sim_compute_sim_state": 0.016871448357899985, "sim_compute_performance-ego": 0.002332003911336263}}
set_robot_commands_max0.0033026893933614096
set_robot_commands_mean0.0032349634170532222
set_robot_commands_median0.0032382543881734212
set_robot_commands_min0.0031606554985046387
sim_compute_performance-ego_max0.002332003911336263
sim_compute_performance-ego_mean0.0023289658625920613
sim_compute_performance-ego_median0.0023285698890686034
sim_compute_performance-ego_min0.0023267197608947752
sim_compute_sim_state_max0.016871448357899985
sim_compute_sim_state_mean0.01491835117340088
sim_compute_sim_state_median0.014366080363591513
sim_compute_sim_state_min0.014069795608520508
sim_render-ego_max0.0036695241928100582
sim_render-ego_mean0.003633461594581604
sim_render-ego_median0.003624401887257894
sim_render-ego_min0.00361551841100057
simulation-passed1
step_physics_max0.05375287135442098
step_physics_mean0.05289395928382873
step_physics_median0.05318379084269206
step_physics_min0.05145538409550985
survival_time_max14.950000000000076
survival_time_mean14.950000000000076
survival_time_min14.950000000000076
No reset possible