Duckietown Challenges Home Challenges Submissions

Evaluator 2757

ID2757
evaluatornogpu-prod-03
ownerI don't have one 😀
machinenogpu-prod_cd8ed8cff8c3
processnogpu-prod-03_cd8ed8cff8c3
version6.1.28
first heard
last heard
statusinactive
# evaluating
# success1 46045
# timeout
# failed
# error3 46054
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
4617011779Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-032:47:10
Waited 10005 seconds [...]
Waited 10005 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4611511815Bea Baselines 🐤template-rosaido5-LFV-sim-testingLFVv-simerrornonogpu-prod-032:47:08
Waited 10004 seconds [...]
Waited 10004 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4605411806Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simerrornonogpu-prod-032:47:12
Waited 10010 seconds [...]
Waited 10010 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4604511795Bea Baselines 🐤straightaido5-LF-sanity-sim-validationsanity-checksuccessyesnogpu-prod-030:01:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.031487066019268095
survival_time_median0.49999999999999994
deviation-center-line_median0.007622193437528264
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.010112957520918411
agent_compute-ego_mean0.010112957520918411
agent_compute-ego_median0.010112957520918411
agent_compute-ego_min0.010112957520918411
complete-iteration_max0.1496077667583119
complete-iteration_mean0.1496077667583119
complete-iteration_median0.1496077667583119
complete-iteration_min0.1496077667583119
deviation-center-line_max0.007622193437528264
deviation-center-line_mean0.007622193437528264
deviation-center-line_min0.007622193437528264
deviation-heading_max0.05365989936758172
deviation-heading_mean0.05365989936758172
deviation-heading_median0.05365989936758172
deviation-heading_min0.05365989936758172
driven_any_max0.031665299219058494
driven_any_mean0.031665299219058494
driven_any_median0.031665299219058494
driven_any_min0.031665299219058494
driven_lanedir_consec_max0.031487066019268095
driven_lanedir_consec_mean0.031487066019268095
driven_lanedir_consec_min0.031487066019268095
driven_lanedir_max0.031487066019268095
driven_lanedir_mean0.031487066019268095
driven_lanedir_median0.031487066019268095
driven_lanedir_min0.031487066019268095
get_duckie_state_max0.0024351206692782316
get_duckie_state_mean0.0024351206692782316
get_duckie_state_median0.0024351206692782316
get_duckie_state_min0.0024351206692782316
get_robot_state_max0.007684924385764382
get_robot_state_mean0.007684924385764382
get_robot_state_median0.007684924385764382
get_robot_state_min0.007684924385764382
get_state_dump_max0.007177136161110618
get_state_dump_mean0.007177136161110618
get_state_dump_median0.007177136161110618
get_state_dump_min0.007177136161110618
get_ui_image_max0.027639779177579017
get_ui_image_mean0.027639779177579017
get_ui_image_median0.027639779177579017
get_ui_image_min0.027639779177579017
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.031665299219058494, "get_ui_image": 0.027639779177579017, "step_physics": 0.07276730103926225, "survival_time": 0.49999999999999994, "driven_lanedir": 0.031487066019268095, "get_state_dump": 0.007177136161110618, "sim_render-ego": 0.0037511262026700106, "get_robot_state": 0.007684924385764382, "get_duckie_state": 0.0024351206692782316, "in-drivable-lane": 0.0, "agent_compute-ego": 0.010112957520918411, "deviation-heading": 0.05365989936758172, "complete-iteration": 0.1496077667583119, "set_robot_commands": 0.002333836121992631, "deviation-center-line": 0.007622193437528264, "driven_lanedir_consec": 0.031487066019268095, "sim_compute_sim_state": 0.013254490765658293, "sim_compute_performance-ego": 0.002355770631269975}}
set_robot_commands_max0.002333836121992631
set_robot_commands_mean0.002333836121992631
set_robot_commands_median0.002333836121992631
set_robot_commands_min0.002333836121992631
sim_compute_performance-ego_max0.002355770631269975
sim_compute_performance-ego_mean0.002355770631269975
sim_compute_performance-ego_median0.002355770631269975
sim_compute_performance-ego_min0.002355770631269975
sim_compute_sim_state_max0.013254490765658293
sim_compute_sim_state_mean0.013254490765658293
sim_compute_sim_state_median0.013254490765658293
sim_compute_sim_state_min0.013254490765658293
sim_render-ego_max0.0037511262026700106
sim_render-ego_mean0.0037511262026700106
sim_render-ego_median0.0037511262026700106
sim_render-ego_min0.0037511262026700106
simulation-passed1
step_physics_max0.07276730103926225
step_physics_mean0.07276730103926225
step_physics_median0.07276730103926225
step_physics_min0.07276730103926225
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible