Duckietown Challenges Home Challenges Submissions

Evaluator 5045

ID5045
evaluatornoname
ownerBenjamin Matson
machineubuntu1804.localdomain
processnoname_ubuntu1804.localdomain
version6.2.19
first heard
last heard
statusinactive
# evaluating
# success1 62736
# timeout
# failed
# error
# aborted
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors3
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)2.2 GB
RAM free (MB)1.3 GB
Disk (MB)3726.0 GB
Disk available (MB)3065.6 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6273613874Benjamin Matsontemplate-randomaido-hello-sim-validation370success Note that this job is not up to date; the challenge has been changed. noname0:03:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.01776567914269187
agent_compute-ego0_mean0.01776567914269187
agent_compute-ego0_median0.01776567914269187
agent_compute-ego0_min0.01776567914269187
complete-iteration_max0.15801511027596213
complete-iteration_mean0.15801511027596213
complete-iteration_median0.15801511027596213
complete-iteration_min0.15801511027596213
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.46033809610608983
driven_any_mean0.46033809610608983
driven_any_median0.46033809610608983
driven_any_min0.46033809610608983
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.005640019070018421
get_duckie_state_mean0.005640019070018421
get_duckie_state_median0.005640019070018421
get_duckie_state_min0.005640019070018421
get_robot_state_max0.0046843398701060905
get_robot_state_mean0.0046843398701060905
get_robot_state_median0.0046843398701060905
get_robot_state_min0.0046843398701060905
get_state_dump_max0.006290863860737194
get_state_dump_mean0.006290863860737194
get_state_dump_median0.006290863860737194
get_state_dump_min0.006290863860737194
get_ui_image_max0.02741660855033181
get_ui_image_mean0.02741660855033181
get_ui_image_median0.02741660855033181
get_ui_image_min0.02741660855033181
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.46033809610608983, "get_ui_image": 0.02741660855033181, "step_physics": 0.07677004012194547, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.006290863860737194, "get_robot_state": 0.0046843398701060905, "sim_render-ego0": 0.0047044049609791146, "get_duckie_state": 0.005640019070018421, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.01776567914269187, "complete-iteration": 0.15801511027596213, "set_robot_commands": 0.004849439317529852, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.006763593717054887, "sim_compute_performance-ego0": 0.003025174140930176}}
set_robot_commands_max0.004849439317529852
set_robot_commands_mean0.004849439317529852
set_robot_commands_median0.004849439317529852
set_robot_commands_min0.004849439317529852
sim_compute_performance-ego0_max0.003025174140930176
sim_compute_performance-ego0_mean0.003025174140930176
sim_compute_performance-ego0_median0.003025174140930176
sim_compute_performance-ego0_min0.003025174140930176
sim_compute_sim_state_max0.006763593717054887
sim_compute_sim_state_mean0.006763593717054887
sim_compute_sim_state_median0.006763593717054887
sim_compute_sim_state_min0.006763593717054887
sim_render-ego0_max0.0047044049609791146
sim_render-ego0_mean0.0047044049609791146
sim_render-ego0_median0.0047044049609791146
sim_render-ego0_min0.0047044049609791146
simulation-passed1
step_physics_max0.07677004012194547
step_physics_mean0.07677004012194547
step_physics_median0.07677004012194547
step_physics_min0.07677004012194547
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible