Duckietown Challenges Home Challenges Submissions

Evaluator 2256

ID2256
evaluatormont11-96ac6211a655-1
ownerI don't have one 😀
machineaido-ms-7b09
processmont11-96ac6211a655-1
versiond-c:6.1.23;d-c-r:6.0.59
first heard
last heard
statusinactive
# evaluating
# success2 39971
# timeout1 39988
# failed
# error
# aborted
# host-error
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
3998811254Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simtimeoutnomont11-96ac6211a655-1----No reset possible
3997811237Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simsuccessnomont11-96ac6211a655-10:12:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5357990364269445
survival_time_median14.950000000000076
deviation-center-line_median0.516409968708577
in-drivable-lane_median9.300000000000065


other stats
agent_compute-ego0_max0.016387712955474854
agent_compute-ego0_mean0.016387712955474854
agent_compute-ego0_median0.016387712955474854
agent_compute-ego0_min0.016387712955474854
agent_compute-ego1_max0.016689467430114745
agent_compute-ego1_mean0.016689467430114745
agent_compute-ego1_median0.016689467430114745
agent_compute-ego1_min0.016689467430114745
agent_compute-ego2_max0.016672112147013345
agent_compute-ego2_mean0.016672112147013345
agent_compute-ego2_median0.016672112147013345
agent_compute-ego2_min0.016672112147013345
complete-iteration_max1.06238525390625
complete-iteration_mean1.06238525390625
complete-iteration_median1.06238525390625
complete-iteration_min1.06238525390625
deviation-center-line_max0.7640043431652787
deviation-center-line_mean0.5551122968166263
deviation-center-line_min0.38492257857602347
deviation-heading_max4.280649180450708
deviation-heading_mean1.972050623887076
deviation-heading_median1.3516281792896734
deviation-heading_min0.2838745119208464
driven_any_max2.4141494224669877
driven_any_mean1.504627899039762
driven_any_median1.6512692866959366
driven_any_min0.448464987956362
driven_lanedir_consec_max0.6513468578527855
driven_lanedir_consec_mean0.5451813124431896
driven_lanedir_consec_min0.4483980430498389
driven_lanedir_max0.6766318008772942
driven_lanedir_mean0.5536096267846925
driven_lanedir_median0.5357990364269445
driven_lanedir_min0.4483980430498389
get_duckie_state_max2.9897689819335935e-06
get_duckie_state_mean2.9897689819335935e-06
get_duckie_state_median2.9897689819335935e-06
get_duckie_state_min2.9897689819335935e-06
get_robot_state_max0.07965415398279826
get_robot_state_mean0.07965415398279826
get_robot_state_median0.07965415398279826
get_robot_state_min0.07965415398279826
get_state_dump_max0.04229827086130778
get_state_dump_mean0.04229827086130778
get_state_dump_median0.04229827086130778
get_state_dump_min0.04229827086130778
get_ui_image_max0.1078362504641215
get_ui_image_mean0.1078362504641215
get_ui_image_median0.1078362504641215
get_ui_image_min0.1078362504641215
in-drivable-lane_max10.100000000000088
in-drivable-lane_mean6.466666666666717
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego0": {"driven_any": 1.6512692866959366, "get_ui_image": 0.1078362504641215, "step_physics": 0.6193653996785482, "survival_time": 14.950000000000076, "driven_lanedir": 0.6766318008772942, "get_state_dump": 0.04229827086130778, "get_robot_state": 0.07965415398279826, "sim_render-ego0": 0.0075506337483723955, "sim_render-ego1": 0.007579720815022786, "sim_render-ego2": 0.00770508607228597, "get_duckie_state": 2.9897689819335935e-06, "in-drivable-lane": 10.100000000000088, "deviation-heading": 1.3516281792896734, "agent_compute-ego0": 0.016387712955474854, "agent_compute-ego1": 0.016689467430114745, "agent_compute-ego2": 0.016672112147013345, "complete-iteration": 1.06238525390625, "set_robot_commands": 0.005308372179667155, "deviation-center-line": 0.38492257857602347, "driven_lanedir_consec": 0.6513468578527855, "sim_compute_sim_state": 0.10886348168055215, "sim_compute_performance-ego0": 0.0051732659339904785, "sim_compute_performance-ego1": 0.005174291133880615, "sim_compute_performance-ego2": 0.0051191226641337075}, "udem1-sc0-0-ego1": {"driven_any": 0.448464987956362, "get_ui_image": 0.1078362504641215, "step_physics": 0.6193653996785482, "survival_time": 14.950000000000076, "driven_lanedir": 0.4483980430498389, "get_state_dump": 0.04229827086130778, "get_robot_state": 0.07965415398279826, "sim_render-ego0": 0.0075506337483723955, "sim_render-ego1": 0.007579720815022786, "sim_render-ego2": 0.00770508607228597, "get_duckie_state": 2.9897689819335935e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.2838745119208464, "agent_compute-ego0": 0.016387712955474854, "agent_compute-ego1": 0.016689467430114745, "agent_compute-ego2": 0.016672112147013345, "complete-iteration": 1.06238525390625, "set_robot_commands": 0.005308372179667155, "deviation-center-line": 0.7640043431652787, "driven_lanedir_consec": 0.4483980430498389, "sim_compute_sim_state": 0.10886348168055215, "sim_compute_performance-ego0": 0.0051732659339904785, "sim_compute_performance-ego1": 0.005174291133880615, "sim_compute_performance-ego2": 0.0051191226641337075}, "udem1-sc0-0-ego2": {"driven_any": 2.4141494224669877, "get_ui_image": 0.1078362504641215, "step_physics": 0.6193653996785482, "survival_time": 14.950000000000076, "driven_lanedir": 0.5357990364269445, "get_state_dump": 0.04229827086130778, "get_robot_state": 0.07965415398279826, "sim_render-ego0": 0.0075506337483723955, "sim_render-ego1": 0.007579720815022786, "sim_render-ego2": 0.00770508607228597, "get_duckie_state": 2.9897689819335935e-06, "in-drivable-lane": 9.300000000000065, "deviation-heading": 4.280649180450708, "agent_compute-ego0": 0.016387712955474854, "agent_compute-ego1": 0.016689467430114745, "agent_compute-ego2": 0.016672112147013345, "complete-iteration": 1.06238525390625, "set_robot_commands": 0.005308372179667155, "deviation-center-line": 0.516409968708577, "driven_lanedir_consec": 0.5357990364269445, "sim_compute_sim_state": 0.10886348168055215, "sim_compute_performance-ego0": 0.0051732659339904785, "sim_compute_performance-ego1": 0.005174291133880615, "sim_compute_performance-ego2": 0.0051191226641337075}}
set_robot_commands_max0.005308372179667155
set_robot_commands_mean0.005308372179667155
set_robot_commands_median0.005308372179667155
set_robot_commands_min0.005308372179667155
sim_compute_performance-ego0_max0.0051732659339904785
sim_compute_performance-ego0_mean0.0051732659339904785
sim_compute_performance-ego0_median0.0051732659339904785
sim_compute_performance-ego0_min0.0051732659339904785
sim_compute_performance-ego1_max0.005174291133880615
sim_compute_performance-ego1_mean0.005174291133880615
sim_compute_performance-ego1_median0.005174291133880615
sim_compute_performance-ego1_min0.005174291133880615
sim_compute_performance-ego2_max0.0051191226641337075
sim_compute_performance-ego2_mean0.0051191226641337075
sim_compute_performance-ego2_median0.0051191226641337075
sim_compute_performance-ego2_min0.0051191226641337075
sim_compute_sim_state_max0.10886348168055215
sim_compute_sim_state_mean0.10886348168055215
sim_compute_sim_state_median0.10886348168055215
sim_compute_sim_state_min0.10886348168055215
sim_render-ego0_max0.0075506337483723955
sim_render-ego0_mean0.0075506337483723955
sim_render-ego0_median0.0075506337483723955
sim_render-ego0_min0.0075506337483723955
sim_render-ego1_max0.007579720815022786
sim_render-ego1_mean0.007579720815022786
sim_render-ego1_median0.007579720815022786
sim_render-ego1_min0.007579720815022786
sim_render-ego2_max0.00770508607228597
sim_render-ego2_mean0.00770508607228597
sim_render-ego2_median0.00770508607228597
sim_render-ego2_min0.00770508607228597
simulation-passed1
step_physics_max0.6193653996785482
step_physics_mean0.6193653996785482
step_physics_median0.6193653996785482
step_physics_min0.6193653996785482
survival_time_max14.950000000000076
survival_time_mean14.95000000000008
survival_time_min14.950000000000076
No reset possible
3997111226Bea Baselines 🐤straightaido5-LF-sanity-sim-validationsanity-checksuccessyesmont11-96ac6211a655-10:01:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.031487066019268095
survival_time_median0.49999999999999994
deviation-center-line_median0.007622193437528264
in-drivable-lane_median0.0


other stats
agent_compute-ego_max0.016348101875998756
agent_compute-ego_mean0.016348101875998756
agent_compute-ego_median0.016348101875998756
agent_compute-ego_min0.016348101875998756
complete-iteration_max0.2750568823380904
complete-iteration_mean0.2750568823380904
complete-iteration_median0.2750568823380904
complete-iteration_min0.2750568823380904
deviation-center-line_max0.007622193437528264
deviation-center-line_mean0.007622193437528264
deviation-center-line_min0.007622193437528264
deviation-heading_max0.05365989936758172
deviation-heading_mean0.05365989936758172
deviation-heading_median0.05365989936758172
deviation-heading_min0.05365989936758172
driven_any_max0.031665299219058494
driven_any_mean0.031665299219058494
driven_any_median0.031665299219058494
driven_any_min0.031665299219058494
driven_lanedir_consec_max0.031487066019268095
driven_lanedir_consec_mean0.031487066019268095
driven_lanedir_consec_min0.031487066019268095
driven_lanedir_max0.031487066019268095
driven_lanedir_mean0.031487066019268095
driven_lanedir_median0.031487066019268095
driven_lanedir_min0.031487066019268095
get_duckie_state_max0.004568511789495295
get_duckie_state_mean0.004568511789495295
get_duckie_state_median0.004568511789495295
get_duckie_state_min0.004568511789495295
get_robot_state_max0.017656998200850052
get_robot_state_mean0.017656998200850052
get_robot_state_median0.017656998200850052
get_robot_state_min0.017656998200850052
get_state_dump_max0.016106887297196823
get_state_dump_mean0.016106887297196823
get_state_dump_median0.016106887297196823
get_state_dump_min0.016106887297196823
get_ui_image_max0.04542992331764915
get_ui_image_mean0.04542992331764915
get_ui_image_median0.04542992331764915
get_ui_image_min0.04542992331764915
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"udem1-sc0-0-ego": {"driven_any": 0.031665299219058494, "get_ui_image": 0.04542992331764915, "step_physics": 0.12795836275274103, "survival_time": 0.49999999999999994, "driven_lanedir": 0.031487066019268095, "get_state_dump": 0.016106887297196823, "sim_render-ego": 0.0069717060435901985, "get_robot_state": 0.017656998200850052, "get_duckie_state": 0.004568511789495295, "in-drivable-lane": 0.0, "agent_compute-ego": 0.016348101875998756, "deviation-heading": 0.05365989936758172, "complete-iteration": 0.2750568823380904, "set_robot_commands": 0.005833734165538441, "deviation-center-line": 0.007622193437528264, "driven_lanedir_consec": 0.031487066019268095, "sim_compute_sim_state": 0.028833844444968483, "sim_compute_performance-ego": 0.005183393304998224}}
set_robot_commands_max0.005833734165538441
set_robot_commands_mean0.005833734165538441
set_robot_commands_median0.005833734165538441
set_robot_commands_min0.005833734165538441
sim_compute_performance-ego_max0.005183393304998224
sim_compute_performance-ego_mean0.005183393304998224
sim_compute_performance-ego_median0.005183393304998224
sim_compute_performance-ego_min0.005183393304998224
sim_compute_sim_state_max0.028833844444968483
sim_compute_sim_state_mean0.028833844444968483
sim_compute_sim_state_median0.028833844444968483
sim_compute_sim_state_min0.028833844444968483
sim_render-ego_max0.0069717060435901985
sim_render-ego_mean0.0069717060435901985
sim_render-ego_median0.0069717060435901985
sim_render-ego_min0.0069717060435901985
simulation-passed1
step_physics_max0.12795836275274103
step_physics_mean0.12795836275274103
step_physics_median0.12795836275274103
step_physics_min0.12795836275274103
survival_time_max0.49999999999999994
survival_time_mean0.49999999999999994
survival_time_min0.49999999999999994
No reset possible