Duckietown Challenges Home Challenges Submissions

Evaluator 5281

ID5281
evaluatornogpu-production-b-spot-0-03
ownerI don't have one 😀
machinenogpu-production-b-spot-0_4e2c427a60f7
processnogpu-production-b-spot-0-03_4e2c427a60f7
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success13 78656
# timeout
# failed
# error
# aborted1 78637
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors96
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)184.7 GB
RAM free (MB)154.2 GB
Disk (MB)969.3 GB
Disk available (MB)595.0 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7911115921Tanmay Samakexercises_braitenbergmooc-BV1sim-0of5successnonogpu-production-b-spot-0-030:08:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.643465682186686


other stats
agent_compute-ego0_max0.010814256179027069
agent_compute-ego0_mean0.010814256179027069
agent_compute-ego0_median0.010814256179027069
agent_compute-ego0_min0.010814256179027069
complete-iteration_max0.2529752672635592
complete-iteration_mean0.2529752672635592
complete-iteration_median0.2529752672635592
complete-iteration_min0.2529752672635592
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.643465682186686
distance-from-start_median5.643465682186686
distance-from-start_min5.643465682186686
driven_any_max6.67419620093137
driven_any_mean6.67419620093137
driven_any_median6.67419620093137
driven_any_min6.67419620093137
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08223750530145107
get_duckie_state_mean0.08223750530145107
get_duckie_state_median0.08223750530145107
get_duckie_state_min0.08223750530145107
get_robot_state_max0.0035800694196652144
get_robot_state_mean0.0035800694196652144
get_robot_state_median0.0035800694196652144
get_robot_state_min0.0035800694196652144
get_state_dump_max0.017237021372868463
get_state_dump_mean0.017237021372868463
get_state_dump_median0.017237021372868463
get_state_dump_min0.017237021372868463
get_ui_image_max0.04093758142911471
get_ui_image_mean0.04093758142911471
get_ui_image_median0.04093758142911471
get_ui_image_min0.04093758142911471
in-drivable-lane_max48.69999999999937
in-drivable-lane_mean48.69999999999937
in-drivable-lane_median48.69999999999937
in-drivable-lane_min48.69999999999937
per-episodes
details{"d45-ego0": {"driven_any": 6.67419620093137, "get_ui_image": 0.04093758142911471, "step_physics": 0.08306359731234036, "survival_time": 48.69999999999937, "driven_lanedir": 0.0, "get_state_dump": 0.017237021372868463, "get_robot_state": 0.0035800694196652144, "sim_render-ego0": 0.0033907897655780497, "get_duckie_state": 0.08223750530145107, "in-drivable-lane": 48.69999999999937, "deviation-heading": 0.0, "agent_compute-ego0": 0.010814256179027069, "complete-iteration": 0.2529752672635592, "set_robot_commands": 0.001964914859869542, "distance-from-start": 5.643465682186686, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007896613585643279, "sim_compute_performance-ego0": 0.001759199240268805}}
set_robot_commands_max0.001964914859869542
set_robot_commands_mean0.001964914859869542
set_robot_commands_median0.001964914859869542
set_robot_commands_min0.001964914859869542
sim_compute_performance-ego0_max0.001759199240268805
sim_compute_performance-ego0_mean0.001759199240268805
sim_compute_performance-ego0_median0.001759199240268805
sim_compute_performance-ego0_min0.001759199240268805
sim_compute_sim_state_max0.007896613585643279
sim_compute_sim_state_mean0.007896613585643279
sim_compute_sim_state_median0.007896613585643279
sim_compute_sim_state_min0.007896613585643279
sim_render-ego0_max0.0033907897655780497
sim_render-ego0_mean0.0033907897655780497
sim_render-ego0_median0.0033907897655780497
sim_render-ego0_min0.0033907897655780497
simulation-passed1
step_physics_max0.08306359731234036
step_physics_mean0.08306359731234036
step_physics_median0.08306359731234036
step_physics_min0.08306359731234036
survival_time_max48.69999999999937
survival_time_mean48.69999999999937
survival_time_median48.69999999999937
survival_time_min48.69999999999937
No reset possible
7909315918Chinmay Samakexercises_braitenbergmooc-BV1sim-2of5successnonogpu-production-b-spot-0-030:11:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.114695206391368


other stats
agent_compute-ego0_max0.010431364910687932
agent_compute-ego0_mean0.010431364910687932
agent_compute-ego0_median0.010431364910687932
agent_compute-ego0_min0.010431364910687932
complete-iteration_max0.2297614101168516
complete-iteration_mean0.2297614101168516
complete-iteration_median0.2297614101168516
complete-iteration_min0.2297614101168516
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.114695206391368
distance-from-start_median5.114695206391368
distance-from-start_min5.114695206391368
driven_any_max5.583571171524675
driven_any_mean5.583571171524675
driven_any_median5.583571171524675
driven_any_min5.583571171524675
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07893841431400957
get_duckie_state_mean0.07893841431400957
get_duckie_state_median0.07893841431400957
get_duckie_state_min0.07893841431400957
get_robot_state_max0.0034914802849838676
get_robot_state_mean0.0034914802849838676
get_robot_state_median0.0034914802849838676
get_robot_state_min0.0034914802849838676
get_state_dump_max0.015649725852858315
get_state_dump_mean0.015649725852858315
get_state_dump_median0.015649725852858315
get_state_dump_min0.015649725852858315
get_ui_image_max0.037459206521560706
get_ui_image_mean0.037459206521560706
get_ui_image_median0.037459206521560706
get_ui_image_min0.037459206521560706
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d40-ego0": {"driven_any": 5.583571171524675, "get_ui_image": 0.037459206521560706, "step_physics": 0.06839867853105912, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.015649725852858315, "get_robot_state": 0.0034914802849838676, "sim_render-ego0": 0.003481241189669213, "get_duckie_state": 0.07893841431400957, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.010431364910687932, "complete-iteration": 0.2297614101168516, "set_robot_commands": 0.002071858047942734, "distance-from-start": 5.114695206391368, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007919176730585535, "sim_compute_performance-ego0": 0.0018310965745276357}}
set_robot_commands_max0.002071858047942734
set_robot_commands_mean0.002071858047942734
set_robot_commands_median0.002071858047942734
set_robot_commands_min0.002071858047942734
sim_compute_performance-ego0_max0.0018310965745276357
sim_compute_performance-ego0_mean0.0018310965745276357
sim_compute_performance-ego0_median0.0018310965745276357
sim_compute_performance-ego0_min0.0018310965745276357
sim_compute_sim_state_max0.007919176730585535
sim_compute_sim_state_mean0.007919176730585535
sim_compute_sim_state_median0.007919176730585535
sim_compute_sim_state_min0.007919176730585535
sim_render-ego0_max0.003481241189669213
sim_render-ego0_mean0.003481241189669213
sim_render-ego0_median0.003481241189669213
sim_render-ego0_min0.003481241189669213
simulation-passed1
step_physics_max0.06839867853105912
step_physics_mean0.06839867853105912
step_physics_median0.06839867853105912
step_physics_min0.06839867853105912
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7894915872Bea Baselines 🐤dummy_collision_checkermooc-collision-check-valistep1successnonogpu-production-b-spot-0-030:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.48
false_positive_rate0.51


other stats
nsamples400
No reset possible
7894115873Bea Baselines 🐤dummy_collision_checkermooc-collision-check-teststep1successnonogpu-production-b-spot-0-030:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.53
false_positive_rate0.47


other stats
nsamples200
No reset possible
7890515864Bea Baselines 🐤dummy_collision_checkermooc-collision-check-teststep1successnonogpu-production-b-spot-0-030:00:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
performance0.5
No reset possible
7888815863Bea Baselines 🐤dummy_collision_checkermooc-collision-check-valistep1successnonogpu-production-b-spot-0-030:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
performance0.5
No reset possible
7879615856Rohan Kaushikexercises_braitenbergmooc-BV1sim-0of5successnonogpu-production-b-spot-0-030:04:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.1074967835343077


other stats
agent_compute-ego0_max0.010820668258946457
agent_compute-ego0_mean0.010820668258946457
agent_compute-ego0_median0.010820668258946457
agent_compute-ego0_min0.010820668258946457
complete-iteration_max0.2529568453848144
complete-iteration_mean0.2529568453848144
complete-iteration_median0.2529568453848144
complete-iteration_min0.2529568453848144
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.1074967835343077
distance-from-start_median1.1074967835343077
distance-from-start_min1.1074967835343077
driven_any_max1.1204999387031769
driven_any_mean1.1204999387031769
driven_any_median1.1204999387031769
driven_any_min1.1204999387031769
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08508829057434976
get_duckie_state_mean0.08508829057434976
get_duckie_state_median0.08508829057434976
get_duckie_state_min0.08508829057434976
get_robot_state_max0.003541808425288497
get_robot_state_mean0.003541808425288497
get_robot_state_median0.003541808425288497
get_robot_state_min0.003541808425288497
get_state_dump_max0.017048723095065946
get_state_dump_mean0.017048723095065946
get_state_dump_median0.017048723095065946
get_state_dump_min0.017048723095065946
get_ui_image_max0.0406567395388425
get_ui_image_mean0.0406567395388425
get_ui_image_median0.0406567395388425
get_ui_image_min0.0406567395388425
in-drivable-lane_max13.600000000000058
in-drivable-lane_mean13.600000000000058
in-drivable-lane_median13.600000000000058
in-drivable-lane_min13.600000000000058
per-episodes
details{"d45-ego0": {"driven_any": 1.1204999387031769, "get_ui_image": 0.0406567395388425, "step_physics": 0.07901350045815492, "survival_time": 13.600000000000058, "driven_lanedir": 0.0, "get_state_dump": 0.017048723095065946, "get_robot_state": 0.003541808425288497, "sim_render-ego0": 0.003432843274685926, "get_duckie_state": 0.08508829057434976, "in-drivable-lane": 13.600000000000058, "deviation-heading": 0.0, "agent_compute-ego0": 0.010820668258946457, "complete-iteration": 0.2529568453848144, "set_robot_commands": 0.0020287089295439667, "distance-from-start": 1.1074967835343077, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009380248003390244, "sim_compute_performance-ego0": 0.0018467422806736312}}
set_robot_commands_max0.0020287089295439667
set_robot_commands_mean0.0020287089295439667
set_robot_commands_median0.0020287089295439667
set_robot_commands_min0.0020287089295439667
sim_compute_performance-ego0_max0.0018467422806736312
sim_compute_performance-ego0_mean0.0018467422806736312
sim_compute_performance-ego0_median0.0018467422806736312
sim_compute_performance-ego0_min0.0018467422806736312
sim_compute_sim_state_max0.009380248003390244
sim_compute_sim_state_mean0.009380248003390244
sim_compute_sim_state_median0.009380248003390244
sim_compute_sim_state_min0.009380248003390244
sim_render-ego0_max0.003432843274685926
sim_render-ego0_mean0.003432843274685926
sim_render-ego0_median0.003432843274685926
sim_render-ego0_min0.003432843274685926
simulation-passed1
step_physics_max0.07901350045815492
step_physics_mean0.07901350045815492
step_physics_median0.07901350045815492
step_physics_min0.07901350045815492
survival_time_max13.600000000000058
survival_time_mean13.600000000000058
survival_time_median13.600000000000058
survival_time_min13.600000000000058
No reset possible
7878815854Juan Ramirezexercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-030:01:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.897884356406937


other stats
agent_compute-ego0_max0.010664362838302834
agent_compute-ego0_mean0.010664362838302834
agent_compute-ego0_median0.010664362838302834
agent_compute-ego0_min0.010664362838302834
complete-iteration_max0.2609169863272404
complete-iteration_mean0.2609169863272404
complete-iteration_median0.2609169863272404
complete-iteration_min0.2609169863272404
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.897884356406937
distance-from-start_median0.897884356406937
distance-from-start_min0.897884356406937
driven_any_max1.0560884571819011
driven_any_mean1.0560884571819011
driven_any_median1.0560884571819011
driven_any_min1.0560884571819011
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09428460356118022
get_duckie_state_mean0.09428460356118022
get_duckie_state_median0.09428460356118022
get_duckie_state_min0.09428460356118022
get_robot_state_max0.003503433172253595
get_robot_state_mean0.003503433172253595
get_robot_state_median0.003503433172253595
get_robot_state_min0.003503433172253595
get_state_dump_max0.01863656182220017
get_state_dump_mean0.01863656182220017
get_state_dump_median0.01863656182220017
get_state_dump_min0.01863656182220017
get_ui_image_max0.04200490661289381
get_ui_image_mean0.04200490661289381
get_ui_image_median0.04200490661289381
get_ui_image_min0.04200490661289381
in-drivable-lane_max3.399999999999996
in-drivable-lane_mean3.399999999999996
in-drivable-lane_median3.399999999999996
in-drivable-lane_min3.399999999999996
per-episodes
details{"d50-ego0": {"driven_any": 1.0560884571819011, "get_ui_image": 0.04200490661289381, "step_physics": 0.07592537437660107, "survival_time": 3.399999999999996, "driven_lanedir": 0.0, "get_state_dump": 0.01863656182220017, "get_robot_state": 0.003503433172253595, "sim_render-ego0": 0.0034212582353232565, "get_duckie_state": 0.09428460356118022, "in-drivable-lane": 3.399999999999996, "deviation-heading": 0.0, "agent_compute-ego0": 0.010664362838302834, "complete-iteration": 0.2609169863272404, "set_robot_commands": 0.002051156500111455, "distance-from-start": 0.897884356406937, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008531770844390427, "sim_compute_performance-ego0": 0.0017941585485486016}}
set_robot_commands_max0.002051156500111455
set_robot_commands_mean0.002051156500111455
set_robot_commands_median0.002051156500111455
set_robot_commands_min0.002051156500111455
sim_compute_performance-ego0_max0.0017941585485486016
sim_compute_performance-ego0_mean0.0017941585485486016
sim_compute_performance-ego0_median0.0017941585485486016
sim_compute_performance-ego0_min0.0017941585485486016
sim_compute_sim_state_max0.008531770844390427
sim_compute_sim_state_mean0.008531770844390427
sim_compute_sim_state_median0.008531770844390427
sim_compute_sim_state_min0.008531770844390427
sim_render-ego0_max0.0034212582353232565
sim_render-ego0_mean0.0034212582353232565
sim_render-ego0_median0.0034212582353232565
sim_render-ego0_min0.0034212582353232565
simulation-passed1
step_physics_max0.07592537437660107
step_physics_mean0.07592537437660107
step_physics_median0.07592537437660107
step_physics_min0.07592537437660107
survival_time_max3.399999999999996
survival_time_mean3.399999999999996
survival_time_median3.399999999999996
survival_time_min3.399999999999996
No reset possible
7878415854Juan Ramirezexercises_braitenbergmooc-BV1sim-0of5successnonogpu-production-b-spot-0-030:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.1810447712133745


other stats
agent_compute-ego0_max0.010428968597860896
agent_compute-ego0_mean0.010428968597860896
agent_compute-ego0_median0.010428968597860896
agent_compute-ego0_min0.010428968597860896
complete-iteration_max0.2369379342771044
complete-iteration_mean0.2369379342771044
complete-iteration_median0.2369379342771044
complete-iteration_min0.2369379342771044
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.1810447712133745
distance-from-start_median1.1810447712133745
distance-from-start_min1.1810447712133745
driven_any_max1.6106896911174051
driven_any_mean1.6106896911174051
driven_any_median1.6106896911174051
driven_any_min1.6106896911174051
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08325523488661822
get_duckie_state_mean0.08325523488661822
get_duckie_state_median0.08325523488661822
get_duckie_state_min0.08325523488661822
get_robot_state_max0.0033274211135565068
get_robot_state_mean0.0033274211135565068
get_robot_state_median0.0033274211135565068
get_robot_state_min0.0033274211135565068
get_state_dump_max0.016274131980596806
get_state_dump_mean0.016274131980596806
get_state_dump_median0.016274131980596806
get_state_dump_min0.016274131980596806
get_ui_image_max0.03844552647833731
get_ui_image_mean0.03844552647833731
get_ui_image_median0.03844552647833731
get_ui_image_min0.03844552647833731
in-drivable-lane_max5.04999999999999
in-drivable-lane_mean5.04999999999999
in-drivable-lane_median5.04999999999999
in-drivable-lane_min5.04999999999999
per-episodes
details{"d45-ego0": {"driven_any": 1.6106896911174051, "get_ui_image": 0.03844552647833731, "step_physics": 0.06920061391942642, "survival_time": 5.04999999999999, "driven_lanedir": 0.0, "get_state_dump": 0.016274131980596806, "get_robot_state": 0.0033274211135565068, "sim_render-ego0": 0.0033098926731184417, "get_duckie_state": 0.08325523488661822, "in-drivable-lane": 5.04999999999999, "deviation-heading": 0.0, "agent_compute-ego0": 0.010428968597860896, "complete-iteration": 0.2369379342771044, "set_robot_commands": 0.0020078327141556085, "distance-from-start": 1.1810447712133745, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008762523239734126, "sim_compute_performance-ego0": 0.001830117375242944}}
set_robot_commands_max0.0020078327141556085
set_robot_commands_mean0.0020078327141556085
set_robot_commands_median0.0020078327141556085
set_robot_commands_min0.0020078327141556085
sim_compute_performance-ego0_max0.001830117375242944
sim_compute_performance-ego0_mean0.001830117375242944
sim_compute_performance-ego0_median0.001830117375242944
sim_compute_performance-ego0_min0.001830117375242944
sim_compute_sim_state_max0.008762523239734126
sim_compute_sim_state_mean0.008762523239734126
sim_compute_sim_state_median0.008762523239734126
sim_compute_sim_state_min0.008762523239734126
sim_render-ego0_max0.0033098926731184417
sim_render-ego0_mean0.0033098926731184417
sim_render-ego0_median0.0033098926731184417
sim_render-ego0_min0.0033098926731184417
simulation-passed1
step_physics_max0.06920061391942642
step_physics_mean0.06920061391942642
step_physics_median0.06920061391942642
step_physics_min0.06920061391942642
survival_time_max5.04999999999999
survival_time_mean5.04999999999999
survival_time_median5.04999999999999
survival_time_min5.04999999999999
No reset possible
7876915853Juan Ramirezexercises_braitenbergmooc-BV1sim-2of5successnonogpu-production-b-spot-0-030:02:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.309294379989735


other stats
agent_compute-ego0_max0.010337031405905018
agent_compute-ego0_mean0.010337031405905018
agent_compute-ego0_median0.010337031405905018
agent_compute-ego0_min0.010337031405905018
complete-iteration_max0.22865578920944876
complete-iteration_mean0.22865578920944876
complete-iteration_median0.22865578920944876
complete-iteration_min0.22865578920944876
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.309294379989735
distance-from-start_median0.309294379989735
distance-from-start_min0.309294379989735
driven_any_max0.4637737916312815
driven_any_mean0.4637737916312815
driven_any_median0.4637737916312815
driven_any_min0.4637737916312815
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07386299838190494
get_duckie_state_mean0.07386299838190494
get_duckie_state_median0.07386299838190494
get_duckie_state_min0.07386299838190494
get_robot_state_max0.003400149552718453
get_robot_state_mean0.003400149552718453
get_robot_state_median0.003400149552718453
get_robot_state_min0.003400149552718453
get_state_dump_max0.015201516773389734
get_state_dump_mean0.015201516773389734
get_state_dump_median0.015201516773389734
get_state_dump_min0.015201516773389734
get_ui_image_max0.03931804325269616
get_ui_image_mean0.03931804325269616
get_ui_image_median0.03931804325269616
get_ui_image_min0.03931804325269616
in-drivable-lane_max2.25
in-drivable-lane_mean2.25
in-drivable-lane_median2.25
in-drivable-lane_min2.25
per-episodes
details{"d40-ego0": {"driven_any": 0.4637737916312815, "get_ui_image": 0.03931804325269616, "step_physics": 0.07142284642095151, "survival_time": 2.25, "driven_lanedir": 0.0, "get_state_dump": 0.015201516773389734, "get_robot_state": 0.003400149552718453, "sim_render-ego0": 0.0033131786014722743, "get_duckie_state": 0.07386299838190494, "in-drivable-lane": 2.25, "deviation-heading": 0.0, "agent_compute-ego0": 0.010337031405905018, "complete-iteration": 0.22865578920944876, "set_robot_commands": 0.002119826233905295, "distance-from-start": 0.309294379989735, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007743597030639648, "sim_compute_performance-ego0": 0.001836859661599864}}
set_robot_commands_max0.002119826233905295
set_robot_commands_mean0.002119826233905295
set_robot_commands_median0.002119826233905295
set_robot_commands_min0.002119826233905295
sim_compute_performance-ego0_max0.001836859661599864
sim_compute_performance-ego0_mean0.001836859661599864
sim_compute_performance-ego0_median0.001836859661599864
sim_compute_performance-ego0_min0.001836859661599864
sim_compute_sim_state_max0.007743597030639648
sim_compute_sim_state_mean0.007743597030639648
sim_compute_sim_state_median0.007743597030639648
sim_compute_sim_state_min0.007743597030639648
sim_render-ego0_max0.0033131786014722743
sim_render-ego0_mean0.0033131786014722743
sim_render-ego0_median0.0033131786014722743
sim_render-ego0_min0.0033131786014722743
simulation-passed1
step_physics_max0.07142284642095151
step_physics_mean0.07142284642095151
step_physics_median0.07142284642095151
step_physics_min0.07142284642095151
survival_time_max2.25
survival_time_mean2.25
survival_time_median2.25
survival_time_min2.25
No reset possible
7873215849Juan Ramirezexercises_braitenbergmooc-BV1sim-4of5successnonogpu-production-b-spot-0-030:03:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.2535470438550753


other stats
agent_compute-ego0_max0.010428920813969204
agent_compute-ego0_mean0.010428920813969204
agent_compute-ego0_median0.010428920813969204
agent_compute-ego0_min0.010428920813969204
complete-iteration_max0.2785981706210545
complete-iteration_mean0.2785981706210545
complete-iteration_median0.2785981706210545
complete-iteration_min0.2785981706210545
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.2535470438550753
distance-from-start_median2.2535470438550753
distance-from-start_min2.2535470438550753
driven_any_max2.5209826032442204
driven_any_mean2.5209826032442204
driven_any_median2.5209826032442204
driven_any_min2.5209826032442204
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.1136636699948992
get_duckie_state_mean0.1136636699948992
get_duckie_state_median0.1136636699948992
get_duckie_state_min0.1136636699948992
get_robot_state_max0.0034591317176818847
get_robot_state_mean0.0034591317176818847
get_robot_state_median0.0034591317176818847
get_robot_state_min0.0034591317176818847
get_state_dump_max0.021038809844425747
get_state_dump_mean0.021038809844425747
get_state_dump_median0.021038809844425747
get_state_dump_min0.021038809844425747
get_ui_image_max0.04242841345923287
get_ui_image_mean0.04242841345923287
get_ui_image_median0.04242841345923287
get_ui_image_min0.04242841345923287
in-drivable-lane_max6.949999999999983
in-drivable-lane_mean6.949999999999983
in-drivable-lane_median6.949999999999983
in-drivable-lane_min6.949999999999983
per-episodes
details{"d60-ego0": {"driven_any": 2.5209826032442204, "get_ui_image": 0.04242841345923287, "step_physics": 0.07083110809326172, "survival_time": 6.949999999999983, "driven_lanedir": 0.0, "get_state_dump": 0.021038809844425747, "get_robot_state": 0.0034591317176818847, "sim_render-ego0": 0.0032943265778677803, "get_duckie_state": 0.1136636699948992, "in-drivable-lane": 6.949999999999983, "deviation-heading": 0.0, "agent_compute-ego0": 0.010428920813969204, "complete-iteration": 0.2785981706210545, "set_robot_commands": 0.002029034069606236, "distance-from-start": 2.2535470438550753, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009538805484771729, "sim_compute_performance-ego0": 0.0017926880291530064}}
set_robot_commands_max0.002029034069606236
set_robot_commands_mean0.002029034069606236
set_robot_commands_median0.002029034069606236
set_robot_commands_min0.002029034069606236
sim_compute_performance-ego0_max0.0017926880291530064
sim_compute_performance-ego0_mean0.0017926880291530064
sim_compute_performance-ego0_median0.0017926880291530064
sim_compute_performance-ego0_min0.0017926880291530064
sim_compute_sim_state_max0.009538805484771729
sim_compute_sim_state_mean0.009538805484771729
sim_compute_sim_state_median0.009538805484771729
sim_compute_sim_state_min0.009538805484771729
sim_render-ego0_max0.0032943265778677803
sim_render-ego0_mean0.0032943265778677803
sim_render-ego0_median0.0032943265778677803
sim_render-ego0_min0.0032943265778677803
simulation-passed1
step_physics_max0.07083110809326172
step_physics_mean0.07083110809326172
step_physics_median0.07083110809326172
step_physics_min0.07083110809326172
survival_time_max6.949999999999983
survival_time_mean6.949999999999983
survival_time_median6.949999999999983
survival_time_min6.949999999999983
No reset possible
7871415848Juan Ramirezexercises_braitenbergmooc-BV1sim-2of5successnonogpu-production-b-spot-0-030:01:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.5970804680631829


other stats
agent_compute-ego0_max0.010432012153394296
agent_compute-ego0_mean0.010432012153394296
agent_compute-ego0_median0.010432012153394296
agent_compute-ego0_min0.010432012153394296
complete-iteration_max0.22669872370633212
complete-iteration_mean0.22669872370633212
complete-iteration_median0.22669872370633212
complete-iteration_min0.22669872370633212
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.5970804680631829
distance-from-start_median0.5970804680631829
distance-from-start_min0.5970804680631829
driven_any_max0.7310826671707509
driven_any_mean0.7310826671707509
driven_any_median0.7310826671707509
driven_any_min0.7310826671707509
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07334223299315482
get_duckie_state_mean0.07334223299315482
get_duckie_state_median0.07334223299315482
get_duckie_state_min0.07334223299315482
get_robot_state_max0.0034782742009018407
get_robot_state_mean0.0034782742009018407
get_robot_state_median0.0034782742009018407
get_robot_state_min0.0034782742009018407
get_state_dump_max0.015534166133765018
get_state_dump_mean0.015534166133765018
get_state_dump_median0.015534166133765018
get_state_dump_min0.015534166133765018
get_ui_image_max0.03769371365055894
get_ui_image_mean0.03769371365055894
get_ui_image_median0.03769371365055894
get_ui_image_min0.03769371365055894
in-drivable-lane_max3.2499999999999964
in-drivable-lane_mean3.2499999999999964
in-drivable-lane_median3.2499999999999964
in-drivable-lane_min3.2499999999999964
per-episodes
details{"d40-ego0": {"driven_any": 0.7310826671707509, "get_ui_image": 0.03769371365055894, "step_physics": 0.07055612405141194, "survival_time": 3.2499999999999964, "driven_lanedir": 0.0, "get_state_dump": 0.015534166133765018, "get_robot_state": 0.0034782742009018407, "sim_render-ego0": 0.003336263425422437, "get_duckie_state": 0.07334223299315482, "in-drivable-lane": 3.2499999999999964, "deviation-heading": 0.0, "agent_compute-ego0": 0.010432012153394296, "complete-iteration": 0.22669872370633212, "set_robot_commands": 0.002114436843178489, "distance-from-start": 0.5970804680631829, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00835279623667399, "sim_compute_performance-ego0": 0.0017652511596679688}}
set_robot_commands_max0.002114436843178489
set_robot_commands_mean0.002114436843178489
set_robot_commands_median0.002114436843178489
set_robot_commands_min0.002114436843178489
sim_compute_performance-ego0_max0.0017652511596679688
sim_compute_performance-ego0_mean0.0017652511596679688
sim_compute_performance-ego0_median0.0017652511596679688
sim_compute_performance-ego0_min0.0017652511596679688
sim_compute_sim_state_max0.00835279623667399
sim_compute_sim_state_mean0.00835279623667399
sim_compute_sim_state_median0.00835279623667399
sim_compute_sim_state_min0.00835279623667399
sim_render-ego0_max0.003336263425422437
sim_render-ego0_mean0.003336263425422437
sim_render-ego0_median0.003336263425422437
sim_render-ego0_min0.003336263425422437
simulation-passed1
step_physics_max0.07055612405141194
step_physics_mean0.07055612405141194
step_physics_median0.07055612405141194
step_physics_min0.07055612405141194
survival_time_max3.2499999999999964
survival_time_mean3.2499999999999964
survival_time_median3.2499999999999964
survival_time_min3.2499999999999964
No reset possible
7865615827Masoud Bahrainiexercises_braitenbergmooc-BV1sim-0of5successnonogpu-production-b-spot-0-030:07:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1876000000001


other stats
agent_compute-ego0_max0.01033869627788762
agent_compute-ego0_mean0.01033869627788762
agent_compute-ego0_median0.01033869627788762
agent_compute-ego0_min0.01033869627788762
complete-iteration_max0.24049193690842224
complete-iteration_mean0.24049193690842224
complete-iteration_median0.24049193690842224
complete-iteration_min0.24049193690842224
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1876000000001
distance-from-start_median2.1876000000001
distance-from-start_min2.1876000000001
driven_any_max2.187600000000121
driven_any_mean2.187600000000121
driven_any_median2.187600000000121
driven_any_min2.187600000000121
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.08255051360149358
get_duckie_state_mean0.08255051360149358
get_duckie_state_median0.08255051360149358
get_duckie_state_min0.08255051360149358
get_robot_state_max0.0033634366112923653
get_robot_state_mean0.0033634366112923653
get_robot_state_median0.0033634366112923653
get_robot_state_min0.0033634366112923653
get_state_dump_max0.016592631486062204
get_state_dump_mean0.016592631486062204
get_state_dump_median0.016592631486062204
get_state_dump_min0.016592631486062204
get_ui_image_max0.040008284280525545
get_ui_image_mean0.040008284280525545
get_ui_image_median0.040008284280525545
get_ui_image_min0.040008284280525545
in-drivable-lane_max37.50000000000001
in-drivable-lane_mean37.50000000000001
in-drivable-lane_median37.50000000000001
in-drivable-lane_min37.50000000000001
per-episodes
details{"d45-ego0": {"driven_any": 2.187600000000121, "get_ui_image": 0.040008284280525545, "step_physics": 0.07155676688081256, "survival_time": 37.50000000000001, "driven_lanedir": 0.0, "get_state_dump": 0.016592631486062204, "get_robot_state": 0.0033634366112923653, "sim_render-ego0": 0.003272039753778003, "get_duckie_state": 0.08255051360149358, "in-drivable-lane": 37.50000000000001, "deviation-heading": 0.0, "agent_compute-ego0": 0.01033869627788762, "complete-iteration": 0.24049193690842224, "set_robot_commands": 0.0019674561471342247, "distance-from-start": 2.1876000000001, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009033584404245674, "sim_compute_performance-ego0": 0.0017283467573427488}}
set_robot_commands_max0.0019674561471342247
set_robot_commands_mean0.0019674561471342247
set_robot_commands_median0.0019674561471342247
set_robot_commands_min0.0019674561471342247
sim_compute_performance-ego0_max0.0017283467573427488
sim_compute_performance-ego0_mean0.0017283467573427488
sim_compute_performance-ego0_median0.0017283467573427488
sim_compute_performance-ego0_min0.0017283467573427488
sim_compute_sim_state_max0.009033584404245674
sim_compute_sim_state_mean0.009033584404245674
sim_compute_sim_state_median0.009033584404245674
sim_compute_sim_state_min0.009033584404245674
sim_render-ego0_max0.003272039753778003
sim_render-ego0_mean0.003272039753778003
sim_render-ego0_median0.003272039753778003
sim_render-ego0_min0.003272039753778003
simulation-passed1
step_physics_max0.07155676688081256
step_physics_mean0.07155676688081256
step_physics_median0.07155676688081256
step_physics_min0.07155676688081256
survival_time_max37.50000000000001
survival_time_mean37.50000000000001
survival_time_median37.50000000000001
survival_time_min37.50000000000001
No reset possible
7863713798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-030:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible