Duckietown Challenges Home Challenges Submissions

Evaluator 5450

ID5450
evaluatornogpu-production-b-spot-1-05
ownerI don't have one 😀
machinenogpu-production-b-spot-1
processnogpu-production-b-spot-1-05
version6.2.32
first heard
last heard
statusinactive
# evaluating
# success14 84162
# timeout
# failed
# error
# aborted2 84103
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors96
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)184.7 GB
RAM free (MB)177.3 GB
Disk (MB)969.3 GB
Disk available (MB)946.0 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
8458916819Raj Aexercises_braitenbergmooc-BV1sim-2of5successnonogpu-production-b-spot-1-050:04:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.1181545051042545


other stats
agent_compute-ego0_max0.008307405465155944
agent_compute-ego0_mean0.008307405465155944
agent_compute-ego0_median0.008307405465155944
agent_compute-ego0_min0.008307405465155944
complete-iteration_max0.2082159112139446
complete-iteration_mean0.2082159112139446
complete-iteration_median0.2082159112139446
complete-iteration_min0.2082159112139446
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.1181545051042545
distance-from-start_median2.1181545051042545
distance-from-start_min2.1181545051042545
driven_any_max2.1181545051042514
driven_any_mean2.1181545051042514
driven_any_median2.1181545051042514
driven_any_min2.1181545051042514
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.06599984600984261
get_duckie_state_mean0.06599984600984261
get_duckie_state_median0.06599984600984261
get_duckie_state_min0.06599984600984261
get_robot_state_max0.0031081035162098315
get_robot_state_mean0.0031081035162098315
get_robot_state_median0.0031081035162098315
get_robot_state_min0.0031081035162098315
get_state_dump_max0.014053119599611502
get_state_dump_mean0.014053119599611502
get_state_dump_median0.014053119599611502
get_state_dump_min0.014053119599611502
get_ui_image_max0.03864803796030503
get_ui_image_mean0.03864803796030503
get_ui_image_median0.03864803796030503
get_ui_image_min0.03864803796030503
in-drivable-lane_max14.300000000000068
in-drivable-lane_mean14.300000000000068
in-drivable-lane_median14.300000000000068
in-drivable-lane_min14.300000000000068
per-episodes
details{"d40-ego0": {"driven_any": 2.1181545051042514, "get_ui_image": 0.03864803796030503, "step_physics": 0.06346054941104264, "survival_time": 14.300000000000068, "driven_lanedir": 0.0, "get_state_dump": 0.014053119599611502, "get_robot_state": 0.0031081035162098315, "sim_render-ego0": 0.0030272289435622586, "get_duckie_state": 0.06599984600984261, "in-drivable-lane": 14.300000000000068, "deviation-heading": 0.0, "agent_compute-ego0": 0.008307405465155944, "complete-iteration": 0.2082159112139446, "set_robot_commands": 0.001818464192779222, "distance-from-start": 2.1181545051042545, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008165383588146249, "sim_compute_performance-ego0": 0.0015496476602055885}}
set_robot_commands_max0.001818464192779222
set_robot_commands_mean0.001818464192779222
set_robot_commands_median0.001818464192779222
set_robot_commands_min0.001818464192779222
sim_compute_performance-ego0_max0.0015496476602055885
sim_compute_performance-ego0_mean0.0015496476602055885
sim_compute_performance-ego0_median0.0015496476602055885
sim_compute_performance-ego0_min0.0015496476602055885
sim_compute_sim_state_max0.008165383588146249
sim_compute_sim_state_mean0.008165383588146249
sim_compute_sim_state_median0.008165383588146249
sim_compute_sim_state_min0.008165383588146249
sim_render-ego0_max0.0030272289435622586
sim_render-ego0_mean0.0030272289435622586
sim_render-ego0_median0.0030272289435622586
sim_render-ego0_min0.0030272289435622586
simulation-passed1
step_physics_max0.06346054941104264
step_physics_mean0.06346054941104264
step_physics_median0.06346054941104264
step_physics_min0.06346054941104264
survival_time_max14.300000000000068
survival_time_mean14.300000000000068
survival_time_median14.300000000000068
survival_time_min14.300000000000068
No reset possible
8437616696Lin Wei-Chihbase-image-mlmooc-visservoingsimsuccessnonogpu-production-b-spot-1-050:15:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median23.94999999999918
deviation-center-line_median2.785602688015555
driven_lanedir_consec_median1.7274402442033057
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.005334891050086232
agent_compute-ego0_mean0.005164306924106874
agent_compute-ego0_median0.005164306924106874
agent_compute-ego0_min0.004993722798127516
complete-iteration_max0.11403311360984122
complete-iteration_mean0.1123766305543898
complete-iteration_median0.1123766305543898
complete-iteration_min0.11072014749893835
deviation-center-line_max3.238998962008789
deviation-center-line_mean2.785602688015555
deviation-center-line_min2.332206414022321
deviation-heading_max27.46679953828115
deviation-heading_mean22.61225014222433
deviation-heading_median22.61225014222433
deviation-heading_min17.7577007461675
distance-from-start_max1.0851499672041016
distance-from-start_mean0.945584854627086
distance-from-start_median0.945584854627086
distance-from-start_min0.8060197420500703
driven_any_max6.246822094675833
driven_any_mean6.244139200143604
driven_any_median6.244139200143604
driven_any_min6.241456305611375
driven_lanedir_consec_max1.817418826457707
driven_lanedir_consec_mean1.7274402442033057
driven_lanedir_consec_min1.6374616619489044
driven_lanedir_max3.3524161455296175
driven_lanedir_mean2.8089292613231347
driven_lanedir_median2.8089292613231347
driven_lanedir_min2.2654423771166514
get_duckie_state_max1.4348788424197285e-06
get_duckie_state_mean1.2491664521203849e-06
get_duckie_state_median1.2491664521203849e-06
get_duckie_state_min1.063454061821041e-06
get_robot_state_max0.003249330584155233
get_robot_state_mean0.0031240424149042365
get_robot_state_median0.0031240424149042365
get_robot_state_min0.0029987542456532397
get_state_dump_max0.0040477932144660535
get_state_dump_mean0.003908929777185089
get_state_dump_median0.003908929777185089
get_state_dump_min0.0037700663399041247
get_ui_image_max0.037561930585761155
get_ui_image_mean0.03689824532311127
get_ui_image_median0.03689824532311127
get_ui_image_min0.03623456006046139
in-drivable-lane_max31.149999999998744
in-drivable-lane_mean23.94999999999918
in-drivable-lane_min16.749999999999613
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.246822094675833, "get_ui_image": 0.037561930585761155, "step_physics": 0.05189107181031341, "survival_time": 59.99999999999873, "driven_lanedir": 2.2654423771166514, "get_state_dump": 0.0037700663399041247, "get_robot_state": 0.0029987542456532397, "sim_render-ego0": 0.0029516680651560713, "get_duckie_state": 1.063454061821041e-06, "in-drivable-lane": 31.149999999998744, "deviation-heading": 17.7577007461675, "agent_compute-ego0": 0.004993722798127516, "complete-iteration": 0.11072014749893835, "set_robot_commands": 0.001778242292253302, "distance-from-start": 1.0851499672041016, "deviation-center-line": 2.332206414022321, "driven_lanedir_consec": 1.6374616619489044, "sim_compute_sim_state": 0.003202646598530054, "sim_compute_performance-ego0": 0.0015030866062313592}, "LF-small-loop-001-ego0": {"driven_any": 6.241456305611375, "get_ui_image": 0.03623456006046139, "step_physics": 0.054235720019058624, "survival_time": 59.99999999999873, "driven_lanedir": 3.3524161455296175, "get_state_dump": 0.0040477932144660535, "get_robot_state": 0.003249330584155233, "sim_render-ego0": 0.0032767133847759924, "get_duckie_state": 1.4348788424197285e-06, "in-drivable-lane": 16.749999999999613, "deviation-heading": 27.46679953828115, "agent_compute-ego0": 0.005334891050086232, "complete-iteration": 0.11403311360984122, "set_robot_commands": 0.0019671652934434114, "distance-from-start": 0.8060197420500703, "deviation-center-line": 3.238998962008789, "driven_lanedir_consec": 1.817418826457707, "sim_compute_sim_state": 0.0037865346913333736, "sim_compute_performance-ego0": 0.0018168633228336944}}
set_robot_commands_max0.0019671652934434114
set_robot_commands_mean0.0018727037928483567
set_robot_commands_median0.0018727037928483567
set_robot_commands_min0.001778242292253302
sim_compute_performance-ego0_max0.0018168633228336944
sim_compute_performance-ego0_mean0.0016599749645325266
sim_compute_performance-ego0_median0.0016599749645325266
sim_compute_performance-ego0_min0.0015030866062313592
sim_compute_sim_state_max0.0037865346913333736
sim_compute_sim_state_mean0.0034945906449317136
sim_compute_sim_state_median0.0034945906449317136
sim_compute_sim_state_min0.003202646598530054
sim_render-ego0_max0.0032767133847759924
sim_render-ego0_mean0.003114190724966032
sim_render-ego0_median0.003114190724966032
sim_render-ego0_min0.0029516680651560713
simulation-passed1
step_physics_max0.054235720019058624
step_physics_mean0.053063395914686014
step_physics_median0.053063395914686014
step_physics_min0.05189107181031341
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8432416652Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-valistep1-3of4successyesnogpu-production-b-spot-1-050:05:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration38.54601697471739
complexity112.16666666666669
avg_min_distance0.23461567781683448


other stats
nfeasible6
nsamples6
No reset possible
8430916660Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-0of4successyesnogpu-production-b-spot-1-050:07:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration37.95894598047838
complexity104.83333333333331
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8429616652Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-valistep1-2of4successyesnogpu-production-b-spot-1-050:05:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration38.72197971078025
complexity101.66666666666669
avg_min_distance0.19793770334129016


other stats
nfeasible6
nsamples6
No reset possible
8427316637Arwa Alabdulkarimbase-image-mlmooc-visservoingsimsuccessnonogpu-production-b-spot-1-050:13:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median4.274999999999961
deviation-center-line_median2.638756986179983
driven_lanedir_consec_median4.361550297592787
survival_time_median47.39999999999944


other stats
agent_compute-ego0_max0.004872603182193143
agent_compute-ego0_mean0.0048637889165596675
agent_compute-ego0_median0.0048637889165596675
agent_compute-ego0_min0.004854974650926193
complete-iteration_max0.10940668948924696
complete-iteration_mean0.10930112799212094
complete-iteration_median0.10930112799212094
complete-iteration_min0.10919556649499491
deviation-center-line_max3.543119033357609
deviation-center-line_mean2.638756986179983
deviation-center-line_min1.7343949390023568
deviation-heading_max11.473906594770964
deviation-heading_mean8.050650213597395
deviation-heading_median8.050650213597395
deviation-heading_min4.627393832423826
distance-from-start_max1.6177935154205214
distance-from-start_mean1.3298290672829969
distance-from-start_median1.3298290672829969
distance-from-start_min1.0418646191454717
driven_any_max6.243012188838569
driven_any_mean4.888258008920381
driven_any_median4.888258008920381
driven_any_min3.5335038290021927
driven_lanedir_consec_max6.077330145011381
driven_lanedir_consec_mean4.361550297592787
driven_lanedir_consec_min2.645770450174194
driven_lanedir_max6.077330145011381
driven_lanedir_mean4.361550297592787
driven_lanedir_median4.361550297592787
driven_lanedir_min2.645770450174194
get_duckie_state_max1.0391903060409567e-06
get_duckie_state_mean9.950426941930363e-07
get_duckie_state_median9.950426941930363e-07
get_duckie_state_min9.50895082345116e-07
get_robot_state_max0.002998422325699653
get_robot_state_mean0.002991683760844966
get_robot_state_median0.002991683760844966
get_robot_state_min0.0029849451959902793
get_state_dump_max0.003740281593508837
get_state_dump_mean0.003709634132189255
get_state_dump_median0.003709634132189255
get_state_dump_min0.003678986670869673
get_ui_image_max0.03778969239037202
get_ui_image_mean0.037761227676197946
get_ui_image_median0.037761227676197946
get_ui_image_min0.03773276296202387
in-drivable-lane_max8.549999999999923
in-drivable-lane_mean4.274999999999961
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 3.5335038290021927, "get_ui_image": 0.03773276296202387, "step_physics": 0.05065961718730297, "survival_time": 34.80000000000016, "driven_lanedir": 2.645770450174194, "get_state_dump": 0.003740281593508837, "get_robot_state": 0.0029849451959902793, "sim_render-ego0": 0.002915202459611715, "get_duckie_state": 1.0391903060409567e-06, "in-drivable-lane": 8.549999999999923, "deviation-heading": 4.627393832423826, "agent_compute-ego0": 0.004854974650926193, "complete-iteration": 0.10940668948924696, "set_robot_commands": 0.0018028901673457888, "distance-from-start": 1.0418646191454717, "deviation-center-line": 1.7343949390023568, "driven_lanedir_consec": 2.645770450174194, "sim_compute_sim_state": 0.0031565983634083993, "sim_compute_performance-ego0": 0.001490666842358013}, "LF-small-loop-001-ego0": {"driven_any": 6.243012188838569, "get_ui_image": 0.03778969239037202, "step_physics": 0.05031754849455339, "survival_time": 59.99999999999873, "driven_lanedir": 6.077330145011381, "get_state_dump": 0.003678986670869673, "get_robot_state": 0.002998422325699653, "sim_render-ego0": 0.0029382219322515862, "get_duckie_state": 9.50895082345116e-07, "in-drivable-lane": 0.0, "deviation-heading": 11.473906594770964, "agent_compute-ego0": 0.004872603182193143, "complete-iteration": 0.10919556649499491, "set_robot_commands": 0.0017344772964591885, "distance-from-start": 1.6177935154205214, "deviation-center-line": 3.543119033357609, "driven_lanedir_consec": 6.077330145011381, "sim_compute_sim_state": 0.0032968884403759197, "sim_compute_performance-ego0": 0.001499846019316077}}
set_robot_commands_max0.0018028901673457888
set_robot_commands_mean0.0017686837319024883
set_robot_commands_median0.0017686837319024883
set_robot_commands_min0.0017344772964591885
sim_compute_performance-ego0_max0.001499846019316077
sim_compute_performance-ego0_mean0.001495256430837045
sim_compute_performance-ego0_median0.001495256430837045
sim_compute_performance-ego0_min0.001490666842358013
sim_compute_sim_state_max0.0032968884403759197
sim_compute_sim_state_mean0.0032267434018921595
sim_compute_sim_state_median0.0032267434018921595
sim_compute_sim_state_min0.0031565983634083993
sim_render-ego0_max0.0029382219322515862
sim_render-ego0_mean0.002926712195931651
sim_render-ego0_median0.002926712195931651
sim_render-ego0_min0.002915202459611715
simulation-passed1
step_physics_max0.05065961718730297
step_physics_mean0.05048858284092818
step_physics_median0.05048858284092818
step_physics_min0.05031754849455339
survival_time_max59.99999999999873
survival_time_mean47.39999999999944
survival_time_min34.80000000000016
No reset possible
8425916632Chahbaz Amanexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-1-050:05:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean5.426749363203781


other stats
agent_compute-ego0_max0.008292854814739018
agent_compute-ego0_mean0.008292854814739018
agent_compute-ego0_median0.008292854814739018
agent_compute-ego0_min0.008292854814739018
complete-iteration_max0.19417830744942463
complete-iteration_mean0.19417830744942463
complete-iteration_median0.19417830744942463
complete-iteration_min0.19417830744942463
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max5.426749363203781
distance-from-start_median5.426749363203781
distance-from-start_min5.426749363203781
driven_any_max5.844680528313987
driven_any_mean5.844680528313987
driven_any_median5.844680528313987
driven_any_min5.844680528313987
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.059061565896966955
get_duckie_state_mean0.059061565896966955
get_duckie_state_median0.059061565896966955
get_duckie_state_min0.059061565896966955
get_robot_state_max0.0033728997785966476
get_robot_state_mean0.0033728997785966476
get_robot_state_median0.0033728997785966476
get_robot_state_min0.0033728997785966476
get_state_dump_max0.012034310744358944
get_state_dump_mean0.012034310744358944
get_state_dump_median0.012034310744358944
get_state_dump_min0.012034310744358944
get_ui_image_max0.03491666880282727
get_ui_image_mean0.03491666880282727
get_ui_image_median0.03491666880282727
get_ui_image_min0.03491666880282727
in-drivable-lane_max36.35000000000007
in-drivable-lane_mean36.35000000000007
in-drivable-lane_median36.35000000000007
in-drivable-lane_min36.35000000000007
per-episodes
details{"d30-ego0": {"driven_any": 5.844680528313987, "get_ui_image": 0.03491666880282727, "step_physics": 0.06221865592422066, "survival_time": 36.35000000000007, "driven_lanedir": 0.0, "get_state_dump": 0.012034310744358944, "get_robot_state": 0.0033728997785966476, "sim_render-ego0": 0.0033169824343461255, "get_duckie_state": 0.059061565896966955, "in-drivable-lane": 36.35000000000007, "deviation-heading": 0.0, "agent_compute-ego0": 0.008292854814739018, "complete-iteration": 0.19417830744942463, "set_robot_commands": 0.0019459776825957243, "distance-from-start": 5.426749363203781, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0071032233945616, "sim_compute_performance-ego0": 0.0018292468982738456}}
set_robot_commands_max0.0019459776825957243
set_robot_commands_mean0.0019459776825957243
set_robot_commands_median0.0019459776825957243
set_robot_commands_min0.0019459776825957243
sim_compute_performance-ego0_max0.0018292468982738456
sim_compute_performance-ego0_mean0.0018292468982738456
sim_compute_performance-ego0_median0.0018292468982738456
sim_compute_performance-ego0_min0.0018292468982738456
sim_compute_sim_state_max0.0071032233945616
sim_compute_sim_state_mean0.0071032233945616
sim_compute_sim_state_median0.0071032233945616
sim_compute_sim_state_min0.0071032233945616
sim_render-ego0_max0.0033169824343461255
sim_render-ego0_mean0.0033169824343461255
sim_render-ego0_median0.0033169824343461255
sim_render-ego0_min0.0033169824343461255
simulation-passed1
step_physics_max0.06221865592422066
step_physics_mean0.06221865592422066
step_physics_median0.06221865592422066
step_physics_min0.06221865592422066
survival_time_max36.35000000000007
survival_time_mean36.35000000000007
survival_time_median36.35000000000007
survival_time_min36.35000000000007
No reset possible
8424416020Martin Cote 🇨🇦collision-check-exercisemooc-collision-check-teststep1successyesnogpu-production-b-spot-1-050:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.05
false_positive_rate0.02


other stats
nsamples200
No reset possible
8423716020Martin Cote 🇨🇦collision-check-exercisemooc-collision-check-teststep1successyesnogpu-production-b-spot-1-050:00:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.05
false_positive_rate0.02


other stats
nsamples200
No reset possible
8422616582Bea Baselines 🐤planning-exercisemooc-planning-dd-dynamic-teststep1-2of4successyesnogpu-production-b-spot-1-050:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8421216582Bea Baselines 🐤planning-exercisemooc-planning-dd-dynamic-teststep1-1of4successyesnogpu-production-b-spot-1-050:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.01661990926948505


other stats
nfeasible6
nsamples6
No reset possible
8419716587Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-valistep1-0of4successyesnogpu-production-b-spot-1-050:03:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8418216591Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-valistep1-0of4successyesnogpu-production-b-spot-1-050:05:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration42.30186554429718
complexity112.5
avg_min_distance0.20018202173222063


other stats
nfeasible6
nsamples6
No reset possible
8416216593Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-valistep1-3of4successyesnogpu-production-b-spot-1-050:07:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration41.3723308277501
complexity109.83333333333331
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8412613798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesnogpu-production-b-spot-1-050:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2021_03_25_17_23_41&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 430, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2021_03_25_17_23_41&fromImage=docker.io%2Fnitaigao%2Faido-submissions: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  2021_03_25_17_23_41

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull nitaigao/aido-submissions:2021_03_25_17_23_41@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8410313798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesnogpu-production-b-spot-1-050:01:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.41/images/create?tag=2021_03_25_17_23_41&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 430, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=2021_03_25_17_23_41&fromImage=docker.io%2Fnitaigao%2Faido-submissions: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  2021_03_25_17_23_41

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull nitaigao/aido-submissions:2021_03_25_17_23_41@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible