Duckietown Challenges Home Challenges Submissions

Evaluator 5308

ID5308
evaluatornogpu-production-b-spot-0-07
ownerI don't have one 😀
machinenogpu-production-b-spot-0_dbb856281da6
processnogpu-production-b-spot-0-07_dbb856281da6
version6.2.7
first heard
last heard
statusinactive
# evaluating
# success9 79213
# timeout
# failed
# error
# aborted1 79191
# host-error
arm0
x86_641
Mac0
gpu available0
Number of processors96
Processor frequency (MHz)0.0 GHz
Free % of processors99%
RAM total (MB)184.7 GB
RAM free (MB)175.8 GB
Disk (MB)969.3 GB
Disk available (MB)922.4 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
7957616074Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-0-070:03:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.058839105083752


other stats
agent_compute-ego0_max0.009845887267938716
agent_compute-ego0_mean0.009845887267938716
agent_compute-ego0_median0.009845887267938716
agent_compute-ego0_min0.009845887267938716
complete-iteration_max0.18983174866712244
complete-iteration_mean0.18983174866712244
complete-iteration_median0.18983174866712244
complete-iteration_min0.18983174866712244
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.058839105083752
distance-from-start_median6.058839105083752
distance-from-start_min6.058839105083752
driven_any_max6.116450039485608
driven_any_mean6.116450039485608
driven_any_median6.116450039485608
driven_any_min6.116450039485608
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0533503608224781
get_duckie_state_mean0.0533503608224781
get_duckie_state_median0.0533503608224781
get_duckie_state_min0.0533503608224781
get_robot_state_max0.0031997738522964543
get_robot_state_mean0.0031997738522964543
get_robot_state_median0.0031997738522964543
get_robot_state_min0.0031997738522964543
get_state_dump_max0.011761593519394369
get_state_dump_mean0.011761593519394369
get_state_dump_median0.011761593519394369
get_state_dump_min0.011761593519394369
get_ui_image_max0.03412918465905609
get_ui_image_mean0.03412918465905609
get_ui_image_median0.03412918465905609
get_ui_image_min0.03412918465905609
in-drivable-lane_max11.900000000000034
in-drivable-lane_mean11.900000000000034
in-drivable-lane_median11.900000000000034
in-drivable-lane_min11.900000000000034
per-episodes
details{"d30-ego0": {"driven_any": 6.116450039485608, "get_ui_image": 0.03412918465905609, "step_physics": 0.06397425280455266, "survival_time": 11.900000000000034, "driven_lanedir": 0.0, "get_state_dump": 0.011761593519394369, "get_robot_state": 0.0031997738522964543, "sim_render-ego0": 0.003140609134690034, "get_duckie_state": 0.0533503608224781, "in-drivable-lane": 11.900000000000034, "deviation-heading": 0.0, "agent_compute-ego0": 0.009845887267938716, "complete-iteration": 0.18983174866712244, "set_robot_commands": 0.001893857532964092, "distance-from-start": 6.058839105083752, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006735946344032447, "sim_compute_performance-ego0": 0.0017170048159036676}}
set_robot_commands_max0.001893857532964092
set_robot_commands_mean0.001893857532964092
set_robot_commands_median0.001893857532964092
set_robot_commands_min0.001893857532964092
sim_compute_performance-ego0_max0.0017170048159036676
sim_compute_performance-ego0_mean0.0017170048159036676
sim_compute_performance-ego0_median0.0017170048159036676
sim_compute_performance-ego0_min0.0017170048159036676
sim_compute_sim_state_max0.006735946344032447
sim_compute_sim_state_mean0.006735946344032447
sim_compute_sim_state_median0.006735946344032447
sim_compute_sim_state_min0.006735946344032447
sim_render-ego0_max0.003140609134690034
sim_render-ego0_mean0.003140609134690034
sim_render-ego0_median0.003140609134690034
sim_render-ego0_min0.003140609134690034
simulation-passed1
step_physics_max0.06397425280455266
step_physics_mean0.06397425280455266
step_physics_median0.06397425280455266
step_physics_min0.06397425280455266
survival_time_max11.900000000000034
survival_time_mean11.900000000000034
survival_time_median11.900000000000034
survival_time_min11.900000000000034
No reset possible
7956816072Evanthia Fasoulaexercises_braitenbergmooc-BV1sim-2of5successnonogpu-production-b-spot-0-070:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean6.276271688182762


other stats
agent_compute-ego0_max0.010162653067173105
agent_compute-ego0_mean0.010162653067173105
agent_compute-ego0_median0.010162653067173105
agent_compute-ego0_min0.010162653067173105
complete-iteration_max0.2386550373501248
complete-iteration_mean0.2386550373501248
complete-iteration_median0.2386550373501248
complete-iteration_min0.2386550373501248
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max6.276271688182762
distance-from-start_median6.276271688182762
distance-from-start_min6.276271688182762
driven_any_max6.290012400991595
driven_any_mean6.290012400991595
driven_any_median6.290012400991595
driven_any_min6.290012400991595
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07991698766366029
get_duckie_state_mean0.07991698766366029
get_duckie_state_median0.07991698766366029
get_duckie_state_min0.07991698766366029
get_robot_state_max0.0035719219435993424
get_robot_state_mean0.0035719219435993424
get_robot_state_median0.0035719219435993424
get_robot_state_min0.0035719219435993424
get_state_dump_max0.015442449822385088
get_state_dump_mean0.015442449822385088
get_state_dump_median0.015442449822385088
get_state_dump_min0.015442449822385088
get_ui_image_max0.04056802774086977
get_ui_image_mean0.04056802774086977
get_ui_image_median0.04056802774086977
get_ui_image_min0.04056802774086977
in-drivable-lane_max11.65000000000003
in-drivable-lane_mean11.65000000000003
in-drivable-lane_median11.65000000000003
in-drivable-lane_min11.65000000000003
per-episodes
details{"d40-ego0": {"driven_any": 6.290012400991595, "get_ui_image": 0.04056802774086977, "step_physics": 0.07396108472449148, "survival_time": 11.65000000000003, "driven_lanedir": 0.0, "get_state_dump": 0.015442449822385088, "get_robot_state": 0.0035719219435993424, "sim_render-ego0": 0.0034580393734141295, "get_duckie_state": 0.07991698766366029, "in-drivable-lane": 11.65000000000003, "deviation-heading": 0.0, "agent_compute-ego0": 0.010162653067173105, "complete-iteration": 0.2386550373501248, "set_robot_commands": 0.0020812199665949894, "distance-from-start": 6.276271688182762, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00750996108747955, "sim_compute_performance-ego0": 0.00188547423762134}}
set_robot_commands_max0.0020812199665949894
set_robot_commands_mean0.0020812199665949894
set_robot_commands_median0.0020812199665949894
set_robot_commands_min0.0020812199665949894
sim_compute_performance-ego0_max0.00188547423762134
sim_compute_performance-ego0_mean0.00188547423762134
sim_compute_performance-ego0_median0.00188547423762134
sim_compute_performance-ego0_min0.00188547423762134
sim_compute_sim_state_max0.00750996108747955
sim_compute_sim_state_mean0.00750996108747955
sim_compute_sim_state_median0.00750996108747955
sim_compute_sim_state_min0.00750996108747955
sim_render-ego0_max0.0034580393734141295
sim_render-ego0_mean0.0034580393734141295
sim_render-ego0_median0.0034580393734141295
sim_render-ego0_min0.0034580393734141295
simulation-passed1
step_physics_max0.07396108472449148
step_physics_mean0.07396108472449148
step_physics_median0.07396108472449148
step_physics_min0.07396108472449148
survival_time_max11.65000000000003
survival_time_mean11.65000000000003
survival_time_median11.65000000000003
survival_time_min11.65000000000003
No reset possible
7952916067Huy Tran Tienexercises_braitenbergmooc-BV1sim-1of5successnonogpu-production-b-spot-0-070:11:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.959557469763586


other stats
agent_compute-ego0_max0.00991834530127634
agent_compute-ego0_mean0.00991834530127634
agent_compute-ego0_median0.00991834530127634
agent_compute-ego0_min0.00991834530127634
complete-iteration_max0.2527007357861775
complete-iteration_mean0.2527007357861775
complete-iteration_median0.2527007357861775
complete-iteration_min0.2527007357861775
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.959557469763586
distance-from-start_median3.959557469763586
distance-from-start_min3.959557469763586
driven_any_max4.424821134149463
driven_any_mean4.424821134149463
driven_any_median4.424821134149463
driven_any_min4.424821134149463
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.1002643576867376
get_duckie_state_mean0.1002643576867376
get_duckie_state_median0.1002643576867376
get_duckie_state_min0.1002643576867376
get_robot_state_max0.003422669228864252
get_robot_state_mean0.003422669228864252
get_robot_state_median0.003422669228864252
get_robot_state_min0.003422669228864252
get_state_dump_max0.01713674253071476
get_state_dump_mean0.01713674253071476
get_state_dump_median0.01713674253071476
get_state_dump_min0.01713674253071476
get_ui_image_max0.035905742724670356
get_ui_image_mean0.035905742724670356
get_ui_image_median0.035905742724670356
get_ui_image_min0.035905742724670356
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d50-ego0": {"driven_any": 4.424821134149463, "get_ui_image": 0.035905742724670356, "step_physics": 0.06947290847740205, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.01713674253071476, "get_robot_state": 0.003422669228864252, "sim_render-ego0": 0.0033301429685009807, "get_duckie_state": 0.1002643576867376, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.00991834530127634, "complete-iteration": 0.2527007357861775, "set_robot_commands": 0.0020146762997184965, "distance-from-start": 3.959557469763586, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009286629369514968, "sim_compute_performance-ego0": 0.00186242965933286}}
set_robot_commands_max0.0020146762997184965
set_robot_commands_mean0.0020146762997184965
set_robot_commands_median0.0020146762997184965
set_robot_commands_min0.0020146762997184965
sim_compute_performance-ego0_max0.00186242965933286
sim_compute_performance-ego0_mean0.00186242965933286
sim_compute_performance-ego0_median0.00186242965933286
sim_compute_performance-ego0_min0.00186242965933286
sim_compute_sim_state_max0.009286629369514968
sim_compute_sim_state_mean0.009286629369514968
sim_compute_sim_state_median0.009286629369514968
sim_compute_sim_state_min0.009286629369514968
sim_render-ego0_max0.0033301429685009807
sim_render-ego0_mean0.0033301429685009807
sim_render-ego0_median0.0033301429685009807
sim_render-ego0_min0.0033301429685009807
simulation-passed1
step_physics_max0.06947290847740205
step_physics_mean0.06947290847740205
step_physics_median0.06947290847740205
step_physics_min0.06947290847740205
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7942016044Zoe Nolanexercises_braitenbergmooc-BV1sim-0of5successnonogpu-production-b-spot-0-070:09:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.2556965157585562


other stats
agent_compute-ego0_max0.009551155080803227
agent_compute-ego0_mean0.009551155080803227
agent_compute-ego0_median0.009551155080803227
agent_compute-ego0_min0.009551155080803227
complete-iteration_max0.2239244238323812
complete-iteration_mean0.2239244238323812
complete-iteration_median0.2239244238323812
complete-iteration_min0.2239244238323812
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.2556965157585562
distance-from-start_median1.2556965157585562
distance-from-start_min1.2556965157585562
driven_any_max4.926646199322658
driven_any_mean4.926646199322658
driven_any_median4.926646199322658
driven_any_min4.926646199322658
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07955182998206196
get_duckie_state_mean0.07955182998206196
get_duckie_state_median0.07955182998206196
get_duckie_state_min0.07955182998206196
get_robot_state_max0.003255088760096465
get_robot_state_mean0.003255088760096465
get_robot_state_median0.003255088760096465
get_robot_state_min0.003255088760096465
get_state_dump_max0.015431334434401284
get_state_dump_mean0.015431334434401284
get_state_dump_median0.015431334434401284
get_state_dump_min0.015431334434401284
get_ui_image_max0.03612383775766644
get_ui_image_mean0.03612383775766644
get_ui_image_median0.03612383775766644
get_ui_image_min0.03612383775766644
in-drivable-lane_max59.99999999999873
in-drivable-lane_mean59.99999999999873
in-drivable-lane_median59.99999999999873
in-drivable-lane_min59.99999999999873
per-episodes
details{"d45-ego0": {"driven_any": 4.926646199322658, "get_ui_image": 0.03612383775766644, "step_physics": 0.06471554266225289, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.015431334434401284, "get_robot_state": 0.003255088760096465, "sim_render-ego0": 0.0031373703311027637, "get_duckie_state": 0.07955182998206196, "in-drivable-lane": 59.99999999999873, "deviation-heading": 0.0, "agent_compute-ego0": 0.009551155080803227, "complete-iteration": 0.2239244238323812, "set_robot_commands": 0.001906358828453299, "distance-from-start": 1.2556965157585562, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008458363424232857, "sim_compute_performance-ego0": 0.001707288049639115}}
set_robot_commands_max0.001906358828453299
set_robot_commands_mean0.001906358828453299
set_robot_commands_median0.001906358828453299
set_robot_commands_min0.001906358828453299
sim_compute_performance-ego0_max0.001707288049639115
sim_compute_performance-ego0_mean0.001707288049639115
sim_compute_performance-ego0_median0.001707288049639115
sim_compute_performance-ego0_min0.001707288049639115
sim_compute_sim_state_max0.008458363424232857
sim_compute_sim_state_mean0.008458363424232857
sim_compute_sim_state_median0.008458363424232857
sim_compute_sim_state_min0.008458363424232857
sim_render-ego0_max0.0031373703311027637
sim_render-ego0_mean0.0031373703311027637
sim_render-ego0_median0.0031373703311027637
sim_render-ego0_min0.0031373703311027637
simulation-passed1
step_physics_max0.06471554266225289
step_physics_mean0.06471554266225289
step_physics_median0.06471554266225289
step_physics_min0.06471554266225289
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_median59.99999999999873
survival_time_min59.99999999999873
No reset possible
7938916039Zoe Nolanexercises_braitenbergmooc-BV1sim-2of5successnonogpu-production-b-spot-0-070:04:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.4831939323800365


other stats
agent_compute-ego0_max0.01012464932032994
agent_compute-ego0_mean0.01012464932032994
agent_compute-ego0_median0.01012464932032994
agent_compute-ego0_min0.01012464932032994
complete-iteration_max0.21824726659661803
complete-iteration_mean0.21824726659661803
complete-iteration_median0.21824726659661803
complete-iteration_min0.21824726659661803
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.4831939323800365
distance-from-start_median1.4831939323800365
distance-from-start_min1.4831939323800365
driven_any_max2.3368742291236853
driven_any_mean2.3368742291236853
driven_any_median2.3368742291236853
driven_any_min2.3368742291236853
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0715527862621932
get_duckie_state_mean0.0715527862621932
get_duckie_state_median0.0715527862621932
get_duckie_state_min0.0715527862621932
get_robot_state_max0.0032885789040489064
get_robot_state_mean0.0032885789040489064
get_robot_state_median0.0032885789040489064
get_robot_state_min0.0032885789040489064
get_state_dump_max0.01492237712448067
get_state_dump_mean0.01492237712448067
get_state_dump_median0.01492237712448067
get_state_dump_min0.01492237712448067
get_ui_image_max0.03567849343662063
get_ui_image_mean0.03567849343662063
get_ui_image_median0.03567849343662063
get_ui_image_min0.03567849343662063
in-drivable-lane_max28.650000000000272
in-drivable-lane_mean28.650000000000272
in-drivable-lane_median28.650000000000272
in-drivable-lane_min28.650000000000272
per-episodes
details{"d40-ego0": {"driven_any": 2.3368742291236853, "get_ui_image": 0.03567849343662063, "step_physics": 0.06677006553689777, "survival_time": 28.650000000000272, "driven_lanedir": 0.0, "get_state_dump": 0.01492237712448067, "get_robot_state": 0.0032885789040489064, "sim_render-ego0": 0.003222502067114002, "get_duckie_state": 0.0715527862621932, "in-drivable-lane": 28.650000000000272, "deviation-heading": 0.0, "agent_compute-ego0": 0.01012464932032994, "complete-iteration": 0.21824726659661803, "set_robot_commands": 0.0019854282252879923, "distance-from-start": 1.4831939323800365, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008905424058229666, "sim_compute_performance-ego0": 0.0017111089586796246}}
set_robot_commands_max0.0019854282252879923
set_robot_commands_mean0.0019854282252879923
set_robot_commands_median0.0019854282252879923
set_robot_commands_min0.0019854282252879923
sim_compute_performance-ego0_max0.0017111089586796246
sim_compute_performance-ego0_mean0.0017111089586796246
sim_compute_performance-ego0_median0.0017111089586796246
sim_compute_performance-ego0_min0.0017111089586796246
sim_compute_sim_state_max0.008905424058229666
sim_compute_sim_state_mean0.008905424058229666
sim_compute_sim_state_median0.008905424058229666
sim_compute_sim_state_min0.008905424058229666
sim_render-ego0_max0.003222502067114002
sim_render-ego0_mean0.003222502067114002
sim_render-ego0_median0.003222502067114002
sim_render-ego0_min0.003222502067114002
simulation-passed1
step_physics_max0.06677006553689777
step_physics_mean0.06677006553689777
step_physics_median0.06677006553689777
step_physics_min0.06677006553689777
survival_time_max28.650000000000272
survival_time_mean28.650000000000272
survival_time_median28.650000000000272
survival_time_min28.650000000000272
No reset possible
7937816037Jerry Kuchexercises_braitenbergmooc-BV1sim-3of5successnonogpu-production-b-spot-0-070:05:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean2.3188999573297044


other stats
agent_compute-ego0_max0.009824576873555887
agent_compute-ego0_mean0.009824576873555887
agent_compute-ego0_median0.009824576873555887
agent_compute-ego0_min0.009824576873555887
complete-iteration_max0.190034141303156
complete-iteration_mean0.190034141303156
complete-iteration_median0.190034141303156
complete-iteration_min0.190034141303156
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max2.3188999573297044
distance-from-start_median2.3188999573297044
distance-from-start_min2.3188999573297044
driven_any_max2.7053830390636726
driven_any_mean2.7053830390636726
driven_any_median2.7053830390636726
driven_any_min2.7053830390636726
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0518407964776236
get_duckie_state_mean0.0518407964776236
get_duckie_state_median0.0518407964776236
get_duckie_state_min0.0518407964776236
get_robot_state_max0.0032010081920930966
get_robot_state_mean0.0032010081920930966
get_robot_state_median0.0032010081920930966
get_robot_state_min0.0032010081920930966
get_state_dump_max0.01191455972316848
get_state_dump_mean0.01191455972316848
get_state_dump_median0.01191455972316848
get_state_dump_min0.01191455972316848
get_ui_image_max0.032971683393285704
get_ui_image_mean0.032971683393285704
get_ui_image_median0.032971683393285704
get_ui_image_min0.032971683393285704
in-drivable-lane_max34.1000000000002
in-drivable-lane_mean34.1000000000002
in-drivable-lane_median34.1000000000002
in-drivable-lane_min34.1000000000002
per-episodes
details{"d30-ego0": {"driven_any": 2.7053830390636726, "get_ui_image": 0.032971683393285704, "step_physics": 0.06441775946107477, "survival_time": 34.1000000000002, "driven_lanedir": 0.0, "get_state_dump": 0.01191455972316848, "get_robot_state": 0.0032010081920930966, "sim_render-ego0": 0.0030861693280333133, "get_duckie_state": 0.0518407964776236, "in-drivable-lane": 34.1000000000002, "deviation-heading": 0.0, "agent_compute-ego0": 0.009824576873555887, "complete-iteration": 0.190034141303156, "set_robot_commands": 0.0018744367457064492, "distance-from-start": 2.3188999573297044, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009210936670596567, "sim_compute_performance-ego0": 0.001606365597614607}}
set_robot_commands_max0.0018744367457064492
set_robot_commands_mean0.0018744367457064492
set_robot_commands_median0.0018744367457064492
set_robot_commands_min0.0018744367457064492
sim_compute_performance-ego0_max0.001606365597614607
sim_compute_performance-ego0_mean0.001606365597614607
sim_compute_performance-ego0_median0.001606365597614607
sim_compute_performance-ego0_min0.001606365597614607
sim_compute_sim_state_max0.009210936670596567
sim_compute_sim_state_mean0.009210936670596567
sim_compute_sim_state_median0.009210936670596567
sim_compute_sim_state_min0.009210936670596567
sim_render-ego0_max0.0030861693280333133
sim_render-ego0_mean0.0030861693280333133
sim_render-ego0_median0.0030861693280333133
sim_render-ego0_min0.0030861693280333133
simulation-passed1
step_physics_max0.06441775946107477
step_physics_mean0.06441775946107477
step_physics_median0.06441775946107477
step_physics_min0.06441775946107477
survival_time_max34.1000000000002
survival_time_mean34.1000000000002
survival_time_median34.1000000000002
survival_time_min34.1000000000002
No reset possible
7932016017Franz Pucherbase-image-mlmooc-visservoingsimsuccessnonogpu-production-b-spot-0-070:06:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median3.725000000000053
deviation-center-line_median0.26672979631196914
driven_lanedir_consec_median0.8269292356649494
survival_time_median12.32500000000004


other stats
agent_compute-ego0_max0.005523947938796013
agent_compute-ego0_mean0.0054784544484646775
agent_compute-ego0_median0.0054784544484646775
agent_compute-ego0_min0.005432960958133342
complete-iteration_max0.11766254325066844
complete-iteration_mean0.11607091992692598
complete-iteration_median0.11607091992692598
complete-iteration_min0.11447929660318353
deviation-center-line_max0.2842653390387332
deviation-center-line_mean0.26672979631196914
deviation-center-line_min0.24919425358520503
deviation-heading_max1.1212839709228988
deviation-heading_mean1.0978773379921325
deviation-heading_median1.0978773379921325
deviation-heading_min1.074470705061366
distance-from-start_max1.17503380661638
distance-from-start_mean1.175019091880797
distance-from-start_median1.175019091880797
distance-from-start_min1.1750043771452143
driven_any_max1.175052482741997
driven_any_mean1.1750524803303666
driven_any_median1.1750524803303666
driven_any_min1.175052477918736
driven_lanedir_consec_max0.8863406887432557
driven_lanedir_consec_mean0.8269292356649494
driven_lanedir_consec_min0.7675177825866432
driven_lanedir_max0.8863406887432557
driven_lanedir_mean0.8269292356649494
driven_lanedir_median0.8269292356649494
driven_lanedir_min0.7675177825866432
get_duckie_state_max1.155561016451928e-06
get_duckie_state_mean1.1115678533399885e-06
get_duckie_state_median1.1115678533399885e-06
get_duckie_state_min1.067574690228049e-06
get_robot_state_max0.0032640964754166142
get_robot_state_mean0.0031193897246816257
get_robot_state_median0.0031193897246816257
get_robot_state_min0.002974682973946637
get_state_dump_max0.004084968759167579
get_state_dump_mean0.003922707831422109
get_state_dump_median0.003922707831422109
get_state_dump_min0.0037604469036766393
get_ui_image_max0.03929696102373996
get_ui_image_mean0.03768029924400858
get_ui_image_median0.03768029924400858
get_ui_image_min0.0360636374642772
in-drivable-lane_max4.25000000000006
in-drivable-lane_mean3.725000000000053
in-drivable-lane_min3.2000000000000455
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 1.175052482741997, "get_ui_image": 0.03929696102373996, "step_physics": 0.05362759717562903, "survival_time": 12.30000000000004, "driven_lanedir": 0.7675177825866432, "get_state_dump": 0.0037604469036766393, "get_robot_state": 0.002974682973946637, "sim_render-ego0": 0.002961752385745647, "get_duckie_state": 1.067574690228049e-06, "in-drivable-lane": 4.25000000000006, "deviation-heading": 1.074470705061366, "agent_compute-ego0": 0.005432960958133342, "complete-iteration": 0.11447929660318353, "set_robot_commands": 0.0018894266985688617, "distance-from-start": 1.1750043771452143, "deviation-center-line": 0.24919425358520503, "driven_lanedir_consec": 0.7675177825866432, "sim_compute_sim_state": 0.002949802499068411, "sim_compute_performance-ego0": 0.0015166722811185396}, "LF-small-loop-001-ego0": {"driven_any": 1.175052477918736, "get_ui_image": 0.0360636374642772, "step_physics": 0.05790235342517976, "survival_time": 12.35000000000004, "driven_lanedir": 0.8863406887432557, "get_state_dump": 0.004084968759167579, "get_robot_state": 0.0032640964754166142, "sim_render-ego0": 0.0031951646650991133, "get_duckie_state": 1.155561016451928e-06, "in-drivable-lane": 3.2000000000000455, "deviation-heading": 1.1212839709228988, "agent_compute-ego0": 0.005523947938796013, "complete-iteration": 0.11766254325066844, "set_robot_commands": 0.002029985189437866, "distance-from-start": 1.17503380661638, "deviation-center-line": 0.2842653390387332, "driven_lanedir_consec": 0.8863406887432557, "sim_compute_sim_state": 0.003753757284533593, "sim_compute_performance-ego0": 0.001762875626164098}}
set_robot_commands_max0.002029985189437866
set_robot_commands_mean0.0019597059440033637
set_robot_commands_median0.0019597059440033637
set_robot_commands_min0.0018894266985688617
sim_compute_performance-ego0_max0.001762875626164098
sim_compute_performance-ego0_mean0.0016397739536413189
sim_compute_performance-ego0_median0.0016397739536413189
sim_compute_performance-ego0_min0.0015166722811185396
sim_compute_sim_state_max0.003753757284533593
sim_compute_sim_state_mean0.003351779891801002
sim_compute_sim_state_median0.003351779891801002
sim_compute_sim_state_min0.002949802499068411
sim_render-ego0_max0.0031951646650991133
sim_render-ego0_mean0.00307845852542238
sim_render-ego0_median0.00307845852542238
sim_render-ego0_min0.002961752385745647
simulation-passed1
step_physics_max0.05790235342517976
step_physics_mean0.05576497530040439
step_physics_median0.05576497530040439
step_physics_min0.05362759717562903
survival_time_max12.35000000000004
survival_time_mean12.32500000000004
survival_time_min12.30000000000004
No reset possible
7931916015Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-teststep1successnonogpu-production-b-spot-0-070:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.14


other stats
nsamples200
No reset possible
7921315955Alessandro Zanardi 🇨🇭minimal-agent-fullaido-LFVI_multi_full-sim-validationsim-3of4successyesnogpu-production-b-spot-0-070:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
other stats
simulation-passed1
skipped1
No reset possible
7919113798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednonogpu-production-b-spot-0-070:00:22
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 745, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 944, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible