Duckietown Challenges Home Challenges Submissions

Evaluator 5432

ID5432
evaluatorgpu-production-spot-0-04
ownerI don't have one 😀
machinegpu-production-spot-0
processgpu-production-spot-0-04
version6.2.32
first heard
last heard
statusinactive
# evaluating
# success168 80467
# timeout2 82120
# failed3 80450
# error42 82342
# aborted10 80426
# host-error5 80511
arm0
x86_641
Mac0
gpu available1
Number of processors64
Processor frequency (MHz)0.0 GHz
Free % of processors100%
RAM total (MB)249.0 GB
RAM free (MB)245.9 GB
Disk (MB)969.3 GB
Disk available (MB)892.2 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
8489616981Andrey Naydenkoexercises_braitenbergmooc-BV1sim-4of5successnogpu-production-spot-0-040:02:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean0.8819051033395061


other stats
agent_compute-ego0_max0.009536024715219225
agent_compute-ego0_mean0.009536024715219225
agent_compute-ego0_median0.009536024715219225
agent_compute-ego0_min0.009536024715219225
complete-iteration_max0.2220233040196555
complete-iteration_mean0.2220233040196555
complete-iteration_median0.2220233040196555
complete-iteration_min0.2220233040196555
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max0.8819051033395061
distance-from-start_median0.8819051033395061
distance-from-start_min0.8819051033395061
driven_any_max0.9068971736989688
driven_any_mean0.9068971736989688
driven_any_median0.9068971736989688
driven_any_min0.9068971736989688
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.09484862961939404
get_duckie_state_mean0.09484862961939404
get_duckie_state_median0.09484862961939404
get_duckie_state_min0.09484862961939404
get_robot_state_max0.00343467401606696
get_robot_state_mean0.00343467401606696
get_robot_state_median0.00343467401606696
get_robot_state_min0.00343467401606696
get_state_dump_max0.019533389380999973
get_state_dump_mean0.019533389380999973
get_state_dump_median0.019533389380999973
get_state_dump_min0.019533389380999973
get_ui_image_max0.014506890305450984
get_ui_image_mean0.014506890305450984
get_ui_image_median0.014506890305450984
get_ui_image_min0.014506890305450984
in-drivable-lane_max11.150000000000023
in-drivable-lane_mean11.150000000000023
in-drivable-lane_median11.150000000000023
in-drivable-lane_min11.150000000000023
per-episodes
details{"d50-ego0": {"driven_any": 0.9068971736989688, "get_ui_image": 0.014506890305450984, "step_physics": 0.06264078829969678, "survival_time": 11.150000000000023, "driven_lanedir": 0.0, "get_state_dump": 0.019533389380999973, "get_robot_state": 0.00343467401606696, "sim_render-ego0": 0.0034362684403147015, "get_duckie_state": 0.09484862961939404, "in-drivable-lane": 11.150000000000023, "deviation-heading": 0.0, "agent_compute-ego0": 0.009536024715219225, "complete-iteration": 0.2220233040196555, "set_robot_commands": 0.002053829176085336, "distance-from-start": 0.8819051033395061, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010177744286400931, "sim_compute_performance-ego0": 0.0017776638269424438}}
set_robot_commands_max0.002053829176085336
set_robot_commands_mean0.002053829176085336
set_robot_commands_median0.002053829176085336
set_robot_commands_min0.002053829176085336
sim_compute_performance-ego0_max0.0017776638269424438
sim_compute_performance-ego0_mean0.0017776638269424438
sim_compute_performance-ego0_median0.0017776638269424438
sim_compute_performance-ego0_min0.0017776638269424438
sim_compute_sim_state_max0.010177744286400931
sim_compute_sim_state_mean0.010177744286400931
sim_compute_sim_state_median0.010177744286400931
sim_compute_sim_state_min0.010177744286400931
sim_render-ego0_max0.0034362684403147015
sim_render-ego0_mean0.0034362684403147015
sim_render-ego0_median0.0034362684403147015
sim_render-ego0_min0.0034362684403147015
simulation-passed1
step_physics_max0.06264078829969678
step_physics_mean0.06264078829969678
step_physics_median0.06264078829969678
step_physics_min0.06264078829969678
survival_time_max11.150000000000023
survival_time_mean11.150000000000023
survival_time_median11.150000000000023
survival_time_min11.150000000000023
No reset possible
8489216979Andrey Naydenkoexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-040:07:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.1662849454131408


other stats
agent_compute-ego0_max0.00872700369876364
agent_compute-ego0_mean0.00872700369876364
agent_compute-ego0_median0.00872700369876364
agent_compute-ego0_min0.00872700369876364
complete-iteration_max0.19309109773324884
complete-iteration_mean0.19309109773324884
complete-iteration_median0.19309109773324884
complete-iteration_min0.19309109773324884
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.1662849454131408
distance-from-start_median3.1662849454131408
distance-from-start_min3.1662849454131408
driven_any_max3.2108946049229568
driven_any_mean3.2108946049229568
driven_any_median3.2108946049229568
driven_any_min3.2108946049229568
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.07463359022917955
get_duckie_state_mean0.07463359022917955
get_duckie_state_median0.07463359022917955
get_duckie_state_min0.07463359022917955
get_robot_state_max0.003344008456105771
get_robot_state_mean0.003344008456105771
get_robot_state_median0.003344008456105771
get_robot_state_min0.003344008456105771
get_state_dump_max0.01609338560829992
get_state_dump_mean0.01609338560829992
get_state_dump_median0.01609338560829992
get_state_dump_min0.01609338560829992
get_ui_image_max0.013579214720622353
get_ui_image_mean0.013579214720622353
get_ui_image_median0.013579214720622353
get_ui_image_min0.013579214720622353
in-drivable-lane_max36.75000000000005
in-drivable-lane_mean36.75000000000005
in-drivable-lane_median36.75000000000005
in-drivable-lane_min36.75000000000005
per-episodes
details{"d40-ego0": {"driven_any": 3.2108946049229568, "get_ui_image": 0.013579214720622353, "step_physics": 0.05888341302457063, "survival_time": 36.75000000000005, "driven_lanedir": 0.0, "get_state_dump": 0.01609338560829992, "get_robot_state": 0.003344008456105771, "sim_render-ego0": 0.0033217905008274574, "get_duckie_state": 0.07463359022917955, "in-drivable-lane": 36.75000000000005, "deviation-heading": 0.0, "agent_compute-ego0": 0.00872700369876364, "complete-iteration": 0.19309109773324884, "set_robot_commands": 0.002038678073364755, "distance-from-start": 3.1662849454131408, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010671633093253426, "sim_compute_performance-ego0": 0.0017299616466397824}}
set_robot_commands_max0.002038678073364755
set_robot_commands_mean0.002038678073364755
set_robot_commands_median0.002038678073364755
set_robot_commands_min0.002038678073364755
sim_compute_performance-ego0_max0.0017299616466397824
sim_compute_performance-ego0_mean0.0017299616466397824
sim_compute_performance-ego0_median0.0017299616466397824
sim_compute_performance-ego0_min0.0017299616466397824
sim_compute_sim_state_max0.010671633093253426
sim_compute_sim_state_mean0.010671633093253426
sim_compute_sim_state_median0.010671633093253426
sim_compute_sim_state_min0.010671633093253426
sim_render-ego0_max0.0033217905008274574
sim_render-ego0_mean0.0033217905008274574
sim_render-ego0_median0.0033217905008274574
sim_render-ego0_min0.0033217905008274574
simulation-passed1
step_physics_max0.05888341302457063
step_physics_mean0.05888341302457063
step_physics_median0.05888341302457063
step_physics_min0.05888341302457063
survival_time_max36.75000000000005
survival_time_mean36.75000000000005
survival_time_median36.75000000000005
survival_time_min36.75000000000005
No reset possible
8470816869Asoka Vardhan Splanning-exercisemooc-planning-dd-dynamic-teststep1-0of4successyesgpu-production-spot-0-040:03:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8469616873Asoka Vardhan Splanning-exercisemooc-planning-cc-static-teststep1-1of4successyesgpu-production-spot-0-040:03:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8468616866Asoka Vardhan Splanning-exercisemooc-planning-dd-static-valistep1-0of4successyesgpu-production-spot-0-040:03:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.004818212149172949


other stats
nfeasible6
nsamples6
No reset possible
8467916866Asoka Vardhan Splanning-exercisemooc-planning-dd-static-valistep1-0of4successyesgpu-production-spot-0-040:03:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.004818212149172949


other stats
nfeasible6
nsamples6
No reset possible
8466716872Asoka Vardhan Splanning-exercisemooc-planning-cc-static-valistep1-3of4successyesgpu-production-spot-0-040:03:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8440716725Arwa Alabdulkarimtemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-040:14:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median13.475000000000056
deviation-center-line_median3.067692257277704
driven_lanedir_consec_median3.591945938564651
survival_time_median39.19999999999943


other stats
agent_compute-ego0_max0.016404657182977775
agent_compute-ego0_mean0.01123361049630184
agent_compute-ego0_median0.01123361049630184
agent_compute-ego0_min0.00606256380962591
complete-iteration_max0.18688470044433264
complete-iteration_mean0.1799159404520361
complete-iteration_median0.1799159404520361
complete-iteration_min0.17294718045973956
deviation-center-line_max6.135384514555408
deviation-center-line_mean3.067692257277704
deviation-center-line_min0.0
deviation-heading_max1.801099267305012
deviation-heading_mean0.900549633652506
deviation-heading_median0.900549633652506
deviation-heading_min0.0
distance-from-start_max8.31698867253786
distance-from-start_mean5.358954583524797
distance-from-start_median5.358954583524797
distance-from-start_min2.4009204945117335
driven_any_max8.324248644958606
driven_any_mean5.375261815714075
driven_any_median5.375261815714075
driven_any_min2.4262749864695436
driven_lanedir_consec_max7.183891877129302
driven_lanedir_consec_mean3.591945938564651
driven_lanedir_consec_min0.0
driven_lanedir_max7.183891877129302
driven_lanedir_mean3.591945938564651
driven_lanedir_median3.591945938564651
driven_lanedir_min0.0
get_duckie_state_max1.6934826445127244e-06
get_duckie_state_mean1.6550021422497108e-06
get_duckie_state_median1.6550021422497108e-06
get_duckie_state_min1.6165216399866972e-06
get_robot_state_max0.0034473969684383735
get_robot_state_mean0.0034204192904077144
get_robot_state_median0.0034204192904077144
get_robot_state_min0.0033934416123770554
get_state_dump_max0.004329703364591935
get_state_dump_mean0.004239158036929842
get_state_dump_median0.004239158036929842
get_state_dump_min0.004148612709267749
get_ui_image_max0.047181046752102655
get_ui_image_mean0.04718035666898465
get_ui_image_median0.04718035666898465
get_ui_image_min0.047179666585866656
in-drivable-lane_max18.400000000000126
in-drivable-lane_mean13.475000000000056
in-drivable-lane_min8.549999999999986
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 8.324248644958606, "get_ui_image": 0.047179666585866656, "step_physics": 0.07387381370220454, "survival_time": 59.99999999999873, "driven_lanedir": 7.183891877129302, "get_state_dump": 0.004148612709267749, "get_robot_state": 0.0033934416123770554, "sim_render-ego0": 0.003499373905267644, "get_duckie_state": 1.6165216399866972e-06, "in-drivable-lane": 8.549999999999986, "deviation-heading": 1.801099267305012, "agent_compute-ego0": 0.00606256380962591, "complete-iteration": 0.17294718045973956, "set_robot_commands": 0.002089354517457884, "distance-from-start": 8.31698867253786, "deviation-center-line": 6.135384514555408, "driven_lanedir_consec": 7.183891877129302, "sim_compute_sim_state": 0.030807580082343085, "sim_compute_performance-ego0": 0.0018250672247487245}, "LF-full-loop-001-ego0": {"driven_any": 2.4262749864695436, "get_ui_image": 0.047181046752102655, "step_physics": 0.08065838413186836, "survival_time": 18.400000000000126, "driven_lanedir": 0.0, "get_state_dump": 0.004329703364591935, "get_robot_state": 0.0034473969684383735, "sim_render-ego0": 0.00367806662065873, "get_duckie_state": 1.6934826445127244e-06, "in-drivable-lane": 18.400000000000126, "deviation-heading": 0.0, "agent_compute-ego0": 0.016404657182977775, "complete-iteration": 0.18688470044433264, "set_robot_commands": 0.002075220511211613, "distance-from-start": 2.4009204945117335, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.02718554861177274, "sim_compute_performance-ego0": 0.001856314134468554}}
set_robot_commands_max0.002089354517457884
set_robot_commands_mean0.0020822875143347483
set_robot_commands_median0.0020822875143347483
set_robot_commands_min0.002075220511211613
sim_compute_performance-ego0_max0.001856314134468554
sim_compute_performance-ego0_mean0.0018406906796086392
sim_compute_performance-ego0_median0.0018406906796086392
sim_compute_performance-ego0_min0.0018250672247487245
sim_compute_sim_state_max0.030807580082343085
sim_compute_sim_state_mean0.028996564347057913
sim_compute_sim_state_median0.028996564347057913
sim_compute_sim_state_min0.02718554861177274
sim_render-ego0_max0.00367806662065873
sim_render-ego0_mean0.003588720262963187
sim_render-ego0_median0.003588720262963187
sim_render-ego0_min0.003499373905267644
simulation-passed1
step_physics_max0.08065838413186836
step_physics_mean0.07726609891703645
step_physics_median0.07726609891703645
step_physics_min0.07387381370220454
survival_time_max59.99999999999873
survival_time_mean39.19999999999943
survival_time_min18.400000000000126
No reset possible
8432816650Bea Baselines 🐤baseline-solutionmooc-planning-dd-empty-valistep1successyesgpu-production-spot-0-040:06:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration9.398582190408936
complexity17.11111111111111
avg_min_distance0.8585070280392633


other stats
nfeasible27
nsamples27
No reset possible
8431816659Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-teststep1-2of4successyesgpu-production-spot-0-040:05:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration24.94836262025912
complexity76.66666666666667
avg_min_distance0.21483334054841263


other stats
nfeasible6
nsamples6
No reset possible
8430216654Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-valistep1-1of4successyesgpu-production-spot-0-040:09:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration43.259052643710525
complexity118.16666666666669
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8427516639Arwa Alabdulkarimbase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-040:16:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median0.0
deviation-center-line_median3.696305801989676
driven_lanedir_consec_median6.182714066879211
survival_time_median59.99999999999873


other stats
agent_compute-ego0_max0.005634326521899678
agent_compute-ego0_mean0.005617843976525046
agent_compute-ego0_median0.005617843976525046
agent_compute-ego0_min0.005601361431150412
complete-iteration_max0.1115184868503669
complete-iteration_mean0.10990697984195172
complete-iteration_median0.10990697984195172
complete-iteration_min0.10829547283353656
deviation-center-line_max3.7364318557625342
deviation-center-line_mean3.696305801989676
deviation-center-line_min3.6561797482168177
deviation-heading_max8.01571567533633
deviation-heading_mean6.644767533365868
deviation-heading_median6.644767533365868
deviation-heading_min5.273819391395406
distance-from-start_max1.6159670343067474
distance-from-start_mean1.35028158844528
distance-from-start_median1.35028158844528
distance-from-start_min1.0845961425838129
driven_any_max6.248374679222964
driven_any_mean6.245725383387421
driven_any_median6.245725383387421
driven_any_min6.243076087551877
driven_lanedir_consec_max6.206329853173274
driven_lanedir_consec_mean6.182714066879211
driven_lanedir_consec_min6.159098280585149
driven_lanedir_max6.206329853173274
driven_lanedir_mean6.182714066879211
driven_lanedir_median6.182714066879211
driven_lanedir_min6.159098280585149
get_duckie_state_max1.27209513312474e-06
get_duckie_state_mean1.1851448103549775e-06
get_duckie_state_median1.1851448103549775e-06
get_duckie_state_min1.0981944875852154e-06
get_robot_state_max0.0034615173625707823
get_robot_state_mean0.0034615083300600837
get_robot_state_median0.0034615083300600837
get_robot_state_min0.003461499297549385
get_state_dump_max0.004324195386964415
get_state_dump_mean0.004260712321056712
get_state_dump_median0.004260712321056712
get_state_dump_min0.004197229255149009
get_ui_image_max0.02806832172987761
get_ui_image_mean0.02772667793111936
get_ui_image_median0.02772667793111936
get_ui_image_min0.02738503413236111
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 6.243076087551877, "get_ui_image": 0.02738503413236111, "step_physics": 0.05667615254455363, "survival_time": 59.99999999999873, "driven_lanedir": 6.206329853173274, "get_state_dump": 0.004197229255149009, "get_robot_state": 0.003461499297549385, "sim_render-ego0": 0.0034358860749586933, "get_duckie_state": 1.0981944875852154e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.273819391395406, "agent_compute-ego0": 0.005601361431150412, "complete-iteration": 0.10829547283353656, "set_robot_commands": 0.0020455140853106826, "distance-from-start": 1.0845961425838129, "deviation-center-line": 3.6561797482168177, "driven_lanedir_consec": 6.206329853173274, "sim_compute_sim_state": 0.0036229571136804943, "sim_compute_performance-ego0": 0.0018040605826143616}, "LF-small-loop-001-ego0": {"driven_any": 6.248374679222964, "get_ui_image": 0.02806832172987761, "step_physics": 0.05894555874807848, "survival_time": 59.99999999999873, "driven_lanedir": 6.159098280585149, "get_state_dump": 0.004324195386964415, "get_robot_state": 0.0034615173625707823, "sim_render-ego0": 0.0034328852962395434, "get_duckie_state": 1.27209513312474e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.01571567533633, "agent_compute-ego0": 0.005634326521899678, "complete-iteration": 0.1115184868503669, "set_robot_commands": 0.00202606758606821, "distance-from-start": 1.6159670343067474, "deviation-center-line": 3.7364318557625342, "driven_lanedir_consec": 6.159098280585149, "sim_compute_sim_state": 0.0037402443643612822, "sim_compute_performance-ego0": 0.0018156001609529089}}
set_robot_commands_max0.0020455140853106826
set_robot_commands_mean0.0020357908356894465
set_robot_commands_median0.0020357908356894465
set_robot_commands_min0.00202606758606821
sim_compute_performance-ego0_max0.0018156001609529089
sim_compute_performance-ego0_mean0.0018098303717836352
sim_compute_performance-ego0_median0.0018098303717836352
sim_compute_performance-ego0_min0.0018040605826143616
sim_compute_sim_state_max0.0037402443643612822
sim_compute_sim_state_mean0.003681600739020889
sim_compute_sim_state_median0.003681600739020889
sim_compute_sim_state_min0.0036229571136804943
sim_render-ego0_max0.0034358860749586933
sim_render-ego0_mean0.003434385685599118
sim_render-ego0_median0.003434385685599118
sim_render-ego0_min0.0034328852962395434
simulation-passed1
step_physics_max0.05894555874807848
step_physics_mean0.05781085564631606
step_physics_median0.05781085564631606
step_physics_min0.05667615254455363
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
8426916633Arwa Alabdulkarimbase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-040:11:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median4.150000000000059
deviation-center-line_median2.8491586592025624
driven_lanedir_consec_median3.621047237922975
survival_time_median39.84999999999944


other stats
agent_compute-ego0_max0.005890311470514611
agent_compute-ego0_mean0.0057355280731830474
agent_compute-ego0_median0.0057355280731830474
agent_compute-ego0_min0.005580744675851484
complete-iteration_max0.11056641747679892
complete-iteration_mean0.10963457149564156
complete-iteration_median0.10963457149564156
complete-iteration_min0.1087027255144842
deviation-center-line_max4.975406990711598
deviation-center-line_mean2.8491586592025624
deviation-center-line_min0.7229103276935273
deviation-heading_max9.751129211347472
deviation-heading_mean5.952559317119238
deviation-heading_median5.952559317119238
deviation-heading_min2.153989422891004
distance-from-start_max1.6883478544331645
distance-from-start_mean1.6516889682179825
distance-from-start_median1.6516889682179825
distance-from-start_min1.6150300820027998
driven_any_max6.248375715046476
driven_any_mean4.096928577860206
driven_any_median4.096928577860206
driven_any_min1.9454814406739371
driven_lanedir_consec_max6.126118700551356
driven_lanedir_consec_mean3.621047237922975
driven_lanedir_consec_min1.115975775294594
driven_lanedir_max6.126118700551356
driven_lanedir_mean3.621047237922975
driven_lanedir_median3.621047237922975
driven_lanedir_min1.115975775294594
get_duckie_state_max1.0777472655640156e-06
get_duckie_state_mean1.075466333595398e-06
get_duckie_state_median1.075466333595398e-06
get_duckie_state_min1.07318540162678e-06
get_robot_state_max0.0034156865711453595
get_robot_state_mean0.0033909709572265607
get_robot_state_median0.0033909709572265607
get_robot_state_min0.003366255343307762
get_state_dump_max0.004239279662044122
get_state_dump_mean0.004235144783947731
get_state_dump_median0.004235144783947731
get_state_dump_min0.00423100990585134
get_ui_image_max0.028543598440629016
get_ui_image_mean0.02839274156955386
get_ui_image_median0.02839274156955386
get_ui_image_min0.028241884698478704
in-drivable-lane_max8.300000000000118
in-drivable-lane_mean4.150000000000059
in-drivable-lane_min0.0
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 1.9454814406739371, "get_ui_image": 0.028543598440629016, "step_physics": 0.05746485372132893, "survival_time": 19.700000000000145, "driven_lanedir": 1.115975775294594, "get_state_dump": 0.00423100990585134, "get_robot_state": 0.0034156865711453595, "sim_render-ego0": 0.0034475278250778777, "get_duckie_state": 1.07318540162678e-06, "in-drivable-lane": 8.300000000000118, "deviation-heading": 2.153989422891004, "agent_compute-ego0": 0.005890311470514611, "complete-iteration": 0.11056641747679892, "set_robot_commands": 0.0021255559559109844, "distance-from-start": 1.6883478544331645, "deviation-center-line": 0.7229103276935273, "driven_lanedir_consec": 1.115975775294594, "sim_compute_sim_state": 0.00358367690557166, "sim_compute_performance-ego0": 0.001794271227679675}, "LF-small-loop-001-ego0": {"driven_any": 6.248375715046476, "get_ui_image": 0.028241884698478704, "step_physics": 0.056386389601339806, "survival_time": 59.99999999999873, "driven_lanedir": 6.126118700551356, "get_state_dump": 0.004239279662044122, "get_robot_state": 0.003366255343307762, "sim_render-ego0": 0.003413441179197694, "get_duckie_state": 1.0777472655640156e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.751129211347472, "agent_compute-ego0": 0.005580744675851484, "complete-iteration": 0.1087027255144842, "set_robot_commands": 0.002035597778180557, "distance-from-start": 1.6150300820027998, "deviation-center-line": 4.975406990711598, "driven_lanedir_consec": 6.126118700551356, "sim_compute_sim_state": 0.003609630487840638, "sim_compute_performance-ego0": 0.0017602272970690318}}
set_robot_commands_max0.0021255559559109844
set_robot_commands_mean0.0020805768670457705
set_robot_commands_median0.0020805768670457705
set_robot_commands_min0.002035597778180557
sim_compute_performance-ego0_max0.001794271227679675
sim_compute_performance-ego0_mean0.0017772492623743534
sim_compute_performance-ego0_median0.0017772492623743534
sim_compute_performance-ego0_min0.0017602272970690318
sim_compute_sim_state_max0.003609630487840638
sim_compute_sim_state_mean0.003596653696706149
sim_compute_sim_state_median0.003596653696706149
sim_compute_sim_state_min0.00358367690557166
sim_render-ego0_max0.0034475278250778777
sim_render-ego0_mean0.003430484502137786
sim_render-ego0_median0.003430484502137786
sim_render-ego0_min0.003413441179197694
simulation-passed1
step_physics_max0.05746485372132893
step_physics_mean0.05692562166133437
step_physics_median0.05692562166133437
step_physics_min0.056386389601339806
survival_time_max59.99999999999873
survival_time_mean39.84999999999944
survival_time_min19.700000000000145
No reset possible
8426016632Chahbaz Amanexercises_braitenbergmooc-BV1sim-1of5abortednogpu-production-spot-0-040:04:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.6262312494466926


other stats
agent_compute-ego0_max0.008895511556815398
agent_compute-ego0_mean0.008895511556815398
agent_compute-ego0_median0.008895511556815398
agent_compute-ego0_min0.008895511556815398
complete-iteration_max0.25641009640429735
complete-iteration_mean0.25641009640429735
complete-iteration_median0.25641009640429735
complete-iteration_min0.25641009640429735
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.6262312494466926
distance-from-start_median1.6262312494466926
distance-from-start_min1.6262312494466926
driven_any_max2.0558417996432823
driven_any_mean2.0558417996432823
driven_any_median2.0558417996432823
driven_any_min2.0558417996432823
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.1172969306087142
get_duckie_state_mean0.1172969306087142
get_duckie_state_median0.1172969306087142
get_duckie_state_min0.1172969306087142
get_robot_state_max0.003694280927031682
get_robot_state_mean0.003694280927031682
get_robot_state_median0.003694280927031682
get_robot_state_min0.003694280927031682
get_state_dump_max0.023224353790283203
get_state_dump_mean0.023224353790283203
get_state_dump_median0.023224353790283203
get_state_dump_min0.023224353790283203
get_ui_image_max0.01581213834980757
get_ui_image_mean0.01581213834980757
get_ui_image_median0.01581213834980757
get_ui_image_min0.01581213834980757
in-drivable-lane_max13.500000000000057
in-drivable-lane_mean13.500000000000057
in-drivable-lane_median13.500000000000057
in-drivable-lane_min13.500000000000057
per-episodes
details{"d60-ego0": {"driven_any": 2.0558417996432823, "get_ui_image": 0.01581213834980757, "step_physics": 0.0699145054905177, "survival_time": 13.500000000000057, "driven_lanedir": 0.0, "get_state_dump": 0.023224353790283203, "get_robot_state": 0.003694280927031682, "sim_render-ego0": 0.003564415822609764, "get_duckie_state": 0.1172969306087142, "in-drivable-lane": 13.500000000000057, "deviation-heading": 0.0, "agent_compute-ego0": 0.008895511556815398, "complete-iteration": 0.25641009640429735, "set_robot_commands": 0.002186629165142665, "distance-from-start": 1.6262312494466926, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009852637224091815, "sim_compute_performance-ego0": 0.0018729688496607257}}
set_robot_commands_max0.002186629165142665
set_robot_commands_mean0.002186629165142665
set_robot_commands_median0.002186629165142665
set_robot_commands_min0.002186629165142665
sim_compute_performance-ego0_max0.0018729688496607257
sim_compute_performance-ego0_mean0.0018729688496607257
sim_compute_performance-ego0_median0.0018729688496607257
sim_compute_performance-ego0_min0.0018729688496607257
sim_compute_sim_state_max0.009852637224091815
sim_compute_sim_state_mean0.009852637224091815
sim_compute_sim_state_median0.009852637224091815
sim_compute_sim_state_min0.009852637224091815
sim_render-ego0_max0.003564415822609764
sim_render-ego0_mean0.003564415822609764
sim_render-ego0_median0.003564415822609764
sim_render-ego0_min0.003564415822609764
simulation-passed1
step_physics_max0.0699145054905177
step_physics_mean0.0699145054905177
step_physics_median0.0699145054905177
step_physics_min0.0699145054905177
survival_time_max13.500000000000057
survival_time_mean13.500000000000057
survival_time_median13.500000000000057
survival_time_min13.500000000000057
No reset possible
8425116076Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.46
false_positive_rate0.48


other stats
nsamples200
No reset possible
8424516076Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.51
false_positive_rate0.53


other stats
nsamples200
No reset possible
8423816076Awni Altabaacollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.51
false_positive_rate0.47


other stats
nsamples200
No reset possible
8422416580Bea Baselines 🐤planning-exercisemooc-planning-dd-static-teststep1-2of4successyesgpu-production-spot-0-040:03:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8420016589Bea Baselines 🐤baseline-solutionmooc-planning-dd-empty-valistep1successyesgpu-production-spot-0-040:06:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration9.398582190408936
complexity17.11111111111111
avg_min_distance0.8585070280392633


other stats
nfeasible27
nsamples27
No reset possible
8418416594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-2of4successyesgpu-production-spot-0-040:05:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.3333333333333333
success_ratio1.0
duration29.889309079566573
complexity85.5
avg_min_distance0.055014608025610395


other stats
nfeasible6
nsamples6
No reset possible
8416116600Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-1of4successyesgpu-production-spot-0-040:07:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration31.39271682968571
complexity93.66666666666669
avg_min_distance0.009823809769874004


other stats
nfeasible6
nsamples6
No reset possible
8414416083Dimitrios Dimopouloscollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.0


other stats
nsamples200
No reset possible
8413016137Andrey Naydenkocollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.45
false_positive_rate0.38


other stats
nsamples200
No reset possible
8412016137Andrey Naydenkocollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.55
false_positive_rate0.56


other stats
nsamples200
No reset possible
8410816137Andrey Naydenkocollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.48
false_positive_rate0.48


other stats
nsamples200
No reset possible
8409116137Andrey Naydenkocollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.5
false_positive_rate0.49


other stats
nsamples200
No reset possible
8408316326Matteo Razzanellicollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.0


other stats
nsamples200
No reset possible
8406616272Ethan Frankcollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.06
false_positive_rate0.0


other stats
nsamples200
No reset possible
8406216176Emanuele Noninocollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.0


other stats
nsamples200
No reset possible
8404416540Cagri Catikmooc-collision-checkmooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.0


other stats
nsamples200
No reset possible
8403516435Aadi Nath Mishracollision-check-exercisemooc-collision-check-teststep1successyesgpu-production-spot-0-040:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.0


other stats
nsamples200
No reset possible
8402116168Emanuele Noninocollision-check-exercisemooc-collision-check-valistep1successyesgpu-production-spot-0-040:01:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.18


other stats
nsamples200
No reset possible
8400816160Awni Altabaacollision-check-exercisemooc-collision-check-valistep1host-erroryesgpu-production-spot-0-040:00:24
Error while running [...]
Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8400516376khalil abdeddaimcollision-check-exercisemooc-collision-check-valistep1successyesgpu-production-spot-0-040:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.49
false_positive_rate0.49


other stats
nsamples200
No reset possible
8398816383Richard Belangercollision-check-exercisemooc-collision-check-valistep1successyesgpu-production-spot-0-040:00:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.46
false_positive_rate0.52


other stats
nsamples200
No reset possible
8398516414Haydar Talibcollision-check-exercisemooc-collision-check-valistep1successyesgpu-production-spot-0-040:00:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.03
false_positive_rate0.02


other stats
nsamples200
No reset possible
8397816383Richard Belangercollision-check-exercisemooc-collision-check-valistep1successyesgpu-production-spot-0-040:00:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.49
false_positive_rate0.49


other stats
nsamples200
No reset possible
8396516505Shuhao Liangcollision-check-exercisemooc-collision-check-valistep1failedyesgpu-production-spot-0-040:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 97, in run_checker
    agent_ci.write_topic_and_expect_zero("set_params", inside.params)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 149, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 310, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "checker" aborted:

error in checker |Exception while handling a message on topic "set_params".
                 |
                 || Traceback (most recent call last):
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
                 ||     attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 135, in object_from_ipce_
                 ||     return object_from_ipce_list(mj, st, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 235, in object_from_ipce_list
                 ||     seq = [rec(_, suggest) for _ in mj]
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 235, in <listcomp>
                 ||     seq = [rec(_, suggest) for _ in mj]
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 220, in rec
                 ||     return object_from_ipce_(x, TT, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
                 ||     return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
                 ||     raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
                 || zuper_commons.types.exceptions.ZValueError: Cannot find field 'motion' in data for class PlacedPrimitive and no default available
                 || │  anns: dict[4]
                 || │        │ pose:
                 || │        │ dataclass aido_schemas.protocol_simulator.FriendlyPose
                 || │        │  field         x : float
                 || │        │  field         y : float
                 || │        │  field theta_deg : float
                 || │        │ primitive: Union[Circle,Rectangle]
                 || │        │ motion: Optional[Motion]
                 || │        │ appearance: Optional[Appearance]
                 || │     T: Optional[Motion]
                 || │ known: [appearance, pose, primitive]
                 || │     f: Field(name='motion',type=typing.Union[dt_protocols.collision_protocol.Motion, NoneType],default=<dataclasses._MISSING_TYPE object at 0x7f87ac31f340>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f87ac31f340>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
                 ||
                 || The above exception was the direct cause of the following exception:
                 ||
                 || Traceback (most recent call last):
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
                 ||     res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
                 ||     return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
                 ||     raise ZValueError(
                 || zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'body' of MapDefinition.
                 || │ K_annotations: {environment: List[PlacedPrimitive], body: List[PlacedPrimitive]}
                 || │   expect_type: List[PlacedPrimitive]
                 || │         ann_K: List[PlacedPrimitive]
                 || │        K_name: MapDefinition
                 ||
                 || The above exception was the direct cause of the following exception:
                 ||
                 || Traceback (most recent call last):
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 526, in handle_message_node
                 ||     ob = object_from_ipce(data, klass, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
                 ||     raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
                 || zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
                 || │ expect_type: dataclass dt_protocols.collision_protocol.MapDefinition
                 || │               field environment : List[PlacedPrimitive]
                 || │               field        body : List[PlacedPrimitive]
                 || │          mj: dict[2]
                 || │              │ body:
                 || │              │ list[1]
                 || │              │ #0 dict[3]
                 || │              │    │ pose: {x: 0.0, y: 0.0, theta_deg: 0.0}
                 || │              │    │ primitive: {xmax: 0.15, xmin: -0.1, ymax: 0.07, ymin: -0.07}
                 || │              │    │ appearance: {fillcolor: blue}
                 || │              │ environment:
                 || │              │ list[24]
                 || │              │ #0 dict[3]
                 || │              │    │ pose: {x: 4.096211474065178, y: 3.921056741058533, theta_deg: 221.0613525576354}
                 || │              │    │ primitive: {radius: 0.11131581219415985}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #1 dict[3]
                 || │              │    │ pose: {x: 4.150524423671857, y: 2.2035047870170787, theta_deg: 284.16843418306377}
                 || │              │    │ primitive: {radius: 0.2487280336575719}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #2 dict[3]
                 || │              │    │ pose: {x: 1.2004517350276562, y: 0.052336540518638786, theta_deg: 290.9855669653161}
                 || │              │    │ primitive: {radius: 0.42932641564434276}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #3 dict[3]
                 || │              │    │ pose: {x: 1.444184055172666, y: 3.894293829797041, theta_deg: 140.8384512701403}
                 || │              │    │ primitive: {radius: 0.7786940577516507}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #4 dict[3]
                 || │              │    │ pose: {x: 0.21735864157959972, y: 1.9139348492956765, theta_deg: 151.57096068164293}
                 || │              │    │ primitive: {radius: 0.24845110245234964}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #5 dict[3]
                 || │              │    │ pose: {x: 2.1388122364996502, y: 0.899693375642297, theta_deg: 91.01981449500508}
                 || │              │    │ primitive: {radius: 0.12544105088248692}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #6 dict[3]
                 || │              │    │ pose: {x: 4.323257870402481, y: 4.547108086660282, theta_deg: 342.89104640210167}
                 || │              │    │ primitive: {radius: 0.1663725304771691}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #7 dict[3]
                 || │              │    │ pose: {x: 0.4312497742670246, y: 3.734186375385332, theta_deg: 138.5698985435081}
                 || │              │    │ primitive: {radius: 0.7971857444694288}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #8 dict[3]
                 || │              │    │ pose: {x: 2.0932457595343665, y: 0.3102506074386441, theta_deg: 212.87917087175435}
                 || │              │    │ primitive: {radius: 0.6497899540998702}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #9 dict[3]
                 || │              │    │ pose: {x: 3.6239526486084928, y: 2.53711202379701, theta_deg: 131.231706647201}
                 || │              │    │ primitive: {radius: 0.2910694262025375}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #10 dict[3]
                 || │              │     │ pose: {x: 3.104003985762769, y: 0.4809516048146001, theta_deg: 197.1070584112744}
                 || │              │     │ primitive: {radius: 0.3955848362453741}
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #11 dict[3]
                 || │              │     │ pose: {x: 4.207997574466457, y: 3.568505116867564, theta_deg: 52.93214745008918}
                 || │              │     │ primitive: {radius: 0.19181966985803955}
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #12 dict[3]
                 || │              │     │ pose: {x: 3.3463275814808364, y: 3.739841327989826, theta_deg: 357.53879237749373}
                 || │              │     │ primitive: {radius: 0.6163356604505417}
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #13 dict[3]
                 || │              │     │ pose: {x: 2.093095465357427, y: 0.09105486717061906, theta_deg: 33.95408847947613}
                 || │              │     │ primitive: {radius: 0.1240898123969043}
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #14 dict[3]
                 || │              │     │ pose: {x: 4.316158712685406, y: 0.14575801841710034, theta_deg: 119.40317697254636}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.394530690402078
                 || │              │     │ │ xmin: -0.394530690402078
                 || │              │     │ │ ymax: 0.15146868158956692
                 || │              │     │ │ ymin: -0.15146868158956692
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #15 dict[3]
                 || │              │     │ pose: {x: 0.08380899366006112, y: 0.4581601168755539, theta_deg: 245.0105954978085}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.2655070912596062
                 || │              │     │ │ xmin: -0.2655070912596062
                 || │              │     │ │ ymax: 0.3803984219153249
                 || │              │     │ │ ymin: -0.3803984219153249
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #16 dict[3]
                 || │              │     │ pose: {x: 1.1813696864745893, y: 4.152775188546135, theta_deg: 296.11805516873613}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.3444191925919513
                 || │              │     │ │ xmin: -0.3444191925919513
                 || │              │     │ │ ymax: 0.17732341688956424
                 || │              │     │ │ ymin: -0.17732341688956424
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #17 dict[3]
                 || │              │     │ pose: {x: 0.4184128758721217, y: 0.6875485737484205, theta_deg: 190.34067804612636}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.17530862141145465
                 || │              │     │ │ xmin: -0.17530862141145465
                 || │              │     │ │ ymax: 0.18518194907997634
                 || │              │     │ │ ymin: -0.18518194907997634
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #18 dict[3]
                 || │              │     │ pose: {x: 0.29906431533518685, y: 4.530533535509441, theta_deg: 6.629862412277174}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.3993464304748172
                 || │              │     │ │ xmin: -0.3993464304748172
                 || │              │     │ │ ymax: 0.3261890406502711
                 || │              │     │ │ ymin: -0.3261890406502711
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #19 dict[3]
                 || │              │     │ pose: {x: 2.39864057992655, y: 3.983917362304292, theta_deg: 243.51551770368442}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.20142640295166614
                 || │              │     │ │ xmin: -0.20142640295166614
                 || │              │     │ │ ymax: 0.3632613053381599
                 || │              │     │ │ ymin: -0.3632613053381599
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #20 dict[3]
                 || │              │     │ pose: {x: 0.2530705684129625, y: 3.5622640358817166, theta_deg: 349.670709981259}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.36982554981352955
                 || │              │     │ │ xmin: -0.36982554981352955
                 || │              │     │ │ ymax: 0.3658276445413813
                 || │              │     │ │ ymin: -0.3658276445413813
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #21 dict[3]
                 || │              │     │ pose: {x: 3.975026290129256, y: 1.178490733787612, theta_deg: 217.39645096981786}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.19444527440603335
                 || │              │     │ │ xmin: -0.19444527440603335
                 || │              │     │ │ ymax: 0.2952395993417677
                 || │              │     │ │ ymin: -0.2952395993417677
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #22 dict[3]
                 || │              │     │ pose: {x: 4.228570784990871, y: 2.0518444874602664, theta_deg: 285.5366186616327}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.28593320683741674
                 || │              │     │ │ xmin: -0.28593320683741674
                 || │              │     │ │ ymax: 0.21129529169225386
                 || │              │     │ │ ymin: -0.21129529169225386
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #23 dict[3]
                 || │              │     │ pose: {x: 1.3016049158502923, y: 0.432987191146314, theta_deg: 159.606101638794}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.33107471652960146
                 || │              │     │ │ xmin: -0.33107471652960146
                 || │              │     │ │ ymax: 0.27975809156801446
                 || │              │     │ │ ymin: -0.27975809156801446
                 || │              │     │ appearance: {fillcolor: brown}
                 ||
                 || The above exception was the direct cause of the following exception:
                 ||
                 || Traceback (most recent call last):
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
                 ||     handle_message_node(parsed, receiver0, context0)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 534, in handle_message_node
                 ||     raise DecodingError(msg) from e
                 || zuper_nodes.structures.DecodingError: Cannot deserialize object for topic "set_params" expecting <class 'dt_protocols.collision_protocol.MapDefinition'>.
                 ||
                 || parsed: |RawTopicMessage(topic='set_params', data={'body': [{'pose': {'x': 0.0, 'y': 0.0, 'theta_deg': 0.0}, 'primitive': {'xmax': 0.15, 'xmin': -0.1, 'ymax': 0.07, 'ymin': -0.07}, 'appearance': {'fillcolor': 'blue'}}], 'environment': [{'pose': {'x': 4.096211474065178, 'y': 3.921056741058533, 'theta_deg': 221.0613525576354}, 'primitive': {'radius': 0.11131581219415985}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 4.150524423671857, 'y': 2.2035047870170787, 'theta_deg': 284.16843418306377}, 'primitive': {'radius': 0.2487280336575719}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 1.2004517350276562, 'y': 0.052336540518638786, 'theta_deg': 290.9855669653161}, 'primitive': {'radius': 0.42932641564434276}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 1.444184055172666, 'y': 3.894293829797041, 'theta_deg': 140.8384512701403}, 'primitive': {'radius': 0.7786940577516507}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.21735864157959972, 'y': 1.9139348492956765, 'theta_deg': 151.57096068164293}, 'primitive': {'radius': 0.24845110245234964}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 2.1388122364996502, 'y': 0.899693375642297, 'theta_deg': 91.01981449500508}, 'primitive': {'radius': 0.12544105088248692}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 4.323257870402481, 'y': 4.547108086660282, 'theta_deg': 342.89104640210167}, 'primitive': {'radius': 0.1663725304771691}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.4312497742670246, 'y': 3.734186375385332, 'theta_deg': 138.5698985435081}, 'primitive': {'radius': 0.7971857444694288}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 2.0932457595343665, 'y': 0.3102506074386441, 'theta_deg': 212.87917087175435}, 'primitive': {'radius': 0.6497899540998702}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 3.6239526486084928, 'y': 2.53711202379701, 'theta_deg': 131.231706647201}, 'primitive': {'radius': 0.2910694262025375}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 3.104003985762769, 'y': 0.4809516048146001, 'theta_deg': 197.1070584112744}, 'primitive': {'radius': 0.3955848362453741}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 4.207997574466457, 'y': 3.568505116867564, 'theta_deg': 52.93214745008918}, 'primitive': {'radius': 0.19181966985803955}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 3.3463275814808364, 'y': 3.739841327989826, 'theta_deg': 357.53879237749373}, 'primitive': {'radius': 0.6163356604505417}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 2.093095465357427, 'y': 0.09105486717061906, 'theta_deg': 33.95408847947613}, 'primitive': {'radius': 0.1240898123969043}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 4.316158712685406, 'y': 0.14575801841710034, 'theta_deg': 119.40317697254636}, 'primitive': {'xmax': 0.394530690402078, 'xmin': -0.394530690402078, 'ymax': 0.15146868158956692, 'ymin': -0.15146868158956692}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.08380899366006112, 'y': 0.4581601168755539, 'theta_deg': 245.0105954978085}, 'primitive': {'xmax': 0.2655070912596062, 'xmin': -0.2655070912596062, 'ymax': 0.3803984219153249, 'ymin': -0.3803984219153249}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 1.1813696864745893, 'y': 4.152775188546135, 'theta_deg': 296.11805516873613}, 'primitive': {'xmax': 0.3444191925919513, 'xmin': -0.3444191925919513, 'ymax': 0.17732341688956424, 'ymin': -0.17732341688956424}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.4184128758721217, 'y': 0.6875485737484205, 'theta_deg': 190.34067804612636}, 'primitive': {'xmax': 0.17530862141145465, 'xmin': -0.17530862141145465, 'ymax': 0.18518194907997634, 'ymin': -0.18518194907997634}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.29906431533518685, 'y': 4.530533535509441, 'theta_deg': 6.629862412277174}, 'primitive': {'xmax': 0.3993464304748172, 'xmin': -0.3993464304748172, 'ymax': 0.3261890406502711, 'ymin': -0.3261890406502711}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 2.39864057992655, 'y': 3.983917362304292, 'theta_deg': 243.51551770368442}, 'primitive': {'xmax': 0.20142640295166614, 'xmin': -0.20142640295166614, 'ymax': 0.3632613053381599, 'ymin': -0.3632613053381599}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.2530705684129625, 'y': 3.5622640358817166, 'theta_deg': 349.670709981259}, 'primitive': {'xmax': 0.36982554981352955, 'xmin': -0.36982554981352955, 'ymax': 0.3658276445413813, 'ymin': -0.3658276445413813}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 3.975026290129256, 'y': 1.178490733787612, 'theta_deg': 217.39645096981786}, 'primitive': {'xmax': 0.19444527440603335, 'xmin': -0.19444527440603335, 'ymax': 0.2952395993417677, 'ymin': -0.2952395993417677}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 4.228570784990871, 'y': 2.0518444874602664, 'theta_deg': 285.5366186616327}, 'primitive': {'xmax': 0.28593320683741674, 'xmin': -0.28593320683741674, 'ymax': 0.21129529169225386, 'ymin': -0.21129529169225386}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 1.3016049158502923, 'y': 0.432987191146314, 'theta_deg': 159.606101638794}, 'primitive': {'xmax': 0.33107471652960146, 'xmin': -0.33107471652960146, 'ymax': 0.27975809156801446, 'ymin': -0.27975809156801446}, 'appearance': {'fillcolor': 'brown'}}]}, timing=None)
                 ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 108, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 115, in run_checker
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8395916456Asoka Vardhan Scollision-check-exercisemooc-collision-check-valistep1failedyesgpu-production-spot-0-040:00:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 97, in run_checker
    agent_ci.write_topic_and_expect_zero("set_params", inside.params)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 149, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 310, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 337, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "checker" aborted:

error in checker |Exception while handling a message on topic "set_params".
                 |
                 || Traceback (most recent call last):
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 360, in object_from_ipce_dataclass_instance
                 ||     attrs[k] = object_from_ipce_(v, et_k, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 135, in object_from_ipce_
                 ||     return object_from_ipce_list(mj, st, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 235, in object_from_ipce_list
                 ||     seq = [rec(_, suggest) for _ in mj]
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 235, in <listcomp>
                 ||     seq = [rec(_, suggest) for _ in mj]
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 220, in rec
                 ||     return object_from_ipce_(x, TT, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
                 ||     return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 391, in object_from_ipce_dataclass_instance
                 ||     raise ZValueError(msg, anns=anns, T=T, known=sorted(mj), f=f)
                 || zuper_commons.types.exceptions.ZValueError: Cannot find field 'motion' in data for class PlacedPrimitive and no default available
                 || │  anns: dict[4]
                 || │        │ pose:
                 || │        │ dataclass aido_schemas.protocol_simulator.FriendlyPose
                 || │        │  field         x : float
                 || │        │  field         y : float
                 || │        │  field theta_deg : float
                 || │        │ primitive: Union[Circle,Rectangle]
                 || │        │ motion: Optional[Motion]
                 || │        │ appearance: Optional[Appearance]
                 || │     T: Optional[Motion]
                 || │ known: [appearance, pose, primitive]
                 || │     f: Field(name='motion',type=typing.Union[dt_protocols.collision_protocol.Motion, NoneType],default=<dataclasses._MISSING_TYPE object at 0x7f506fb8d340>,default_factory=<dataclasses._MISSING_TYPE object at 0x7f506fb8d340>,init=True,repr=True,hash=None,compare=True,metadata=mappingproxy({}),_field_type=_FIELD)
                 ||
                 || The above exception was the direct cause of the following exception:
                 ||
                 || Traceback (most recent call last):
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 74, in object_from_ipce
                 ||     res = object_from_ipce_(mj, expect_type, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 185, in object_from_ipce_
                 ||     return object_from_ipce_dataclass_instance(mj, K, ieds=ieds, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 366, in object_from_ipce_dataclass_instance
                 ||     raise ZValueError(
                 || zuper_commons.types.exceptions.ZValueError: Cannot deserialize attribute 'body' of MapDefinition.
                 || │ K_annotations: {environment: List[PlacedPrimitive], body: List[PlacedPrimitive]}
                 || │   expect_type: List[PlacedPrimitive]
                 || │         ann_K: List[PlacedPrimitive]
                 || │        K_name: MapDefinition
                 ||
                 || The above exception was the direct cause of the following exception:
                 ||
                 || Traceback (most recent call last):
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 526, in handle_message_node
                 ||     ob = object_from_ipce(data, klass, iedo=iedo)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_ipce/conv_object_from_ipce.py", line 93, in object_from_ipce
                 ||     raise ZValueError(msg, expect_type=expect_type, mj=mj) from e
                 || zuper_commons.types.exceptions.ZValueError: Cannot deserialize object
                 || │ expect_type: dataclass dt_protocols.collision_protocol.MapDefinition
                 || │               field environment : List[PlacedPrimitive]
                 || │               field        body : List[PlacedPrimitive]
                 || │          mj: dict[2]
                 || │              │ body:
                 || │              │ list[1]
                 || │              │ #0 dict[3]
                 || │              │    │ pose: {x: 0.0, y: 0.0, theta_deg: 0.0}
                 || │              │    │ primitive: {xmax: 0.15, xmin: -0.1, ymax: 0.07, ymin: -0.07}
                 || │              │    │ appearance: {fillcolor: blue}
                 || │              │ environment:
                 || │              │ list[24]
                 || │              │ #0 dict[3]
                 || │              │    │ pose: {x: 4.096211474065178, y: 3.921056741058533, theta_deg: 221.0613525576354}
                 || │              │    │ primitive: {radius: 0.11131581219415985}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #1 dict[3]
                 || │              │    │ pose: {x: 4.150524423671857, y: 2.2035047870170787, theta_deg: 284.16843418306377}
                 || │              │    │ primitive: {radius: 0.2487280336575719}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #2 dict[3]
                 || │              │    │ pose: {x: 1.2004517350276562, y: 0.052336540518638786, theta_deg: 290.9855669653161}
                 || │              │    │ primitive: {radius: 0.42932641564434276}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #3 dict[3]
                 || │              │    │ pose: {x: 1.444184055172666, y: 3.894293829797041, theta_deg: 140.8384512701403}
                 || │              │    │ primitive: {radius: 0.7786940577516507}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #4 dict[3]
                 || │              │    │ pose: {x: 0.21735864157959972, y: 1.9139348492956765, theta_deg: 151.57096068164293}
                 || │              │    │ primitive: {radius: 0.24845110245234964}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #5 dict[3]
                 || │              │    │ pose: {x: 2.1388122364996502, y: 0.899693375642297, theta_deg: 91.01981449500508}
                 || │              │    │ primitive: {radius: 0.12544105088248692}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #6 dict[3]
                 || │              │    │ pose: {x: 4.323257870402481, y: 4.547108086660282, theta_deg: 342.89104640210167}
                 || │              │    │ primitive: {radius: 0.1663725304771691}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #7 dict[3]
                 || │              │    │ pose: {x: 0.4312497742670246, y: 3.734186375385332, theta_deg: 138.5698985435081}
                 || │              │    │ primitive: {radius: 0.7971857444694288}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #8 dict[3]
                 || │              │    │ pose: {x: 2.0932457595343665, y: 0.3102506074386441, theta_deg: 212.87917087175435}
                 || │              │    │ primitive: {radius: 0.6497899540998702}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #9 dict[3]
                 || │              │    │ pose: {x: 3.6239526486084928, y: 2.53711202379701, theta_deg: 131.231706647201}
                 || │              │    │ primitive: {radius: 0.2910694262025375}
                 || │              │    │ appearance: {fillcolor: brown}
                 || │              │ #10 dict[3]
                 || │              │     │ pose: {x: 3.104003985762769, y: 0.4809516048146001, theta_deg: 197.1070584112744}
                 || │              │     │ primitive: {radius: 0.3955848362453741}
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #11 dict[3]
                 || │              │     │ pose: {x: 4.207997574466457, y: 3.568505116867564, theta_deg: 52.93214745008918}
                 || │              │     │ primitive: {radius: 0.19181966985803955}
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #12 dict[3]
                 || │              │     │ pose: {x: 3.3463275814808364, y: 3.739841327989826, theta_deg: 357.53879237749373}
                 || │              │     │ primitive: {radius: 0.6163356604505417}
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #13 dict[3]
                 || │              │     │ pose: {x: 2.093095465357427, y: 0.09105486717061906, theta_deg: 33.95408847947613}
                 || │              │     │ primitive: {radius: 0.1240898123969043}
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #14 dict[3]
                 || │              │     │ pose: {x: 4.316158712685406, y: 0.14575801841710034, theta_deg: 119.40317697254636}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.394530690402078
                 || │              │     │ │ xmin: -0.394530690402078
                 || │              │     │ │ ymax: 0.15146868158956692
                 || │              │     │ │ ymin: -0.15146868158956692
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #15 dict[3]
                 || │              │     │ pose: {x: 0.08380899366006112, y: 0.4581601168755539, theta_deg: 245.0105954978085}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.2655070912596062
                 || │              │     │ │ xmin: -0.2655070912596062
                 || │              │     │ │ ymax: 0.3803984219153249
                 || │              │     │ │ ymin: -0.3803984219153249
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #16 dict[3]
                 || │              │     │ pose: {x: 1.1813696864745893, y: 4.152775188546135, theta_deg: 296.11805516873613}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.3444191925919513
                 || │              │     │ │ xmin: -0.3444191925919513
                 || │              │     │ │ ymax: 0.17732341688956424
                 || │              │     │ │ ymin: -0.17732341688956424
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #17 dict[3]
                 || │              │     │ pose: {x: 0.4184128758721217, y: 0.6875485737484205, theta_deg: 190.34067804612636}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.17530862141145465
                 || │              │     │ │ xmin: -0.17530862141145465
                 || │              │     │ │ ymax: 0.18518194907997634
                 || │              │     │ │ ymin: -0.18518194907997634
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #18 dict[3]
                 || │              │     │ pose: {x: 0.29906431533518685, y: 4.530533535509441, theta_deg: 6.629862412277174}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.3993464304748172
                 || │              │     │ │ xmin: -0.3993464304748172
                 || │              │     │ │ ymax: 0.3261890406502711
                 || │              │     │ │ ymin: -0.3261890406502711
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #19 dict[3]
                 || │              │     │ pose: {x: 2.39864057992655, y: 3.983917362304292, theta_deg: 243.51551770368442}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.20142640295166614
                 || │              │     │ │ xmin: -0.20142640295166614
                 || │              │     │ │ ymax: 0.3632613053381599
                 || │              │     │ │ ymin: -0.3632613053381599
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #20 dict[3]
                 || │              │     │ pose: {x: 0.2530705684129625, y: 3.5622640358817166, theta_deg: 349.670709981259}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.36982554981352955
                 || │              │     │ │ xmin: -0.36982554981352955
                 || │              │     │ │ ymax: 0.3658276445413813
                 || │              │     │ │ ymin: -0.3658276445413813
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #21 dict[3]
                 || │              │     │ pose: {x: 3.975026290129256, y: 1.178490733787612, theta_deg: 217.39645096981786}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.19444527440603335
                 || │              │     │ │ xmin: -0.19444527440603335
                 || │              │     │ │ ymax: 0.2952395993417677
                 || │              │     │ │ ymin: -0.2952395993417677
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #22 dict[3]
                 || │              │     │ pose: {x: 4.228570784990871, y: 2.0518444874602664, theta_deg: 285.5366186616327}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.28593320683741674
                 || │              │     │ │ xmin: -0.28593320683741674
                 || │              │     │ │ ymax: 0.21129529169225386
                 || │              │     │ │ ymin: -0.21129529169225386
                 || │              │     │ appearance: {fillcolor: brown}
                 || │              │ #23 dict[3]
                 || │              │     │ pose: {x: 1.3016049158502923, y: 0.432987191146314, theta_deg: 159.606101638794}
                 || │              │     │ primitive:
                 || │              │     │ dict[4]
                 || │              │     │ │ xmax: 0.33107471652960146
                 || │              │     │ │ xmin: -0.33107471652960146
                 || │              │     │ │ ymax: 0.27975809156801446
                 || │              │     │ │ ymin: -0.27975809156801446
                 || │              │     │ appearance: {fillcolor: brown}
                 ||
                 || The above exception was the direct cause of the following exception:
                 ||
                 || Traceback (most recent call last):
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 385, in loop
                 ||     handle_message_node(parsed, receiver0, context0)
                 ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 534, in handle_message_node
                 ||     raise DecodingError(msg) from e
                 || zuper_nodes.structures.DecodingError: Cannot deserialize object for topic "set_params" expecting <class 'dt_protocols.collision_protocol.MapDefinition'>.
                 ||
                 || parsed: |RawTopicMessage(topic='set_params', data={'body': [{'pose': {'x': 0.0, 'y': 0.0, 'theta_deg': 0.0}, 'primitive': {'xmax': 0.15, 'xmin': -0.1, 'ymax': 0.07, 'ymin': -0.07}, 'appearance': {'fillcolor': 'blue'}}], 'environment': [{'pose': {'x': 4.096211474065178, 'y': 3.921056741058533, 'theta_deg': 221.0613525576354}, 'primitive': {'radius': 0.11131581219415985}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 4.150524423671857, 'y': 2.2035047870170787, 'theta_deg': 284.16843418306377}, 'primitive': {'radius': 0.2487280336575719}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 1.2004517350276562, 'y': 0.052336540518638786, 'theta_deg': 290.9855669653161}, 'primitive': {'radius': 0.42932641564434276}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 1.444184055172666, 'y': 3.894293829797041, 'theta_deg': 140.8384512701403}, 'primitive': {'radius': 0.7786940577516507}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.21735864157959972, 'y': 1.9139348492956765, 'theta_deg': 151.57096068164293}, 'primitive': {'radius': 0.24845110245234964}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 2.1388122364996502, 'y': 0.899693375642297, 'theta_deg': 91.01981449500508}, 'primitive': {'radius': 0.12544105088248692}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 4.323257870402481, 'y': 4.547108086660282, 'theta_deg': 342.89104640210167}, 'primitive': {'radius': 0.1663725304771691}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.4312497742670246, 'y': 3.734186375385332, 'theta_deg': 138.5698985435081}, 'primitive': {'radius': 0.7971857444694288}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 2.0932457595343665, 'y': 0.3102506074386441, 'theta_deg': 212.87917087175435}, 'primitive': {'radius': 0.6497899540998702}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 3.6239526486084928, 'y': 2.53711202379701, 'theta_deg': 131.231706647201}, 'primitive': {'radius': 0.2910694262025375}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 3.104003985762769, 'y': 0.4809516048146001, 'theta_deg': 197.1070584112744}, 'primitive': {'radius': 0.3955848362453741}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 4.207997574466457, 'y': 3.568505116867564, 'theta_deg': 52.93214745008918}, 'primitive': {'radius': 0.19181966985803955}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 3.3463275814808364, 'y': 3.739841327989826, 'theta_deg': 357.53879237749373}, 'primitive': {'radius': 0.6163356604505417}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 2.093095465357427, 'y': 0.09105486717061906, 'theta_deg': 33.95408847947613}, 'primitive': {'radius': 0.1240898123969043}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 4.316158712685406, 'y': 0.14575801841710034, 'theta_deg': 119.40317697254636}, 'primitive': {'xmax': 0.394530690402078, 'xmin': -0.394530690402078, 'ymax': 0.15146868158956692, 'ymin': -0.15146868158956692}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.08380899366006112, 'y': 0.4581601168755539, 'theta_deg': 245.0105954978085}, 'primitive': {'xmax': 0.2655070912596062, 'xmin': -0.2655070912596062, 'ymax': 0.3803984219153249, 'ymin': -0.3803984219153249}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 1.1813696864745893, 'y': 4.152775188546135, 'theta_deg': 296.11805516873613}, 'primitive': {'xmax': 0.3444191925919513, 'xmin': -0.3444191925919513, 'ymax': 0.17732341688956424, 'ymin': -0.17732341688956424}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.4184128758721217, 'y': 0.6875485737484205, 'theta_deg': 190.34067804612636}, 'primitive': {'xmax': 0.17530862141145465, 'xmin': -0.17530862141145465, 'ymax': 0.18518194907997634, 'ymin': -0.18518194907997634}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.29906431533518685, 'y': 4.530533535509441, 'theta_deg': 6.629862412277174}, 'primitive': {'xmax': 0.3993464304748172, 'xmin': -0.3993464304748172, 'ymax': 0.3261890406502711, 'ymin': -0.3261890406502711}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 2.39864057992655, 'y': 3.983917362304292, 'theta_deg': 243.51551770368442}, 'primitive': {'xmax': 0.20142640295166614, 'xmin': -0.20142640295166614, 'ymax': 0.3632613053381599, 'ymin': -0.3632613053381599}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 0.2530705684129625, 'y': 3.5622640358817166, 'theta_deg': 349.670709981259}, 'primitive': {'xmax': 0.36982554981352955, 'xmin': -0.36982554981352955, 'ymax': 0.3658276445413813, 'ymin': -0.3658276445413813}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 3.975026290129256, 'y': 1.178490733787612, 'theta_deg': 217.39645096981786}, 'primitive': {'xmax': 0.19444527440603335, 'xmin': -0.19444527440603335, 'ymax': 0.2952395993417677, 'ymin': -0.2952395993417677}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 4.228570784990871, 'y': 2.0518444874602664, 'theta_deg': 285.5366186616327}, 'primitive': {'xmax': 0.28593320683741674, 'xmin': -0.28593320683741674, 'ymax': 0.21129529169225386, 'ymin': -0.21129529169225386}, 'appearance': {'fillcolor': 'brown'}}, {'pose': {'x': 1.3016049158502923, 'y': 0.432987191146314, 'theta_deg': 159.606101638794}, 'primitive': {'xmax': 0.33107471652960146, 'xmin': -0.33107471652960146, 'ymax': 0.27975809156801446, 'ymin': -0.27975809156801446}, 'appearance': {'fillcolor': 'brown'}}]}, timing=None)
                 ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_collision/planning_checker.py", line 108, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 115, in run_checker
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: The remote node has violated protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8395016538Cagri Catikmooc-collision-checkmooc-collision-check-valistep1successyesgpu-production-spot-0-040:00:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.0


other stats
nsamples200
No reset possible
8394516580Bea Baselines 🐤planning-exercisemooc-planning-dd-static-teststep1-0of4successnogpu-production-spot-0-040:03:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8392216580Bea Baselines 🐤planning-exercisemooc-planning-dd-static-teststep1-1of4successnogpu-production-spot-0-040:03:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8391816581Bea Baselines 🐤planning-exercisemooc-planning-dd-dynamic-valistep1-3of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8391716581Bea Baselines 🐤planning-exercisemooc-planning-dd-dynamic-valistep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8390116598Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-teststep1-0of4successnogpu-production-spot-0-040:05:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration24.731134534515434
complexity86.66666666666667
avg_min_distance0.2164156666138596


other stats
nfeasible6
nsamples6
No reset possible
8389116597Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-valistep1-2of4successnogpu-production-spot-0-040:06:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration35.480012120116584
complexity101.16666666666669
avg_min_distance0.20036974653167172


other stats
nfeasible6
nsamples6
No reset possible
8388916582Bea Baselines 🐤planning-exercisemooc-planning-dd-dynamic-teststep1-1of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8388516582Bea Baselines 🐤planning-exercisemooc-planning-dd-dynamic-teststep1-1of4successnogpu-production-spot-0-040:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8387116586Bea Baselines 🐤planning-exercisemooc-planning-cc-static-teststep1-2of4successnogpu-production-spot-0-040:03:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8385216586Bea Baselines 🐤planning-exercisemooc-planning-cc-static-teststep1-0of4successnogpu-production-spot-0-040:03:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible6
nsamples6
No reset possible
8384116588Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-teststep1-0of4successnogpu-production-spot-0-040:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8383816588Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8383416588Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8382816594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-3of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8382716594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8382116594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8378916598Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-teststep1-0of4successnogpu-production-spot-0-040:05:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration24.731134534515434
complexity86.66666666666667
avg_min_distance0.2164156666138596


other stats
nfeasible6
nsamples6
No reset possible
8378516599Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-3of4successnogpu-production-spot-0-040:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8374516592Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-teststep1-0of4successnogpu-production-spot-0-040:05:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration29.402100996475905
complexity86.33333333333333
avg_min_distance0.21365583537368907


other stats
nfeasible6
nsamples6
No reset possible
8370616598Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-teststep1-1of4host-errornogpu-production-spot-0-040:05:09
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/3de0f35f3b087b132279a566b39d1abc3682dc7c3699fc2639204244529a22cb/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1245, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 889, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 773, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/3de0f35f3b087b132279a566b39d1abc3682dc7c3699fc2639204244529a22cb/json: Not Found ("No such container: 3de0f35f3b087b132279a566b39d1abc3682dc7c3699fc2639204244529a22cb")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8370116600Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-1of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8369816600Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-1of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8369516600Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-1of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8369216600Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8368916600Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8368516600Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-1of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8368316599Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-2of4successnogpu-production-spot-0-040:00:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8368016599Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-3of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8367416599Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-1of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8362716592Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-teststep1-1of4successnogpu-production-spot-0-040:06:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration33.00657813759664
complexity97.5
avg_min_distance0.19126888599160857


other stats
nfeasible6
nsamples6
No reset possible
8360316585Bea Baselines 🐤planning-exercisemooc-planning-cc-static-valistep1-3of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8359116586Bea Baselines 🐤planning-exercisemooc-planning-cc-static-teststep1-3of4successnogpu-production-spot-0-040:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8357616597Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-valistep1-1of4successnogpu-production-spot-0-040:00:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8357216597Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-valistep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8356016597Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-valistep1-3of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8354316597Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-valistep1-2of4successnogpu-production-spot-0-040:01:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8353016585Bea Baselines 🐤planning-exercisemooc-planning-cc-static-valistep1-0of4successnogpu-production-spot-0-040:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8351616585Bea Baselines 🐤planning-exercisemooc-planning-cc-static-valistep1-0of4successnogpu-production-spot-0-040:00:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8350716585Bea Baselines 🐤planning-exercisemooc-planning-cc-static-valistep1-0of4successnogpu-production-spot-0-040:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8350016585Bea Baselines 🐤planning-exercisemooc-planning-cc-static-valistep1-0of4successnogpu-production-spot-0-040:01:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8348116607Arwa Alabdulkarimbase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-040:06:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median3.1500000000000448
deviation-center-line_median0.4431919943602463
driven_lanedir_consec_median1.002518157618047
survival_time_median13.350000000000056


other stats
agent_compute-ego0_max0.005905123487595589
agent_compute-ego0_mean0.0058699450238631195
agent_compute-ego0_median0.0058699450238631195
agent_compute-ego0_min0.005834766560130649
complete-iteration_max0.11608931422233582
complete-iteration_mean0.11578303865260547
complete-iteration_median0.11578303865260547
complete-iteration_min0.11547676308287516
deviation-center-line_max0.6579687214554257
deviation-center-line_mean0.4431919943602463
deviation-center-line_min0.2284152672650669
deviation-heading_max1.1645310322731963
deviation-heading_mean1.1530589292923237
deviation-heading_median1.1530589292923237
deviation-heading_min1.1415868263114508
distance-from-start_max1.250877136816668
distance-from-start_mean1.2127296383075008
distance-from-start_median1.2127296383075008
distance-from-start_min1.1745821397983336
driven_any_max1.389934167155075
driven_any_mean1.2824933070238045
driven_any_median1.2824933070238045
driven_any_min1.175052446892534
driven_lanedir_consec_max1.2268793870284185
driven_lanedir_consec_mean1.002518157618047
driven_lanedir_consec_min0.7781569282076757
driven_lanedir_max1.2268793870284185
driven_lanedir_mean1.002518157618047
driven_lanedir_median1.002518157618047
driven_lanedir_min0.7781569282076757
get_duckie_state_max1.2757049666510688e-06
get_duckie_state_mean1.272834223231107e-06
get_duckie_state_median1.272834223231107e-06
get_duckie_state_min1.2699634798111451e-06
get_robot_state_max0.0035215087475315215
get_robot_state_mean0.0034891541339590556
get_robot_state_median0.0034891541339590556
get_robot_state_min0.0034567995203865897
get_state_dump_max0.004545908781789964
get_state_dump_mean0.004517055193369534
get_state_dump_median0.004517055193369534
get_state_dump_min0.004488201604949104
get_ui_image_max0.0286668481098281
get_ui_image_mean0.02856051199485324
get_ui_image_median0.02856051199485324
get_ui_image_min0.028454175879878384
in-drivable-lane_max4.150000000000059
in-drivable-lane_mean3.1500000000000448
in-drivable-lane_min2.1500000000000306
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 1.175052446892534, "get_ui_image": 0.028454175879878384, "step_physics": 0.06279815204681889, "survival_time": 12.35000000000004, "driven_lanedir": 0.7781569282076757, "get_state_dump": 0.004545908781789964, "get_robot_state": 0.0035215087475315215, "sim_render-ego0": 0.0034963642397234517, "get_duckie_state": 1.2699634798111451e-06, "in-drivable-lane": 4.150000000000059, "deviation-heading": 1.1415868263114508, "agent_compute-ego0": 0.005905123487595589, "complete-iteration": 0.11608931422233582, "set_robot_commands": 0.0020976172339531684, "distance-from-start": 1.1745821397983336, "deviation-center-line": 0.2284152672650669, "driven_lanedir_consec": 0.7781569282076757, "sim_compute_sim_state": 0.003354942606341454, "sim_compute_performance-ego0": 0.00183704879976088}, "LF-small-loop-001-ego0": {"driven_any": 1.389934167155075, "get_ui_image": 0.0286668481098281, "step_physics": 0.061634679635365806, "survival_time": 14.350000000000067, "driven_lanedir": 1.2268793870284185, "get_state_dump": 0.004488201604949104, "get_robot_state": 0.0034567995203865897, "sim_render-ego0": 0.003417412439982096, "get_duckie_state": 1.2757049666510688e-06, "in-drivable-lane": 2.1500000000000306, "deviation-heading": 1.1645310322731963, "agent_compute-ego0": 0.005834766560130649, "complete-iteration": 0.11547676308287516, "set_robot_commands": 0.0021132652958234153, "distance-from-start": 1.250877136816668, "deviation-center-line": 0.6579687214554257, "driven_lanedir_consec": 1.2268793870284185, "sim_compute_sim_state": 0.003998895486195882, "sim_compute_performance-ego0": 0.001791050864590539}}
set_robot_commands_max0.0021132652958234153
set_robot_commands_mean0.002105441264888292
set_robot_commands_median0.002105441264888292
set_robot_commands_min0.0020976172339531684
sim_compute_performance-ego0_max0.00183704879976088
sim_compute_performance-ego0_mean0.0018140498321757095
sim_compute_performance-ego0_median0.0018140498321757095
sim_compute_performance-ego0_min0.001791050864590539
sim_compute_sim_state_max0.003998895486195882
sim_compute_sim_state_mean0.003676919046268668
sim_compute_sim_state_median0.003676919046268668
sim_compute_sim_state_min0.003354942606341454
sim_render-ego0_max0.0034963642397234517
sim_render-ego0_mean0.003456888339852774
sim_render-ego0_median0.003456888339852774
sim_render-ego0_min0.003417412439982096
simulation-passed1
step_physics_max0.06279815204681889
step_physics_mean0.062216415841092346
step_physics_median0.062216415841092346
step_physics_min0.061634679635365806
survival_time_max14.350000000000067
survival_time_mean13.350000000000056
survival_time_min12.35000000000004
No reset possible
8346916579Bea Baselines 🐤planning-exercisemooc-planning-dd-static-valistep1-3of4successnogpu-production-spot-0-040:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8345416580Bea Baselines 🐤planning-exercisemooc-planning-dd-static-teststep1-0of4successnogpu-production-spot-0-040:00:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8344816580Bea Baselines 🐤planning-exercisemooc-planning-dd-static-teststep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8343616579Bea Baselines 🐤planning-exercisemooc-planning-dd-static-valistep1-1of4successnogpu-production-spot-0-040:00:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8342416580Bea Baselines 🐤planning-exercisemooc-planning-dd-static-teststep1-1of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8341216582Bea Baselines 🐤planning-exercisemooc-planning-dd-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8339616582Bea Baselines 🐤planning-exercisemooc-planning-dd-dynamic-teststep1-0of4successnogpu-production-spot-0-040:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8338516582Bea Baselines 🐤planning-exercisemooc-planning-dd-dynamic-teststep1-0of4successnogpu-production-spot-0-040:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8337616588Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8336716588Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8335916588Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8334216588Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8333216588Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8332816588Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8331916600Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-3of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8330916592Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-teststep1-1of4successnogpu-production-spot-0-040:00:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8330216592Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-teststep1-1of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8328816592Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-teststep1-1of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8328016594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-3of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8327516592Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-teststep1-1of4successnogpu-production-spot-0-040:00:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8326216594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-2of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8325316594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-1of4successnogpu-production-spot-0-040:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8324116594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-1of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8323816594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-1of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8322816592Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-teststep1-3of4successnogpu-production-spot-0-040:00:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8322016594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-1of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8321116594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-3of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8318416594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-0of4successnogpu-production-spot-0-040:02:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration35.221539978224165
complexity102.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8315516594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-0of4successnogpu-production-spot-0-040:01:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration35.221539978224165
complexity102.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8314716599Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-3of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8314316599Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-2of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8313916599Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-2of4successnogpu-production-spot-0-040:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8313316599Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-3of4successnogpu-production-spot-0-040:00:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8312916599Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-1of4successnogpu-production-spot-0-040:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8311816593Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-valistep1-0of4successnogpu-production-spot-0-040:02:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration40.25254342377523
complexity104.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8311416593Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-valistep1-2of4successnogpu-production-spot-0-040:00:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8310916591Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-valistep1-1of4successnogpu-production-spot-0-040:00:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0
avg_min_distance0.0


other stats
nfeasible0
nsamples0
No reset possible
8309416591Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-valistep1-0of4successnogpu-production-spot-0-040:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration34.27918203902017
complexity114.0
avg_min_distance0.1762563132923511


other stats
nfeasible1
nsamples1
No reset possible
8308916585Bea Baselines 🐤planning-exercisemooc-planning-cc-static-valistep1-0of4successnogpu-production-spot-0-040:00:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8307816595Bea Baselines 🐤baseline-solutionmooc-planning-cc-empty-vali585erroryesgpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'avg_min_distance': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 103, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0


other stats
nfeasible0
nsamples0
No reset possible
8307216593Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-valistep1-3of4errornogpu-production-spot-0-040:00:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'avg_min_distance': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 103, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio0.0
duration1000.0
complexity1000.0


other stats
nfeasible0
nsamples0
No reset possible
8306716585Bea Baselines 🐤planning-exercisemooc-planning-cc-static-valistep1-3of4errornogpu-production-spot-0-040:00:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8305116585Bea Baselines 🐤planning-exercisemooc-planning-cc-static-valistep1-3of4errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8303416585Bea Baselines 🐤planning-exercisemooc-planning-cc-static-valistep1-3of4errornogpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8296516590Bea Baselines 🐤baseline-solutionmooc-planning-dd-empty-test562successyesgpu-production-spot-0-040:05:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration9.398582190408936
complexity17.11111111111111
avg_min_distance0.8585070280392633


other stats
nfeasible27
nsamples27
No reset possible
8295916590Bea Baselines 🐤baseline-solutionmooc-planning-dd-empty-test565erroryesgpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8294516594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-2of4errornogpu-production-spot-0-040:00:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8294216593Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-valistep1-1of4errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8292816594Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-3of4errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8291416593Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-valistep1-1of4errornogpu-production-spot-0-040:00:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8290616595Bea Baselines 🐤baseline-solutionmooc-planning-cc-empty-vali584errornogpu-production-spot-0-040:00:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8289516595Bea Baselines 🐤baseline-solutionmooc-planning-cc-empty-vali584errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8288916597Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-valistep1-3of4errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8288316595Bea Baselines 🐤baseline-solutionmooc-planning-cc-empty-vali583errornogpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8285916597Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-valistep1-0of4successnogpu-production-spot-0-040:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration32.90271466736775
complexity115.0
avg_min_distance0.17625631329235691


other stats
nfeasible1
nsamples1
No reset possible
8283816597Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-valistep1-0of4successnogpu-production-spot-0-040:01:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration32.90271466736775
complexity115.0
avg_min_distance0.17625631329235691


other stats
nfeasible1
nsamples1
No reset possible
8283116596Bea Baselines 🐤baseline-solutionmooc-planning-cc-empty-test587erroryesgpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8281616596Bea Baselines 🐤baseline-solutionmooc-planning-cc-empty-test588erroryesgpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8280916596Bea Baselines 🐤baseline-solutionmooc-planning-cc-empty-test587erroryesgpu-production-spot-0-040:00:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 111, in run_checker
    cie.set_score(k, v)
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 343, in set_score
    raise ValueError(msg)
ValueError: Invalid value nan for score 'complexity': we do not allow infinity or NaN.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0


No reset possible
8280316596Bea Baselines 🐤baseline-solutionmooc-planning-cc-empty-test589abortednogpu-production-spot-0-040:00:24
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1237, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8277516600Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-0of4successnogpu-production-spot-0-040:02:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration37.18787011304273
complexity101.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8274716600Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-0of4successnogpu-production-spot-0-040:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration37.18787011304273
complexity101.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8274216600Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-3of4errornogpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8273716598Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-teststep1-3of4errornogpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8273016599Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-2of4errornogpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8272316590Bea Baselines 🐤baseline-solutionmooc-planning-dd-empty-test564errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8271316587Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-valistep1-0of4successnogpu-production-spot-0-040:01:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8270216587Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-valistep1-3of4errornogpu-production-spot-0-040:00:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8269616588Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-teststep1-3of4errornogpu-production-spot-0-040:00:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8268816587Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-valistep1-1of4errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8268616588Bea Baselines 🐤planning-exercisemooc-planning-cc-dynamic-teststep1-2of4errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8267816582Bea Baselines 🐤planning-exercisemooc-planning-dd-dynamic-teststep1-2of4errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8266816572Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-valistep1-2of4abortednogpu-production-spot-0-040:00:24
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1237, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8266216571Bea Baselines 🐤baseline-solutionmooc-planning-cc-empty-test589errornogpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8263016574Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-0of4successnogpu-production-spot-0-040:02:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration43.25381407444357
complexity110.0
avg_min_distance0.0


other stats
nfeasible1
nsamples1
No reset possible
8262016573Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-teststep1-3of4errornogpu-production-spot-0-040:00:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8260616574Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-2of4errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8259716575Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-3of4errornogpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8259216573Bea Baselines 🐤baseline-solutionmooc-planning-cc-static-teststep1-1of4errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8258116574Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-1of4errornogpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8257616574Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-valistep1-1of4errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8257116575Bea Baselines 🐤baseline-solutionmooc-planning-cc-dynamic-teststep1-1of4errornogpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8255916569Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-3of4errornogpu-production-spot-0-040:00:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8255316570Bea Baselines 🐤baseline-solutionmooc-planning-cc-empty-vali584errornogpu-production-spot-0-040:00:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8254316570Bea Baselines 🐤baseline-solutionmooc-planning-cc-empty-vali585errornogpu-production-spot-0-040:00:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8253716569Bea Baselines 🐤baseline-solutionmooc-planning-dd-dynamic-teststep1-1of4errornogpu-production-spot-0-040:00:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8252516566Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-valistep1-3of4errornogpu-production-spot-0-040:00:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8251816566Bea Baselines 🐤baseline-solutionmooc-planning-dd-static-valistep1-3of4errornogpu-production-spot-0-040:00:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 108, in run_checker
    final_scores = finalize_scores(scores)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 59, in finalize_scores
    "mistakes": mistakes / len(feasible),
ZeroDivisionError: division by zero

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 97, in planning_checker_main
    sessions = run_checker(
  File "/usr/local/lib/python3.8/site-packages/dt_protocols/checker.py", line 119, in run_checker
    raise dc.InvalidEvaluator() from e
duckietown_challenges.exceptions.InvalidEvaluator: 

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8251216561Haridas P Tcollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-040:01:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.05


other stats
nsamples200
No reset possible
8249716554Bea Baselines 🐤baseline-solution_mooc-planning-constrained-valistep1-2of4successyesgpu-production-spot-0-040:03:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration32.03289486467135
complexity87.25
avg_min_distance0.2261470745705977


other stats
nfeasible4
nsamples4
No reset possible
8249116555Bea Baselines 🐤baseline-solution_mooc-planning-constrained-teststep1-1of4erroryesgpu-production-spot-0-040:01:12
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 123, in planning_checker_main
    es = get_stats(r.dataset.params, inter.query, response, dt=EVAL_DT)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/make_environments.py", line 734, in get_stats
    plan_granular = more_granular(pr.plan, dt)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/make_environments.py", line 538, in more_granular
    for p in plan:
TypeError: 'NoneType' object is not iterable
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio0.75
duration38.842711471601234
complexity91.33333333333331
avg_min_distance0.06141424429954679


other stats
nfeasible3
nsamples4
No reset possible
8247616551Bea Baselines 🐤baseline-solution_mooc-planning-empty-valistep1successyesgpu-production-spot-0-040:06:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration9.398582190408936
complexity17.11111111111111
avg_min_distance0.8585070280392633


other stats
nfeasible27
nsamples27
No reset possible
8247216550Rohan Kaushikexercises_braitenbergmooc-BV1sim-2of5successnogpu-production-spot-0-040:09:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean3.7769998110703176


other stats
agent_compute-ego0_max0.008834220231362176
agent_compute-ego0_mean0.008834220231362176
agent_compute-ego0_median0.008834220231362176
agent_compute-ego0_min0.008834220231362176
complete-iteration_max0.2013693110804173
complete-iteration_mean0.2013693110804173
complete-iteration_median0.2013693110804173
complete-iteration_min0.2013693110804173
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max3.7769998110703176
distance-from-start_median3.7769998110703176
distance-from-start_min3.7769998110703176
driven_any_max3.834494837274963
driven_any_mean3.834494837274963
driven_any_median3.834494837274963
driven_any_min3.834494837274963
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.0765082585655055
get_duckie_state_mean0.0765082585655055
get_duckie_state_median0.0765082585655055
get_duckie_state_min0.0765082585655055
get_robot_state_max0.003542476255048283
get_robot_state_mean0.003542476255048283
get_robot_state_median0.003542476255048283
get_robot_state_min0.003542476255048283
get_state_dump_max0.016772454719829737
get_state_dump_mean0.016772454719829737
get_state_dump_median0.016772454719829737
get_state_dump_min0.016772454719829737
get_ui_image_max0.014193928040438251
get_ui_image_mean0.014193928040438251
get_ui_image_median0.014193928040438251
get_ui_image_min0.014193928040438251
in-drivable-lane_max53.24999999999911
in-drivable-lane_mean53.24999999999911
in-drivable-lane_median53.24999999999911
in-drivable-lane_min53.24999999999911
per-episodes
details{"d40-ego0": {"driven_any": 3.834494837274963, "get_ui_image": 0.014193928040438251, "step_physics": 0.0632729425215587, "survival_time": 53.24999999999911, "driven_lanedir": 0.0, "get_state_dump": 0.016772454719829737, "get_robot_state": 0.003542476255048283, "sim_render-ego0": 0.003423567337122017, "get_duckie_state": 0.0765082585655055, "in-drivable-lane": 53.24999999999911, "deviation-heading": 0.0, "agent_compute-ego0": 0.008834220231362176, "complete-iteration": 0.2013693110804173, "set_robot_commands": 0.0021188234522463456, "distance-from-start": 3.7769998110703176, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010826345008935982, "sim_compute_performance-ego0": 0.0017955334504147183}}
set_robot_commands_max0.0021188234522463456
set_robot_commands_mean0.0021188234522463456
set_robot_commands_median0.0021188234522463456
set_robot_commands_min0.0021188234522463456
sim_compute_performance-ego0_max0.0017955334504147183
sim_compute_performance-ego0_mean0.0017955334504147183
sim_compute_performance-ego0_median0.0017955334504147183
sim_compute_performance-ego0_min0.0017955334504147183
sim_compute_sim_state_max0.010826345008935982
sim_compute_sim_state_mean0.010826345008935982
sim_compute_sim_state_median0.010826345008935982
sim_compute_sim_state_min0.010826345008935982
sim_render-ego0_max0.003423567337122017
sim_render-ego0_mean0.003423567337122017
sim_render-ego0_median0.003423567337122017
sim_render-ego0_min0.003423567337122017
simulation-passed1
step_physics_max0.0632729425215587
step_physics_mean0.0632729425215587
step_physics_median0.0632729425215587
step_physics_min0.0632729425215587
survival_time_max53.24999999999911
survival_time_mean53.24999999999911
survival_time_median53.24999999999911
survival_time_min53.24999999999911
No reset possible
8246016541Cagri Catikmooc-collision-checkmooc-collision-check-teststep1successnogpu-production-spot-0-040:00:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible
8244616531Lin Wei-Chihtemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-040:11:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median24.42500000000021
deviation-center-line_median0.16617141803966395
driven_lanedir_consec_median0.1132621227044306
survival_time_median26.200000000000237


other stats
agent_compute-ego0_max0.0167699920868348
agent_compute-ego0_mean0.011497012529154338
agent_compute-ego0_median0.011497012529154338
agent_compute-ego0_min0.006224032971473874
complete-iteration_max0.20720340398127188
complete-iteration_mean0.19575537818289013
complete-iteration_median0.19575537818289013
complete-iteration_min0.1843073523845084
deviation-center-line_max0.1674594603386881
deviation-center-line_mean0.16617141803966395
deviation-center-line_min0.1648833757406398
deviation-heading_max1.9903709174361917
deviation-heading_mean1.9458088679722103
deviation-heading_median1.9458088679722103
deviation-heading_min1.901246818508229
distance-from-start_max3.1704349144285064
distance-from-start_mean3.0870410397204804
distance-from-start_median3.0870410397204804
distance-from-start_min3.0036471650124543
driven_any_max3.684074628572446
driven_any_mean3.509375515987694
driven_any_median3.509375515987694
driven_any_min3.3346764034029417
driven_lanedir_consec_max0.1236917716683732
driven_lanedir_consec_mean0.1132621227044306
driven_lanedir_consec_min0.10283247374048798
driven_lanedir_max0.1236917716683732
driven_lanedir_mean0.1132621227044306
driven_lanedir_median0.1132621227044306
driven_lanedir_min0.10283247374048798
get_duckie_state_max1.3478533299509176e-06
get_duckie_state_mean1.290093736918517e-06
get_duckie_state_median1.290093736918517e-06
get_duckie_state_min1.2323341438861162e-06
get_robot_state_max0.003683759597594848
get_robot_state_mean0.0036167377992879206
get_robot_state_median0.0036167377992879206
get_robot_state_min0.0035497160009809936
get_state_dump_max0.004710049332979925
get_state_dump_mean0.004611248912783323
get_state_dump_median0.004611248912783323
get_state_dump_min0.004512448492586721
get_ui_image_max0.04839619880579344
get_ui_image_mean0.04836448178925146
get_ui_image_median0.04836448178925146
get_ui_image_min0.04833276477270948
in-drivable-lane_max25.75000000000023
in-drivable-lane_mean24.42500000000021
in-drivable-lane_min23.100000000000193
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.684074628572446, "get_ui_image": 0.04839619880579344, "step_physics": 0.08486342603195385, "survival_time": 27.500000000000256, "driven_lanedir": 0.10283247374048798, "get_state_dump": 0.004512448492586721, "get_robot_state": 0.0035497160009809936, "sim_render-ego0": 0.0037474225523683857, "get_duckie_state": 1.2323341438861162e-06, "in-drivable-lane": 25.75000000000023, "deviation-heading": 1.9903709174361917, "agent_compute-ego0": 0.006224032971473874, "complete-iteration": 0.1843073523845084, "set_robot_commands": 0.002114684092803789, "distance-from-start": 3.1704349144285064, "deviation-center-line": 0.1648833757406398, "driven_lanedir_consec": 0.10283247374048798, "sim_compute_sim_state": 0.02888707673268396, "sim_compute_performance-ego0": 0.001929654400058753}, "LF-full-loop-001-ego0": {"driven_any": 3.3346764034029417, "get_ui_image": 0.04833276477270948, "step_physics": 0.09447579393405953, "survival_time": 24.90000000000022, "driven_lanedir": 0.1236917716683732, "get_state_dump": 0.004710049332979925, "get_robot_state": 0.003683759597594848, "sim_render-ego0": 0.003845938699756691, "get_duckie_state": 1.3478533299509176e-06, "in-drivable-lane": 23.100000000000193, "deviation-heading": 1.901246818508229, "agent_compute-ego0": 0.0167699920868348, "complete-iteration": 0.20720340398127188, "set_robot_commands": 0.0022216244546588294, "distance-from-start": 3.0036471650124543, "deviation-center-line": 0.1674594603386881, "driven_lanedir_consec": 0.1236917716683732, "sim_compute_sim_state": 0.031000542497348217, "sim_compute_performance-ego0": 0.002075110265391623}}
set_robot_commands_max0.0022216244546588294
set_robot_commands_mean0.002168154273731309
set_robot_commands_median0.002168154273731309
set_robot_commands_min0.002114684092803789
sim_compute_performance-ego0_max0.002075110265391623
sim_compute_performance-ego0_mean0.002002382332725188
sim_compute_performance-ego0_median0.002002382332725188
sim_compute_performance-ego0_min0.001929654400058753
sim_compute_sim_state_max0.031000542497348217
sim_compute_sim_state_mean0.02994380961501609
sim_compute_sim_state_median0.02994380961501609
sim_compute_sim_state_min0.02888707673268396
sim_render-ego0_max0.003845938699756691
sim_render-ego0_mean0.0037966806260625384
sim_render-ego0_median0.0037966806260625384
sim_render-ego0_min0.0037474225523683857
simulation-passed1
step_physics_max0.09447579393405953
step_physics_mean0.08966960998300669
step_physics_median0.08966960998300669
step_physics_min0.08486342603195385
survival_time_max27.500000000000256
survival_time_mean26.200000000000237
survival_time_min24.90000000000022
No reset possible
8243516474Andrea Censi 🇨🇭planning-exercise_mooc-planning-constrained-teststep1-2of4successyesgpu-production-spot-0-040:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8242416511Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-teststep1-3of4successyesgpu-production-spot-0-040:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.047241638407149414


other stats
nfeasible4
nsamples4
No reset possible
8241516514Bea Baselines 🐤planning-exercise_mooc-planning-dynamic-valistep1-3of4successyesgpu-production-spot-0-040:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible2
nsamples2
No reset possible
8240316519Andrea Censi 🇨🇭planning-exercise_mooc-planning-dynamic-valistep1-0of4successyesgpu-production-spot-0-040:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8239916519Andrea Censi 🇨🇭planning-exercise_mooc-planning-dynamic-valistep1-3of4successyesgpu-production-spot-0-040:01:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible2
nsamples2
No reset possible
8238716527Bea Baselines 🐤baseline-solution_mooc-planning-dynamic-valistep1-2of4successyesgpu-production-spot-0-040:03:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration47.476025327409545
complexity145.5
avg_min_distance0.0


other stats
nfeasible2
nsamples2
No reset possible
8236616522Bea Baselines 🐤baseline-solution_mooc-planning-empty-valistep1successyesgpu-production-spot-0-040:06:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration9.398582190408936
complexity17.11111111111111
avg_min_distance0.8585070280392633


other stats
nfeasible27
nsamples27
No reset possible
8235316510Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-valistep1-2of4abortednogpu-production-spot-0-040:02:12
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1237, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8234216525Bea Baselines 🐤baseline-solution_mooc-planning-constrained-valistep1-3of4errornogpu-production-spot-0-040:02:35
Unexpected exception [...]
Unexpected exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/dt_planning/planning_checker.py", line 121, in planning_checker_main
    es = get_stats(r.dataset.params, inter.query, response, dt=EVAL_DT)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/make_environments.py", line 734, in get_stats
    plan_granular = more_granular(pr.plan, dt)
  File "/usr/local/lib/python3.8/site-packages/dt_planning/make_environments.py", line 538, in more_granular
    for p in plan:
TypeError: 'NoneType' object is not iterable
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio0.75
duration27.041186466824367
complexity82.33333333333333
avg_min_distance0.2056808662745515


other stats
nfeasible3
nsamples4
No reset possible
8233416527Bea Baselines 🐤baseline-solution_mooc-planning-dynamic-valistep1-1of4successnogpu-production-spot-0-040:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration43.9739719691967
complexity113.0
avg_min_distance0.0


other stats
nfeasible2
nsamples2
No reset possible
8232616524Bea Baselines 🐤baseline-solution_mooc-planning-intermediate-teststep1-3of4successnogpu-production-spot-0-040:04:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes0.0
success_ratio1.0
duration30.106997953850964
complexity88.25
avg_min_distance0.20195571998318293


other stats
nfeasible4
nsamples4
No reset possible
8231316474Andrea Censi 🇨🇭planning-exercise_mooc-planning-constrained-teststep1-0of4successnogpu-production-spot-0-040:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8229116520Arwa Alabdulkarimbase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-040:06:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median9.450000000000038
deviation-center-line_median0.2139648207066558
driven_lanedir_consec_median0.19976828283304623
survival_time_median12.750000000000046


other stats
agent_compute-ego0_max0.0065497675059754176
agent_compute-ego0_mean0.006125643804170047
agent_compute-ego0_median0.006125643804170047
agent_compute-ego0_min0.0057015201023646765
complete-iteration_max0.11415468321906196
complete-iteration_mean0.11301666755524892
complete-iteration_median0.11301666755524892
complete-iteration_min0.11187865189143588
deviation-center-line_max0.24084295822344387
deviation-center-line_mean0.2139648207066558
deviation-center-line_min0.1870866831898677
deviation-heading_max2.8873135960947094
deviation-heading_mean2.1710337839218035
deviation-heading_median2.1710337839218035
deviation-heading_min1.454753971748897
distance-from-start_max1.614569541677273
distance-from-start_mean1.1433749579912431
distance-from-start_median1.1433749579912431
distance-from-start_min0.6721803743052135
driven_any_max1.7148705012157124
driven_any_mean1.2195755497640628
driven_any_median1.2195755497640628
driven_any_min0.7242805983124131
driven_lanedir_consec_max0.26574868391342465
driven_lanedir_consec_mean0.19976828283304623
driven_lanedir_consec_min0.13378788175266787
driven_lanedir_max0.26574868391342465
driven_lanedir_mean0.19976828283304623
driven_lanedir_median0.19976828283304623
driven_lanedir_min0.13378788175266787
get_duckie_state_max1.3848881662627796e-06
get_duckie_state_mean1.2983678720195036e-06
get_duckie_state_median1.2983678720195036e-06
get_duckie_state_min1.2118475777762277e-06
get_robot_state_max0.0038562291934166426
get_robot_state_mean0.003678682237285365
get_robot_state_median0.003678682237285365
get_robot_state_min0.0035011352811540877
get_state_dump_max0.004867958433834123
get_state_dump_mean0.004638879004819893
get_state_dump_median0.004638879004819893
get_state_dump_min0.004409799575805664
get_ui_image_max0.02929788453238351
get_ui_image_mean0.02862477667117245
get_ui_image_median0.02862477667117245
get_ui_image_min0.02795166880996139
in-drivable-lane_max14.300000000000091
in-drivable-lane_mean9.450000000000038
in-drivable-lane_min4.599999999999984
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 0.7242805983124131, "get_ui_image": 0.02795166880996139, "step_physics": 0.059392078423205714, "survival_time": 8.04999999999998, "driven_lanedir": 0.26574868391342465, "get_state_dump": 0.004867958433834123, "get_robot_state": 0.0038562291934166426, "sim_render-ego0": 0.003703314581035096, "get_duckie_state": 1.3848881662627796e-06, "in-drivable-lane": 4.599999999999984, "deviation-heading": 1.454753971748897, "agent_compute-ego0": 0.0065497675059754176, "complete-iteration": 0.11415468321906196, "set_robot_commands": 0.0021801554126504026, "distance-from-start": 0.6721803743052135, "deviation-center-line": 0.1870866831898677, "driven_lanedir_consec": 0.26574868391342465, "sim_compute_sim_state": 0.0035583987648104445, "sim_compute_performance-ego0": 0.0020089546839396157}, "LF-small-loop-001-ego0": {"driven_any": 1.7148705012157124, "get_ui_image": 0.02929788453238351, "step_physics": 0.057843401772635326, "survival_time": 17.450000000000113, "driven_lanedir": 0.13378788175266787, "get_state_dump": 0.004409799575805664, "get_robot_state": 0.0035011352811540877, "sim_render-ego0": 0.003462561879839216, "get_duckie_state": 1.2118475777762277e-06, "in-drivable-lane": 14.300000000000091, "deviation-heading": 2.8873135960947094, "agent_compute-ego0": 0.0057015201023646765, "complete-iteration": 0.11187865189143588, "set_robot_commands": 0.0021314941133771625, "distance-from-start": 1.614569541677273, "deviation-center-line": 0.24084295822344387, "driven_lanedir_consec": 0.13378788175266787, "sim_compute_sim_state": 0.003635939189365932, "sim_compute_performance-ego0": 0.0018219246183122904}}
set_robot_commands_max0.0021801554126504026
set_robot_commands_mean0.0021558247630137826
set_robot_commands_median0.0021558247630137826
set_robot_commands_min0.0021314941133771625
sim_compute_performance-ego0_max0.0020089546839396157
sim_compute_performance-ego0_mean0.0019154396511259532
sim_compute_performance-ego0_median0.0019154396511259532
sim_compute_performance-ego0_min0.0018219246183122904
sim_compute_sim_state_max0.003635939189365932
sim_compute_sim_state_mean0.003597168977088188
sim_compute_sim_state_median0.003597168977088188
sim_compute_sim_state_min0.0035583987648104445
sim_render-ego0_max0.003703314581035096
sim_render-ego0_mean0.0035829382304371563
sim_render-ego0_median0.0035829382304371563
sim_render-ego0_min0.003462561879839216
simulation-passed1
step_physics_max0.059392078423205714
step_physics_mean0.05861774009792052
step_physics_median0.05861774009792052
step_physics_min0.057843401772635326
survival_time_max17.450000000000113
survival_time_mean12.750000000000046
survival_time_min8.04999999999998
No reset possible
8228216512Bea Baselines 🐤planning-exercise_mooc-planning-constrained-valistep1-0of4successnogpu-production-spot-0-040:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8227016514Bea Baselines 🐤planning-exercise_mooc-planning-dynamic-valistep1-0of4successnogpu-production-spot-0-040:02:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8224816511Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-teststep1-0of4successnogpu-production-spot-0-040:02:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8223916511Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-teststep1-3of4successnogpu-production-spot-0-040:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.047241638407149414


other stats
nfeasible4
nsamples4
No reset possible
8223216511Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-teststep1-3of4abortednogpu-production-spot-0-040:00:35
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1237, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8222216511Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-teststep1-0of4abortednogpu-production-spot-0-040:00:36
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1237, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8221416510Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-valistep1-2of4successnogpu-production-spot-0-040:02:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8219516511Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-teststep1-1of4abortednogpu-production-spot-0-040:01:46
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1237, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8218216511Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-teststep1-1of4successnogpu-production-spot-0-040:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8217316511Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-teststep1-2of4successnogpu-production-spot-0-040:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.044822277503839915


other stats
nfeasible4
nsamples4
No reset possible
8216116510Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-valistep1-0of4successnogpu-production-spot-0-040:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8215416510Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-valistep1-3of4host-errornogpu-production-spot-0-040:01:27
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/a133b2ae6758da2c90f7051464b3cc0511b5b51be8d0bba0704987c3d3af9713/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1245, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 889, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 773, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/a133b2ae6758da2c90f7051464b3cc0511b5b51be8d0bba0704987c3d3af9713/json: Not Found ("No such container: a133b2ae6758da2c90f7051464b3cc0511b5b51be8d0bba0704987c3d3af9713")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8215016511Bea Baselines 🐤planning-exercise_mooc-planning-intermediate-teststep1-2of4host-errornogpu-production-spot-0-040:01:58
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/containers/268ff0fa26c5d10881bcd451f4ab582d36b9340ea2681b4abf4e898f8700774b/json

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1245, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 889, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 773, in inspect_container
    return self._result(
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 274, in _result
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error for http+docker://localhost/v1.40/containers/268ff0fa26c5d10881bcd451f4ab582d36b9340ea2681b4abf4e898f8700774b/json: Not Found ("No such container: 268ff0fa26c5d10881bcd451f4ab582d36b9340ea2681b4abf4e898f8700774b")
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8213816512Bea Baselines 🐤planning-exercise_mooc-planning-constrained-valistep1-2of4timeoutnogpu-production-spot-0-040:01:23
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8212416513Bea Baselines 🐤planning-exercise_mooc-planning-constrained-teststep1-1of4successnogpu-production-spot-0-040:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8212016513Bea Baselines 🐤planning-exercise_mooc-planning-constrained-teststep1-1of4timeoutnogpu-production-spot-0-040:00:30
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8211216513Bea Baselines 🐤planning-exercise_mooc-planning-constrained-teststep1-2of4successnogpu-production-spot-0-040:02:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8209616513Bea Baselines 🐤planning-exercise_mooc-planning-constrained-teststep1-3of4successnogpu-production-spot-0-040:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8209016515Bea Baselines 🐤planning-exercise_mooc-planning-dynamic-teststep1-0of4successnogpu-production-spot-0-040:02:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8207916514Bea Baselines 🐤planning-exercise_mooc-planning-dynamic-valistep1-3of4successnogpu-production-spot-0-040:01:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible2
nsamples2
No reset possible
8207616514Bea Baselines 🐤planning-exercise_mooc-planning-dynamic-valistep1-2of4successnogpu-production-spot-0-040:01:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible2
nsamples2
No reset possible
8206416514Bea Baselines 🐤planning-exercise_mooc-planning-dynamic-valistep1-1of4successnogpu-production-spot-0-040:01:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible2
nsamples2
No reset possible
8204916514Bea Baselines 🐤planning-exercise_mooc-planning-dynamic-valistep1-0of4successnogpu-production-spot-0-040:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8204116472Andrea Censi 🇨🇭planning-exercise_mooc-planning-intermediate-valistep1-1of4abortednogpu-production-spot-0-040:00:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1237, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8203316474Andrea Censi 🇨🇭planning-exercise_mooc-planning-constrained-teststep1-1of4successnogpu-production-spot-0-040:02:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8203116472Andrea Censi 🇨🇭planning-exercise_mooc-planning-intermediate-valistep1-3of4abortednogpu-production-spot-0-040:00:35
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1237, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 687, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8200516475Andrea Censi 🇨🇭planning-exercise_mooc-planning-dynamic-teststep1-3of4successnogpu-production-spot-0-040:02:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8199916475Andrea Censi 🇨🇭planning-exercise_mooc-planning-dynamic-teststep1-1of4successnogpu-production-spot-0-040:03:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.0


other stats
nfeasible4
nsamples4
No reset possible
8191916474Andrea Censi 🇨🇭planning-exercise_mooc-planning-constrained-teststep1-3of4successnogpu-production-spot-0-040:11:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.008589388801299893


other stats
nfeasible22
nsamples22
No reset possible
8191016474Andrea Censi 🇨🇭planning-exercise_mooc-planning-constrained-teststep1-3of4successnogpu-production-spot-0-040:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
mistakes1.0
success_ratio1.0
duration22.0
complexity8.0
avg_min_distance0.008589388801299893


other stats
nfeasible22
nsamples22
No reset possible
8150016464Arwa Alabdulkarimbase-image-mlmooc-visservoingsimsuccessnogpu-production-spot-0-040:06:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median3.725000000000053
deviation-center-line_median0.2669506654427264
driven_lanedir_consec_median0.8271314076648599
survival_time_median12.32500000000004


other stats
agent_compute-ego0_max0.005610158366541709
agent_compute-ego0_mean0.005498727463673281
agent_compute-ego0_median0.005498727463673281
agent_compute-ego0_min0.005387296560804854
complete-iteration_max0.10851106720585976
complete-iteration_mean0.1083474688186212
complete-iteration_median0.1083474688186212
complete-iteration_min0.10818387043138264
deviation-center-line_max0.28457293682790064
deviation-center-line_mean0.2669506654427264
deviation-center-line_min0.2493283940575521
deviation-heading_max1.1250848583000277
deviation-heading_mean1.095299037596166
deviation-heading_median1.095299037596166
deviation-heading_min1.0655132168923045
distance-from-start_max1.1750524915159026
distance-from-start_mean1.1750524915159015
distance-from-start_median1.1750524915159015
distance-from-start_min1.1750524915159009
driven_any_max1.1750524915159026
driven_any_mean1.1750524915159015
driven_any_median1.1750524915159015
driven_any_min1.1750524915159009
driven_lanedir_consec_max0.8860866230921803
driven_lanedir_consec_mean0.8271314076648599
driven_lanedir_consec_min0.7681761922375394
driven_lanedir_max0.8860866230921803
driven_lanedir_mean0.8271314076648599
driven_lanedir_median0.8271314076648599
driven_lanedir_min0.7681761922375394
get_duckie_state_max1.1737530048076924e-06
get_duckie_state_mean1.1165887487141723e-06
get_duckie_state_median1.1165887487141723e-06
get_duckie_state_min1.0594244926206529e-06
get_robot_state_max0.003443503572094825
get_robot_state_mean0.0033941577316747252
get_robot_state_median0.0033941577316747252
get_robot_state_min0.0033448118912546257
get_state_dump_max0.004263856718617101
get_state_dump_mean0.004218068725526901
get_state_dump_median0.004218068725526901
get_state_dump_min0.004172280732436701
get_ui_image_max0.028615001709230484
get_ui_image_mean0.02846439067355581
get_ui_image_median0.02846439067355581
get_ui_image_min0.028313779637881138
in-drivable-lane_max4.25000000000006
in-drivable-lane_mean3.725000000000053
in-drivable-lane_min3.2000000000000455
per-episodes
details{"LF-small-loop-000-ego0": {"driven_any": 1.1750524915159009, "get_ui_image": 0.028615001709230484, "step_physics": 0.0559848835391383, "survival_time": 12.35000000000004, "driven_lanedir": 0.7681761922375394, "get_state_dump": 0.004263856718617101, "get_robot_state": 0.003443503572094825, "sim_render-ego0": 0.0034179947068614346, "get_duckie_state": 1.0594244926206529e-06, "in-drivable-lane": 4.25000000000006, "deviation-heading": 1.0655132168923045, "agent_compute-ego0": 0.005610158366541709, "complete-iteration": 0.10851106720585976, "set_robot_commands": 0.002077979426230154, "distance-from-start": 1.1750524915159009, "deviation-center-line": 0.2493283940575521, "driven_lanedir_consec": 0.7681761922375394, "sim_compute_sim_state": 0.0032242257748880693, "sim_compute_performance-ego0": 0.001801530199666177}, "LF-small-loop-001-ego0": {"driven_any": 1.1750524915159026, "get_ui_image": 0.028313779637881138, "step_physics": 0.05591110661927505, "survival_time": 12.30000000000004, "driven_lanedir": 0.8860866230921803, "get_state_dump": 0.004172280732436701, "get_robot_state": 0.0033448118912546257, "sim_render-ego0": 0.003343774239543961, "get_duckie_state": 1.1737530048076924e-06, "in-drivable-lane": 3.2000000000000455, "deviation-heading": 1.1250848583000277, "agent_compute-ego0": 0.005387296560804854, "complete-iteration": 0.10818387043138264, "set_robot_commands": 0.0019993183583865764, "distance-from-start": 1.1750524915159026, "deviation-center-line": 0.28457293682790064, "driven_lanedir_consec": 0.8860866230921803, "sim_compute_sim_state": 0.0038756368613918784, "sim_compute_performance-ego0": 0.0017659702764348945}}
set_robot_commands_max0.002077979426230154
set_robot_commands_mean0.002038648892308365
set_robot_commands_median0.002038648892308365
set_robot_commands_min0.0019993183583865764
sim_compute_performance-ego0_max0.001801530199666177
sim_compute_performance-ego0_mean0.0017837502380505356
sim_compute_performance-ego0_median0.0017837502380505356
sim_compute_performance-ego0_min0.0017659702764348945
sim_compute_sim_state_max0.0038756368613918784
sim_compute_sim_state_mean0.0035499313181399737
sim_compute_sim_state_median0.0035499313181399737
sim_compute_sim_state_min0.0032242257748880693
sim_render-ego0_max0.0034179947068614346
sim_render-ego0_mean0.0033808844732026977
sim_render-ego0_median0.0033808844732026977
sim_render-ego0_min0.003343774239543961
simulation-passed1
step_physics_max0.0559848835391383
step_physics_mean0.05594799507920667
step_physics_median0.05594799507920667
step_physics_min0.05591110661927505
survival_time_max12.35000000000004
survival_time_mean12.32500000000004
survival_time_min12.30000000000004
No reset possible
8132616435Aadi Nath Mishracollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-040:01:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.0
false_positive_rate0.03


other stats
nsamples200
No reset possible
8110416414Haydar Talibcollision-check-exercisemooc-collision-check-valistep1successnogpu-production-spot-0-040:01:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.04
false_positive_rate0.035


other stats
nsamples400
No reset possible
8106416411Nicola Carrinotemplate-randomaido-hello-sim-validation370successyesgpu-production-spot-0-040:02:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.01167120174928145
agent_compute-ego0_mean0.01167120174928145
agent_compute-ego0_median0.01167120174928145
agent_compute-ego0_min0.01167120174928145
complete-iteration_max0.1524769121950323
complete-iteration_mean0.1524769121950323
complete-iteration_median0.1524769121950323
complete-iteration_min0.1524769121950323
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.004516292702067982
get_duckie_state_mean0.004516292702067982
get_duckie_state_median0.004516292702067982
get_duckie_state_min0.004516292702067982
get_robot_state_max0.0038965561173178935
get_robot_state_mean0.0038965561173178935
get_robot_state_median0.0038965561173178935
get_robot_state_min0.0038965561173178935
get_state_dump_max0.006195046684958718
get_state_dump_mean0.006195046684958718
get_state_dump_median0.006195046684958718
get_state_dump_min0.006195046684958718
get_ui_image_max0.029501752419905228
get_ui_image_mean0.029501752419905228
get_ui_image_median0.029501752419905228
get_ui_image_min0.029501752419905228
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.029501752419905228, "step_physics": 0.08281955935738304, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.006195046684958718, "get_robot_state": 0.0038965561173178935, "sim_render-ego0": 0.003954415971582586, "get_duckie_state": 0.004516292702067982, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.01167120174928145, "complete-iteration": 0.1524769121950323, "set_robot_commands": 0.002276512709530917, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.005448216741735285, "sim_compute_performance-ego0": 0.0021087798205288973}}
set_robot_commands_max0.002276512709530917
set_robot_commands_mean0.002276512709530917
set_robot_commands_median0.002276512709530917
set_robot_commands_min0.002276512709530917
sim_compute_performance-ego0_max0.0021087798205288973
sim_compute_performance-ego0_mean0.0021087798205288973
sim_compute_performance-ego0_median0.0021087798205288973
sim_compute_performance-ego0_min0.0021087798205288973
sim_compute_sim_state_max0.005448216741735285
sim_compute_sim_state_mean0.005448216741735285
sim_compute_sim_state_median0.005448216741735285
sim_compute_sim_state_min0.005448216741735285
sim_render-ego0_max0.003954415971582586
sim_render-ego0_mean0.003954415971582586
sim_render-ego0_median0.003954415971582586
sim_render-ego0_min0.003954415971582586
simulation-passed1
step_physics_max0.08281955935738304
step_physics_mean0.08281955935738304
step_physics_median0.08281955935738304
step_physics_min0.08281955935738304
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
8074416377khalil abdeddaimcollision-check-exercisemooc-collision-check-teststep1successnogpu-production-spot-0-040:01:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
false_negative_rate0.48
false_positive_rate0.55


other stats
nsamples200
No reset possible
8067116338Arwa Alabdulkarimtemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-040:09:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median17.825000000000127
deviation-center-line_median0.562383308598817
driven_lanedir_consec_median0.32591061131345145
survival_time_median22.77500000000019


other stats
agent_compute-ego0_max0.01621698966393104
agent_compute-ego0_mean0.011549663350834252
agent_compute-ego0_median0.011549663350834252
agent_compute-ego0_min0.006882337037737466
complete-iteration_max0.18011076083550087
complete-iteration_mean0.1792809616434064
complete-iteration_median0.1792809616434064
complete-iteration_min0.17845116245131193
deviation-center-line_max0.7664782612106223
deviation-center-line_mean0.562383308598817
deviation-center-line_min0.35828835598701175
deviation-heading_max6.149407524273224
deviation-heading_mean5.125634344173566
deviation-heading_median5.125634344173566
deviation-heading_min4.101861164073907
distance-from-start_max0.7895505265529734
distance-from-start_mean0.5460871494073961
distance-from-start_median0.5460871494073961
distance-from-start_min0.30262377226181875
driven_any_max3.4877161891791673
driven_any_mean3.030212393576493
driven_any_median3.030212393576493
driven_any_min2.572708597973818
driven_lanedir_consec_max0.3495222898760473
driven_lanedir_consec_mean0.32591061131345145
driven_lanedir_consec_min0.3022989327508556
driven_lanedir_max0.3495222898760473
driven_lanedir_mean0.32591061131345145
driven_lanedir_median0.32591061131345145
driven_lanedir_min0.3022989327508556
get_duckie_state_max1.347999499815144e-06
get_duckie_state_mean1.2874690938265923e-06
get_duckie_state_median1.2874690938265923e-06
get_duckie_state_min1.226938687838041e-06
get_robot_state_max0.0035717473659187156
get_robot_state_mean0.0034802151835595365
get_robot_state_median0.0034802151835595365
get_robot_state_min0.003388683001200358
get_state_dump_max0.004629103221127454
get_state_dump_mean0.004500202888448186
get_state_dump_median0.004500202888448186
get_state_dump_min0.0043713025557689175
get_ui_image_max0.046728723591645864
get_ui_image_mean0.046530895412695866
get_ui_image_median0.046530895412695866
get_ui_image_min0.04633306723374587
in-drivable-lane_max20.450000000000166
in-drivable-lane_mean17.825000000000127
in-drivable-lane_min15.200000000000086
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 3.4877161891791673, "get_ui_image": 0.046728723591645864, "step_physics": 0.07670271738537411, "survival_time": 26.100000000000236, "driven_lanedir": 0.3495222898760473, "get_state_dump": 0.004629103221127454, "get_robot_state": 0.0035717473659187156, "sim_render-ego0": 0.0036910501082586286, "get_duckie_state": 1.347999499815144e-06, "in-drivable-lane": 20.450000000000166, "deviation-heading": 6.149407524273224, "agent_compute-ego0": 0.006882337037737466, "complete-iteration": 0.17845116245131193, "set_robot_commands": 0.0023048885921675205, "distance-from-start": 0.7895505265529734, "deviation-center-line": 0.7664782612106223, "driven_lanedir_consec": 0.3495222898760473, "sim_compute_sim_state": 0.03193144588579867, "sim_compute_performance-ego0": 0.0019242394266803225}, "LF-full-loop-001-ego0": {"driven_any": 2.572708597973818, "get_ui_image": 0.04633306723374587, "step_physics": 0.0734700667552459, "survival_time": 19.45000000000014, "driven_lanedir": 0.3022989327508556, "get_state_dump": 0.0043713025557689175, "get_robot_state": 0.003388683001200358, "sim_render-ego0": 0.00350188658787654, "get_duckie_state": 1.226938687838041e-06, "in-drivable-lane": 15.200000000000086, "deviation-heading": 4.101861164073907, "agent_compute-ego0": 0.01621698966393104, "complete-iteration": 0.18011076083550087, "set_robot_commands": 0.0020494717818040115, "distance-from-start": 0.30262377226181875, "deviation-center-line": 0.35828835598701175, "driven_lanedir_consec": 0.3022989327508556, "sim_compute_sim_state": 0.028902215224045975, "sim_compute_performance-ego0": 0.0018004888143294895}}
set_robot_commands_max0.0023048885921675205
set_robot_commands_mean0.002177180186985766
set_robot_commands_median0.002177180186985766
set_robot_commands_min0.0020494717818040115
sim_compute_performance-ego0_max0.0019242394266803225
sim_compute_performance-ego0_mean0.001862364120504906
sim_compute_performance-ego0_median0.001862364120504906
sim_compute_performance-ego0_min0.0018004888143294895
sim_compute_sim_state_max0.03193144588579867
sim_compute_sim_state_mean0.03041683055492232
sim_compute_sim_state_median0.03041683055492232
sim_compute_sim_state_min0.028902215224045975
sim_render-ego0_max0.0036910501082586286
sim_render-ego0_mean0.0035964683480675845
sim_render-ego0_median0.0035964683480675845
sim_render-ego0_min0.00350188658787654
simulation-passed1
step_physics_max0.07670271738537411
step_physics_mean0.07508639207031001
step_physics_median0.07508639207031001
step_physics_min0.0734700667552459
survival_time_max26.100000000000236
survival_time_mean22.77500000000019
survival_time_min19.45000000000014
No reset possible
8051116255Maximilian van Amerongentemplate-rosmooc-modconsimhost-errornogpu-production-spot-0-040:01:52
Error while running [...]
Error while running Docker Compose:

Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8048816236Ray Greenexercises_braitenbergmooc-BV1sim-1of5successnogpu-production-spot-0-040:03:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
distance-from-start_mean1.0529755510578622


other stats
agent_compute-ego0_max0.01305247476135475
agent_compute-ego0_mean0.01305247476135475
agent_compute-ego0_median0.01305247476135475
agent_compute-ego0_min0.01305247476135475
complete-iteration_max0.25487925004268036
complete-iteration_mean0.25487925004268036
complete-iteration_median0.25487925004268036
complete-iteration_min0.25487925004268036
deviation-center-line_max0.0
deviation-center-line_mean0.0
deviation-center-line_median0.0
deviation-center-line_min0.0
deviation-heading_max0.0
deviation-heading_mean0.0
deviation-heading_median0.0
deviation-heading_min0.0
distance-from-start_max1.0529755510578622
distance-from-start_median1.0529755510578622
distance-from-start_min1.0529755510578622
driven_any_max1.056425813682318
driven_any_mean1.056425813682318
driven_any_median1.056425813682318
driven_any_min1.056425813682318
driven_lanedir_consec_max0.0
driven_lanedir_consec_mean0.0
driven_lanedir_consec_median0.0
driven_lanedir_consec_min0.0
driven_lanedir_max0.0
driven_lanedir_mean0.0
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max0.116608504799829
get_duckie_state_mean0.116608504799829
get_duckie_state_median0.116608504799829
get_duckie_state_min0.116608504799829
get_robot_state_max0.003735962121383004
get_robot_state_mean0.003735962121383004
get_robot_state_median0.003735962121383004
get_robot_state_min0.003735962121383004
get_state_dump_max0.02309435174085092
get_state_dump_mean0.02309435174085092
get_state_dump_median0.02309435174085092
get_state_dump_min0.02309435174085092
get_ui_image_max0.0129007869872494
get_ui_image_mean0.0129007869872494
get_ui_image_median0.0129007869872494
get_ui_image_min0.0129007869872494
in-drivable-lane_max13.75000000000006
in-drivable-lane_mean13.75000000000006
in-drivable-lane_median13.75000000000006
in-drivable-lane_min13.75000000000006
per-episodes
details{"d60-ego0": {"driven_any": 1.056425813682318, "get_ui_image": 0.0129007869872494, "step_physics": 0.06734605716622394, "survival_time": 13.75000000000006, "driven_lanedir": 0.0, "get_state_dump": 0.02309435174085092, "get_robot_state": 0.003735962121383004, "sim_render-ego0": 0.0035727101823557978, "get_duckie_state": 0.116608504799829, "in-drivable-lane": 13.75000000000006, "deviation-heading": 0.0, "agent_compute-ego0": 0.01305247476135475, "complete-iteration": 0.25487925004268036, "set_robot_commands": 0.002126783564470816, "distance-from-start": 1.0529755510578622, "deviation-center-line": 0.0, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.010465129562046215, "sim_compute_performance-ego0": 0.0018783298091612}}
set_robot_commands_max0.002126783564470816
set_robot_commands_mean0.002126783564470816
set_robot_commands_median0.002126783564470816
set_robot_commands_min0.002126783564470816
sim_compute_performance-ego0_max0.0018783298091612
sim_compute_performance-ego0_mean0.0018783298091612
sim_compute_performance-ego0_median0.0018783298091612
sim_compute_performance-ego0_min0.0018783298091612
sim_compute_sim_state_max0.010465129562046215
sim_compute_sim_state_mean0.010465129562046215
sim_compute_sim_state_median0.010465129562046215
sim_compute_sim_state_min0.010465129562046215
sim_render-ego0_max0.0035727101823557978
sim_render-ego0_mean0.0035727101823557978
sim_render-ego0_median0.0035727101823557978
sim_render-ego0_min0.0035727101823557978
simulation-passed1
step_physics_max0.06734605716622394
step_physics_mean0.06734605716622394
step_physics_median0.06734605716622394
step_physics_min0.06734605716622394
survival_time_max13.75000000000006
survival_time_mean13.75000000000006
survival_time_median13.75000000000006
survival_time_min13.75000000000006
No reset possible
8046716225Maximilian van Amerongentemplate-rosmooc-modconsimsuccessnogpu-production-spot-0-040:09:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
in-drivable-lane_median17.450000000000134
deviation-center-line_median0.3812091429409804
driven_lanedir_consec_median0.5049749138744862
survival_time_median21.45000000000017


other stats
agent_compute-ego0_max0.016377842130739825
agent_compute-ego0_mean0.0111557844261807
agent_compute-ego0_median0.0111557844261807
agent_compute-ego0_min0.005933726721621574
complete-iteration_max0.20356470740531105
complete-iteration_mean0.1867173723765117
complete-iteration_median0.1867173723765117
complete-iteration_min0.16987003734771242
deviation-center-line_max0.5224613278900231
deviation-center-line_mean0.3812091429409804
deviation-center-line_min0.23995695799193775
deviation-heading_max1.691841031050832
deviation-heading_mean1.642520950723368
deviation-heading_median1.642520950723368
deviation-heading_min1.593200870395904
distance-from-start_max3.01687525168383
distance-from-start_mean2.732534480794304
distance-from-start_median2.732534480794304
distance-from-start_min2.4481937099047784
driven_any_max3.229906566686826
driven_any_mean2.8455610358080348
driven_any_median2.8455610358080348
driven_any_min2.461215504929243
driven_lanedir_consec_max0.7292882981283146
driven_lanedir_consec_mean0.5049749138744862
driven_lanedir_consec_min0.2806615296206578
driven_lanedir_max0.7292882981283146
driven_lanedir_mean0.5049749138744862
driven_lanedir_median0.5049749138744862
driven_lanedir_min0.2806615296206578
get_duckie_state_max1.3216467928295291e-06
get_duckie_state_mean1.2001186132389103e-06
get_duckie_state_median1.2001186132389103e-06
get_duckie_state_min1.078590433648292e-06
get_robot_state_max0.0034458686497585832
get_robot_state_mean0.003398343213249724
get_robot_state_median0.003398343213249724
get_robot_state_min0.0033508177767408655
get_state_dump_max0.004611668015314528
get_state_dump_mean0.004346323247552861
get_state_dump_median0.004346323247552861
get_state_dump_min0.0040809784797911945
get_ui_image_max0.04766289508047183
get_ui_image_mean0.04722446789111826
get_ui_image_median0.04722446789111826
get_ui_image_min0.046786040701764696
in-drivable-lane_max21.600000000000172
in-drivable-lane_mean17.450000000000134
in-drivable-lane_min13.300000000000097
per-episodes
details{"LF-full-loop-000-ego0": {"driven_any": 2.461215504929243, "get_ui_image": 0.046786040701764696, "step_physics": 0.07221748981070011, "survival_time": 18.75000000000013, "driven_lanedir": 0.7292882981283146, "get_state_dump": 0.0040809784797911945, "get_robot_state": 0.0033508177767408655, "sim_render-ego0": 0.0035250935148685536, "get_duckie_state": 1.078590433648292e-06, "in-drivable-lane": 13.300000000000097, "deviation-heading": 1.593200870395904, "agent_compute-ego0": 0.005933726721621574, "complete-iteration": 0.16987003734771242, "set_robot_commands": 0.002138549343068549, "distance-from-start": 2.4481937099047784, "deviation-center-line": 0.5224613278900231, "driven_lanedir_consec": 0.7292882981283146, "sim_compute_sim_state": 0.02998822420201403, "sim_compute_performance-ego0": 0.001778175856204743}, "LF-full-loop-001-ego0": {"driven_any": 3.229906566686826, "get_ui_image": 0.04766289508047183, "step_physics": 0.09273495358869065, "survival_time": 24.150000000000208, "driven_lanedir": 0.2806615296206578, "get_state_dump": 0.004611668015314528, "get_robot_state": 0.0034458686497585832, "sim_render-ego0": 0.003628626835247702, "get_duckie_state": 1.3216467928295291e-06, "in-drivable-lane": 21.600000000000172, "deviation-heading": 1.691841031050832, "agent_compute-ego0": 0.016377842130739825, "complete-iteration": 0.20356470740531105, "set_robot_commands": 0.0020790297137804267, "distance-from-start": 3.01687525168383, "deviation-center-line": 0.23995695799193775, "driven_lanedir_consec": 0.2806615296206578, "sim_compute_sim_state": 0.03103519224923504, "sim_compute_performance-ego0": 0.0019105288608015076}}
set_robot_commands_max0.002138549343068549
set_robot_commands_mean0.002108789528424488
set_robot_commands_median0.002108789528424488
set_robot_commands_min0.0020790297137804267
sim_compute_performance-ego0_max0.0019105288608015076
sim_compute_performance-ego0_mean0.0018443523585031252
sim_compute_performance-ego0_median0.0018443523585031252
sim_compute_performance-ego0_min0.001778175856204743
sim_compute_sim_state_max0.03103519224923504
sim_compute_sim_state_mean0.03051170822562454
sim_compute_sim_state_median0.03051170822562454
sim_compute_sim_state_min0.02998822420201403
sim_render-ego0_max0.003628626835247702
sim_render-ego0_mean0.003576860175058128
sim_render-ego0_median0.003576860175058128
sim_render-ego0_min0.0035250935148685536
simulation-passed1
step_physics_max0.09273495358869065
step_physics_mean0.08247622169969537
step_physics_median0.08247622169969537
step_physics_min0.07221748981070011
survival_time_max24.150000000000208
survival_time_mean21.45000000000017
survival_time_min18.75000000000013
No reset possible
8045016206Ashley Reidobjdet exercisemooc-objdetsimfailednogpu-production-spot-0-040:06:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 601, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 190 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 60, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 33, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 315, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 605, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
8042613798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortedyesgpu-production-spot-0-040:00:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 268, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.40/images/create?tag=2021_03_25_17_23_41&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 93, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 430, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 270, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error for http+docker://localhost/v1.40/images/create?tag=2021_03_25_17_23_41&fromImage=docker.io%2Fnitaigao%2Faido-submissions: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 47, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet, credentials=credentials)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 112, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  2021_03_25_17_23_41

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 836, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1038, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5, credentials=credentials, quiet=False)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 51, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull nitaigao/aido-submissions:2021_03_25_17_23_41@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible