Duckietown Challenges Home Challenges Submissions

Evaluator 5012

ID5012
evaluatorreg03
ownerI don't have one 😀
machinearchimede_25c5c0f2133c
processreg03_25c5c0f2133c
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success40 62052
# timeout
# failed11 62061
# error1 62062
# aborted5 62256
# host-error10 62190
arm0
x86_641
Mac0
gpu available1
Number of processors40
Processor frequency (MHz)2.1 GHz
Free % of processors82%
RAM total (MB)376.6 GB
RAM free (MB)241.4 GB
Disk (MB)74209.1 GB
Disk available (MB)59013.2 GB
Docker Hub
P11
P2
Cloud simulations1
PI Camera0
# Duckiebots0
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
6299413999Jeff Moytemplate-randomaido-hello-sim-validation370successnoreg030:02:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.03739102862098
agent_compute-ego0_mean0.03739102862098
agent_compute-ego0_median0.03739102862098
agent_compute-ego0_min0.03739102862098
complete-iteration_max0.30030823295766657
complete-iteration_mean0.30030823295766657
complete-iteration_median0.30030823295766657
complete-iteration_min0.30030823295766657
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.014011345126412132
get_duckie_state_mean0.014011345126412132
get_duckie_state_median0.014011345126412132
get_duckie_state_min0.014011345126412132
get_robot_state_max0.013487469066273084
get_robot_state_mean0.013487469066273084
get_robot_state_median0.013487469066273084
get_robot_state_min0.013487469066273084
get_state_dump_max0.02177395603873513
get_state_dump_mean0.02177395603873513
get_state_dump_median0.02177395603873513
get_state_dump_min0.02177395603873513
get_ui_image_max0.04705040563236584
get_ui_image_mean0.04705040563236584
get_ui_image_median0.04705040563236584
get_ui_image_min0.04705040563236584
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.04705040563236584, "step_physics": 0.11798417568206788, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.02177395603873513, "get_robot_state": 0.013487469066273084, "sim_render-ego0": 0.01511095870624889, "get_duckie_state": 0.014011345126412132, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.03739102862098, "complete-iteration": 0.30030823295766657, "set_robot_commands": 0.008765876293182373, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.017349069768732243, "sim_compute_performance-ego0": 0.00715913555838845}}
set_robot_commands_max0.008765876293182373
set_robot_commands_mean0.008765876293182373
set_robot_commands_median0.008765876293182373
set_robot_commands_min0.008765876293182373
sim_compute_performance-ego0_max0.00715913555838845
sim_compute_performance-ego0_mean0.00715913555838845
sim_compute_performance-ego0_median0.00715913555838845
sim_compute_performance-ego0_min0.00715913555838845
sim_compute_sim_state_max0.017349069768732243
sim_compute_sim_state_mean0.017349069768732243
sim_compute_sim_state_median0.017349069768732243
sim_compute_sim_state_min0.017349069768732243
sim_render-ego0_max0.01511095870624889
sim_render-ego0_mean0.01511095870624889
sim_render-ego0_median0.01511095870624889
sim_render-ego0_min0.01511095870624889
simulation-passed1
step_physics_max0.11798417568206788
step_physics_mean0.11798417568206788
step_physics_median0.11798417568206788
step_physics_min0.11798417568206788
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6299013992Frank (Chude) Qian 🇨🇦CBC Net - MixTraining - Expert LF Human LFPaido-LFP-sim-validation350successyesreg030:11:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median6.999999999999983
in-drivable-lane_median1.9499999999999948
driven_lanedir_consec_median2.0661821082003633
deviation-center-line_median0.39495703722433695


other stats
agent_compute-ego0_max0.12017749061047192
agent_compute-ego0_mean0.10767237166386535
agent_compute-ego0_median0.10671469230710724
agent_compute-ego0_min0.09708261143077504
complete-iteration_max0.6168652787620639
complete-iteration_mean0.5513150070185485
complete-iteration_median0.5826748258071326
complete-iteration_min0.42304509769786486
deviation-center-line_max0.8012540640702224
deviation-center-line_mean0.43078373248788093
deviation-center-line_min0.1319667914326275
deviation-heading_max3.429006107499589
deviation-heading_mean1.9270914230539584
deviation-heading_median1.7237577513481337
deviation-heading_min0.8318440820199781
driven_any_max6.412962939019453
driven_any_mean3.39741637948428
driven_any_median2.9855741817644303
driven_any_min1.2055542153888077
driven_lanedir_consec_max3.904574554173258
driven_lanedir_consec_mean2.111660352043978
driven_lanedir_consec_min0.40970263760192693
driven_lanedir_max3.904574554173258
driven_lanedir_mean2.111660352043978
driven_lanedir_median2.0661821082003633
driven_lanedir_min0.40970263760192693
get_duckie_state_max0.0973314662774404
get_duckie_state_mean0.07350511757132978
get_duckie_state_median0.08968216894896336
get_duckie_state_min0.01732466610995206
get_robot_state_max0.014058574329723012
get_robot_state_mean0.01252314051273106
get_robot_state_median0.01239926344911817
get_robot_state_min0.011235460822964892
get_state_dump_max0.0492352028967629
get_state_dump_mean0.0356170846489796
get_state_dump_median0.036989033590128395
get_state_dump_min0.019255068518898705
get_ui_image_max0.07418332276520906
get_ui_image_mean0.06260874367275544
get_ui_image_median0.06418848011135496
get_ui_image_min0.0478746917031028
in-drivable-lane_max4.250000000000001
in-drivable-lane_mean2.499999999999996
in-drivable-lane_min1.8499999999999936
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.462362680394298, "get_ui_image": 0.05762189825375875, "step_physics": 0.20655600825945536, "survival_time": 5.949999999999987, "driven_lanedir": 1.839224198488635, "get_state_dump": 0.03222868839899699, "get_robot_state": 0.012155723571777344, "sim_render-ego0": 0.013227007786432902, "get_duckie_state": 0.0973314662774404, "in-drivable-lane": 1.8499999999999936, "deviation-heading": 1.108804024375748, "agent_compute-ego0": 0.1010164697964986, "complete-iteration": 0.5597771962483724, "set_robot_commands": 0.009325361251831057, "deviation-center-line": 0.2992043139346018, "driven_lanedir_consec": 1.839224198488635, "sim_compute_sim_state": 0.02291651169459025, "sim_compute_performance-ego0": 0.007157862186431885}, "LFP-norm-zigzag-000-ego0": {"driven_any": 1.2055542153888077, "get_ui_image": 0.07075506196895116, "step_physics": 0.19740636919585752, "survival_time": 3.4999999999999956, "driven_lanedir": 0.40970263760192693, "get_state_dump": 0.0492352028967629, "get_robot_state": 0.012642803326458998, "sim_render-ego0": 0.015976398763522297, "get_duckie_state": 0.0955454195049447, "in-drivable-lane": 2.0499999999999963, "deviation-heading": 0.8318440820199781, "agent_compute-ego0": 0.12017749061047192, "complete-iteration": 0.6055724553658929, "set_robot_commands": 0.009332038986850791, "deviation-center-line": 0.1319667914326275, "driven_lanedir_consec": 0.40970263760192693, "sim_compute_sim_state": 0.0278246671381131, "sim_compute_performance-ego0": 0.006440209670805596}, "LFP-norm-techtrack-000-ego0": {"driven_any": 3.5087856831345627, "get_ui_image": 0.07418332276520906, "step_physics": 0.22371035740699297, "survival_time": 8.04999999999998, "driven_lanedir": 2.2931400179120915, "get_state_dump": 0.0417493787812598, "get_robot_state": 0.011235460822964892, "sim_render-ego0": 0.01283789564062048, "get_duckie_state": 0.08381891839298201, "in-drivable-lane": 1.8499999999999936, "deviation-heading": 2.3387114783205187, "agent_compute-ego0": 0.11241291481771588, "complete-iteration": 0.6168652787620639, "set_robot_commands": 0.008897993299696181, "deviation-center-line": 0.49070976051407217, "driven_lanedir_consec": 2.2931400179120915, "sim_compute_sim_state": 0.039278502817507145, "sim_compute_performance-ego0": 0.00850193147306089}, "LFP-norm-small_loop-000-ego0": {"driven_any": 6.412962939019453, "get_ui_image": 0.0478746917031028, "step_physics": 0.17811507658524947, "survival_time": 13.70000000000006, "driven_lanedir": 3.904574554173258, "get_state_dump": 0.019255068518898705, "get_robot_state": 0.014058574329723012, "sim_render-ego0": 0.012705652063543146, "get_duckie_state": 0.01732466610995206, "in-drivable-lane": 4.250000000000001, "deviation-heading": 3.429006107499589, "agent_compute-ego0": 0.09708261143077504, "complete-iteration": 0.42304509769786486, "set_robot_commands": 0.008930505405772816, "deviation-center-line": 0.8012540640702224, "driven_lanedir_consec": 3.904574554173258, "sim_compute_sim_state": 0.018791411139748315, "sim_compute_performance-ego0": 0.00867494756525213}}
set_robot_commands_max0.009332038986850791
set_robot_commands_mean0.009121474736037713
set_robot_commands_median0.009127933328801937
set_robot_commands_min0.008897993299696181
sim_compute_performance-ego0_max0.00867494756525213
sim_compute_performance-ego0_mean0.007693737723887626
sim_compute_performance-ego0_median0.007829896829746387
sim_compute_performance-ego0_min0.006440209670805596
sim_compute_sim_state_max0.039278502817507145
sim_compute_sim_state_mean0.027202773197489705
sim_compute_sim_state_median0.02537058941635167
sim_compute_sim_state_min0.018791411139748315
sim_render-ego0_max0.015976398763522297
sim_render-ego0_mean0.013686738563529706
sim_render-ego0_median0.01303245171352669
sim_render-ego0_min0.012705652063543146
simulation-passed1
step_physics_max0.22371035740699297
step_physics_mean0.20144695286188885
step_physics_median0.20198118872765644
step_physics_min0.17811507658524947
survival_time_max13.70000000000006
survival_time_mean7.800000000000005
survival_time_min3.4999999999999956
No reset possible
6296813979Andrea Censi 🇨🇭exercise_ros_templateaido-LF-sim-validation347failedyesreg030:03:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6293213960Matteo Razzanellitemplate-randomaido-hello-sim-validation370successnoreg030:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.035989224910736084
agent_compute-ego0_mean0.035989224910736084
agent_compute-ego0_median0.035989224910736084
agent_compute-ego0_min0.035989224910736084
complete-iteration_max0.28724957596171985
complete-iteration_mean0.28724957596171985
complete-iteration_median0.28724957596171985
complete-iteration_min0.28724957596171985
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.01484314420006492
get_duckie_state_mean0.01484314420006492
get_duckie_state_median0.01484314420006492
get_duckie_state_min0.01484314420006492
get_robot_state_max0.014123873277144
get_robot_state_mean0.014123873277144
get_robot_state_median0.014123873277144
get_robot_state_min0.014123873277144
get_state_dump_max0.020187957720323044
get_state_dump_mean0.020187957720323044
get_state_dump_median0.020187957720323044
get_state_dump_min0.020187957720323044
get_ui_image_max0.04590383984825828
get_ui_image_mean0.04590383984825828
get_ui_image_median0.04590383984825828
get_ui_image_min0.04590383984825828
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.04590383984825828, "step_physics": 0.10763730244203049, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.020187957720323044, "get_robot_state": 0.014123873277144, "sim_render-ego0": 0.014215501871975985, "get_duckie_state": 0.01484314420006492, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.035989224910736084, "complete-iteration": 0.28724957596171985, "set_robot_commands": 0.011171275919133966, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.014715308492833918, "sim_compute_performance-ego0": 0.008229223164645109}}
set_robot_commands_max0.011171275919133966
set_robot_commands_mean0.011171275919133966
set_robot_commands_median0.011171275919133966
set_robot_commands_min0.011171275919133966
sim_compute_performance-ego0_max0.008229223164645109
sim_compute_performance-ego0_mean0.008229223164645109
sim_compute_performance-ego0_median0.008229223164645109
sim_compute_performance-ego0_min0.008229223164645109
sim_compute_sim_state_max0.014715308492833918
sim_compute_sim_state_mean0.014715308492833918
sim_compute_sim_state_median0.014715308492833918
sim_compute_sim_state_min0.014715308492833918
sim_render-ego0_max0.014215501871975985
sim_render-ego0_mean0.014215501871975985
sim_render-ego0_median0.014215501871975985
sim_render-ego0_min0.014215501871975985
simulation-passed1
step_physics_max0.10763730244203049
step_physics_mean0.10763730244203049
step_physics_median0.10763730244203049
step_physics_min0.10763730244203049
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6290413947YU CHENCBC Net v2 test - added APR 1 3 times anomaly + mar 28 bc_v1aido-LF-sim-validation347successyesreg031:07:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median17.131151113310494
survival_time_median59.99999999999873
deviation-center-line_median3.556882687708546
in-drivable-lane_median14.924999999999692


other stats
agent_compute-ego0_max0.15130561654712635
agent_compute-ego0_mean0.1497925134820803
agent_compute-ego0_median0.14971913554884808
agent_compute-ego0_min0.1484261662834987
complete-iteration_max0.5588419195218051
complete-iteration_mean0.5048325400765392
complete-iteration_median0.5036106420297806
complete-iteration_min0.453266956724791
deviation-center-line_max4.130285185263564
deviation-center-line_mean3.686897960365215
deviation-center-line_min3.503541280780205
deviation-heading_max18.863085740062647
deviation-heading_mean15.320553301542262
deviation-heading_median15.24550239062565
deviation-heading_min11.928122684855104
driven_any_max27.012848370494417
driven_any_mean24.28959676444274
driven_any_median23.44183021640315
driven_any_min23.261878254470247
driven_lanedir_consec_max20.27508247378842
driven_lanedir_consec_mean17.310808050884052
driven_lanedir_consec_min14.7058475031268
driven_lanedir_max20.27508247378842
driven_lanedir_mean17.310808050884052
driven_lanedir_median17.131151113310494
driven_lanedir_min14.7058475031268
get_duckie_state_max3.4367214333107825e-06
get_duckie_state_mean3.211107182562301e-06
get_duckie_state_median3.1713045804724903e-06
get_duckie_state_min3.065098135993443e-06
get_robot_state_max0.01436362655633296
get_robot_state_mean0.013678287139641651
get_robot_state_median0.013798208359774702
get_robot_state_min0.01275310528268425
get_state_dump_max0.017901380095851113
get_state_dump_mean0.017035850726198294
get_state_dump_median0.01688823860749714
get_state_dump_min0.016465545593947792
get_ui_image_max0.06054707947222021
get_ui_image_mean0.05324129816098177
get_ui_image_median0.052590262482902786
get_ui_image_min0.047237588205901314
in-drivable-lane_max19.44999999999959
in-drivable-lane_mean14.574999999999722
in-drivable-lane_min8.999999999999917
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 27.012848370494417, "get_ui_image": 0.04916978775710488, "step_physics": 0.18225285135439095, "survival_time": 59.99999999999873, "driven_lanedir": 20.27508247378842, "get_state_dump": 0.016931752777417236, "get_robot_state": 0.01436362655633296, "sim_render-ego0": 0.013132515795324168, "get_duckie_state": 3.2376091645024e-06, "in-drivable-lane": 12.449999999999758, "deviation-heading": 11.928122684855104, "agent_compute-ego0": 0.1489551940825857, "complete-iteration": 0.4686882996142258, "set_robot_commands": 0.00999823220067973, "deviation-center-line": 4.130285185263564, "driven_lanedir_consec": 20.27508247378842, "sim_compute_sim_state": 0.025608628516788783, "sim_compute_performance-ego0": 0.008009942941721235}, "LF-norm-zigzag-000-ego0": {"driven_any": 23.55139547372529, "get_ui_image": 0.06054707947222021, "step_physics": 0.25715266993202635, "survival_time": 59.99999999999873, "driven_lanedir": 18.487514838292523, "get_state_dump": 0.017901380095851113, "get_robot_state": 0.01275310528268425, "sim_render-ego0": 0.011638183577868664, "get_duckie_state": 3.1049999964425805e-06, "in-drivable-lane": 8.999999999999917, "deviation-heading": 15.17225594685342, "agent_compute-ego0": 0.1504830770151105, "complete-iteration": 0.5588419195218051, "set_robot_commands": 0.008794905641096815, "deviation-center-line": 3.608612781391389, "driven_lanedir_consec": 18.487514838292523, "sim_compute_sim_state": 0.03203465499846167, "sim_compute_performance-ego0": 0.007279664650249243}, "LF-norm-techtrack-000-ego0": {"driven_any": 23.332264959081023, "get_ui_image": 0.056010737208700694, "step_physics": 0.2412990747542306, "survival_time": 59.99999999999873, "driven_lanedir": 15.774787388328466, "get_state_dump": 0.016844724437577042, "get_robot_state": 0.013491569014016436, "sim_render-ego0": 0.01259700384465582, "get_duckie_state": 3.065098135993443e-06, "in-drivable-lane": 17.39999999999963, "deviation-heading": 15.31874883439788, "agent_compute-ego0": 0.15130561654712635, "complete-iteration": 0.5385329844453353, "set_robot_commands": 0.00900863548996645, "deviation-center-line": 3.505152594025703, "driven_lanedir_consec": 15.774787388328466, "sim_compute_sim_state": 0.0304916742739332, "sim_compute_performance-ego0": 0.0072327668621180756}, "LF-norm-small_loop-000-ego0": {"driven_any": 23.261878254470247, "get_ui_image": 0.047237588205901314, "step_physics": 0.17922648621240722, "survival_time": 59.99999999999873, "driven_lanedir": 14.7058475031268, "get_state_dump": 0.016465545593947792, "get_robot_state": 0.014104847705532967, "sim_render-ego0": 0.012277262296208137, "get_duckie_state": 3.4367214333107825e-06, "in-drivable-lane": 19.44999999999959, "deviation-heading": 18.863085740062647, "agent_compute-ego0": 0.1484261662834987, "complete-iteration": 0.453266956724791, "set_robot_commands": 0.009557939191146456, "deviation-center-line": 3.503541280780205, "driven_lanedir_consec": 14.7058475031268, "sim_compute_sim_state": 0.018576779234518517, "sim_compute_performance-ego0": 0.007143644567929537}}
set_robot_commands_max0.00999823220067973
set_robot_commands_mean0.009339928130722364
set_robot_commands_median0.009283287340556452
set_robot_commands_min0.008794905641096815
sim_compute_performance-ego0_max0.008009942941721235
sim_compute_performance-ego0_mean0.007416504755504523
sim_compute_performance-ego0_median0.007256215756183659
sim_compute_performance-ego0_min0.007143644567929537
sim_compute_sim_state_max0.03203465499846167
sim_compute_sim_state_mean0.026677934255925545
sim_compute_sim_state_median0.028050151395360993
sim_compute_sim_state_min0.018576779234518517
sim_render-ego0_max0.013132515795324168
sim_render-ego0_mean0.012411241378514196
sim_render-ego0_median0.01243713307043198
sim_render-ego0_min0.011638183577868664
simulation-passed1
step_physics_max0.25715266993202635
step_physics_mean0.2149827705632638
step_physics_median0.2117759630543108
step_physics_min0.17922648621240722
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6289913942Sai Prasanna Ramantemplate-randomaido-hello-sim-validation370successnoreg030:02:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.039512460882013496
agent_compute-ego0_mean0.039512460882013496
agent_compute-ego0_median0.039512460882013496
agent_compute-ego0_min0.039512460882013496
complete-iteration_max0.31372136961330066
complete-iteration_mean0.31372136961330066
complete-iteration_median0.31372136961330066
complete-iteration_min0.31372136961330066
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.01546755704012784
get_duckie_state_mean0.01546755704012784
get_duckie_state_median0.01546755704012784
get_duckie_state_min0.01546755704012784
get_robot_state_max0.011097539554942738
get_robot_state_mean0.011097539554942738
get_robot_state_median0.011097539554942738
get_robot_state_min0.011097539554942738
get_state_dump_max0.02395547520030629
get_state_dump_mean0.02395547520030629
get_state_dump_median0.02395547520030629
get_state_dump_min0.02395547520030629
get_ui_image_max0.06018967520106922
get_ui_image_mean0.06018967520106922
get_ui_image_median0.06018967520106922
get_ui_image_min0.06018967520106922
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.06018967520106922, "step_physics": 0.11902364817532626, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.02395547520030629, "get_robot_state": 0.011097539554942738, "sim_render-ego0": 0.012282051823355934, "get_duckie_state": 0.01546755704012784, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.039512460882013496, "complete-iteration": 0.31372136961330066, "set_robot_commands": 0.008079014041207054, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.01511494679884477, "sim_compute_performance-ego0": 0.00878186659379439}}
set_robot_commands_max0.008079014041207054
set_robot_commands_mean0.008079014041207054
set_robot_commands_median0.008079014041207054
set_robot_commands_min0.008079014041207054
sim_compute_performance-ego0_max0.00878186659379439
sim_compute_performance-ego0_mean0.00878186659379439
sim_compute_performance-ego0_median0.00878186659379439
sim_compute_performance-ego0_min0.00878186659379439
sim_compute_sim_state_max0.01511494679884477
sim_compute_sim_state_mean0.01511494679884477
sim_compute_sim_state_median0.01511494679884477
sim_compute_sim_state_min0.01511494679884477
sim_render-ego0_max0.012282051823355934
sim_render-ego0_mean0.012282051823355934
sim_render-ego0_median0.012282051823355934
sim_render-ego0_min0.012282051823355934
simulation-passed1
step_physics_max0.11902364817532626
step_physics_mean0.11902364817532626
step_physics_median0.11902364817532626
step_physics_min0.11902364817532626
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6288513933Dheeraj Bhogisettytemplate-randomaido-hello-sim-validation370successnoreg030:01:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.03958822380412708
agent_compute-ego0_mean0.03958822380412708
agent_compute-ego0_median0.03958822380412708
agent_compute-ego0_min0.03958822380412708
complete-iteration_max0.336161114952781
complete-iteration_mean0.336161114952781
complete-iteration_median0.336161114952781
complete-iteration_min0.336161114952781
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.017402719367634167
get_duckie_state_mean0.017402719367634167
get_duckie_state_median0.017402719367634167
get_duckie_state_min0.017402719367634167
get_robot_state_max0.014246095310557972
get_robot_state_mean0.014246095310557972
get_robot_state_median0.014246095310557972
get_robot_state_min0.014246095310557972
get_state_dump_max0.02381465109911832
get_state_dump_mean0.02381465109911832
get_state_dump_median0.02381465109911832
get_state_dump_min0.02381465109911832
get_ui_image_max0.057420465079220856
get_ui_image_mean0.057420465079220856
get_ui_image_median0.057420465079220856
get_ui_image_min0.057420465079220856
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.057420465079220856, "step_physics": 0.11428651484576138, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.02381465109911832, "get_robot_state": 0.014246095310557972, "sim_render-ego0": 0.02075414224104448, "get_duckie_state": 0.017402719367634167, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.03958822380412708, "complete-iteration": 0.336161114952781, "set_robot_commands": 0.01219042864712802, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.024365484714508057, "sim_compute_performance-ego0": 0.011888525702736597}}
set_robot_commands_max0.01219042864712802
set_robot_commands_mean0.01219042864712802
set_robot_commands_median0.01219042864712802
set_robot_commands_min0.01219042864712802
sim_compute_performance-ego0_max0.011888525702736597
sim_compute_performance-ego0_mean0.011888525702736597
sim_compute_performance-ego0_median0.011888525702736597
sim_compute_performance-ego0_min0.011888525702736597
sim_compute_sim_state_max0.024365484714508057
sim_compute_sim_state_mean0.024365484714508057
sim_compute_sim_state_median0.024365484714508057
sim_compute_sim_state_min0.024365484714508057
sim_render-ego0_max0.02075414224104448
sim_render-ego0_mean0.02075414224104448
sim_render-ego0_median0.02075414224104448
sim_render-ego0_min0.02075414224104448
simulation-passed1
step_physics_max0.11428651484576138
step_physics_mean0.11428651484576138
step_physics_median0.11428651484576138
step_physics_min0.11428651484576138
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6288013931j durantemplate-randomaido-hello-sim-validation370successnoreg030:01:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.028179504654624245
agent_compute-ego0_mean0.028179504654624245
agent_compute-ego0_median0.028179504654624245
agent_compute-ego0_min0.028179504654624245
complete-iteration_max0.2836461771618236
complete-iteration_mean0.2836461771618236
complete-iteration_median0.2836461771618236
complete-iteration_min0.2836461771618236
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.01525370099327781
get_duckie_state_mean0.01525370099327781
get_duckie_state_median0.01525370099327781
get_duckie_state_min0.01525370099327781
get_robot_state_max0.01052291826768355
get_robot_state_mean0.01052291826768355
get_robot_state_median0.01052291826768355
get_robot_state_min0.01052291826768355
get_state_dump_max0.0234319730238481
get_state_dump_mean0.0234319730238481
get_state_dump_median0.0234319730238481
get_state_dump_min0.0234319730238481
get_ui_image_max0.05274440483613448
get_ui_image_mean0.05274440483613448
get_ui_image_median0.05274440483613448
get_ui_image_min0.05274440483613448
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.05274440483613448, "step_physics": 0.1106341156092557, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.0234319730238481, "get_robot_state": 0.01052291826768355, "sim_render-ego0": 0.013298858295787464, "get_duckie_state": 0.01525370099327781, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.028179504654624245, "complete-iteration": 0.2836461771618236, "set_robot_commands": 0.006707099351015958, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.0163637020371177, "sim_compute_performance-ego0": 0.0062723268162120475}}
set_robot_commands_max0.006707099351015958
set_robot_commands_mean0.006707099351015958
set_robot_commands_median0.006707099351015958
set_robot_commands_min0.006707099351015958
sim_compute_performance-ego0_max0.0062723268162120475
sim_compute_performance-ego0_mean0.0062723268162120475
sim_compute_performance-ego0_median0.0062723268162120475
sim_compute_performance-ego0_min0.0062723268162120475
sim_compute_sim_state_max0.0163637020371177
sim_compute_sim_state_mean0.0163637020371177
sim_compute_sim_state_median0.0163637020371177
sim_compute_sim_state_min0.0163637020371177
sim_render-ego0_max0.013298858295787464
sim_render-ego0_mean0.013298858295787464
sim_render-ego0_median0.013298858295787464
sim_render-ego0_min0.013298858295787464
simulation-passed1
step_physics_max0.1106341156092557
step_physics_mean0.1106341156092557
step_physics_median0.1106341156092557
step_physics_min0.1106341156092557
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6285813925Patrick Genevatemplate-randomaido-hello-sim-validation370host-errornoreg030:00:37
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A929b5188a9b5978ea78814123e2e9dc311d26d3ce658c7d75a975d0e04f6503d&fromImage=docker.io%2Fgoldbattle%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for goldbattle/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/goldbattle/aido-submissions@sha256:929b5188a9b5978ea78814123e2e9dc311d26d3ce658c7d75a975d0e04f6503d  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/goldbattle/aido-submissions@sha256:929b5188a9b5978ea78814123e2e9dc311d26d3ce658c7d75a975d0e04f6503d
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6282913917Marek Dlugosztemplate-randomaido-hello-sim-validation370successnoreg030:01:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.03229979493401267
agent_compute-ego0_mean0.03229979493401267
agent_compute-ego0_median0.03229979493401267
agent_compute-ego0_min0.03229979493401267
complete-iteration_max0.28405373204838147
complete-iteration_mean0.28405373204838147
complete-iteration_median0.28405373204838147
complete-iteration_min0.28405373204838147
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.013478246602145107
get_duckie_state_mean0.013478246602145107
get_duckie_state_median0.013478246602145107
get_duckie_state_min0.013478246602145107
get_robot_state_max0.013893853534351696
get_robot_state_mean0.013893853534351696
get_robot_state_median0.013893853534351696
get_robot_state_min0.013893853534351696
get_state_dump_max0.0199670899998058
get_state_dump_mean0.0199670899998058
get_state_dump_median0.0199670899998058
get_state_dump_min0.0199670899998058
get_ui_image_max0.04879284446889704
get_ui_image_mean0.04879284446889704
get_ui_image_median0.04879284446889704
get_ui_image_min0.04879284446889704
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.04879284446889704, "step_physics": 0.11088205467570912, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.0199670899998058, "get_robot_state": 0.013893853534351696, "sim_render-ego0": 0.01624842123551802, "get_duckie_state": 0.013478246602145107, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.03229979493401267, "complete-iteration": 0.28405373204838147, "set_robot_commands": 0.006929673931815408, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.015392233024943958, "sim_compute_performance-ego0": 0.005946110595356335}}
set_robot_commands_max0.006929673931815408
set_robot_commands_mean0.006929673931815408
set_robot_commands_median0.006929673931815408
set_robot_commands_min0.006929673931815408
sim_compute_performance-ego0_max0.005946110595356335
sim_compute_performance-ego0_mean0.005946110595356335
sim_compute_performance-ego0_median0.005946110595356335
sim_compute_performance-ego0_min0.005946110595356335
sim_compute_sim_state_max0.015392233024943958
sim_compute_sim_state_mean0.015392233024943958
sim_compute_sim_state_median0.015392233024943958
sim_compute_sim_state_min0.015392233024943958
sim_render-ego0_max0.01624842123551802
sim_render-ego0_mean0.01624842123551802
sim_render-ego0_median0.01624842123551802
sim_render-ego0_min0.01624842123551802
simulation-passed1
step_physics_max0.11088205467570912
step_physics_mean0.11088205467570912
step_physics_median0.11088205467570912
step_physics_min0.11088205467570912
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6282613916Stan Yamanetemplate-randomaido-hello-sim-validation370successnoreg030:02:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.044851075519214974
agent_compute-ego0_mean0.044851075519214974
agent_compute-ego0_median0.044851075519214974
agent_compute-ego0_min0.044851075519214974
complete-iteration_max0.2921013019301675
complete-iteration_mean0.2921013019301675
complete-iteration_median0.2921013019301675
complete-iteration_min0.2921013019301675
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.015096669847315008
get_duckie_state_mean0.015096669847315008
get_duckie_state_median0.015096669847315008
get_duckie_state_min0.015096669847315008
get_robot_state_max0.011880273168737238
get_robot_state_mean0.011880273168737238
get_robot_state_median0.011880273168737238
get_robot_state_min0.011880273168737238
get_state_dump_max0.02643532102758234
get_state_dump_mean0.02643532102758234
get_state_dump_median0.02643532102758234
get_state_dump_min0.02643532102758234
get_ui_image_max0.044026602398265495
get_ui_image_mean0.044026602398265495
get_ui_image_median0.044026602398265495
get_ui_image_min0.044026602398265495
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.044026602398265495, "step_physics": 0.10752540826797484, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.02643532102758234, "get_robot_state": 0.011880273168737238, "sim_render-ego0": 0.010829356583681974, "get_duckie_state": 0.015096669847315008, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.044851075519214974, "complete-iteration": 0.2921013019301675, "set_robot_commands": 0.007154746489091353, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.017695242708379574, "sim_compute_performance-ego0": 0.006394055756655606}}
set_robot_commands_max0.007154746489091353
set_robot_commands_mean0.007154746489091353
set_robot_commands_median0.007154746489091353
set_robot_commands_min0.007154746489091353
sim_compute_performance-ego0_max0.006394055756655606
sim_compute_performance-ego0_mean0.006394055756655606
sim_compute_performance-ego0_median0.006394055756655606
sim_compute_performance-ego0_min0.006394055756655606
sim_compute_sim_state_max0.017695242708379574
sim_compute_sim_state_mean0.017695242708379574
sim_compute_sim_state_median0.017695242708379574
sim_compute_sim_state_min0.017695242708379574
sim_render-ego0_max0.010829356583681974
sim_render-ego0_mean0.010829356583681974
sim_render-ego0_median0.010829356583681974
sim_render-ego0_min0.010829356583681974
simulation-passed1
step_physics_max0.10752540826797484
step_physics_mean0.10752540826797484
step_physics_median0.10752540826797484
step_physics_min0.10752540826797484
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6281613910YU CHENCBC Net v2 - testaido-LFP-sim-validation350successyesreg030:15:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median9.700000000000015
in-drivable-lane_median3.775000000000015
driven_lanedir_consec_median2.007133024625691
deviation-center-line_median0.4225502670353343


other stats
agent_compute-ego0_max0.19321768891577623
agent_compute-ego0_mean0.16253592748340678
agent_compute-ego0_median0.15342698509340913
agent_compute-ego0_min0.15007205083103253
complete-iteration_max0.7589656839183733
complete-iteration_mean0.6265304244790921
complete-iteration_median0.6270743053521782
complete-iteration_min0.49300740329363874
deviation-center-line_max1.0037343418973077
deviation-center-line_mean0.5119456259306931
deviation-center-line_min0.19894762775479607
deviation-heading_max3.945305783208272
deviation-heading_mean2.169770193989023
deviation-heading_median1.9903810332454397
deviation-heading_min0.7530129262569403
driven_any_max7.255002649529664
driven_any_mean3.7209959159009474
driven_any_median3.5290091211509926
driven_any_min0.5709627717721388
driven_lanedir_consec_max5.098840418619931
driven_lanedir_consec_mean2.35100891894207
driven_lanedir_consec_min0.2909292078969693
driven_lanedir_max5.098840418619931
driven_lanedir_mean2.35100891894207
driven_lanedir_median2.007133024625691
driven_lanedir_min0.2909292078969693
get_duckie_state_max0.11222007227878944
get_duckie_state_mean0.07961943393158771
get_duckie_state_median0.09410229157907146
get_duckie_state_min0.01805308028941846
get_robot_state_max0.021642511966181735
get_robot_state_mean0.016404857628363793
get_robot_state_median0.015755482360184567
get_robot_state_min0.012465953826904295
get_state_dump_max0.055477390102311674
get_state_dump_mean0.0348969465322653
get_state_dump_median0.029057073898035097
get_state_dump_min0.025996248230679343
get_ui_image_max0.09954261312297746
get_ui_image_mean0.06712126145602951
get_ui_image_median0.05898786654318047
get_ui_image_min0.05096669961477964
in-drivable-lane_max5.200000000000021
in-drivable-lane_mean3.350000000000013
in-drivable-lane_min0.6500000000000005
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 5.039229377105823, "get_ui_image": 0.05342813900538853, "step_physics": 0.21076869504332085, "survival_time": 12.900000000000048, "driven_lanedir": 2.813393683249493, "get_state_dump": 0.02632883156588639, "get_robot_state": 0.012465953826904295, "sim_render-ego0": 0.011745427105877853, "get_duckie_state": 0.0949855577991736, "in-drivable-lane": 5.200000000000021, "deviation-heading": 2.512714719043029, "agent_compute-ego0": 0.15007205083103253, "complete-iteration": 0.5979418441595719, "set_robot_commands": 0.008323502816748896, "deviation-center-line": 0.5953886098937181, "driven_lanedir_consec": 2.813393683249493, "sim_compute_sim_state": 0.022353143765659406, "sim_compute_performance-ego0": 0.00722589179815933}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5709627717721388, "get_ui_image": 0.09954261312297746, "step_physics": 0.19272485901327693, "survival_time": 2.499999999999999, "driven_lanedir": 0.2909292078969693, "get_state_dump": 0.055477390102311674, "get_robot_state": 0.021642511966181735, "sim_render-ego0": 0.018495330623551912, "get_duckie_state": 0.11222007227878944, "in-drivable-lane": 0.6500000000000005, "deviation-heading": 0.7530129262569403, "agent_compute-ego0": 0.19321768891577623, "complete-iteration": 0.7589656839183733, "set_robot_commands": 0.01295319257997999, "deviation-center-line": 0.19894762775479607, "driven_lanedir_consec": 0.2909292078969693, "sim_compute_sim_state": 0.03415743042440975, "sim_compute_performance-ego0": 0.0182956527261173}, "LFP-norm-techtrack-000-ego0": {"driven_any": 7.255002649529664, "get_ui_image": 0.06454759408097241, "step_physics": 0.2361478647474426, "survival_time": 18.05000000000012, "driven_lanedir": 5.098840418619931, "get_state_dump": 0.031785316230183804, "get_robot_state": 0.0149434396575169, "sim_render-ego0": 0.013553151768215454, "get_duckie_state": 0.09321902535896934, "in-drivable-lane": 4.500000000000041, "deviation-heading": 3.945305783208272, "agent_compute-ego0": 0.1529089172900711, "complete-iteration": 0.6562067665447846, "set_robot_commands": 0.010028437356263893, "deviation-center-line": 1.0037343418973077, "driven_lanedir_consec": 5.098840418619931, "sim_compute_sim_state": 0.030021651673712124, "sim_compute_performance-ego0": 0.008811411278023904}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.0187888651961625, "get_ui_image": 0.05096669961477964, "step_physics": 0.17753323707871763, "survival_time": 6.499999999999985, "driven_lanedir": 1.2008723660018883, "get_state_dump": 0.025996248230679343, "get_robot_state": 0.016567525062852233, "sim_render-ego0": 0.011353048659462964, "get_duckie_state": 0.01805308028941846, "in-drivable-lane": 3.0499999999999905, "deviation-heading": 1.4680473474478497, "agent_compute-ego0": 0.15394505289674715, "complete-iteration": 0.49300740329363874, "set_robot_commands": 0.011578437936215, "deviation-center-line": 0.2497119241769505, "driven_lanedir_consec": 1.2008723660018883, "sim_compute_sim_state": 0.018909923902904715, "sim_compute_performance-ego0": 0.007869720458984375}}
set_robot_commands_max0.01295319257997999
set_robot_commands_mean0.010720892672301944
set_robot_commands_median0.010803437646239446
set_robot_commands_min0.008323502816748896
sim_compute_performance-ego0_max0.0182956527261173
sim_compute_performance-ego0_mean0.010550669065321228
sim_compute_performance-ego0_median0.00834056586850414
sim_compute_performance-ego0_min0.00722589179815933
sim_compute_sim_state_max0.03415743042440975
sim_compute_sim_state_mean0.0263605374416715
sim_compute_sim_state_median0.026187397719685764
sim_compute_sim_state_min0.018909923902904715
sim_render-ego0_max0.018495330623551912
sim_render-ego0_mean0.013786739539277046
sim_render-ego0_median0.012649289437046652
sim_render-ego0_min0.011353048659462964
simulation-passed1
step_physics_max0.2361478647474426
step_physics_mean0.2042936639706895
step_physics_median0.20174677702829888
step_physics_min0.17753323707871763
survival_time_max18.05000000000012
survival_time_mean9.987500000000038
survival_time_min2.499999999999999
No reset possible
6280313904Michal Wójciktemplate-randomaido-hello-sim-validation370successnoreg030:03:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.04334209723906084
agent_compute-ego0_mean0.04334209723906084
agent_compute-ego0_median0.04334209723906084
agent_compute-ego0_min0.04334209723906084
complete-iteration_max0.30251396786082874
complete-iteration_mean0.30251396786082874
complete-iteration_median0.30251396786082874
complete-iteration_min0.30251396786082874
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.015451447530226274
get_duckie_state_mean0.015451447530226274
get_duckie_state_median0.015451447530226274
get_duckie_state_min0.015451447530226274
get_robot_state_max0.013337005268443714
get_robot_state_mean0.013337005268443714
get_robot_state_median0.013337005268443714
get_robot_state_min0.013337005268443714
get_state_dump_max0.02151510932228782
get_state_dump_mean0.02151510932228782
get_state_dump_median0.02151510932228782
get_state_dump_min0.02151510932228782
get_ui_image_max0.047958146442066536
get_ui_image_mean0.047958146442066536
get_ui_image_median0.047958146442066536
get_ui_image_min0.047958146442066536
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.047958146442066536, "step_physics": 0.10799471898512408, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.02151510932228782, "get_robot_state": 0.013337005268443714, "sim_render-ego0": 0.01786880059675737, "get_duckie_state": 0.015451447530226274, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.04334209723906084, "complete-iteration": 0.30251396786082874, "set_robot_commands": 0.011518749323758211, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.016551294110038063, "sim_compute_performance-ego0": 0.006727267395366322}}
set_robot_commands_max0.011518749323758211
set_robot_commands_mean0.011518749323758211
set_robot_commands_median0.011518749323758211
set_robot_commands_min0.011518749323758211
sim_compute_performance-ego0_max0.006727267395366322
sim_compute_performance-ego0_mean0.006727267395366322
sim_compute_performance-ego0_median0.006727267395366322
sim_compute_performance-ego0_min0.006727267395366322
sim_compute_sim_state_max0.016551294110038063
sim_compute_sim_state_mean0.016551294110038063
sim_compute_sim_state_median0.016551294110038063
sim_compute_sim_state_min0.016551294110038063
sim_render-ego0_max0.01786880059675737
sim_render-ego0_mean0.01786880059675737
sim_render-ego0_median0.01786880059675737
sim_render-ego0_min0.01786880059675737
simulation-passed1
step_physics_max0.10799471898512408
step_physics_mean0.10799471898512408
step_physics_median0.10799471898512408
step_physics_min0.10799471898512408
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6279413900Akshay Miryalkartemplate-randomaido-hello-sim-validation370successnoreg030:01:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.03548543019728227
agent_compute-ego0_mean0.03548543019728227
agent_compute-ego0_median0.03548543019728227
agent_compute-ego0_min0.03548543019728227
complete-iteration_max0.26873179457404395
complete-iteration_mean0.26873179457404395
complete-iteration_median0.26873179457404395
complete-iteration_min0.26873179457404395
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.013708775693720036
get_duckie_state_mean0.013708775693720036
get_duckie_state_median0.013708775693720036
get_duckie_state_min0.013708775693720036
get_robot_state_max0.01346180113879117
get_robot_state_mean0.01346180113879117
get_robot_state_median0.01346180113879117
get_robot_state_min0.01346180113879117
get_state_dump_max0.01656023480675437
get_state_dump_mean0.01656023480675437
get_state_dump_median0.01656023480675437
get_state_dump_min0.01656023480675437
get_ui_image_max0.04676813970912586
get_ui_image_mean0.04676813970912586
get_ui_image_median0.04676813970912586
get_ui_image_min0.04676813970912586
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.04676813970912586, "step_physics": 0.1041930534622886, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.01656023480675437, "get_robot_state": 0.01346180113879117, "sim_render-ego0": 0.01203586838462136, "get_duckie_state": 0.013708775693720036, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.03548543019728227, "complete-iteration": 0.26873179457404395, "set_robot_commands": 0.006645083427429199, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.013911268927834251, "sim_compute_performance-ego0": 0.005728466944261031}}
set_robot_commands_max0.006645083427429199
set_robot_commands_mean0.006645083427429199
set_robot_commands_median0.006645083427429199
set_robot_commands_min0.006645083427429199
sim_compute_performance-ego0_max0.005728466944261031
sim_compute_performance-ego0_mean0.005728466944261031
sim_compute_performance-ego0_median0.005728466944261031
sim_compute_performance-ego0_min0.005728466944261031
sim_compute_sim_state_max0.013911268927834251
sim_compute_sim_state_mean0.013911268927834251
sim_compute_sim_state_median0.013911268927834251
sim_compute_sim_state_min0.013911268927834251
sim_render-ego0_max0.01203586838462136
sim_render-ego0_mean0.01203586838462136
sim_render-ego0_median0.01203586838462136
sim_render-ego0_min0.01203586838462136
simulation-passed1
step_physics_max0.1041930534622886
step_physics_mean0.1041930534622886
step_physics_median0.1041930534622886
step_physics_min0.1041930534622886
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6276013883Arwa Alabdulkarimtemplate-randomaido-hello-sim-validation370successnoreg030:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.035954702984202995
agent_compute-ego0_mean0.035954702984202995
agent_compute-ego0_median0.035954702984202995
agent_compute-ego0_min0.035954702984202995
complete-iteration_max0.29035755721005524
complete-iteration_mean0.29035755721005524
complete-iteration_median0.29035755721005524
complete-iteration_min0.29035755721005524
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.017221981828862972
get_duckie_state_mean0.017221981828862972
get_duckie_state_median0.017221981828862972
get_duckie_state_min0.017221981828862972
get_robot_state_max0.011437421495264229
get_robot_state_mean0.011437421495264229
get_robot_state_median0.011437421495264229
get_robot_state_min0.011437421495264229
get_state_dump_max0.023698519576679577
get_state_dump_mean0.023698519576679577
get_state_dump_median0.023698519576679577
get_state_dump_min0.023698519576679577
get_ui_image_max0.04703466458754106
get_ui_image_mean0.04703466458754106
get_ui_image_median0.04703466458754106
get_ui_image_min0.04703466458754106
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.04703466458754106, "step_physics": 0.1113221753727306, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.023698519576679577, "get_robot_state": 0.011437421495264229, "sim_render-ego0": 0.01328154043717818, "get_duckie_state": 0.017221981828862972, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.035954702984202995, "complete-iteration": 0.29035755721005524, "set_robot_commands": 0.009065340865742077, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.012717756358059967, "sim_compute_performance-ego0": 0.008418007330460981}}
set_robot_commands_max0.009065340865742077
set_robot_commands_mean0.009065340865742077
set_robot_commands_median0.009065340865742077
set_robot_commands_min0.009065340865742077
sim_compute_performance-ego0_max0.008418007330460981
sim_compute_performance-ego0_mean0.008418007330460981
sim_compute_performance-ego0_median0.008418007330460981
sim_compute_performance-ego0_min0.008418007330460981
sim_compute_sim_state_max0.012717756358059967
sim_compute_sim_state_mean0.012717756358059967
sim_compute_sim_state_median0.012717756358059967
sim_compute_sim_state_min0.012717756358059967
sim_render-ego0_max0.01328154043717818
sim_render-ego0_mean0.01328154043717818
sim_render-ego0_median0.01328154043717818
sim_render-ego0_min0.01328154043717818
simulation-passed1
step_physics_max0.1113221753727306
step_physics_mean0.1113221753727306
step_physics_median0.1113221753727306
step_physics_min0.1113221753727306
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6270913870Peder Seflandtemplate-randomaido-hello-sim-validation370host-errornoreg030:00:35
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809&fromImage=docker.io%2Fh0mlab%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for h0mlab/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/h0mlab/aido-submissions@sha256:2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/h0mlab/aido-submissions@sha256:2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6268113866Peder Seflandtemplate-randomaido-hello-sim-validation370host-errornoreg030:00:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809&fromImage=docker.io%2Fh0mlab%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for h0mlab/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/h0mlab/aido-submissions@sha256:2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/h0mlab/aido-submissions@sha256:2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6268013866Peder Seflandtemplate-randomaido-hello-sim-validation370host-errornoreg030:00:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809&fromImage=docker.io%2Fh0mlab%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for h0mlab/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/h0mlab/aido-submissions@sha256:2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/h0mlab/aido-submissions@sha256:2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6267913866Peder Seflandtemplate-randomaido-hello-sim-validation370host-errornoreg030:00:36
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809&fromImage=docker.io%2Fh0mlab%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for h0mlab/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/h0mlab/aido-submissions@sha256:2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/h0mlab/aido-submissions@sha256:2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6265613866Peder Seflandtemplate-randomaido-hello-sim-validation370abortednoreg030:00:41
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809&fromImage=docker.io%2Fh0mlab%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for h0mlab/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/h0mlab/aido-submissions@sha256:2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/h0mlab/aido-submissions@sha256:2a8b625a92c565f6505a4c3cc11e9240bd29d6c68007963ac067d49418699809
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6265413865Manuel Herediatemplate-randomaido-hello-sim-validation370successnoreg030:01:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.03567474538629705
agent_compute-ego0_mean0.03567474538629705
agent_compute-ego0_median0.03567474538629705
agent_compute-ego0_min0.03567474538629705
complete-iteration_max0.2826521775939248
complete-iteration_mean0.2826521775939248
complete-iteration_median0.2826521775939248
complete-iteration_min0.2826521775939248
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.015769541263580322
get_duckie_state_mean0.015769541263580322
get_duckie_state_median0.015769541263580322
get_duckie_state_min0.015769541263580322
get_robot_state_max0.01211679523641413
get_robot_state_mean0.01211679523641413
get_robot_state_median0.01211679523641413
get_robot_state_min0.01211679523641413
get_state_dump_max0.018236176534132523
get_state_dump_mean0.018236176534132523
get_state_dump_median0.018236176534132523
get_state_dump_min0.018236176534132523
get_ui_image_max0.048341989517211914
get_ui_image_mean0.048341989517211914
get_ui_image_median0.048341989517211914
get_ui_image_min0.048341989517211914
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.048341989517211914, "step_physics": 0.1009825738993558, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.018236176534132523, "get_robot_state": 0.01211679523641413, "sim_render-ego0": 0.018799646334214645, "get_duckie_state": 0.015769541263580322, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.03567474538629705, "complete-iteration": 0.2826521775939248, "set_robot_commands": 0.010174361142245208, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.017211729829961605, "sim_compute_performance-ego0": 0.005124232985756614}}
set_robot_commands_max0.010174361142245208
set_robot_commands_mean0.010174361142245208
set_robot_commands_median0.010174361142245208
set_robot_commands_min0.010174361142245208
sim_compute_performance-ego0_max0.005124232985756614
sim_compute_performance-ego0_mean0.005124232985756614
sim_compute_performance-ego0_median0.005124232985756614
sim_compute_performance-ego0_min0.005124232985756614
sim_compute_sim_state_max0.017211729829961605
sim_compute_sim_state_mean0.017211729829961605
sim_compute_sim_state_median0.017211729829961605
sim_compute_sim_state_min0.017211729829961605
sim_render-ego0_max0.018799646334214645
sim_render-ego0_mean0.018799646334214645
sim_render-ego0_median0.018799646334214645
sim_render-ego0_min0.018799646334214645
simulation-passed1
step_physics_max0.1009825738993558
step_physics_mean0.1009825738993558
step_physics_median0.1009825738993558
step_physics_min0.1009825738993558
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6254313823Maria-Elena Algorritemplate-randomaido-hello-sim-validation370successnoreg030:01:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median2.1500000000000004
in-drivable-lane_median1.15
driven_lanedir_consec_median0.2357331065993169
deviation-center-line_median0.05863921966719952


other stats
agent_compute-ego0_max0.036101492968472565
agent_compute-ego0_mean0.036101492968472565
agent_compute-ego0_median0.036101492968472565
agent_compute-ego0_min0.036101492968472565
complete-iteration_max0.30153804475610907
complete-iteration_mean0.30153804475610907
complete-iteration_median0.30153804475610907
complete-iteration_min0.30153804475610907
deviation-center-line_max0.05863921966719952
deviation-center-line_mean0.05863921966719952
deviation-center-line_min0.05863921966719952
deviation-heading_max0.46108604520141144
deviation-heading_mean0.46108604520141144
deviation-heading_median0.46108604520141144
deviation-heading_min0.46108604520141144
driven_any_max0.4603380961060899
driven_any_mean0.4603380961060899
driven_any_median0.4603380961060899
driven_any_min0.4603380961060899
driven_lanedir_consec_max0.2357331065993169
driven_lanedir_consec_mean0.2357331065993169
driven_lanedir_consec_min0.2357331065993169
driven_lanedir_max0.2357331065993169
driven_lanedir_mean0.2357331065993169
driven_lanedir_median0.2357331065993169
driven_lanedir_min0.2357331065993169
get_duckie_state_max0.02083997292952104
get_duckie_state_mean0.02083997292952104
get_duckie_state_median0.02083997292952104
get_duckie_state_min0.02083997292952104
get_robot_state_max0.015948116779327393
get_robot_state_mean0.015948116779327393
get_robot_state_median0.015948116779327393
get_robot_state_min0.015948116779327393
get_state_dump_max0.02244535901329734
get_state_dump_mean0.02244535901329734
get_state_dump_median0.02244535901329734
get_state_dump_min0.02244535901329734
get_ui_image_max0.05105892636559226
get_ui_image_mean0.05105892636559226
get_ui_image_median0.05105892636559226
get_ui_image_min0.05105892636559226
in-drivable-lane_max1.15
in-drivable-lane_mean1.15
in-drivable-lane_min1.15
per-episodes
details{"hello-norm-small_loop-000-ego0": {"driven_any": 0.4603380961060899, "get_ui_image": 0.05105892636559226, "step_physics": 0.10389320958744395, "survival_time": 2.1500000000000004, "driven_lanedir": 0.2357331065993169, "get_state_dump": 0.02244535901329734, "get_robot_state": 0.015948116779327393, "sim_render-ego0": 0.01315594803203236, "get_duckie_state": 0.02083997292952104, "in-drivable-lane": 1.15, "deviation-heading": 0.46108604520141144, "agent_compute-ego0": 0.036101492968472565, "complete-iteration": 0.30153804475610907, "set_robot_commands": 0.00970943949439309, "deviation-center-line": 0.05863921966719952, "driven_lanedir_consec": 0.2357331065993169, "sim_compute_sim_state": 0.01936275308782404, "sim_compute_performance-ego0": 0.008779374035921965}}
set_robot_commands_max0.00970943949439309
set_robot_commands_mean0.00970943949439309
set_robot_commands_median0.00970943949439309
set_robot_commands_min0.00970943949439309
sim_compute_performance-ego0_max0.008779374035921965
sim_compute_performance-ego0_mean0.008779374035921965
sim_compute_performance-ego0_median0.008779374035921965
sim_compute_performance-ego0_min0.008779374035921965
sim_compute_sim_state_max0.01936275308782404
sim_compute_sim_state_mean0.01936275308782404
sim_compute_sim_state_median0.01936275308782404
sim_compute_sim_state_min0.01936275308782404
sim_render-ego0_max0.01315594803203236
sim_render-ego0_mean0.01315594803203236
sim_render-ego0_median0.01315594803203236
sim_render-ego0_min0.01315594803203236
simulation-passed1
step_physics_max0.10389320958744395
step_physics_mean0.10389320958744395
step_physics_median0.10389320958744395
step_physics_min0.10389320958744395
survival_time_max2.1500000000000004
survival_time_mean2.1500000000000004
survival_time_min2.1500000000000004
No reset possible
6247013798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednoreg030:00:37
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6246913798Nicholas Kostelniktemplate-randomaido-hello-sim-validation370abortednoreg030:00:38
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3Ab13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691&fromImage=docker.io%2Fnitaigao%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for nitaigao/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/nitaigao/aido-submissions@sha256:b13078d04947eb3a802ebc4e9db985f6a60c2a3cae145d65fbd44ef0177e1691
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6237013746Frank (Chude) Qian 🇨🇦CBC Net v1aido-LFP-sim-validation350successyesreg030:08:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.649999999999988
in-drivable-lane_median0.0
driven_lanedir_consec_median1.647060046064113
deviation-center-line_median0.26493349898954244


other stats
agent_compute-ego0_max0.12309570105179496
agent_compute-ego0_mean0.09742968423280132
agent_compute-ego0_median0.08924447587588236
agent_compute-ego0_min0.08813408412764558
complete-iteration_max0.5512478247932766
complete-iteration_mean0.5026401411587693
complete-iteration_median0.5246767301905644
complete-iteration_min0.4099592794606715
deviation-center-line_max0.4087790432152253
deviation-center-line_mean0.2693316699090744
deviation-center-line_min0.13868063844198747
deviation-heading_max2.24991992730224
deviation-heading_mean1.3203281518597056
deviation-heading_median1.1916778986763767
deviation-heading_min0.648036882783829
driven_any_max2.5436264308400265
driven_any_mean1.7399638760798286
driven_any_median1.9444876044203787
driven_any_min0.5272538646385305
driven_lanedir_consec_max2.074046605641011
driven_lanedir_consec_mean1.4705952759264405
driven_lanedir_consec_min0.5142144059365246
driven_lanedir_max2.074046605641011
driven_lanedir_mean1.4705952759264405
driven_lanedir_median1.647060046064113
driven_lanedir_min0.5142144059365246
get_duckie_state_max0.07807880069898522
get_duckie_state_mean0.05974274963497543
get_duckie_state_median0.07345177936967323
get_duckie_state_min0.013988639101570036
get_robot_state_max0.01347105903963072
get_robot_state_mean0.012318991855650977
get_robot_state_median0.012116566567475964
get_robot_state_min0.011571775248021256
get_state_dump_max0.02719194992728855
get_state_dump_mean0.02369452470169734
get_state_dump_median0.024082989194924076
get_state_dump_min0.019420170489652656
get_ui_image_max0.06339804980219627
get_ui_image_mean0.05668559473748308
get_ui_image_median0.05695477330074626
get_ui_image_min0.04943478254624355
in-drivable-lane_max2.8999999999999897
in-drivable-lane_mean0.7249999999999974
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.1243050180931413, "get_ui_image": 0.05396280703337296, "step_physics": 0.21645477751026984, "survival_time": 5.699999999999988, "driven_lanedir": 2.074046605641011, "get_state_dump": 0.02719194992728855, "get_robot_state": 0.011705321850983993, "sim_render-ego0": 0.009984795943550442, "get_duckie_state": 0.07807880069898522, "in-drivable-lane": 0.0, "deviation-heading": 1.2146131231085082, "agent_compute-ego0": 0.12309570105179496, "complete-iteration": 0.5512478247932766, "set_robot_commands": 0.00621221169181492, "deviation-center-line": 0.2837850782357974, "driven_lanedir_consec": 2.074046605641011, "sim_compute_sim_state": 0.01902158778646718, "sim_compute_performance-ego0": 0.005319738388061523}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5272538646385305, "get_ui_image": 0.06339804980219627, "step_physics": 0.2010549817766462, "survival_time": 2.3999999999999995, "driven_lanedir": 0.5142144059365246, "get_state_dump": 0.023520396680248027, "get_robot_state": 0.012527811283967932, "sim_render-ego0": 0.009042910167149134, "get_duckie_state": 0.07528988195925343, "in-drivable-lane": 0.0, "deviation-heading": 0.648036882783829, "agent_compute-ego0": 0.08956729149331852, "complete-iteration": 0.5104416535825146, "set_robot_commands": 0.0077109288196174465, "deviation-center-line": 0.13868063844198747, "driven_lanedir_consec": 0.5142144059365246, "sim_compute_sim_state": 0.021887020188934948, "sim_compute_performance-ego0": 0.00621998066804847}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.764670190747616, "get_ui_image": 0.05994673956811956, "step_physics": 0.22883400874855245, "survival_time": 5.599999999999988, "driven_lanedir": 1.7287985314892802, "get_state_dump": 0.02464558170960013, "get_robot_state": 0.01347105903963072, "sim_render-ego0": 0.010097856015230704, "get_duckie_state": 0.07161367678009303, "in-drivable-lane": 0.0, "deviation-heading": 1.168742674244245, "agent_compute-ego0": 0.08813408412764558, "complete-iteration": 0.5389118067986143, "set_robot_commands": 0.0080706798924809, "deviation-center-line": 0.24608191974328747, "driven_lanedir_consec": 1.7287985314892802, "sim_compute_sim_state": 0.02720503047504256, "sim_compute_performance-ego0": 0.006672530047661435}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.5436264308400265, "get_ui_image": 0.04943478254624355, "step_physics": 0.1865857427502856, "survival_time": 8.04999999999998, "driven_lanedir": 1.5653215606389457, "get_state_dump": 0.019420170489652656, "get_robot_state": 0.011571775248021256, "sim_render-ego0": 0.010107146369086372, "get_duckie_state": 0.013988639101570036, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 2.24991992730224, "agent_compute-ego0": 0.08892166025844621, "complete-iteration": 0.4099592794606715, "set_robot_commands": 0.007874718418827763, "deviation-center-line": 0.4087790432152253, "driven_lanedir_consec": 1.5653215606389457, "sim_compute_sim_state": 0.015461789237128364, "sim_compute_performance-ego0": 0.006381826636231976}}
set_robot_commands_max0.0080706798924809
set_robot_commands_mean0.007467134705685258
set_robot_commands_median0.0077928236192226046
set_robot_commands_min0.00621221169181492
sim_compute_performance-ego0_max0.006672530047661435
sim_compute_performance-ego0_mean0.0061485189350008514
sim_compute_performance-ego0_median0.006300903652140223
sim_compute_performance-ego0_min0.005319738388061523
sim_compute_sim_state_max0.02720503047504256
sim_compute_sim_state_mean0.020893856921893265
sim_compute_sim_state_median0.020454303987701063
sim_compute_sim_state_min0.015461789237128364
sim_render-ego0_max0.010107146369086372
sim_render-ego0_mean0.009808177123754164
sim_render-ego0_median0.010041325979390572
sim_render-ego0_min0.009042910167149134
simulation-passed1
step_physics_max0.22883400874855245
step_physics_mean0.20823237769643851
step_physics_median0.208754879643458
step_physics_min0.1865857427502856
survival_time_max8.04999999999998
survival_time_mean5.4374999999999885
survival_time_min2.3999999999999995
No reset possible
6236813525András Kalapos 🇭🇺real-v1.0-3092-363aido-LFP-sim-testing351successyesreg030:11:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.550000000000017
in-drivable-lane_median0.0
driven_lanedir_consec_median3.0547997262996724
deviation-center-line_median0.425028594243627


other stats
agent_compute-ego0_max0.04387945816165111
agent_compute-ego0_mean0.03756032350563648
agent_compute-ego0_median0.03612298743934924
agent_compute-ego0_min0.03411586098219632
complete-iteration_max0.5688839282518552
complete-iteration_mean0.4754483843994245
complete-iteration_median0.4811250645082116
complete-iteration_min0.37065948032941975
deviation-center-line_max0.7176569445225937
deviation-center-line_mean0.423024672104636
deviation-center-line_min0.1243845554086962
deviation-heading_max2.0977637127932427
deviation-heading_mean1.200054128563915
deviation-heading_median1.2571614839973642
deviation-heading_min0.188129833467689
driven_any_max5.882518478277116
driven_any_mean3.1201990926474887
driven_any_median3.0994123181024604
driven_any_min0.39945325610791793
driven_lanedir_consec_max5.793964035923391
driven_lanedir_consec_mean3.0745304531526543
driven_lanedir_consec_min0.3945583240878803
driven_lanedir_max5.793964035923391
driven_lanedir_mean3.0745304531526543
driven_lanedir_median3.0547997262996724
driven_lanedir_min0.3945583240878803
get_duckie_state_max0.0880129403538174
get_duckie_state_mean0.06397369918483624
get_duckie_state_median0.07753101928835983
get_duckie_state_min0.012819817808807874
get_robot_state_max0.014197000598542078
get_robot_state_mean0.012636692892185704
get_robot_state_median0.01320465946216811
get_robot_state_min0.00994045204586453
get_state_dump_max0.029463959521934636
get_state_dump_mean0.02831495204423628
get_state_dump_median0.02853273178172041
get_state_dump_min0.026730385091569688
get_ui_image_max0.06692291219572455
get_ui_image_mean0.05949886122471196
get_ui_image_median0.059816187914506894
get_ui_image_min0.05144015687410949
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.39945325610791793, "get_ui_image": 0.05413505103853014, "step_physics": 0.14322657717598808, "survival_time": 1.7500000000000009, "driven_lanedir": 0.3945583240878803, "get_state_dump": 0.026730385091569688, "get_robot_state": 0.00994045204586453, "sim_render-ego0": 0.009634706709120007, "get_duckie_state": 0.0880129403538174, "in-drivable-lane": 0.0, "deviation-heading": 0.188129833467689, "agent_compute-ego0": 0.03622719314363268, "complete-iteration": 0.39545150597890216, "set_robot_commands": 0.0057345231374104815, "deviation-center-line": 0.1243845554086962, "driven_lanedir_consec": 0.3945583240878803, "sim_compute_sim_state": 0.015986541906992596, "sim_compute_performance-ego0": 0.005610512362586128}, "LFP-norm-zigzag-000-ego0": {"driven_any": 5.882518478277116, "get_ui_image": 0.06692291219572455, "step_physics": 0.28046752209864356, "survival_time": 13.00000000000005, "driven_lanedir": 5.793964035923391, "get_state_dump": 0.027783788483718347, "get_robot_state": 0.014197000598542078, "sim_render-ego0": 0.012202727840321274, "get_duckie_state": 0.0762194810699229, "in-drivable-lane": 0.0, "deviation-heading": 2.0977637127932427, "agent_compute-ego0": 0.0360187817350658, "complete-iteration": 0.5667986230375209, "set_robot_commands": 0.009103467181267866, "deviation-center-line": 0.6735294291391366, "driven_lanedir_consec": 5.793964035923391, "sim_compute_sim_state": 0.03606990196695729, "sim_compute_performance-ego0": 0.007581164553704389}, "LFP-norm-techtrack-000-ego0": {"driven_any": 5.215012348466909, "get_ui_image": 0.06549732479048365, "step_physics": 0.2882781519320767, "survival_time": 12.100000000000035, "driven_lanedir": 5.143583384105871, "get_state_dump": 0.029281675079722465, "get_robot_state": 0.013466293429150991, "sim_render-ego0": 0.012926288102389364, "get_duckie_state": 0.07884255750679675, "in-drivable-lane": 0.0, "deviation-heading": 1.916963538889054, "agent_compute-ego0": 0.03411586098219632, "complete-iteration": 0.5688839282518552, "set_robot_commands": 0.00792313505102087, "deviation-center-line": 0.7176569445225937, "driven_lanedir_consec": 5.143583384105871, "sim_compute_sim_state": 0.03133286272056799, "sim_compute_performance-ego0": 0.007002507708200211}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.9838122877380112, "get_ui_image": 0.05144015687410949, "step_physics": 0.1765488757461798, "survival_time": 2.9999999999999973, "driven_lanedir": 0.966016068493474, "get_state_dump": 0.029463959521934636, "get_robot_state": 0.012943025495185228, "sim_render-ego0": 0.011439913608988776, "get_duckie_state": 0.012819817808807874, "in-drivable-lane": 0.0, "deviation-heading": 0.5973594291056744, "agent_compute-ego0": 0.04387945816165111, "complete-iteration": 0.37065948032941975, "set_robot_commands": 0.007977634179787557, "deviation-center-line": 0.1765277593481174, "driven_lanedir_consec": 0.966016068493474, "sim_compute_sim_state": 0.01835336841520716, "sim_compute_performance-ego0": 0.005591236177037974}}
set_robot_commands_max0.009103467181267866
set_robot_commands_mean0.007684689887371693
set_robot_commands_median0.007950384615404213
set_robot_commands_min0.0057345231374104815
sim_compute_performance-ego0_max0.007581164553704389
sim_compute_performance-ego0_mean0.006446355200382175
sim_compute_performance-ego0_median0.006306510035393169
sim_compute_performance-ego0_min0.005591236177037974
sim_compute_sim_state_max0.03606990196695729
sim_compute_sim_state_mean0.025435668752431254
sim_compute_sim_state_median0.024843115567887576
sim_compute_sim_state_min0.015986541906992596
sim_render-ego0_max0.012926288102389364
sim_render-ego0_mean0.011550909065204855
sim_render-ego0_median0.011821320724655028
sim_render-ego0_min0.009634706709120007
simulation-passed1
step_physics_max0.2882781519320767
step_physics_mean0.22213028173822205
step_physics_median0.2285081989224117
step_physics_min0.14322657717598808
survival_time_max13.00000000000005
survival_time_mean7.462500000000021
survival_time_min1.7500000000000009
No reset possible
6235513534András Kalapos 🇭🇺3090aido-LF-sim-testing348successyesreg030:58:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median27.633993393372776
survival_time_median59.99999999999873
deviation-center-line_median2.4527173833676925
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.03635882199753532
agent_compute-ego0_mean0.03442961473846118
agent_compute-ego0_median0.03415169247381892
agent_compute-ego0_min0.033056252008671565
complete-iteration_max0.4698677017329436
complete-iteration_mean0.40797437090957095
complete-iteration_median0.4087419213105201
complete-iteration_min0.34454593928430005
deviation-center-line_max3.0384228235725153
deviation-center-line_mean2.564461230916936
deviation-center-line_min2.3139873333598446
deviation-heading_max15.16349651216898
deviation-heading_mean11.106622237856005
deviation-heading_median10.764318696925468
deviation-heading_min7.734355045404099
driven_any_max28.5299911405434
driven_any_mean27.895283281949443
driven_any_median28.121766730665215
driven_any_min26.80760852592394
driven_lanedir_consec_max27.914886870233477
driven_lanedir_consec_mean27.21835362972683
driven_lanedir_consec_min25.690540861928305
driven_lanedir_max27.914886870233477
driven_lanedir_mean27.21835362972683
driven_lanedir_median27.633993393372776
driven_lanedir_min25.690540861928305
get_duckie_state_max2.9229601654383065e-06
get_duckie_state_mean2.8772020617889226e-06
get_duckie_state_median2.8897086150640256e-06
get_duckie_state_min2.806430851589333e-06
get_robot_state_max0.013218909874248268
get_robot_state_mean0.012662600666954554
get_robot_state_median0.012613151492326086
get_robot_state_min0.01220518980891778
get_state_dump_max0.018963191034791868
get_state_dump_mean0.01757963779665449
get_state_dump_median0.017473422319664745
get_state_dump_min0.016408515512496606
get_ui_image_max0.0600653647582398
get_ui_image_mean0.0528143453260544
get_ui_image_median0.053581265684567725
get_ui_image_min0.044029485176842374
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 28.5299911405434, "get_ui_image": 0.04948812738048544, "step_physics": 0.2177480861209612, "survival_time": 59.99999999999873, "driven_lanedir": 27.914886870233477, "get_state_dump": 0.016479676808048346, "get_robot_state": 0.01220518980891778, "sim_render-ego0": 0.01049671502633456, "get_duckie_state": 2.806430851589333e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.770648496261304, "agent_compute-ego0": 0.033056252008671565, "complete-iteration": 0.3771254565693953, "set_robot_commands": 0.007873640767144323, "deviation-center-line": 2.3139873333598446, "driven_lanedir_consec": 27.914886870233477, "sim_compute_sim_state": 0.023135962434652744, "sim_compute_performance-ego0": 0.0064408769218451175}, "LF-norm-zigzag-000-ego0": {"driven_any": 28.023903016704573, "get_ui_image": 0.0600653647582398, "step_physics": 0.2840961617891437, "survival_time": 59.99999999999873, "driven_lanedir": 27.65975995076918, "get_state_dump": 0.018963191034791868, "get_robot_state": 0.013218909874248268, "sim_render-ego0": 0.010302937298789809, "get_duckie_state": 2.9023144266984542e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.734355045404099, "agent_compute-ego0": 0.03436676628087383, "complete-iteration": 0.4698677017329436, "set_robot_commands": 0.008696476883137851, "deviation-center-line": 2.319764758470876, "driven_lanedir_consec": 27.65975995076918, "sim_compute_sim_state": 0.03308529301944323, "sim_compute_performance-ego0": 0.0068651704764386}, "LF-norm-techtrack-000-ego0": {"driven_any": 28.219630444625857, "get_ui_image": 0.05767440398865, "step_physics": 0.25826040136129236, "survival_time": 59.99999999999873, "driven_lanedir": 27.60822683597637, "get_state_dump": 0.018467167831281144, "get_robot_state": 0.012769039822657044, "sim_render-ego0": 0.010496409906137993, "get_duckie_state": 2.9229601654383065e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.757988897589634, "agent_compute-ego0": 0.03635882199753532, "complete-iteration": 0.4403583860516449, "set_robot_commands": 0.00807575024137092, "deviation-center-line": 2.585670008264509, "driven_lanedir_consec": 27.60822683597637, "sim_compute_sim_state": 0.031297109803986686, "sim_compute_performance-ego0": 0.0067526192391147025}, "LF-norm-small_loop-000-ego0": {"driven_any": 26.80760852592394, "get_ui_image": 0.044029485176842374, "step_physics": 0.1945870843755514, "survival_time": 59.99999999999873, "driven_lanedir": 25.690540861928305, "get_state_dump": 0.016408515512496606, "get_robot_state": 0.01245726316199513, "sim_render-ego0": 0.010299215110315074, "get_duckie_state": 2.8771028034295965e-06, "in-drivable-lane": 0.0, "deviation-heading": 15.16349651216898, "agent_compute-ego0": 0.03393661866676401, "complete-iteration": 0.34454593928430005, "set_robot_commands": 0.008066684776896938, "deviation-center-line": 3.0384228235725153, "driven_lanedir_consec": 25.690540861928305, "sim_compute_sim_state": 0.01785915757496093, "sim_compute_performance-ego0": 0.006696801697781044}}
set_robot_commands_max0.008696476883137851
set_robot_commands_mean0.008178138167137507
set_robot_commands_median0.008071217509133928
set_robot_commands_min0.007873640767144323
sim_compute_performance-ego0_max0.0068651704764386
sim_compute_performance-ego0_mean0.006688867083794866
sim_compute_performance-ego0_median0.0067247104684478734
sim_compute_performance-ego0_min0.0064408769218451175
sim_compute_sim_state_max0.03308529301944323
sim_compute_sim_state_mean0.026344380708260895
sim_compute_sim_state_median0.027216536119319713
sim_compute_sim_state_min0.01785915757496093
sim_render-ego0_max0.01049671502633456
sim_render-ego0_mean0.010398819335394358
sim_render-ego0_median0.0103996736024639
sim_render-ego0_min0.010299215110315074
simulation-passed1
step_physics_max0.2840961617891437
step_physics_mean0.23867293341173715
step_physics_median0.2380042437411268
step_physics_min0.1945870843755514
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6235313541András Kalapos 🇭🇺3090aido-LFP-sim-validation350successyesreg030:07:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.27499999999999
in-drivable-lane_median0.0
driven_lanedir_consec_median1.9719834164233996
deviation-center-line_median0.21435454573742285


other stats
agent_compute-ego0_max0.03551608219481351
agent_compute-ego0_mean0.03368489074401176
agent_compute-ego0_median0.03425707749541412
agent_compute-ego0_min0.030709325790405275
complete-iteration_max0.5339828597174751
complete-iteration_mean0.4601790565954587
complete-iteration_median0.484972483960842
complete-iteration_min0.3367883987426758
deviation-center-line_max0.26202003826130843
deviation-center-line_mean0.2242699186309404
deviation-center-line_min0.20635054478760745
deviation-heading_max1.0004781965473697
deviation-heading_mean0.8480539542106119
deviation-heading_median0.8634327733782843
deviation-heading_min0.6648720735385094
driven_any_max2.4485872267150515
driven_any_mean1.7569495085256277
driven_any_median2.008512325397146
driven_any_min0.5621861565931654
driven_lanedir_consec_max2.425577624754385
driven_lanedir_consec_mean1.7194289472362714
driven_lanedir_consec_min0.5081713313439002
driven_lanedir_max2.425577624754385
driven_lanedir_mean1.7194289472362714
driven_lanedir_median1.9719834164233996
driven_lanedir_min0.5081713313439002
get_duckie_state_max0.08276083493473554
get_duckie_state_mean0.061477839029455555
get_duckie_state_median0.07502621216777625
get_duckie_state_min0.01309809684753418
get_robot_state_max0.012073791388309362
get_robot_state_mean0.011384597736690883
get_robot_state_median0.011904942922424852
get_robot_state_min0.009654713713604471
get_state_dump_max0.027866341850974342
get_state_dump_mean0.023583818865321675
get_state_dump_median0.02462007833927483
get_state_dump_min0.017228776931762696
get_ui_image_max0.06321143067401389
get_ui_image_mean0.05664968422489022
get_ui_image_median0.05942094135892828
get_ui_image_min0.04454542350769043
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.1672156201645167, "get_ui_image": 0.05803134566859195, "step_physics": 0.21650667148723937, "survival_time": 5.649999999999988, "driven_lanedir": 2.1300981286409773, "get_state_dump": 0.027402616383736592, "get_robot_state": 0.011987370357178805, "sim_render-ego0": 0.011500511253089237, "get_duckie_state": 0.08078148699643319, "in-drivable-lane": 0.0, "deviation-heading": 0.9890294168610662, "agent_compute-ego0": 0.03551608219481351, "complete-iteration": 0.47894817695283054, "set_robot_commands": 0.008893830734386779, "deviation-center-line": 0.21594832061456487, "driven_lanedir_consec": 2.1300981286409773, "sim_compute_sim_state": 0.022338218856276126, "sim_compute_performance-ego0": 0.005749982700013278}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5621861565931654, "get_ui_image": 0.06321143067401389, "step_physics": 0.24418652057647705, "survival_time": 2.25, "driven_lanedir": 0.5081713313439002, "get_state_dump": 0.021837540294813072, "get_robot_state": 0.009654713713604471, "sim_render-ego0": 0.01273234512494958, "get_duckie_state": 0.06927093733911929, "in-drivable-lane": 0.0, "deviation-heading": 1.0004781965473697, "agent_compute-ego0": 0.034785244775855026, "complete-iteration": 0.4909967909688535, "set_robot_commands": 0.007049213285031526, "deviation-center-line": 0.2127607708602809, "driven_lanedir_consec": 0.5081713313439002, "sim_compute_sim_state": 0.020934141200521717, "sim_compute_performance-ego0": 0.0071038007736206055}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.8498090306297768, "get_ui_image": 0.06081053704926462, "step_physics": 0.2600886219679707, "survival_time": 4.899999999999991, "driven_lanedir": 1.813868704205822, "get_state_dump": 0.027866341850974342, "get_robot_state": 0.012073791388309362, "sim_render-ego0": 0.012437541075427124, "get_duckie_state": 0.08276083493473554, "in-drivable-lane": 0.0, "deviation-heading": 0.6648720735385094, "agent_compute-ego0": 0.03372891021497322, "complete-iteration": 0.5339828597174751, "set_robot_commands": 0.00799423275571881, "deviation-center-line": 0.26202003826130843, "driven_lanedir_consec": 1.813868704205822, "sim_compute_sim_state": 0.026970583983141967, "sim_compute_performance-ego0": 0.0090093058769149}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.4485872267150515, "get_ui_image": 0.04454542350769043, "step_physics": 0.18080290031433105, "survival_time": 6.199999999999986, "driven_lanedir": 2.425577624754385, "get_state_dump": 0.017228776931762696, "get_robot_state": 0.0118225154876709, "sim_render-ego0": 0.009586126327514648, "get_duckie_state": 0.01309809684753418, "in-drivable-lane": 0.0, "deviation-heading": 0.7378361298955024, "agent_compute-ego0": 0.030709325790405275, "complete-iteration": 0.3367883987426758, "set_robot_commands": 0.006375696182250977, "deviation-center-line": 0.20635054478760745, "driven_lanedir_consec": 2.425577624754385, "sim_compute_sim_state": 0.01576329803466797, "sim_compute_performance-ego0": 0.00663823127746582}}
set_robot_commands_max0.008893830734386779
set_robot_commands_mean0.007578243239347023
set_robot_commands_median0.007521723020375168
set_robot_commands_min0.006375696182250977
sim_compute_performance-ego0_max0.0090093058769149
sim_compute_performance-ego0_mean0.0071253301570036506
sim_compute_performance-ego0_median0.006871016025543212
sim_compute_performance-ego0_min0.005749982700013278
sim_compute_sim_state_max0.026970583983141967
sim_compute_sim_state_mean0.021501560518651944
sim_compute_sim_state_median0.02163618002839892
sim_compute_sim_state_min0.01576329803466797
sim_render-ego0_max0.01273234512494958
sim_render-ego0_mean0.011564130945245148
sim_render-ego0_median0.01196902616425818
sim_render-ego0_min0.009586126327514648
simulation-passed1
step_physics_max0.2600886219679707
step_physics_mean0.22539617858650457
step_physics_median0.2303465960318582
step_physics_min0.18080290031433105
survival_time_max6.199999999999986
survival_time_mean4.749999999999991
survival_time_min2.25
No reset possible
6235113570Márton Tim 🇭🇺3626aido-LFP-sim-testing351successyesreg030:10:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.92499999999999
in-drivable-lane_median0.0
driven_lanedir_consec_median1.4074606869295334
deviation-center-line_median0.2930062766075487


other stats
agent_compute-ego0_max0.08670316582961048
agent_compute-ego0_mean0.08417425682280609
agent_compute-ego0_median0.0838928040631761
agent_compute-ego0_min0.08220825333526169
complete-iteration_max0.6118828315529035
complete-iteration_mean0.5025309998360841
complete-iteration_median0.5006416115701569
complete-iteration_min0.39695794465111905
deviation-center-line_max0.8731255182178675
deviation-center-line_mean0.3852666549530591
deviation-center-line_min0.08192854837927166
deviation-heading_max2.8093250982373945
deviation-heading_mean1.411784159394937
deviation-heading_median1.3112039922650829
deviation-heading_min0.21540355481218895
driven_any_max6.182250849979711
driven_any_mean2.545446912618071
driven_any_median1.8187681380816612
driven_any_min0.36200052432925134
driven_lanedir_consec_max6.025418043017982
driven_lanedir_consec_mean2.299750629229972
driven_lanedir_consec_min0.3586631000428402
driven_lanedir_max6.025418043017982
driven_lanedir_mean2.299750629229972
driven_lanedir_median1.4074606869295334
driven_lanedir_min0.3586631000428402
get_duckie_state_max0.07638842718941825
get_duckie_state_mean0.05712026849859974
get_duckie_state_median0.07047447925463618
get_duckie_state_min0.011143688295708328
get_robot_state_max0.01275193691253662
get_robot_state_mean0.011000979082835965
get_robot_state_median0.010712583415503334
get_robot_state_min0.009826812587800573
get_state_dump_max0.023966671751557495
get_state_dump_mean0.021566794411995258
get_state_dump_median0.022589280812636663
get_state_dump_min0.017121944271150182
get_ui_image_max0.06389633099809824
get_ui_image_mean0.05787135035969202
get_ui_image_median0.0577270281487617
get_ui_image_min0.05213501414314645
in-drivable-lane_max1.9499999999999953
in-drivable-lane_mean0.4874999999999988
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.36200052432925134, "get_ui_image": 0.05600671768188477, "step_physics": 0.1490647452218192, "survival_time": 1.7000000000000008, "driven_lanedir": 0.3586631000428402, "get_state_dump": 0.022457027435302736, "get_robot_state": 0.01033812931605748, "sim_render-ego0": 0.010604579108101982, "get_duckie_state": 0.07638842718941825, "in-drivable-lane": 0.0, "deviation-heading": 0.21540355481218895, "agent_compute-ego0": 0.0828824656350272, "complete-iteration": 0.4406165531703404, "set_robot_commands": 0.007710654394967215, "deviation-center-line": 0.08192854837927166, "driven_lanedir_consec": 0.3586631000428402, "sim_compute_sim_state": 0.01661205972943987, "sim_compute_performance-ego0": 0.008320678983415876}, "LFP-norm-zigzag-000-ego0": {"driven_any": 6.182250849979711, "get_ui_image": 0.06389633099809824, "step_physics": 0.2938792868483838, "survival_time": 13.850000000000062, "driven_lanedir": 6.025418043017982, "get_state_dump": 0.023966671751557495, "get_robot_state": 0.01275193691253662, "sim_render-ego0": 0.009625137281074798, "get_duckie_state": 0.0735755669984886, "in-drivable-lane": 0.0, "deviation-heading": 2.8093250982373945, "agent_compute-ego0": 0.08670316582961048, "complete-iteration": 0.6118828315529035, "set_robot_commands": 0.00862763082380775, "deviation-center-line": 0.8731255182178675, "driven_lanedir_consec": 6.025418043017982, "sim_compute_sim_state": 0.03227487399423723, "sim_compute_performance-ego0": 0.006344710322592756}, "LFP-norm-techtrack-000-ego0": {"driven_any": 2.689848398926713, "get_ui_image": 0.059447338615638626, "step_physics": 0.2706754363101462, "survival_time": 6.849999999999984, "driven_lanedir": 1.8786243596818153, "get_state_dump": 0.022721534189970596, "get_robot_state": 0.01108703751494919, "sim_render-ego0": 0.009437554124472796, "get_duckie_state": 0.06737339151078377, "in-drivable-lane": 1.9499999999999953, "deviation-heading": 2.051504917101876, "agent_compute-ego0": 0.08220825333526169, "complete-iteration": 0.5606666699699734, "set_robot_commands": 0.008060332657634348, "deviation-center-line": 0.4513687441911224, "driven_lanedir_consec": 1.8786243596818153, "sim_compute_sim_state": 0.024105574773705524, "sim_compute_performance-ego0": 0.005318138910376508}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.9476878772366096, "get_ui_image": 0.05213501414314645, "step_physics": 0.17977552726620533, "survival_time": 2.9999999999999973, "driven_lanedir": 0.9362970141772516, "get_state_dump": 0.017121944271150182, "get_robot_state": 0.009826812587800573, "sim_render-ego0": 0.009165455083378026, "get_duckie_state": 0.011143688295708328, "in-drivable-lane": 0.0, "deviation-heading": 0.5709030674282894, "agent_compute-ego0": 0.08490314249132501, "complete-iteration": 0.39695794465111905, "set_robot_commands": 0.006547986483964764, "deviation-center-line": 0.134643809023975, "driven_lanedir_consec": 0.9362970141772516, "sim_compute_sim_state": 0.02067237994709953, "sim_compute_performance-ego0": 0.005461329319437996}}
set_robot_commands_max0.00862763082380775
set_robot_commands_mean0.007736651090093518
set_robot_commands_median0.007885493526300781
set_robot_commands_min0.006547986483964764
sim_compute_performance-ego0_max0.008320678983415876
sim_compute_performance-ego0_mean0.006361214383955784
sim_compute_performance-ego0_median0.005903019821015376
sim_compute_performance-ego0_min0.005318138910376508
sim_compute_sim_state_max0.03227487399423723
sim_compute_sim_state_mean0.023416222111120537
sim_compute_sim_state_median0.022388977360402525
sim_compute_sim_state_min0.01661205972943987
sim_render-ego0_max0.010604579108101982
sim_render-ego0_mean0.009708181399256902
sim_render-ego0_median0.009531345702773798
sim_render-ego0_min0.009165455083378026
simulation-passed1
step_physics_max0.2938792868483838
step_physics_mean0.22334874891163864
step_physics_median0.22522548178817575
step_physics_min0.1490647452218192
survival_time_max13.850000000000062
survival_time_mean6.350000000000011
survival_time_min1.7000000000000008
No reset possible
6235013548András Kalapos 🇭🇺3090aido-LFV_multi-sim-validation356failedyesreg030:02:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1365, in _do_call
              ||     return fn(*args)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1349, in _run_fn
              ||     return self._call_tf_sessionrun(options, feed_dict, fetch_list,
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1441, in _call_tf_sessionrun
              ||     return tf_session.TF_SessionRun_wrapper(self._session, options, feed_dict,
              || tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
              ||   (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[{{node default_policy/functional_1_1/conv_value_1/Relu}}]]
              || 	 [[default_policy/strided_slice_1/_3]]
              ||   (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[{{node default_policy/functional_1_1/conv_value_1/Relu}}]]
              || 0 successful operations.
              || 0 derived errors ignored.
              ||
              || During handling of the above exception, another exception occurred:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 29, in init
              ||     self.model = RLlibModel(SEED,experiment_idx=0,checkpoint_idx=0,logger=context)
              ||   File "/submission/model.py", line 55, in __init__
              ||     self.model = PPOTrainer(config=config["rllib_config"])
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 90, in __init__
              ||     Trainer.__init__(self, config, env, logger_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 455, in __init__
              ||     super().__init__(config, logger_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/tune/trainable.py", line 174, in __init__
              ||     self._setup(copy.deepcopy(self.config))
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 596, in _setup
              ||     self._init(self.config, self.env_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 115, in _init
              ||     self.workers = self._make_workers(env_creator, self._policy,
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 662, in _make_workers
              ||     return WorkerSet(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 61, in __init__
              ||     self._local_worker = self._make_worker(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 237, in _make_worker
              ||     worker = cls(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 360, in __init__
              ||     self._build_policy_map(policy_dict, policy_config)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 842, in _build_policy_map
              ||     policy_map[name] = cls(obs_space, act_space, merged_conf)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 129, in __init__
              ||     DynamicTFPolicy.__init__(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 237, in __init__
              ||     self._initialize_loss()
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 324, in _initialize_loss
              ||     postprocessed_batch = self.postprocess_trajectory(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 155, in postprocess_trajectory
              ||     return postprocess_fn(self, sample_batch, other_agent_batches,
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 182, in postprocess_ppo_gae
              ||     last_r = policy._value(sample_batch[SampleBatch.NEXT_OBS][-1],
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/utils/tf_ops.py", line 86, in call
              ||     return session_or_none.run(symbolic_out[0], feed_dict)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 957, in run
              ||     result = self._run(None, fetches, feed_dict, options_ptr,
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1180, in _run
              ||     results = self._do_run(handle, final_targets, final_fetches,
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1358, in _do_run
              ||     return self._do_call(_run_fn, feeds, fetches, targets, options,
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1384, in _do_call
              ||     raise type(e)(node_def, op, message)
              || tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
              ||   (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[node default_policy/functional_1_1/conv_value_1/Relu (defined at /usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py:103) ]]
              || 	 [[default_policy/strided_slice_1/_3]]
              ||   (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || 	 [[node default_policy/functional_1_1/conv_value_1/Relu (defined at /usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py:103) ]]
              || 0 successful operations.
              || 0 derived errors ignored.
              ||
              || Original stack trace for 'default_policy/functional_1_1/conv_value_1/Relu':
              ||   File "solution.py", line 126, in <module>
              ||     main()
              ||   File "solution.py", line 122, in main
              ||     wrap_direct(node=node, protocol=protocol)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/interface.py", line 24, in wrap_direct
              ||     run_loop(node, protocol, args)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 243, in run_loop
              ||     loop(node_name, fi, fo, node, protocol, tin, tout, config=config, fi_desc=fin, fo_desc=fout)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 29, in init
              ||     self.model = RLlibModel(SEED,experiment_idx=0,checkpoint_idx=0,logger=context)
              ||   File "/submission/model.py", line 55, in __init__
              ||     self.model = PPOTrainer(config=config["rllib_config"])
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 90, in __init__
              ||     Trainer.__init__(self, config, env, logger_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 455, in __init__
              ||     super().__init__(config, logger_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/tune/trainable.py", line 174, in __init__
              ||     self._setup(copy.deepcopy(self.config))
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 596, in _setup
              ||     self._init(self.config, self.env_creator)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 115, in _init
              ||     self.workers = self._make_workers(env_creator, self._policy,
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 662, in _make_workers
              ||     return WorkerSet(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 61, in __init__
              ||     self._local_worker = self._make_worker(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 237, in _make_worker
              ||     worker = cls(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 360, in __init__
              ||     self._build_policy_map(policy_dict, policy_config)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 842, in _build_policy_map
              ||     policy_map[name] = cls(obs_space, act_space, merged_conf)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 129, in __init__
              ||     DynamicTFPolicy.__init__(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 237, in __init__
              ||     self._initialize_loss()
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 324, in _initialize_loss
              ||     postprocessed_batch = self.postprocess_trajectory(
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 155, in postprocess_trajectory
              ||     return postprocess_fn(self, sample_batch, other_agent_batches,
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 182, in postprocess_ppo_gae
              ||     last_r = policy._value(sample_batch[SampleBatch.NEXT_OBS][-1],
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/utils/tf_ops.py", line 84, in call
              ||     symbolic_out[0] = fn(*placeholders)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 235, in value
              ||     model_out, _ = self.model({
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/models/modelv2.py", line 150, in __call__
              ||     res = self.forward(restored, state or [], seq_lens)
              ||   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py", line 103, in forward
              ||     model_out, self._value_out = self.base_model(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 776, in __call__
              ||     outputs = call_fn(cast_inputs, *args, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/functional.py", line 385, in call
              ||     return self._run_internal_graph(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/functional.py", line 508, in _run_internal_graph
              ||     outputs = node.layer(*args, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 776, in __call__
              ||     outputs = call_fn(cast_inputs, *args, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/convolutional.py", line 269, in call
              ||     return self.activation(outputs)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_nn_ops.py", line 10435, in relu
              ||     _, _, _op, _outputs = _op_def_library._apply_op_helper(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/op_def_library.py", line 742, in _apply_op_helper
              ||     op = g._create_op_internal(op_type_name, inputs, dtypes=None,
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 3477, in _create_op_internal
              ||     ret = Operation(
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 1949, in __init__
              ||     self._traceback = tf_stack.extract_stack()
              ||
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1365, in _do_call
              || |     return fn(*args)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1349, in _run_fn
              || |     return self._call_tf_sessionrun(options, feed_dict, fetch_list,
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1441, in _call_tf_sessionrun
              || |     return tf_session.TF_SessionRun_wrapper(self._session, options, feed_dict,
              || | tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
              || |   (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || | 	 [[{{node default_policy/functional_1_1/conv_value_1/Relu}}]]
              || | 	 [[default_policy/strided_slice_1/_3]]
              || |   (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || | 	 [[{{node default_policy/functional_1_1/conv_value_1/Relu}}]]
              || | 0 successful operations.
              || | 0 derived errors ignored.
              || |
              || | During handling of the above exception, another exception occurred:
              || |
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 29, in init
              || |     self.model = RLlibModel(SEED,experiment_idx=0,checkpoint_idx=0,logger=context)
              || |   File "/submission/model.py", line 55, in __init__
              || |     self.model = PPOTrainer(config=config["rllib_config"])
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 90, in __init__
              || |     Trainer.__init__(self, config, env, logger_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 455, in __init__
              || |     super().__init__(config, logger_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/tune/trainable.py", line 174, in __init__
              || |     self._setup(copy.deepcopy(self.config))
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 596, in _setup
              || |     self._init(self.config, self.env_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 115, in _init
              || |     self.workers = self._make_workers(env_creator, self._policy,
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 662, in _make_workers
              || |     return WorkerSet(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 61, in __init__
              || |     self._local_worker = self._make_worker(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 237, in _make_worker
              || |     worker = cls(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 360, in __init__
              || |     self._build_policy_map(policy_dict, policy_config)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 842, in _build_policy_map
              || |     policy_map[name] = cls(obs_space, act_space, merged_conf)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 129, in __init__
              || |     DynamicTFPolicy.__init__(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 237, in __init__
              || |     self._initialize_loss()
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 324, in _initialize_loss
              || |     postprocessed_batch = self.postprocess_trajectory(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 155, in postprocess_trajectory
              || |     return postprocess_fn(self, sample_batch, other_agent_batches,
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 182, in postprocess_ppo_gae
              || |     last_r = policy._value(sample_batch[SampleBatch.NEXT_OBS][-1],
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/utils/tf_ops.py", line 86, in call
              || |     return session_or_none.run(symbolic_out[0], feed_dict)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 957, in run
              || |     result = self._run(None, fetches, feed_dict, options_ptr,
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1180, in _run
              || |     results = self._do_run(handle, final_targets, final_fetches,
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1358, in _do_run
              || |     return self._do_call(_run_fn, feeds, fetches, targets, options,
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/session.py", line 1384, in _do_call
              || |     raise type(e)(node_def, op, message)
              || | tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
              || |   (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || | 	 [[node default_policy/functional_1_1/conv_value_1/Relu (defined at /usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py:103) ]]
              || | 	 [[default_policy/strided_slice_1/_3]]
              || |   (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above.
              || | 	 [[node default_policy/functional_1_1/conv_value_1/Relu (defined at /usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py:103) ]]
              || | 0 successful operations.
              || | 0 derived errors ignored.
              || |
              || | Original stack trace for 'default_policy/functional_1_1/conv_value_1/Relu':
              || |   File "solution.py", line 126, in <module>
              || |     main()
              || |   File "solution.py", line 122, in main
              || |     wrap_direct(node=node, protocol=protocol)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/interface.py", line 24, in wrap_direct
              || |     run_loop(node, protocol, args)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 243, in run_loop
              || |     loop(node_name, fi, fo, node, protocol, tin, tout, config=config, fi_desc=fin, fo_desc=fout)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 29, in init
              || |     self.model = RLlibModel(SEED,experiment_idx=0,checkpoint_idx=0,logger=context)
              || |   File "/submission/model.py", line 55, in __init__
              || |     self.model = PPOTrainer(config=config["rllib_config"])
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 90, in __init__
              || |     Trainer.__init__(self, config, env, logger_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 455, in __init__
              || |     super().__init__(config, logger_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/tune/trainable.py", line 174, in __init__
              || |     self._setup(copy.deepcopy(self.config))
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 596, in _setup
              || |     self._init(self.config, self.env_creator)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer_template.py", line 115, in _init
              || |     self.workers = self._make_workers(env_creator, self._policy,
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/trainer.py", line 662, in _make_workers
              || |     return WorkerSet(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 61, in __init__
              || |     self._local_worker = self._make_worker(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/worker_set.py", line 237, in _make_worker
              || |     worker = cls(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 360, in __init__
              || |     self._build_policy_map(policy_dict, policy_config)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/evaluation/rollout_worker.py", line 842, in _build_policy_map
              || |     policy_map[name] = cls(obs_space, act_space, merged_conf)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 129, in __init__
              || |     DynamicTFPolicy.__init__(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 237, in __init__
              || |     self._initialize_loss()
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/dynamic_tf_policy.py", line 324, in _initialize_loss
              || |     postprocessed_batch = self.postprocess_trajectory(
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/policy/tf_policy_template.py", line 155, in postprocess_trajectory
              || |     return postprocess_fn(self, sample_batch, other_agent_batches,
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 182, in postprocess_ppo_gae
              || |     last_r = policy._value(sample_batch[SampleBatch.NEXT_OBS][-1],
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/utils/tf_ops.py", line 84, in call
              || |     symbolic_out[0] = fn(*placeholders)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/agents/ppo/ppo_tf_policy.py", line 235, in value
              || |     model_out, _ = self.model({
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/models/modelv2.py", line 150, in __call__
              || |     res = self.forward(restored, state or [], seq_lens)
              || |   File "/usr/local/lib/python3.8/dist-packages/ray/rllib/models/tf/visionnet_v2.py", line 103, in forward
              || |     model_out, self._value_out = self.base_model(
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 776, in __call__
              || |     outputs = call_fn(cast_inputs, *args, **kwargs)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/functional.py", line 385, in call
              || |     return self._run_internal_graph(
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/functional.py", line 508, in _run_internal_graph
              || |     outputs = node.layer(*args, **kwargs)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 776, in __call__
              || |     outputs = call_fn(cast_inputs, *args, **kwargs)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/layers/convolutional.py", line 269, in call
              || |     return self.activation(outputs)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/ops/gen_nn_ops.py", line 10435, in relu
              || |     _, _, _op, _outputs = _op_def_library._apply_op_helper(
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/op_def_library.py", line 742, in _apply_op_helper
              || |     op = g._create_op_internal(op_type_name, inputs, dtypes=None,
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 3477, in _create_op_internal
              || |     ret = Operation(
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/ops.py", line 1949, in __init__
              || |     self._traceback = tf_stack.extract_stack()
              || |
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6234813556András Kalapos 🇭🇺real-v0.9-3092-363aido-LFP-sim-validation350successyesreg030:07:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.324999999999989
in-drivable-lane_median0.0
driven_lanedir_consec_median1.936357752497966
deviation-center-line_median0.2568910005545605


other stats
agent_compute-ego0_max0.03801375389099121
agent_compute-ego0_mean0.03585894979158193
agent_compute-ego0_median0.03572727151539015
agent_compute-ego0_min0.033967502244556226
complete-iteration_max0.4988644218444824
complete-iteration_mean0.4523473940661608
complete-iteration_median0.4824382062580274
complete-iteration_min0.3456487419041058
deviation-center-line_max0.2891751203451925
deviation-center-line_mean0.24721681656417732
deviation-center-line_min0.1859101448023958
deviation-heading_max0.8647393336842559
deviation-heading_mean0.7026572091479113
deviation-heading_median0.7331901855590841
deviation-heading_min0.4795091317892209
driven_any_max2.4631209538753422
driven_any_mean1.7404692507674784
driven_any_median1.9567362096297891
driven_any_min0.5852836299349924
driven_lanedir_consec_max2.444148553641244
driven_lanedir_consec_mean1.6760995836874386
driven_lanedir_consec_min0.3875342761125783
driven_lanedir_max2.444148553641244
driven_lanedir_mean1.6760995836874386
driven_lanedir_median1.936357752497966
driven_lanedir_min0.3875342761125783
get_duckie_state_max0.0894390168397323
get_duckie_state_mean0.05912288567373375
get_duckie_state_median0.06601284265518188
get_duckie_state_min0.01502684054483894
get_robot_state_max0.013046828560207202
get_robot_state_mean0.012594300810379957
get_robot_state_median0.012614040356555969
get_robot_state_min0.012102293968200685
get_state_dump_max0.02874990960826045
get_state_dump_mean0.02348863918995723
get_state_dump_median0.02419413566589355
get_state_dump_min0.016816375819781355
get_ui_image_max0.06598448753356934
get_ui_image_mean0.05836449699824409
get_ui_image_median0.060149021045021386
get_ui_image_min0.047175458369364265
in-drivable-lane_max0.40000000000000024
in-drivable-lane_mean0.10000000000000006
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.1657413488121096, "get_ui_image": 0.05810407140980596, "step_physics": 0.19310276404671048, "survival_time": 5.699999999999988, "driven_lanedir": 2.146216645003011, "get_state_dump": 0.02874990960826045, "get_robot_state": 0.013046828560207202, "sim_render-ego0": 0.009514574382616126, "get_duckie_state": 0.0894390168397323, "in-drivable-lane": 0.0, "deviation-heading": 0.7422027537232161, "agent_compute-ego0": 0.0357527960901675, "complete-iteration": 0.4671494380287502, "set_robot_commands": 0.008984605125758958, "deviation-center-line": 0.2891751203451925, "driven_lanedir_consec": 2.146216645003011, "sim_compute_sim_state": 0.020502563144849693, "sim_compute_performance-ego0": 0.009728500117426334}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5852836299349924, "get_ui_image": 0.06598448753356934, "step_physics": 0.2448973274230957, "survival_time": 2.4499999999999993, "driven_lanedir": 0.3875342761125783, "get_state_dump": 0.027258105278015136, "get_robot_state": 0.012699084281921388, "sim_render-ego0": 0.00922715663909912, "get_duckie_state": 0.06471484184265136, "in-drivable-lane": 0.40000000000000024, "deviation-heading": 0.4795091317892209, "agent_compute-ego0": 0.03801375389099121, "complete-iteration": 0.4977269744873047, "set_robot_commands": 0.008261327743530273, "deviation-center-line": 0.22592031687617836, "driven_lanedir_consec": 0.3875342761125783, "sim_compute_sim_state": 0.02121241569519043, "sim_compute_performance-ego0": 0.005244622230529785}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.7477310704474691, "get_ui_image": 0.06219397068023682, "step_physics": 0.24848244428634644, "survival_time": 4.94999999999999, "driven_lanedir": 1.7264988599929212, "get_state_dump": 0.021130166053771972, "get_robot_state": 0.012102293968200685, "sim_render-ego0": 0.01109553337097168, "get_duckie_state": 0.0673108434677124, "in-drivable-lane": 0.0, "deviation-heading": 0.7241776173949522, "agent_compute-ego0": 0.035701746940612795, "complete-iteration": 0.4988644218444824, "set_robot_commands": 0.008833088874816895, "deviation-center-line": 0.1859101448023958, "driven_lanedir_consec": 1.7264988599929212, "sim_compute_sim_state": 0.026578490734100343, "sim_compute_performance-ego0": 0.005204107761383057}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.4631209538753422, "get_ui_image": 0.047175458369364265, "step_physics": 0.17235260883360418, "survival_time": 6.499999999999985, "driven_lanedir": 2.444148553641244, "get_state_dump": 0.016816375819781355, "get_robot_state": 0.012528996431190547, "sim_render-ego0": 0.010896804678531094, "get_duckie_state": 0.01502684054483894, "in-drivable-lane": 0.0, "deviation-heading": 0.8647393336842559, "agent_compute-ego0": 0.033967502244556226, "complete-iteration": 0.3456487419041058, "set_robot_commands": 0.008059838345942606, "deviation-center-line": 0.28786168423294267, "driven_lanedir_consec": 2.444148553641244, "sim_compute_sim_state": 0.0205061235500656, "sim_compute_performance-ego0": 0.008111913695590186}}
set_robot_commands_max0.008984605125758958
set_robot_commands_mean0.008534715022512183
set_robot_commands_median0.008547208309173583
set_robot_commands_min0.008059838345942606
sim_compute_performance-ego0_max0.009728500117426334
sim_compute_performance-ego0_mean0.0070722859512323405
sim_compute_performance-ego0_median0.006678267963059986
sim_compute_performance-ego0_min0.005204107761383057
sim_compute_sim_state_max0.026578490734100343
sim_compute_sim_state_mean0.02219989828105152
sim_compute_sim_state_median0.02085926962262802
sim_compute_sim_state_min0.020502563144849693
sim_render-ego0_max0.01109553337097168
sim_render-ego0_mean0.010183517267804506
sim_render-ego0_median0.01020568953057361
sim_render-ego0_min0.00922715663909912
simulation-passed1
step_physics_max0.24848244428634644
step_physics_mean0.2147087861474392
step_physics_median0.2190000457349031
step_physics_min0.17235260883360418
survival_time_max6.499999999999985
survival_time_mean4.899999999999991
survival_time_min2.4499999999999993
No reset possible
6234713578Márton Tim 🇭🇺3626aido-LFV_multi-sim-validation356failedyesreg030:02:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 90, in on_received_get_commands
              ||     pwm_left, pwm_right = self.compute_action(self.current_image)
              ||   File "solution.py", line 84, in compute_action
              ||     action = self.model.predict(observation)
              ||   File "/submission/model.py", line 71, in predict
              ||     observation = wrapper.observation(observation)
              ||   File "/submission/duckietown_utils/wrappers/SegmentObsWrapper.py", line 56, in observation
              ||     _, pred = torch.max(self.model.forward(obs_prep), 1)
              ||   File "/submission/duckietown_utils/wrappers/my_models/tiramisu.py", line 145, in forward
              ||     x = self.featureExtractor(x)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/submission/duckietown_utils/wrappers/my_models/tiramisu.py", line 102, in forward
              ||     out = self.denseBlocksUp[i](out)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/submission/duckietown_utils/wrappers/my_models/layers.py", line 38, in forward
              ||     out = layer(x)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/submission/duckietown_utils/wrappers/my_models/layers.py", line 15, in forward
              ||     return super().forward(x)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/container.py", line 117, in forward
              ||     input = module(input)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/modules/batchnorm.py", line 131, in forward
              ||     return F.batch_norm(
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/nn/functional.py", line 2056, in batch_norm
              ||     return torch.batch_norm(
              || RuntimeError: CUDA out of memory. Tried to allocate 14.00 MiB (GPU 0; 10.76 GiB total capacity; 280.34 MiB already allocated; 12.12 MiB free; 340.00 MiB reserved in total by PyTorch)
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6233513593Andras Beres202-1aido-LFV_multi-sim-validation356successyesreg031:34:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median27.90000000000026
in-drivable-lane_median0.7500000000000067
driven_lanedir_consec_median9.837692937373188
deviation-center-line_median1.777319009090093


other stats
agent_compute-ego0_max0.12692438001218048
agent_compute-ego0_mean0.12407085585678594
agent_compute-ego0_median0.12524239004474796
agent_compute-ego0_min0.1187431172522748
agent_compute-ego1_max0.11449019138934333
agent_compute-ego1_mean0.10893843575016868
agent_compute-ego1_median0.1065439118797765
agent_compute-ego1_min0.1054023647137746
complete-iteration_max1.7611329964016829
complete-iteration_mean1.442540831741816
complete-iteration_median1.5467396174391654
complete-iteration_min0.7382076216040191
deviation-center-line_max4.685258885331869
deviation-center-line_mean2.2429384379788195
deviation-center-line_min0.46580390692958307
deviation-heading_max14.88277701798551
deviation-heading_mean5.362963104124053
deviation-heading_median3.6476800548091695
deviation-heading_min1.1525089054371125
driven_any_max22.4584202936406
driven_any_mean9.904478979266091
driven_any_median10.288953309705168
driven_any_min3.222519519891979
driven_lanedir_consec_max21.08988072347855
driven_lanedir_consec_mean9.473534309584284
driven_lanedir_consec_min3.060634333986818
driven_lanedir_max21.08988072347855
driven_lanedir_mean9.473534309584284
driven_lanedir_median9.837692937373188
driven_lanedir_min3.060634333986818
get_duckie_state_max4.659660175121927e-06
get_duckie_state_mean4.532869271414036e-06
get_duckie_state_median4.57204143330068e-06
get_duckie_state_min4.349113150444781e-06
get_robot_state_max0.05132073805523479
get_robot_state_mean0.04545123098953603
get_robot_state_median0.04885511193591068
get_robot_state_min0.02282157595853628
get_state_dump_max0.02782393226896501
get_state_dump_mean0.02667290598656539
get_state_dump_median0.027679542143396872
get_state_dump_min0.021201514309237463
get_ui_image_max0.0847734974180798
get_ui_image_mean0.0750565846784236
get_ui_image_median0.07922077972128433
get_ui_image_min0.052316899625410945
in-drivable-lane_max12.25000000000017
in-drivable-lane_mean1.9785714285714493
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 11.798883092579498, "get_ui_image": 0.07254531942241307, "step_physics": 0.6563435441052977, "survival_time": 27.90000000000026, "driven_lanedir": 11.499611340641405, "get_state_dump": 0.02782393226896501, "get_robot_state": 0.04885511193591068, "sim_render-ego0": 0.010133358574937195, "sim_render-ego1": 0.008979039883144427, "sim_render-ego2": 0.008335171957135413, "sim_render-ego3": 0.008964007570406619, "get_duckie_state": 4.349113150444781e-06, "in-drivable-lane": 0.4499999999999984, "deviation-heading": 3.248634824751084, "agent_compute-ego0": 0.1187431172522748, "agent_compute-ego1": 0.1054023647137746, "agent_compute-ego2": 0.10561360101580408, "agent_compute-ego3": 0.10669514531526242, "complete-iteration": 1.3719164864534985, "set_robot_commands": 0.006775779246430917, "deviation-center-line": 1.7364045836706137, "driven_lanedir_consec": 11.499611340641405, "sim_compute_sim_state": 0.04538437846734827, "sim_compute_performance-ego0": 0.00635677544076882, "sim_compute_performance-ego1": 0.004964869862592284, "sim_compute_performance-ego2": 0.00452025162725841, "sim_compute_performance-ego3": 0.0055663461975206845}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 14.046879812216815, "get_ui_image": 0.07254531942241307, "step_physics": 0.6563435441052977, "survival_time": 27.90000000000026, "driven_lanedir": 13.88463503393233, "get_state_dump": 0.02782393226896501, "get_robot_state": 0.04885511193591068, "sim_render-ego0": 0.010133358574937195, "sim_render-ego1": 0.008979039883144427, "sim_render-ego2": 0.008335171957135413, "sim_render-ego3": 0.008964007570406619, "get_duckie_state": 4.349113150444781e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.253559435436557, "agent_compute-ego0": 0.1187431172522748, "agent_compute-ego1": 0.1054023647137746, "agent_compute-ego2": 0.10561360101580408, "agent_compute-ego3": 0.10669514531526242, "complete-iteration": 1.3719164864534985, "set_robot_commands": 0.006775779246430917, "deviation-center-line": 1.8182334345095723, "driven_lanedir_consec": 13.88463503393233, "sim_compute_sim_state": 0.04538437846734827, "sim_compute_performance-ego0": 0.00635677544076882, "sim_compute_performance-ego1": 0.004964869862592284, "sim_compute_performance-ego2": 0.00452025162725841, "sim_compute_performance-ego3": 0.0055663461975206845}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 8.097935102673823, "get_ui_image": 0.07254531942241307, "step_physics": 0.6563435441052977, "survival_time": 27.90000000000026, "driven_lanedir": 7.720220240206597, "get_state_dump": 0.02782393226896501, "get_robot_state": 0.04885511193591068, "sim_render-ego0": 0.010133358574937195, "sim_render-ego1": 0.008979039883144427, "sim_render-ego2": 0.008335171957135413, "sim_render-ego3": 0.008964007570406619, "get_duckie_state": 4.349113150444781e-06, "in-drivable-lane": 12.25000000000017, "deviation-heading": 2.111181056891049, "agent_compute-ego0": 0.1187431172522748, "agent_compute-ego1": 0.1054023647137746, "agent_compute-ego2": 0.10561360101580408, "agent_compute-ego3": 0.10669514531526242, "complete-iteration": 1.3719164864534985, "set_robot_commands": 0.006775779246430917, "deviation-center-line": 1.2247377716510863, "driven_lanedir_consec": 7.720220240206597, "sim_compute_sim_state": 0.04538437846734827, "sim_compute_performance-ego0": 0.00635677544076882, "sim_compute_performance-ego1": 0.004964869862592284, "sim_compute_performance-ego2": 0.00452025162725841, "sim_compute_performance-ego3": 0.0055663461975206845}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 8.50210938242297, "get_ui_image": 0.07254531942241307, "step_physics": 0.6563435441052977, "survival_time": 27.90000000000026, "driven_lanedir": 8.410018306558204, "get_state_dump": 0.02782393226896501, "get_robot_state": 0.04885511193591068, "sim_render-ego0": 0.010133358574937195, "sim_render-ego1": 0.008979039883144427, "sim_render-ego2": 0.008335171957135413, "sim_render-ego3": 0.008964007570406619, "get_duckie_state": 4.349113150444781e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.79082935172686, "agent_compute-ego0": 0.1187431172522748, "agent_compute-ego1": 0.1054023647137746, "agent_compute-ego2": 0.10561360101580408, "agent_compute-ego3": 0.10669514531526242, "complete-iteration": 1.3719164864534985, "set_robot_commands": 0.006775779246430917, "deviation-center-line": 1.0424583166628598, "driven_lanedir_consec": 8.410018306558204, "sim_compute_sim_state": 0.04538437846734827, "sim_compute_performance-ego0": 0.00635677544076882, "sim_compute_performance-ego1": 0.004964869862592284, "sim_compute_performance-ego2": 0.00452025162725841, "sim_compute_performance-ego3": 0.0055663461975206845}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 22.4584202936406, "get_ui_image": 0.0847734974180798, "step_physics": 0.9903290893182328, "survival_time": 48.099999999999405, "driven_lanedir": 21.08988072347855, "get_state_dump": 0.027679542143396872, "get_robot_state": 0.04749267049296251, "sim_render-ego0": 0.010024066778482058, "sim_render-ego1": 0.0094257114089538, "sim_render-ego2": 0.008945447757360472, "sim_render-ego3": 0.009545777817010137, "get_duckie_state": 4.57204143330068e-06, "in-drivable-lane": 2.599999999999987, "deviation-heading": 7.488414182630852, "agent_compute-ego0": 0.1268002981956379, "agent_compute-ego1": 0.11449019138934333, "agent_compute-ego2": 0.1099992479243135, "agent_compute-ego3": 0.10878171356296244, "complete-iteration": 1.7611329964016829, "set_robot_commands": 0.006510898455404914, "deviation-center-line": 3.5117593562722984, "driven_lanedir_consec": 21.08988072347855, "sim_compute_sim_state": 0.06171175203095591, "sim_compute_performance-ego0": 0.007230829722165813, "sim_compute_performance-ego1": 0.005673510015691676, "sim_compute_performance-ego2": 0.005237454318307023, "sim_compute_performance-ego3": 0.004995611474026277}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.600709578828434, "get_ui_image": 0.0847734974180798, "step_physics": 0.9903290893182328, "survival_time": 48.099999999999405, "driven_lanedir": 10.92528890466095, "get_state_dump": 0.027679542143396872, "get_robot_state": 0.04749267049296251, "sim_render-ego0": 0.010024066778482058, "sim_render-ego1": 0.0094257114089538, "sim_render-ego2": 0.008945447757360472, "sim_render-ego3": 0.009545777817010137, "get_duckie_state": 4.57204143330068e-06, "in-drivable-lane": 1.2500000000000044, "deviation-heading": 14.88277701798551, "agent_compute-ego0": 0.1268002981956379, "agent_compute-ego1": 0.11449019138934333, "agent_compute-ego2": 0.1099992479243135, "agent_compute-ego3": 0.10878171356296244, "complete-iteration": 1.7611329964016829, "set_robot_commands": 0.006510898455404914, "deviation-center-line": 4.685258885331869, "driven_lanedir_consec": 10.92528890466095, "sim_compute_sim_state": 0.06171175203095591, "sim_compute_performance-ego0": 0.007230829722165813, "sim_compute_performance-ego1": 0.005673510015691676, "sim_compute_performance-ego2": 0.005237454318307023, "sim_compute_performance-ego3": 0.004995611474026277}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.882625929480804, "get_ui_image": 0.0847734974180798, "step_physics": 0.9903290893182328, "survival_time": 48.099999999999405, "driven_lanedir": 14.082195873383895, "get_state_dump": 0.027679542143396872, "get_robot_state": 0.04749267049296251, "sim_render-ego0": 0.010024066778482058, "sim_render-ego1": 0.0094257114089538, "sim_render-ego2": 0.008945447757360472, "sim_render-ego3": 0.009545777817010137, "get_duckie_state": 4.57204143330068e-06, "in-drivable-lane": 1.4500000000000108, "deviation-heading": 6.631339641284122, "agent_compute-ego0": 0.1268002981956379, "agent_compute-ego1": 0.11449019138934333, "agent_compute-ego2": 0.1099992479243135, "agent_compute-ego3": 0.10878171356296244, "complete-iteration": 1.7611329964016829, "set_robot_commands": 0.006510898455404914, "deviation-center-line": 3.3761229140722087, "driven_lanedir_consec": 14.082195873383895, "sim_compute_sim_state": 0.06171175203095591, "sim_compute_performance-ego0": 0.007230829722165813, "sim_compute_performance-ego1": 0.005673510015691676, "sim_compute_performance-ego2": 0.005237454318307023, "sim_compute_performance-ego3": 0.004995611474026277}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.288432337203725, "get_ui_image": 0.0847734974180798, "step_physics": 0.9903290893182328, "survival_time": 48.099999999999405, "driven_lanedir": 10.909233457179283, "get_state_dump": 0.027679542143396872, "get_robot_state": 0.04749267049296251, "sim_render-ego0": 0.010024066778482058, "sim_render-ego1": 0.0094257114089538, "sim_render-ego2": 0.008945447757360472, "sim_render-ego3": 0.009545777817010137, "get_duckie_state": 4.57204143330068e-06, "in-drivable-lane": 0.3500000000000032, "deviation-heading": 10.291517953394273, "agent_compute-ego0": 0.1268002981956379, "agent_compute-ego1": 0.11449019138934333, "agent_compute-ego2": 0.1099992479243135, "agent_compute-ego3": 0.10878171356296244, "complete-iteration": 1.7611329964016829, "set_robot_commands": 0.006510898455404914, "deviation-center-line": 3.973005565851766, "driven_lanedir_consec": 10.909233457179283, "sim_compute_sim_state": 0.06171175203095591, "sim_compute_performance-ego0": 0.007230829722165813, "sim_compute_performance-ego1": 0.005673510015691676, "sim_compute_performance-ego2": 0.005237454318307023, "sim_compute_performance-ego3": 0.004995611474026277}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.289474282206614, "get_ui_image": 0.07922077972128433, "step_physics": 0.8101696114250825, "survival_time": 25.500000000000227, "driven_lanedir": 8.76615241756709, "get_state_dump": 0.027250939385998273, "get_robot_state": 0.05132073805523479, "sim_render-ego0": 0.009631125194452514, "sim_render-ego1": 0.00878328399882158, "sim_render-ego2": 0.009189772279295202, "sim_render-ego3": 0.008439490473200431, "get_duckie_state": 4.659660175121927e-06, "in-drivable-lane": 7.0000000000000995, "deviation-heading": 3.355866733742272, "agent_compute-ego0": 0.12524239004474796, "agent_compute-ego1": 0.1065439118797765, "agent_compute-ego2": 0.10637909792174098, "agent_compute-ego3": 0.10592519980354086, "complete-iteration": 1.5467396174391654, "set_robot_commands": 0.006686714530691008, "deviation-center-line": 1.1572362815813495, "driven_lanedir_consec": 8.76615241756709, "sim_compute_sim_state": 0.051718041388255975, "sim_compute_performance-ego0": 0.005944077982594589, "sim_compute_performance-ego1": 0.0047186377463742015, "sim_compute_performance-ego2": 0.004887126429906796, "sim_compute_performance-ego3": 0.005261723542633355}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.634422435690906, "get_ui_image": 0.07922077972128433, "step_physics": 0.8101696114250825, "survival_time": 25.500000000000227, "driven_lanedir": 3.060634333986818, "get_state_dump": 0.027250939385998273, "get_robot_state": 0.05132073805523479, "sim_render-ego0": 0.009631125194452514, "sim_render-ego1": 0.00878328399882158, "sim_render-ego2": 0.009189772279295202, "sim_render-ego3": 0.008439490473200431, "get_duckie_state": 4.659660175121927e-06, "in-drivable-lane": 1.3000000000000007, "deviation-heading": 9.103409844428269, "agent_compute-ego0": 0.12524239004474796, "agent_compute-ego1": 0.1065439118797765, "agent_compute-ego2": 0.10637909792174098, "agent_compute-ego3": 0.10592519980354086, "complete-iteration": 1.5467396174391654, "set_robot_commands": 0.006686714530691008, "deviation-center-line": 3.5437718854438516, "driven_lanedir_consec": 3.060634333986818, "sim_compute_sim_state": 0.051718041388255975, "sim_compute_performance-ego0": 0.005944077982594589, "sim_compute_performance-ego1": 0.0047186377463742015, "sim_compute_performance-ego2": 0.004887126429906796, "sim_compute_performance-ego3": 0.005261723542633355}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 4.131995111470532, "get_ui_image": 0.07922077972128433, "step_physics": 0.8101696114250825, "survival_time": 25.500000000000227, "driven_lanedir": 4.082488962295669, "get_state_dump": 0.027250939385998273, "get_robot_state": 0.05132073805523479, "sim_render-ego0": 0.009631125194452514, "sim_render-ego1": 0.00878328399882158, "sim_render-ego2": 0.009189772279295202, "sim_render-ego3": 0.008439490473200431, "get_duckie_state": 4.659660175121927e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.200506294096474, "agent_compute-ego0": 0.12524239004474796, "agent_compute-ego1": 0.1065439118797765, "agent_compute-ego2": 0.10637909792174098, "agent_compute-ego3": 0.10592519980354086, "complete-iteration": 1.5467396174391654, "set_robot_commands": 0.006686714530691008, "deviation-center-line": 2.793224769868812, "driven_lanedir_consec": 4.082488962295669, "sim_compute_sim_state": 0.051718041388255975, "sim_compute_performance-ego0": 0.005944077982594589, "sim_compute_performance-ego1": 0.0047186377463742015, "sim_compute_performance-ego2": 0.004887126429906796, "sim_compute_performance-ego3": 0.005261723542633355}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.166247135608948, "get_ui_image": 0.07922077972128433, "step_physics": 0.8101696114250825, "survival_time": 25.500000000000227, "driven_lanedir": 11.573623696993607, "get_state_dump": 0.027250939385998273, "get_robot_state": 0.05132073805523479, "sim_render-ego0": 0.009631125194452514, "sim_render-ego1": 0.00878328399882158, "sim_render-ego2": 0.009189772279295202, "sim_render-ego3": 0.008439490473200431, "get_duckie_state": 4.659660175121927e-06, "in-drivable-lane": 1.050000000000015, "deviation-heading": 3.939493375876067, "agent_compute-ego0": 0.12524239004474796, "agent_compute-ego1": 0.1065439118797765, "agent_compute-ego2": 0.10637909792174098, "agent_compute-ego3": 0.10592519980354086, "complete-iteration": 1.5467396174391654, "set_robot_commands": 0.006686714530691008, "deviation-center-line": 1.548662468903218, "driven_lanedir_consec": 11.573623696993607, "sim_compute_sim_state": 0.051718041388255975, "sim_compute_performance-ego0": 0.005944077982594589, "sim_compute_performance-ego1": 0.0047186377463742015, "sim_compute_performance-ego2": 0.004887126429906796, "sim_compute_performance-ego3": 0.005261723542633355}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 3.542051695809606, "get_ui_image": 0.052316899625410945, "step_physics": 0.34021753850190534, "survival_time": 7.99999999999998, "driven_lanedir": 3.485589746288337, "get_state_dump": 0.021201514309237463, "get_robot_state": 0.02282157595853628, "sim_render-ego0": 0.009861177539233094, "sim_render-ego1": 0.007777449507150591, "get_duckie_state": 4.56845538216348e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1525089054371125, "agent_compute-ego0": 0.12692438001218048, "agent_compute-ego1": 0.10969611428539204, "complete-iteration": 0.7382076216040191, "set_robot_commands": 0.0072102635543538915, "deviation-center-line": 0.5244579909543857, "driven_lanedir_consec": 3.485589746288337, "sim_compute_sim_state": 0.022363387279628968, "sim_compute_performance-ego0": 0.006669679783886264, "sim_compute_performance-ego1": 0.00466912429525245}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 3.222519519891979, "get_ui_image": 0.052316899625410945, "step_physics": 0.34021753850190534, "survival_time": 7.99999999999998, "driven_lanedir": 3.1399072970072126, "get_state_dump": 0.021201514309237463, "get_robot_state": 0.02282157595853628, "sim_render-ego0": 0.009861177539233094, "sim_render-ego1": 0.007777449507150591, "get_duckie_state": 4.56845538216348e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.6314448400562316, "agent_compute-ego0": 0.12692438001218048, "agent_compute-ego1": 0.10969611428539204, "complete-iteration": 0.7382076216040191, "set_robot_commands": 0.0072102635543538915, "deviation-center-line": 0.46580390692958307, "driven_lanedir_consec": 3.1399072970072126, "sim_compute_sim_state": 0.022363387279628968, "sim_compute_performance-ego0": 0.006669679783886264, "sim_compute_performance-ego1": 0.00466912429525245}}
set_robot_commands_max0.0072102635543538915
set_robot_commands_mean0.006736721145629653
set_robot_commands_median0.006686714530691008
set_robot_commands_min0.006510898455404914
sim_compute_performance-ego0_max0.007230829722165813
sim_compute_performance-ego0_mean0.006533292296420673
sim_compute_performance-ego0_median0.00635677544076882
sim_compute_performance-ego0_min0.005944077982594589
sim_compute_performance-ego1_max0.005673510015691676
sim_compute_performance-ego1_mean0.005054737077795538
sim_compute_performance-ego1_median0.004964869862592284
sim_compute_performance-ego1_min0.00466912429525245
sim_compute_sim_state_max0.06171175203095591
sim_compute_sim_state_mean0.048570247293249894
sim_compute_sim_state_median0.051718041388255975
sim_compute_sim_state_min0.022363387279628968
sim_render-ego0_max0.010133358574937195
sim_render-ego0_mean0.009919754090710949
sim_render-ego0_median0.010024066778482058
sim_render-ego0_min0.009631125194452514
sim_render-ego1_max0.0094257114089538
sim_render-ego1_mean0.008879074298427174
sim_render-ego1_median0.008979039883144427
sim_render-ego1_min0.007777449507150591
simulation-passed1
step_physics_max0.9903290893182328
step_physics_mean0.750557432599876
step_physics_median0.8101696114250825
step_physics_min0.34021753850190534
survival_time_max48.099999999999405
survival_time_mean30.14285714285711
survival_time_min7.99999999999998
No reset possible
6233313602Andras Beresfsf+ilaido-LFP-sim-validation350successyesreg030:07:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.674999999999992
in-drivable-lane_median0.0
driven_lanedir_consec_median1.8090297297225213
deviation-center-line_median0.2998538837666246


other stats
agent_compute-ego0_max0.14334747195243835
agent_compute-ego0_mean0.13040448469422283
agent_compute-ego0_median0.13208203397393536
agent_compute-ego0_min0.11410639887658236
complete-iteration_max0.6393658911928217
complete-iteration_mean0.5664272695120456
complete-iteration_median0.5647829383822272
complete-iteration_min0.4967773100909065
deviation-center-line_max0.4257199605729894
deviation-center-line_mean0.30431052215105414
deviation-center-line_min0.19181436049797795
deviation-heading_max1.214770654593495
deviation-heading_mean0.7869451226663189
deviation-heading_median0.7747365703146812
deviation-heading_min0.38353669544241825
driven_any_max2.646667534116804
driven_any_mean1.7158743215256218
driven_any_median1.837969937471437
driven_any_min0.540889877042809
driven_lanedir_consec_max2.593616185382574
driven_lanedir_consec_mean1.6864801695931515
driven_lanedir_consec_min0.53424503354499
driven_lanedir_max2.593616185382574
driven_lanedir_mean1.6864801695931515
driven_lanedir_median1.8090297297225213
driven_lanedir_min0.53424503354499
get_duckie_state_max0.08028796900098568
get_duckie_state_mean0.05516237964155505
get_duckie_state_median0.06304141370261587
get_duckie_state_min0.014278722160002763
get_robot_state_max0.01202094554901123
get_robot_state_mean0.010642211509922606
get_robot_state_median0.010516076349647931
get_robot_state_min0.009515747791383323
get_state_dump_max0.03722915243595205
get_state_dump_mean0.03194892588088812
get_state_dump_median0.03166662006928897
get_state_dump_min0.027233310949022524
get_ui_image_max0.08288836986460585
get_ui_image_mean0.06532945120952517
get_ui_image_median0.06310011869360543
get_ui_image_min0.05222919758628397
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.2158609502276843, "get_ui_image": 0.05633812752839561, "step_physics": 0.19012585978641688, "survival_time": 5.299999999999989, "driven_lanedir": 2.189215031771119, "get_state_dump": 0.027233310949022524, "get_robot_state": 0.011400868959516008, "sim_render-ego0": 0.009305918328115873, "get_duckie_state": 0.08028796900098568, "in-drivable-lane": 0.0, "deviation-heading": 0.7706741729104595, "agent_compute-ego0": 0.11410639887658236, "complete-iteration": 0.5219245112944986, "set_robot_commands": 0.006920402295121523, "deviation-center-line": 0.32237896476739686, "driven_lanedir_consec": 2.189215031771119, "sim_compute_sim_state": 0.020302473941696025, "sim_compute_performance-ego0": 0.005693428984312254}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.540889877042809, "get_ui_image": 0.08288836986460585, "step_physics": 0.26642922644919537, "survival_time": 2.3, "driven_lanedir": 0.53424503354499, "get_state_dump": 0.03722915243595205, "get_robot_state": 0.009631283739779858, "sim_render-ego0": 0.010076061208197411, "get_duckie_state": 0.06368470191955566, "in-drivable-lane": 0.0, "deviation-heading": 0.38353669544241825, "agent_compute-ego0": 0.1373368628481601, "complete-iteration": 0.6393658911928217, "set_robot_commands": 0.0051663276997018365, "deviation-center-line": 0.19181436049797795, "driven_lanedir_consec": 0.53424503354499, "sim_compute_sim_state": 0.021165244122768972, "sim_compute_performance-ego0": 0.0055636547981424535}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.4600789247151902, "get_ui_image": 0.06986210985881526, "step_physics": 0.2445853803215957, "survival_time": 4.049999999999994, "driven_lanedir": 1.428844427673923, "get_state_dump": 0.034542694324400366, "get_robot_state": 0.009515747791383323, "sim_render-ego0": 0.01000609048982946, "get_duckie_state": 0.06239812548567609, "in-drivable-lane": 0.0, "deviation-heading": 0.778798967718903, "agent_compute-ego0": 0.1268272050997106, "complete-iteration": 0.6076413654699558, "set_robot_commands": 0.008053640039955698, "deviation-center-line": 0.27732880276585226, "driven_lanedir_consec": 1.428844427673923, "sim_compute_sim_state": 0.033821315300173876, "sim_compute_performance-ego0": 0.00782610148918338}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.646667534116804, "get_ui_image": 0.05222919758628397, "step_physics": 0.20823130011558533, "survival_time": 6.749999999999984, "driven_lanedir": 2.593616185382574, "get_state_dump": 0.02879054581417757, "get_robot_state": 0.01202094554901123, "sim_render-ego0": 0.009138442137662102, "get_duckie_state": 0.014278722160002763, "in-drivable-lane": 0.0, "deviation-heading": 1.214770654593495, "agent_compute-ego0": 0.14334747195243835, "complete-iteration": 0.4967773100909065, "set_robot_commands": 0.005926055066725787, "deviation-center-line": 0.4257199605729894, "driven_lanedir_consec": 2.593616185382574, "sim_compute_sim_state": 0.01666175968506757, "sim_compute_performance-ego0": 0.0059552788734436035}}
set_robot_commands_max0.008053640039955698
set_robot_commands_mean0.006516606275376211
set_robot_commands_median0.006423228680923655
set_robot_commands_min0.0051663276997018365
sim_compute_performance-ego0_max0.00782610148918338
sim_compute_performance-ego0_mean0.006259616036270422
sim_compute_performance-ego0_median0.0058243539288779286
sim_compute_performance-ego0_min0.0055636547981424535
sim_compute_sim_state_max0.033821315300173876
sim_compute_sim_state_mean0.022987698262426613
sim_compute_sim_state_median0.020733859032232495
sim_compute_sim_state_min0.01666175968506757
sim_render-ego0_max0.010076061208197411
sim_render-ego0_mean0.009631628040951213
sim_render-ego0_median0.009656004408972666
sim_render-ego0_min0.009138442137662102
simulation-passed1
step_physics_max0.26642922644919537
step_physics_mean0.22734294166819832
step_physics_median0.22640834021859052
step_physics_min0.19012585978641688
survival_time_max6.749999999999984
survival_time_mean4.5999999999999925
survival_time_min2.3
No reset possible
6232813625Raphael Jeanmobile-segmentationaido-LF-sim-testing348successyesreg031:15:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median27.08094353965123
survival_time_median59.99999999999873
deviation-center-line_median2.2380167499071684
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.22235553151463391
agent_compute-ego0_mean0.2047275240276378
agent_compute-ego0_median0.2050118714347668
agent_compute-ego0_min0.18653082172638372
complete-iteration_max0.709567901990892
complete-iteration_mean0.5993273806115372
complete-iteration_median0.5762833690365388
complete-iteration_min0.5351748823821793
deviation-center-line_max2.520152405316696
deviation-center-line_mean2.1713494957385007
deviation-center-line_min1.6892120778229691
deviation-heading_max9.388615175544205
deviation-heading_mean8.870177650591636
deviation-heading_median9.005380673000724
deviation-heading_min8.08133408082089
driven_any_max28.09484032099536
driven_any_mean27.575385347389755
driven_any_median27.573132108742097
driven_any_min27.06043685107947
driven_lanedir_consec_max27.64823111578472
driven_lanedir_consec_mean26.592373500848847
driven_lanedir_consec_min24.559375808308214
driven_lanedir_max27.64823111578472
driven_lanedir_mean26.592373500848847
driven_lanedir_median27.08094353965123
driven_lanedir_min24.559375808308214
get_duckie_state_max3.2012806049890064e-06
get_duckie_state_mean3.0841061118044124e-06
get_duckie_state_median3.1046029630052755e-06
get_duckie_state_min2.925937916218093e-06
get_robot_state_max0.013593681051173276
get_robot_state_mean0.012891594317433835
get_robot_state_median0.012771607537154454
get_robot_state_min0.01242948114425316
get_state_dump_max0.025849687368248424
get_state_dump_mean0.020836167937015912
get_state_dump_median0.02026980177349691
get_state_dump_min0.016955380832821405
get_ui_image_max0.07207690369179603
get_ui_image_mean0.058067835389724085
get_ui_image_median0.054392719149688795
get_ui_image_min0.0514089995677227
in-drivable-lane_max5.09999999999984
in-drivable-lane_mean1.27499999999996
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 27.910673532715855, "get_ui_image": 0.052106813030576425, "step_physics": 0.2267285256858273, "survival_time": 59.99999999999873, "driven_lanedir": 27.54796801735067, "get_state_dump": 0.017971684593245153, "get_robot_state": 0.012547373076858966, "sim_render-ego0": 0.01049881592876806, "get_duckie_state": 2.925937916218093e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.08133408082089, "agent_compute-ego0": 0.20751675042780512, "complete-iteration": 0.5690326797872857, "set_robot_commands": 0.009632149306463262, "deviation-center-line": 1.6892120778229691, "driven_lanedir_consec": 27.54796801735067, "sim_compute_sim_state": 0.024595106174110076, "sim_compute_performance-ego0": 0.007243743645559243}, "LF-norm-zigzag-000-ego0": {"driven_any": 27.06043685107947, "get_ui_image": 0.07207690369179603, "step_physics": 0.3119478261441017, "survival_time": 59.99999999999873, "driven_lanedir": 26.61391906195179, "get_state_dump": 0.025849687368248424, "get_robot_state": 0.01299584199744994, "sim_render-ego0": 0.011722339380789955, "get_duckie_state": 3.125844251901085e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.17356600256098, "agent_compute-ego0": 0.22235553151463391, "complete-iteration": 0.709567901990892, "set_robot_commands": 0.008595712178950504, "deviation-center-line": 2.520152405316696, "driven_lanedir_consec": 26.61391906195179, "sim_compute_sim_state": 0.03634823589499646, "sim_compute_performance-ego0": 0.007481391781275715}, "LF-norm-techtrack-000-ego0": {"driven_any": 27.235590684768336, "get_ui_image": 0.056678625268801165, "step_physics": 0.2550084106531072, "survival_time": 59.99999999999873, "driven_lanedir": 24.559375808308214, "get_state_dump": 0.016955380832821405, "get_robot_state": 0.01242948114425316, "sim_render-ego0": 0.01098535122422751, "get_duckie_state": 3.083361674109466e-06, "in-drivable-lane": 5.09999999999984, "deviation-heading": 9.388615175544205, "agent_compute-ego0": 0.18653082172638372, "complete-iteration": 0.5835340582857919, "set_robot_commands": 0.0078479261025104, "deviation-center-line": 2.47587700232883, "driven_lanedir_consec": 24.559375808308214, "sim_compute_sim_state": 0.030332852759825796, "sim_compute_performance-ego0": 0.006567533367579426}, "LF-norm-small_loop-000-ego0": {"driven_any": 28.09484032099536, "get_ui_image": 0.0514089995677227, "step_physics": 0.1980447663951178, "survival_time": 59.99999999999873, "driven_lanedir": 27.64823111578472, "get_state_dump": 0.022567918953748663, "get_robot_state": 0.013593681051173276, "sim_render-ego0": 0.01094813569201518, "get_duckie_state": 3.2012806049890064e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.837195343440468, "agent_compute-ego0": 0.20250699244172848, "complete-iteration": 0.5351748823821793, "set_robot_commands": 0.009550983363841596, "deviation-center-line": 2.0001564974855066, "driven_lanedir_consec": 27.64823111578472, "sim_compute_sim_state": 0.019052135656517213, "sim_compute_performance-ego0": 0.007302974681870129}}
set_robot_commands_max0.009632149306463262
set_robot_commands_mean0.008906692737941441
set_robot_commands_median0.00907334777139605
set_robot_commands_min0.0078479261025104
sim_compute_performance-ego0_max0.007481391781275715
sim_compute_performance-ego0_mean0.007148910869071128
sim_compute_performance-ego0_median0.007273359163714686
sim_compute_performance-ego0_min0.006567533367579426
sim_compute_sim_state_max0.03634823589499646
sim_compute_sim_state_mean0.027582082621362383
sim_compute_sim_state_median0.027463979466967936
sim_compute_sim_state_min0.019052135656517213
sim_render-ego0_max0.011722339380789955
sim_render-ego0_mean0.011038660556450176
sim_render-ego0_median0.010966743458121344
sim_render-ego0_min0.01049881592876806
simulation-passed1
step_physics_max0.3119478261441017
step_physics_mean0.2479323822195385
step_physics_median0.24086846816946725
step_physics_min0.1980447663951178
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6232713631Raphael Jeanmobile-segmentationaido-LFP-sim-testing351successyesreg030:12:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.125000000000021
in-drivable-lane_median0.1999999999999993
driven_lanedir_consec_median2.192125042395335
deviation-center-line_median0.4294712887821197


other stats
agent_compute-ego0_max0.03798381332308054
agent_compute-ego0_mean0.03724121163476457
agent_compute-ego0_median0.037122782854086066
agent_compute-ego0_min0.036735467507805625
complete-iteration_max0.5660070709346496
complete-iteration_mean0.4773663177369183
complete-iteration_median0.49338119173128353
complete-iteration_min0.3566958165504563
deviation-center-line_max0.8317392944240117
deviation-center-line_mean0.4398632684808645
deviation-center-line_min0.06877120193520658
deviation-heading_max2.9506037918101677
deviation-heading_mean1.8210890430516131
deviation-heading_median2.0087832234380465
deviation-heading_min0.3161859335201908
driven_any_max6.149910456750158
driven_any_mean3.183043480899828
driven_any_median3.12179589374021
driven_any_min0.3386716793687344
driven_lanedir_consec_max5.99978693751025
driven_lanedir_consec_mean2.678963718990949
driven_lanedir_consec_min0.33181785366287553
driven_lanedir_max5.99978693751025
driven_lanedir_mean2.678963718990949
driven_lanedir_median2.192125042395335
driven_lanedir_min0.33181785366287553
get_duckie_state_max0.0886224257318597
get_duckie_state_mean0.05876064646989942
get_duckie_state_median0.06641137952631487
get_duckie_state_min0.013597401095108248
get_robot_state_max0.012417454468576531
get_robot_state_mean0.011078433351083989
get_robot_state_median0.011127908486885711
get_robot_state_min0.009640461961987992
get_state_dump_max0.025346799900657253
get_state_dump_mean0.02066103263006456
get_state_dump_median0.02140711232558968
get_state_dump_min0.014483105968421612
get_ui_image_max0.06408706563444891
get_ui_image_mean0.057735862293858346
get_ui_image_median0.059293418166864856
get_ui_image_min0.04826954720725476
in-drivable-lane_max3.2000000000000064
in-drivable-lane_mean0.9000000000000012
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.3386716793687344, "get_ui_image": 0.057787801090039705, "step_physics": 0.18870737050708972, "survival_time": 1.850000000000001, "driven_lanedir": 0.33181785366287553, "get_state_dump": 0.025346799900657253, "get_robot_state": 0.012417454468576531, "sim_render-ego0": 0.009361900781330307, "get_duckie_state": 0.0886224257318597, "in-drivable-lane": 0.0, "deviation-heading": 0.3161859335201908, "agent_compute-ego0": 0.03721043310667339, "complete-iteration": 0.44754196468152496, "set_robot_commands": 0.007520437240600586, "deviation-center-line": 0.06877120193520658, "driven_lanedir_consec": 0.33181785366287553, "sim_compute_sim_state": 0.013842124687997918, "sim_compute_performance-ego0": 0.006497389391848915}, "LFP-norm-zigzag-000-ego0": {"driven_any": 6.149910456750158, "get_ui_image": 0.06408706563444891, "step_physics": 0.30907604129044053, "survival_time": 14.500000000000073, "driven_lanedir": 5.99978693751025, "get_state_dump": 0.021169453552088786, "get_robot_state": 0.01080205432328162, "sim_render-ego0": 0.010511479426905052, "get_duckie_state": 0.06681855355751064, "in-drivable-lane": 0.0, "deviation-heading": 2.7902363069240557, "agent_compute-ego0": 0.03703513260149874, "complete-iteration": 0.5660070709346496, "set_robot_commands": 0.007331599894258165, "deviation-center-line": 0.8317392944240117, "driven_lanedir_consec": 5.99978693751025, "sim_compute_sim_state": 0.03325410151399698, "sim_compute_performance-ego0": 0.0056978951614746936}, "LFP-norm-techtrack-000-ego0": {"driven_any": 5.164481810750428, "get_ui_image": 0.060799035243690014, "step_physics": 0.28910451382398605, "survival_time": 12.750000000000046, "driven_lanedir": 3.546359351442341, "get_state_dump": 0.021644771099090576, "get_robot_state": 0.011453762650489809, "sim_render-ego0": 0.010066747665405272, "get_duckie_state": 0.0660042054951191, "in-drivable-lane": 3.2000000000000064, "deviation-heading": 2.9506037918101677, "agent_compute-ego0": 0.03798381332308054, "complete-iteration": 0.5392204187810421, "set_robot_commands": 0.007548633962869644, "deviation-center-line": 0.6135539204838313, "driven_lanedir_consec": 3.546359351442341, "sim_compute_sim_state": 0.0285083819180727, "sim_compute_performance-ego0": 0.005869660526514053}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.0791099767299916, "get_ui_image": 0.04826954720725476, "step_physics": 0.1946612109600658, "survival_time": 3.4999999999999956, "driven_lanedir": 0.8378907333483296, "get_state_dump": 0.014483105968421612, "get_robot_state": 0.009640461961987992, "sim_render-ego0": 0.010354824469123088, "get_duckie_state": 0.013597401095108248, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 1.2273301399520375, "agent_compute-ego0": 0.036735467507805625, "complete-iteration": 0.3566958165504563, "set_robot_commands": 0.006480337868274098, "deviation-center-line": 0.24538865708040816, "driven_lanedir_consec": 0.8378907333483296, "sim_compute_sim_state": 0.015421568507879553, "sim_compute_performance-ego0": 0.006834896517471528}}
set_robot_commands_max0.007548633962869644
set_robot_commands_mean0.007220252241500623
set_robot_commands_median0.007426018567429376
set_robot_commands_min0.006480337868274098
sim_compute_performance-ego0_max0.006834896517471528
sim_compute_performance-ego0_mean0.006224960399327298
sim_compute_performance-ego0_median0.006183524959181484
sim_compute_performance-ego0_min0.0056978951614746936
sim_compute_sim_state_max0.03325410151399698
sim_compute_sim_state_mean0.022756544156986788
sim_compute_sim_state_median0.021964975212976127
sim_compute_sim_state_min0.013842124687997918
sim_render-ego0_max0.010511479426905052
sim_render-ego0_mean0.01007373808569093
sim_render-ego0_median0.01021078606726418
sim_render-ego0_min0.009361900781330307
simulation-passed1
step_physics_max0.30907604129044053
step_physics_mean0.2453872841453955
step_physics_median0.24188286239202592
step_physics_min0.18870737050708972
survival_time_max14.500000000000073
survival_time_mean8.150000000000029
survival_time_min1.850000000000001
No reset possible
6232313649Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido-LFV-sim-validation354successyesreg030:33:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.874999999999996
in-drivable-lane_median0.575000000000002
driven_lanedir_consec_median2.7381025113127255
deviation-center-line_median0.48873435290319134


other stats
agent_compute-ego0_max0.04047768592834473
agent_compute-ego0_mean0.03776716365689518
agent_compute-ego0_median0.0388339386621626
agent_compute-ego0_min0.03292309137491079
agent_compute-npc0_max0.088088698387146
agent_compute-npc0_mean0.07402218696358977
agent_compute-npc0_median0.0705996138613672
agent_compute-npc0_min0.06680082174447867
complete-iteration_max1.9352955572665147
complete-iteration_mean1.2354157791124123
complete-iteration_median1.214472759011863
complete-iteration_min0.5774220411594098
deviation-center-line_max1.541040902167358
deviation-center-line_mean0.7347051569897856
deviation-center-line_min0.4203110199854016
deviation-heading_max6.448732182791687
deviation-heading_mean2.894769668092683
deviation-heading_median1.835721399496067
deviation-heading_min1.4589036905869108
driven_any_max9.292571605396583
driven_any_mean4.704885265708527
driven_any_median3.5074988309440993
driven_any_min2.5119717955493246
driven_lanedir_consec_max8.24059926776264
driven_lanedir_consec_mean4.043039517308012
driven_lanedir_consec_min2.4553537788439552
driven_lanedir_max8.24059926776264
driven_lanedir_mean4.043039517308012
driven_lanedir_median2.7381025113127255
driven_lanedir_min2.4553537788439552
get_duckie_state_max5.075533275473309e-06
get_duckie_state_mean4.735527999355068e-06
get_duckie_state_median4.6866527502087575e-06
get_duckie_state_min4.493273221529447e-06
get_robot_state_max0.065453482983587
get_robot_state_mean0.04978630761103813
get_robot_state_median0.05615935054954123
get_robot_state_min0.021373046361483065
get_state_dump_max0.03538048585255941
get_state_dump_mean0.03073408399182862
get_state_dump_median0.033668481209427836
get_state_dump_min0.020218887695899378
get_ui_image_max0.0987873993967436
get_ui_image_mean0.07905531561242465
get_ui_image_median0.08275345087051392
get_ui_image_min0.05192696131192721
in-drivable-lane_max3.2500000000000284
in-drivable-lane_mean1.100000000000008
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 4.169922203937482, "get_ui_image": 0.07667764027913411, "step_physics": 0.42159894699059824, "survival_time": 10.300000000000011, "driven_lanedir": 2.873805504583008, "get_state_dump": 0.03238899696276384, "get_robot_state": 0.04774731253656212, "sim_render-ego0": 0.010850085152520074, "sim_render-npc0": 0.009862715495381378, "sim_render-npc1": 0.011477777923362844, "sim_render-npc2": 0.010754738452929806, "get_duckie_state": 4.533408344655797e-06, "in-drivable-lane": 3.2500000000000284, "deviation-heading": 1.8064738138868408, "agent_compute-ego0": 0.0383977256535332, "agent_compute-npc0": 0.06967487772881696, "agent_compute-npc1": 0.07211329280466273, "agent_compute-npc2": 0.09268022274625476, "complete-iteration": 1.012213693148848, "set_robot_commands": 0.008200237716453663, "deviation-center-line": 0.5209552810544605, "driven_lanedir_consec": 2.873805504583008, "sim_compute_sim_state": 0.054343543766777296, "sim_compute_performance-ego0": 0.009894260461779608, "sim_compute_performance-npc0": 0.007174079544878236, "sim_compute_performance-npc1": 0.006477311037588811, "sim_compute_performance-npc2": 0.0053117632290015475}, "LFV-norm-zigzag-000-ego0": {"driven_any": 9.292571605396583, "get_ui_image": 0.0987873993967436, "step_physics": 1.1523937338822494, "survival_time": 21.800000000000175, "driven_lanedir": 8.24059926776264, "get_state_dump": 0.03494796545609184, "get_robot_state": 0.065453482983587, "sim_render-ego0": 0.010475124865429352, "sim_render-npc0": 0.01061660583286591, "sim_render-npc1": 0.011274839156825155, "sim_render-npc2": 0.011365551697580438, "sim_render-npc3": 0.01176597651955192, "get_duckie_state": 5.075533275473309e-06, "in-drivable-lane": 0.9000000000000048, "deviation-heading": 6.448732182791687, "agent_compute-ego0": 0.03927015167079201, "agent_compute-npc0": 0.07152434999391744, "agent_compute-npc1": 0.07696113979243578, "agent_compute-npc2": 0.0774429646454905, "agent_compute-npc3": 0.07437875287210914, "complete-iteration": 1.9352955572665147, "set_robot_commands": 0.009251006407923227, "deviation-center-line": 1.541040902167358, "driven_lanedir_consec": 8.24059926776264, "sim_compute_sim_state": 0.1104340242302936, "sim_compute_performance-ego0": 0.007271111966270604, "sim_compute_performance-npc0": 0.007158138113654723, "sim_compute_performance-npc1": 0.006277305310596317, "sim_compute_performance-npc2": 0.006444175401595965, "sim_compute_performance-npc3": 0.007107585191181104}, "LFV-norm-techtrack-000-ego0": {"driven_any": 2.845075457950717, "get_ui_image": 0.08882926146189372, "step_physics": 0.6147730509440105, "survival_time": 7.449999999999981, "driven_lanedir": 2.6023995180424433, "get_state_dump": 0.03538048585255941, "get_robot_state": 0.06457138856252034, "sim_render-ego0": 0.01059305985768636, "sim_render-npc0": 0.012271981239318847, "sim_render-npc1": 0.01114675521850586, "sim_render-npc2": 0.010389224688212077, "sim_render-npc3": 0.013337769508361816, "get_duckie_state": 4.839897155761719e-06, "in-drivable-lane": 0.2499999999999991, "deviation-heading": 1.8649689851052935, "agent_compute-ego0": 0.04047768592834473, "agent_compute-npc0": 0.088088698387146, "agent_compute-npc1": 0.08227703253428141, "agent_compute-npc2": 0.08664776802062989, "agent_compute-npc3": 0.08461403369903564, "complete-iteration": 1.416731824874878, "set_robot_commands": 0.007280294100443522, "deviation-center-line": 0.4565134247519221, "driven_lanedir_consec": 2.6023995180424433, "sim_compute_sim_state": 0.09851073424021405, "sim_compute_performance-ego0": 0.007482740084330241, "sim_compute_performance-npc0": 0.0071115875244140625, "sim_compute_performance-npc1": 0.007336344718933106, "sim_compute_performance-npc2": 0.006053606669108073, "sim_compute_performance-npc3": 0.006958942413330078}, "LFV-norm-small_loop-000-ego0": {"driven_any": 2.5119717955493246, "get_ui_image": 0.05192696131192721, "step_physics": 0.31217278700608475, "survival_time": 6.449999999999985, "driven_lanedir": 2.4553537788439552, "get_state_dump": 0.020218887695899378, "get_robot_state": 0.021373046361483065, "sim_render-ego0": 0.009983255312992975, "sim_render-npc0": 0.009823138897235576, "get_duckie_state": 4.493273221529447e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.4589036905869108, "agent_compute-ego0": 0.03292309137491079, "agent_compute-npc0": 0.06680082174447867, "complete-iteration": 0.5774220411594098, "set_robot_commands": 0.008343861653254582, "deviation-center-line": 0.4203110199854016, "driven_lanedir_consec": 2.4553537788439552, "sim_compute_sim_state": 0.02416649598341722, "sim_compute_performance-ego0": 0.007170198513911321, "sim_compute_performance-npc0": 0.006044301619896522}}
set_robot_commands_max0.009251006407923227
set_robot_commands_mean0.008268849969518748
set_robot_commands_median0.008272049684854121
set_robot_commands_min0.007280294100443522
sim_compute_performance-ego0_max0.009894260461779608
sim_compute_performance-ego0_mean0.007954577756572942
sim_compute_performance-ego0_median0.007376926025300422
sim_compute_performance-ego0_min0.007170198513911321
sim_compute_performance-npc0_max0.007174079544878236
sim_compute_performance-npc0_mean0.006872026700710886
sim_compute_performance-npc0_median0.007134862819034393
sim_compute_performance-npc0_min0.006044301619896522
sim_compute_sim_state_max0.1104340242302936
sim_compute_sim_state_mean0.07186369955517555
sim_compute_sim_state_median0.07642713900349567
sim_compute_sim_state_min0.02416649598341722
sim_render-ego0_max0.010850085152520074
sim_render-ego0_mean0.01047538129715719
sim_render-ego0_median0.010534092361557857
sim_render-ego0_min0.009983255312992975
sim_render-npc0_max0.012271981239318847
sim_render-npc0_mean0.010643610366200427
sim_render-npc0_median0.010239660664123644
sim_render-npc0_min0.009823138897235576
simulation-passed1
step_physics_max1.1523937338822494
step_physics_mean0.6252346297057357
step_physics_median0.5181859989673043
step_physics_min0.31217278700608475
survival_time_max21.800000000000175
survival_time_mean11.50000000000004
survival_time_min6.449999999999985
No reset possible
6231613743Frank (Chude) Qian 🇨🇦CBC Net v1aido-LF-sim-validation347successyesreg030:28:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.212919148897283
survival_time_median17.400000000000112
deviation-center-line_median0.6976166677897078
in-drivable-lane_median8.625000000000057


other stats
agent_compute-ego0_max0.10877423469836896
agent_compute-ego0_mean0.09641994965183748
agent_compute-ego0_median0.09433220353273064
agent_compute-ego0_min0.0882411568435197
complete-iteration_max0.4957974887874028
complete-iteration_mean0.4536399828171589
complete-iteration_median0.4484306059358235
complete-iteration_min0.4219012306095857
deviation-center-line_max4.02331688046553
deviation-center-line_mean1.415542205099675
deviation-center-line_min0.2436186043537546
deviation-heading_max19.328873988776504
deviation-heading_mean7.132999814314223
deviation-heading_median4.048526971323312
deviation-heading_min1.106071325833763
driven_any_max24.956531448998955
driven_any_mean10.380608761940236
driven_any_median6.534624355369311
driven_any_min3.4966548880233663
driven_lanedir_consec_max16.604217844348764
driven_lanedir_consec_mean6.103369683835081
driven_lanedir_consec_min1.383422593196992
driven_lanedir_max16.604217844348764
driven_lanedir_mean6.103369683835081
driven_lanedir_median3.212919148897283
driven_lanedir_min1.383422593196992
get_duckie_state_max3.2074346232672316e-06
get_duckie_state_mean3.149710842416304e-06
get_duckie_state_median3.1386476527587877e-06
get_duckie_state_min3.1141134408804086e-06
get_robot_state_max0.014805993667015665
get_robot_state_mean0.012883394141438504
get_robot_state_median0.012757351889397816
get_robot_state_min0.01121287911994272
get_state_dump_max0.02303839921951294
get_state_dump_mean0.02049649100620486
get_state_dump_median0.020563807272119816
get_state_dump_min0.01781995026106687
get_ui_image_max0.06445614333566466
get_ui_image_mean0.05594216621411021
get_ui_image_median0.05521702068273648
get_ui_image_min0.04887848015530322
in-drivable-lane_max14.949999999999642
in-drivable-lane_mean9.63749999999994
in-drivable-lane_min6.350000000000007
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.4966548880233663, "get_ui_image": 0.05405696151182823, "step_physics": 0.20720639794143209, "survival_time": 9.650000000000002, "driven_lanedir": 1.383422593196992, "get_state_dump": 0.01781995026106687, "get_robot_state": 0.011573954955818729, "sim_render-ego0": 0.011455140162989036, "get_duckie_state": 3.147371036490214e-06, "in-drivable-lane": 6.350000000000007, "deviation-heading": 1.106071325833763, "agent_compute-ego0": 0.0882411568435197, "complete-iteration": 0.4288411349365392, "set_robot_commands": 0.00775147098855874, "deviation-center-line": 0.2436186043537546, "driven_lanedir_consec": 1.383422593196992, "sim_compute_sim_state": 0.02403032411005079, "sim_compute_performance-ego0": 0.006502032279968262}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.358746604832792, "get_ui_image": 0.06445614333566466, "step_physics": 0.2519652446111043, "survival_time": 21.850000000000176, "driven_lanedir": 4.946478213636219, "get_state_dump": 0.01858402659359588, "get_robot_state": 0.01121287911994272, "sim_render-ego0": 0.01183757498928401, "get_duckie_state": 3.1299242690273614e-06, "in-drivable-lane": 8.85000000000008, "deviation-heading": 5.1519261486046375, "agent_compute-ego0": 0.09363353034677026, "complete-iteration": 0.4957974887874028, "set_robot_commands": 0.008999820713583193, "deviation-center-line": 0.9831246926762204, "driven_lanedir_consec": 4.946478213636219, "sim_compute_sim_state": 0.02884631559729032, "sim_compute_performance-ego0": 0.006061663366343877}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.71050210590583, "get_ui_image": 0.056377079853644735, "step_physics": 0.20851466564031748, "survival_time": 12.950000000000047, "driven_lanedir": 1.4793600841583463, "get_state_dump": 0.02303839921951294, "get_robot_state": 0.014805993667015665, "sim_render-ego0": 0.010601734198056734, "get_duckie_state": 3.1141134408804086e-06, "in-drivable-lane": 8.400000000000034, "deviation-heading": 2.945127794041988, "agent_compute-ego0": 0.10877423469836896, "complete-iteration": 0.4680200769351079, "set_robot_commands": 0.01039876754467304, "deviation-center-line": 0.4121086429031952, "driven_lanedir_consec": 1.4793600841583463, "sim_compute_sim_state": 0.02807145852309007, "sim_compute_performance-ego0": 0.007215509047875037}, "LF-norm-small_loop-000-ego0": {"driven_any": 24.956531448998955, "get_ui_image": 0.04887848015530322, "step_physics": 0.19419234261524668, "survival_time": 59.99999999999873, "driven_lanedir": 16.604217844348764, "get_state_dump": 0.02254358795064375, "get_robot_state": 0.013940748822976906, "sim_render-ego0": 0.011631790148427742, "get_duckie_state": 3.2074346232672316e-06, "in-drivable-lane": 14.949999999999642, "deviation-heading": 19.328873988776504, "agent_compute-ego0": 0.09503087671869104, "complete-iteration": 0.4219012306095857, "set_robot_commands": 0.00914593223330381, "deviation-center-line": 4.02331688046553, "driven_lanedir_consec": 16.604217844348764, "sim_compute_sim_state": 0.01921472541497808, "sim_compute_performance-ego0": 0.007103218821859876}}
set_robot_commands_max0.01039876754467304
set_robot_commands_mean0.009073997870029694
set_robot_commands_median0.0090728764734435
set_robot_commands_min0.00775147098855874
sim_compute_performance-ego0_max0.007215509047875037
sim_compute_performance-ego0_mean0.006720605879011763
sim_compute_performance-ego0_median0.006802625550914069
sim_compute_performance-ego0_min0.006061663366343877
sim_compute_sim_state_max0.02884631559729032
sim_compute_sim_state_mean0.025040705911352316
sim_compute_sim_state_median0.02605089131657043
sim_compute_sim_state_min0.01921472541497808
sim_render-ego0_max0.01183757498928401
sim_render-ego0_mean0.01138155987468938
sim_render-ego0_median0.01154346515570839
sim_render-ego0_min0.010601734198056734
simulation-passed1
step_physics_max0.2519652446111043
step_physics_mean0.2154696627020251
step_physics_median0.20786053179087477
step_physics_min0.19419234261524668
survival_time_max59.99999999999873
survival_time_mean26.11249999999974
survival_time_min9.650000000000002
No reset possible
6231113749Bea Baselines 🐤template-randomaido-LF-sim-validation347abortedyesreg030:03:16
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The admin aborted the submission.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6229713697Samuel Alexandertemplate-pytorchaido-LF-sim-validation347successyesreg031:06:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8464941611913903
survival_time_median59.99999999999873
deviation-center-line_median1.8420338491866304
in-drivable-lane_median41.849999999999085


other stats
agent_compute-ego0_max0.08186227872310134
agent_compute-ego0_mean0.07719720566302514
agent_compute-ego0_median0.08053103761807964
agent_compute-ego0_min0.06586446869283989
complete-iteration_max0.6127496220289321
complete-iteration_mean0.5282462014445258
complete-iteration_median0.5216579687386924
complete-iteration_min0.45691924627178615
deviation-center-line_max2.7458194638394153
deviation-center-line_mean1.860717228513454
deviation-center-line_min1.0129817518411397
deviation-heading_max24.767285536281634
deviation-heading_mean15.237238137356108
deviation-heading_median15.282975427439412
deviation-heading_min5.615716158263973
driven_any_max8.527385477164719
driven_any_mean8.234551628052921
driven_any_median8.236416269256338
driven_any_min7.937988496534293
driven_lanedir_consec_max2.824355650924622
driven_lanedir_consec_mean1.226459248553775
driven_lanedir_consec_min0.3884930209076974
driven_lanedir_max2.824355650924622
driven_lanedir_mean1.6356805124208742
driven_lanedir_median1.4482714012688238
driven_lanedir_min0.8218235962212271
get_duckie_state_max3.1321967868979628e-06
get_duckie_state_mean3.0168089441812404e-06
get_duckie_state_median2.998396518526228e-06
get_duckie_state_min2.9382459527745434e-06
get_robot_state_max0.014673074020334922
get_robot_state_mean0.013816704559484983
get_robot_state_median0.0139606899266239
get_robot_state_min0.012672364364357216
get_state_dump_max0.026282401605013703
get_state_dump_mean0.021845836970927218
get_state_dump_median0.020913651344877396
get_state_dump_min0.01927364358894037
get_ui_image_max0.06537530920487657
get_ui_image_mean0.0563166126124964
get_ui_image_median0.05521162413836121
get_ui_image_min0.049467892968386634
in-drivable-lane_max50.69999999999878
in-drivable-lane_mean40.524999999999096
in-drivable-lane_min27.699999999999417
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.487745348261301, "get_ui_image": 0.05059430382829423, "step_physics": 0.2818382493065954, "survival_time": 59.99999999999873, "driven_lanedir": 0.8932805327906248, "get_state_dump": 0.01927364358894037, "get_robot_state": 0.012672364364357216, "sim_render-ego0": 0.010737453273293576, "get_duckie_state": 3.0514004824064254e-06, "in-drivable-lane": 50.69999999999878, "deviation-heading": 5.615716158263973, "agent_compute-ego0": 0.06586446869283989, "complete-iteration": 0.4767511278068295, "set_robot_commands": 0.006489960974598805, "deviation-center-line": 1.0129817518411397, "driven_lanedir_consec": 0.8932805327906248, "sim_compute_sim_state": 0.02190097464212867, "sim_compute_performance-ego0": 0.00718164523376414}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.527385477164719, "get_ui_image": 0.06537530920487657, "step_physics": 0.3707977623665561, "survival_time": 59.99999999999873, "driven_lanedir": 2.003262269747023, "get_state_dump": 0.02126633852943592, "get_robot_state": 0.014673074020334922, "sim_render-ego0": 0.012600576550041409, "get_duckie_state": 2.945392554646031e-06, "in-drivable-lane": 35.59999999999937, "deviation-heading": 19.975309285262256, "agent_compute-ego0": 0.08106883538950492, "complete-iteration": 0.6127496220289321, "set_robot_commands": 0.008656337795209924, "deviation-center-line": 2.7458194638394153, "driven_lanedir_consec": 0.3884930209076974, "sim_compute_sim_state": 0.03136353627728185, "sim_compute_performance-ego0": 0.0067575499973725915}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.985087190251376, "get_ui_image": 0.05982894444842819, "step_physics": 0.3330027465518567, "survival_time": 59.99999999999873, "driven_lanedir": 0.8218235962212271, "get_state_dump": 0.026282401605013703, "get_robot_state": 0.013749211555118865, "sim_render-ego0": 0.011826316085485098, "get_duckie_state": 2.9382459527745434e-06, "in-drivable-lane": 48.09999999999881, "deviation-heading": 10.590641569616569, "agent_compute-ego0": 0.08186227872310134, "complete-iteration": 0.5665648096705554, "set_robot_commands": 0.0072495641557501315, "deviation-center-line": 1.076006132311395, "driven_lanedir_consec": 0.7997077895921557, "sim_compute_sim_state": 0.026023775215053637, "sim_compute_performance-ego0": 0.006551508899533084}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.937988496534293, "get_ui_image": 0.049467892968386634, "step_physics": 0.2479751941861955, "survival_time": 59.99999999999873, "driven_lanedir": 2.824355650924622, "get_state_dump": 0.02056096416031887, "get_robot_state": 0.01417216829812894, "sim_render-ego0": 0.01111964877697947, "get_duckie_state": 3.1321967868979628e-06, "in-drivable-lane": 27.699999999999417, "deviation-heading": 24.767285536281634, "agent_compute-ego0": 0.07999323984665438, "complete-iteration": 0.45691924627178615, "set_robot_commands": 0.00807822673743611, "deviation-center-line": 2.608061566061865, "driven_lanedir_consec": 2.824355650924622, "sim_compute_sim_state": 0.018008378622037583, "sim_compute_performance-ego0": 0.007358683634558685}}
set_robot_commands_max0.008656337795209924
set_robot_commands_mean0.007618522415748743
set_robot_commands_median0.00766389544659312
set_robot_commands_min0.006489960974598805
sim_compute_performance-ego0_max0.007358683634558685
sim_compute_performance-ego0_mean0.0069623469413071255
sim_compute_performance-ego0_median0.006969597615568366
sim_compute_performance-ego0_min0.006551508899533084
sim_compute_sim_state_max0.03136353627728185
sim_compute_sim_state_mean0.024324166189125435
sim_compute_sim_state_median0.023962374928591153
sim_compute_sim_state_min0.018008378622037583
sim_render-ego0_max0.012600576550041409
sim_render-ego0_mean0.011570998671449888
sim_render-ego0_median0.011472982431232284
sim_render-ego0_min0.010737453273293576
simulation-passed1
step_physics_max0.3707977623665561
step_physics_mean0.30840348810280094
step_physics_median0.30742049792922604
step_physics_min0.2479751941861955
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6228613723Frank (Chude) Qian 🇨🇦CBC Net v1aido-LF-sim-validation347successyesreg030:46:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median18.22708770068505
survival_time_median59.99999999999873
deviation-center-line_median3.5923072990843834
in-drivable-lane_median6.649999999999865


other stats
agent_compute-ego0_max0.090829262229227
agent_compute-ego0_mean0.0891073934343038
agent_compute-ego0_median0.08935597526540764
agent_compute-ego0_min0.08688836097717285
complete-iteration_max0.47559289332730487
complete-iteration_mean0.4251622795094431
complete-iteration_median0.41582189908531886
complete-iteration_min0.3934124265398298
deviation-center-line_max4.591843933816273
deviation-center-line_mean2.972521663995581
deviation-center-line_min0.11362812399728472
deviation-heading_max21.363012825327445
deviation-heading_mean12.023551335443972
deviation-heading_median13.003337808757887
deviation-heading_min0.7245168989326686
driven_any_max27.205850997519203
driven_any_mean19.20579853709289
driven_any_median23.94827319811339
driven_any_min1.72079675462557
driven_lanedir_consec_max24.83495469004709
driven_lanedir_consec_mean15.477060135131564
driven_lanedir_consec_min0.6191104491090598
driven_lanedir_max24.83495469004709
driven_lanedir_mean15.477060135131564
driven_lanedir_median18.22708770068505
driven_lanedir_min0.6191104491090598
get_duckie_state_max3.127035352213e-06
get_duckie_state_mean2.96882508998868e-06
get_duckie_state_median2.9709170780761933e-06
get_duckie_state_min2.806430851589333e-06
get_robot_state_max0.013396634745855913
get_robot_state_mean0.012722226601702705
get_robot_state_median0.012620432388867106
get_robot_state_min0.012251406883220689
get_state_dump_max0.019442040755488693
get_state_dump_mean0.018145814587985688
get_state_dump_median0.018085039525504512
get_state_dump_min0.016971138545445033
get_ui_image_max0.06162495613098144
get_ui_image_mean0.05240154235587331
get_ui_image_median0.05087306854826128
get_ui_image_min0.046235076195989225
in-drivable-lane_max11.099999999999842
in-drivable-lane_mean6.93749999999989
in-drivable-lane_min3.3499999999999885
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 27.205850997519203, "get_ui_image": 0.04739996436037291, "step_physics": 0.20108249423704375, "survival_time": 59.99999999999873, "driven_lanedir": 24.83495469004709, "get_state_dump": 0.01877881366942546, "get_robot_state": 0.012251406883220689, "sim_render-ego0": 0.010370790710258645, "get_duckie_state": 2.806430851589333e-06, "in-drivable-lane": 3.999999999999961, "deviation-heading": 11.384700885403191, "agent_compute-ego0": 0.08964835674339885, "complete-iteration": 0.41885724671178814, "set_robot_commands": 0.008230251039096855, "deviation-center-line": 4.591843933816273, "driven_lanedir_consec": 24.83495469004709, "sim_compute_sim_state": 0.02429670457736737, "sim_compute_performance-ego0": 0.006599235494964625}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.72079675462557, "get_ui_image": 0.06162495613098144, "step_physics": 0.17050851640247164, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6191104491090598, "get_state_dump": 0.016971138545445033, "get_robot_state": 0.012424157914661223, "sim_render-ego0": 0.009094817297799249, "get_duckie_state": 2.9654729933965774e-06, "in-drivable-lane": 3.3499999999999885, "deviation-heading": 0.7245168989326686, "agent_compute-ego0": 0.08688836097717285, "complete-iteration": 0.3934124265398298, "set_robot_commands": 0.007269520986647833, "deviation-center-line": 0.11362812399728472, "driven_lanedir_consec": 0.6191104491090598, "sim_compute_sim_state": 0.022596082233247303, "sim_compute_performance-ego0": 0.005832844688778832}, "LF-norm-techtrack-000-ego0": {"driven_any": 23.455938341566988, "get_ui_image": 0.054346172736149646, "step_physics": 0.2480906995508097, "survival_time": 59.99999999999873, "driven_lanedir": 18.20792028581749, "get_state_dump": 0.017391265381583563, "get_robot_state": 0.012816706863072989, "sim_render-ego0": 0.010099462625089038, "get_duckie_state": 2.976361162755809e-06, "in-drivable-lane": 11.099999999999842, "deviation-heading": 14.621974732112584, "agent_compute-ego0": 0.08906359378741643, "complete-iteration": 0.47559289332730487, "set_robot_commands": 0.007858382176598542, "deviation-center-line": 3.355858762188386, "driven_lanedir_consec": 18.20792028581749, "sim_compute_sim_state": 0.029684237893872416, "sim_compute_performance-ego0": 0.00603897883234969}, "LF-norm-small_loop-000-ego0": {"driven_any": 24.4406080546598, "get_ui_image": 0.046235076195989225, "step_physics": 0.1988104535181457, "survival_time": 59.99999999999873, "driven_lanedir": 18.24625511555261, "get_state_dump": 0.019442040755488693, "get_robot_state": 0.013396634745855913, "sim_render-ego0": 0.010025846074761004, "get_duckie_state": 3.127035352213e-06, "in-drivable-lane": 9.29999999999977, "deviation-heading": 21.363012825327445, "agent_compute-ego0": 0.090829262229227, "complete-iteration": 0.4127865514588495, "set_robot_commands": 0.008781050960785344, "deviation-center-line": 3.82875583598038, "driven_lanedir_consec": 18.24625511555261, "sim_compute_sim_state": 0.018329734905474786, "sim_compute_performance-ego0": 0.0067369042586327395}}
set_robot_commands_max0.008781050960785344
set_robot_commands_mean0.008034801290782143
set_robot_commands_median0.008044316607847699
set_robot_commands_min0.007269520986647833
sim_compute_performance-ego0_max0.0067369042586327395
sim_compute_performance-ego0_mean0.006301990818681472
sim_compute_performance-ego0_median0.006319107163657157
sim_compute_performance-ego0_min0.005832844688778832
sim_compute_sim_state_max0.029684237893872416
sim_compute_sim_state_mean0.023726689902490463
sim_compute_sim_state_median0.02344639340530734
sim_compute_sim_state_min0.018329734905474786
sim_render-ego0_max0.010370790710258645
sim_render-ego0_mean0.009897729176976984
sim_render-ego0_median0.01006265434992502
sim_render-ego0_min0.009094817297799249
simulation-passed1
step_physics_max0.2480906995508097
step_physics_mean0.2046230409271177
step_physics_median0.19994647387759473
step_physics_min0.17050851640247164
survival_time_max59.99999999999873
survival_time_mean46.299999999999045
survival_time_min5.1999999999999895
No reset possible
6228413725Anthony Courchesne 🇨🇦straightaido-LF-sim-validation347failedyesreg030:03:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6228313728YU CHENBC Net V2aido-LF-sim-validation347failedyesreg030:01:22
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 54, in init
              ||     self.model = cbcNet.get_inference("cbcNet.h5")
              ||   File "/submission/cbcNet.py", line 95, in get_inference
              ||     model.load_weights(weigths)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 2234, in load_weights
              ||     hdf5_format.load_weights_from_hdf5_group(f, self.layers)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/saving/hdf5_format.py", line 685, in load_weights_from_hdf5_group
              ||     raise ValueError('You are trying to load a weight file '
              || ValueError: You are trying to load a weight file containing 21 layers into a model with 19 layers.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 54, in init
              || |     self.model = cbcNet.get_inference("cbcNet.h5")
              || |   File "/submission/cbcNet.py", line 95, in get_inference
              || |     model.load_weights(weigths)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 2234, in load_weights
              || |     hdf5_format.load_weights_from_hdf5_group(f, self.layers)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/saving/hdf5_format.py", line 685, in load_weights_from_hdf5_group
              || |     raise ValueError('You are trying to load a weight file '
              || | ValueError: You are trying to load a weight file containing 21 layers into a model with 19 layers.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6228213728YU CHENBC Net V2aido-LF-sim-validation347failedyesreg030:01:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 54, in init
              ||     self.model = cbcNet.get_inference("cbcNet.h5")
              ||   File "/submission/cbcNet.py", line 95, in get_inference
              ||     model.load_weights(weigths)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 2234, in load_weights
              ||     hdf5_format.load_weights_from_hdf5_group(f, self.layers)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/saving/hdf5_format.py", line 685, in load_weights_from_hdf5_group
              ||     raise ValueError('You are trying to load a weight file '
              || ValueError: You are trying to load a weight file containing 21 layers into a model with 19 layers.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 54, in init
              || |     self.model = cbcNet.get_inference("cbcNet.h5")
              || |   File "/submission/cbcNet.py", line 95, in get_inference
              || |     model.load_weights(weigths)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 2234, in load_weights
              || |     hdf5_format.load_weights_from_hdf5_group(f, self.layers)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/saving/hdf5_format.py", line 685, in load_weights_from_hdf5_group
              || |     raise ValueError('You are trying to load a weight file '
              || | ValueError: You are trying to load a weight file containing 21 layers into a model with 19 layers.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6228113728YU CHENBC Net V2aido-LF-sim-validation347failedyesreg030:01:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 54, in init
              ||     self.model = cbcNet.get_inference("cbcNet.h5")
              ||   File "/submission/cbcNet.py", line 95, in get_inference
              ||     model.load_weights(weigths)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 2234, in load_weights
              ||     hdf5_format.load_weights_from_hdf5_group(f, self.layers)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/saving/hdf5_format.py", line 685, in load_weights_from_hdf5_group
              ||     raise ValueError('You are trying to load a weight file '
              || ValueError: You are trying to load a weight file containing 21 layers into a model with 19 layers.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 54, in init
              || |     self.model = cbcNet.get_inference("cbcNet.h5")
              || |   File "/submission/cbcNet.py", line 95, in get_inference
              || |     model.load_weights(weigths)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 2234, in load_weights
              || |     hdf5_format.load_weights_from_hdf5_group(f, self.layers)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/saving/hdf5_format.py", line 685, in load_weights_from_hdf5_group
              || |     raise ValueError('You are trying to load a weight file '
              || | ValueError: You are trying to load a weight file containing 21 layers into a model with 19 layers.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6227613732YU CHENBC Net V2aido-LF-sim-validation347successyesreg030:28:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.9913481005137057
survival_time_median20.375000000000156
deviation-center-line_median0.8685630680984984
in-drivable-lane_median9.600000000000096


other stats
agent_compute-ego0_max0.09037403937283404
agent_compute-ego0_mean0.08820867491386222
agent_compute-ego0_median0.08867006183260888
agent_compute-ego0_min0.08512053661739703
complete-iteration_max0.466061321567727
complete-iteration_mean0.42274756512613737
complete-iteration_median0.4172754721358285
complete-iteration_min0.39037799466516554
deviation-center-line_max4.02331688046553
deviation-center-line_mean1.5010154052540703
deviation-center-line_min0.2436186043537546
deviation-heading_max19.328873988776504
deviation-heading_mean7.222260072087736
deviation-heading_median4.227047486870339
deviation-heading_min1.106071325833763
driven_any_max24.956531448998955
driven_any_mean10.786572130167336
driven_any_median7.346551091823512
driven_any_min3.4966548880233663
driven_lanedir_consec_max16.604217844348764
driven_lanedir_consec_mean6.492584159643291
driven_lanedir_consec_min1.383422593196992
driven_lanedir_max16.604217844348764
driven_lanedir_mean6.492584159643291
driven_lanedir_median3.9913481005137057
driven_lanedir_min1.383422593196992
get_duckie_state_max3.708093787708648e-06
get_duckie_state_mean3.6223403247583585e-06
get_duckie_state_median3.6737741937815537e-06
get_duckie_state_min3.4337191237616786e-06
get_robot_state_max0.012576173088334183
get_robot_state_mean0.01126324054284332
get_robot_state_median0.011098529329914753
get_robot_state_min0.010279730423209591
get_state_dump_max0.02083617721767251
get_state_dump_mean0.016177842496380237
get_state_dump_median0.01548903623285174
get_state_dump_min0.012897120302144958
get_ui_image_max0.061503607388500754
get_ui_image_mean0.05175985938670609
get_ui_image_median0.05025323508192411
get_ui_image_min0.045029359994475375
in-drivable-lane_max14.949999999999642
in-drivable-lane_mean10.12499999999996
in-drivable-lane_min6.350000000000007
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.4966548880233663, "get_ui_image": 0.045029359994475375, "step_physics": 0.19267606120748615, "survival_time": 9.650000000000002, "driven_lanedir": 1.383422593196992, "get_state_dump": 0.01404401076208685, "get_robot_state": 0.010279730423209591, "sim_render-ego0": 0.007961051980244745, "get_duckie_state": 3.4337191237616786e-06, "in-drivable-lane": 6.350000000000007, "deviation-heading": 1.106071325833763, "agent_compute-ego0": 0.08512053661739703, "complete-iteration": 0.39037799466516554, "set_robot_commands": 0.00694011044256466, "deviation-center-line": 0.2436186043537546, "driven_lanedir_consec": 1.383422593196992, "sim_compute_sim_state": 0.02219044424823879, "sim_compute_performance-ego0": 0.005941717895035891}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.358746604832792, "get_ui_image": 0.061503607388500754, "step_physics": 0.23584199169455053, "survival_time": 21.850000000000176, "driven_lanedir": 4.946478213636219, "get_state_dump": 0.016934061703616627, "get_robot_state": 0.011456415533475137, "sim_render-ego0": 0.009567340759381857, "get_duckie_state": 3.6693599126110337e-06, "in-drivable-lane": 8.85000000000008, "deviation-heading": 5.1519261486046375, "agent_compute-ego0": 0.08921788979883064, "complete-iteration": 0.466061321567727, "set_robot_commands": 0.00850928863978277, "deviation-center-line": 0.9831246926762204, "driven_lanedir_consec": 4.946478213636219, "sim_compute_sim_state": 0.02674657460217062, "sim_compute_performance-ego0": 0.006079069555622258}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.334355578814232, "get_ui_image": 0.052786776761580896, "step_physics": 0.20755400632490895, "survival_time": 18.900000000000137, "driven_lanedir": 3.036217987391191, "get_state_dump": 0.012897120302144958, "get_robot_state": 0.010740643126354367, "sim_render-ego0": 0.008937031109289003, "get_duckie_state": 3.6781884749520736e-06, "in-drivable-lane": 10.350000000000112, "deviation-heading": 3.3021688251360413, "agent_compute-ego0": 0.08812223386638712, "complete-iteration": 0.4203137527355104, "set_robot_commands": 0.007841307758341364, "deviation-center-line": 0.7540014435207765, "driven_lanedir_consec": 3.036217987391191, "sim_compute_sim_state": 0.025765217073989103, "sim_compute_performance-ego0": 0.005462416872814652}, "LF-norm-small_loop-000-ego0": {"driven_any": 24.956531448998955, "get_ui_image": 0.04771969340226732, "step_physics": 0.19932929363774815, "survival_time": 59.99999999999873, "driven_lanedir": 16.604217844348764, "get_state_dump": 0.02083617721767251, "get_robot_state": 0.012576173088334183, "sim_render-ego0": 0.010396706273811842, "get_duckie_state": 3.708093787708648e-06, "in-drivable-lane": 14.949999999999642, "deviation-heading": 19.328873988776504, "agent_compute-ego0": 0.09037403937283404, "complete-iteration": 0.41423719153614663, "set_robot_commands": 0.00861055328883696, "deviation-center-line": 4.02331688046553, "driven_lanedir_consec": 16.604217844348764, "sim_compute_sim_state": 0.01742297406002048, "sim_compute_performance-ego0": 0.006770911760671649}}
set_robot_commands_max0.00861055328883696
set_robot_commands_mean0.007975315032381438
set_robot_commands_median0.008175298199062066
set_robot_commands_min0.00694011044256466
sim_compute_performance-ego0_max0.006770911760671649
sim_compute_performance-ego0_mean0.006063529021036112
sim_compute_performance-ego0_median0.006010393725329074
sim_compute_performance-ego0_min0.005462416872814652
sim_compute_sim_state_max0.02674657460217062
sim_compute_sim_state_mean0.02303130249610475
sim_compute_sim_state_median0.023977830661113947
sim_compute_sim_state_min0.01742297406002048
sim_render-ego0_max0.010396706273811842
sim_render-ego0_mean0.009215532530681862
sim_render-ego0_median0.00925218593433543
sim_render-ego0_min0.007961051980244745
simulation-passed1
step_physics_max0.23584199169455053
step_physics_mean0.20885033821617344
step_physics_median0.20344164998132855
step_physics_min0.19267606120748615
survival_time_max59.99999999999873
survival_time_mean27.599999999999763
survival_time_min9.650000000000002
No reset possible
6227013535András Kalapos 🇭🇺3090aido-LF-sim-validation347successyesreg030:58:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median27.986516281614776
survival_time_median59.99999999999873
deviation-center-line_median2.4359528716209793
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.03463720501114387
agent_compute-ego0_mean0.03305029412491137
agent_compute-ego0_median0.033242449673089654
agent_compute-ego0_min0.031079072142322296
complete-iteration_max0.47115746862584607
complete-iteration_mean0.4019950197003069
complete-iteration_median0.4032585449163165
complete-iteration_min0.33030552034274824
deviation-center-line_max2.5293011530900125
deviation-center-line_mean2.2551887635391905
deviation-center-line_min1.6195481578247903
deviation-heading_max10.40329986466453
deviation-heading_mean8.22597283274032
deviation-heading_median8.580405660374687
deviation-heading_min5.339780145547371
driven_any_max28.624567824583956
driven_any_mean28.30258482312481
driven_any_median28.374571777795826
driven_any_min27.83662791232365
driven_lanedir_consec_max28.225778035276495
driven_lanedir_consec_mean27.903789313996853
driven_lanedir_consec_min27.416346657481363
driven_lanedir_max28.225778035276495
driven_lanedir_mean27.903789313996853
driven_lanedir_median27.986516281614776
driven_lanedir_min27.416346657481363
get_duckie_state_max2.9465836549579452e-06
get_duckie_state_mean2.894671533030336e-06
get_duckie_state_median2.8855397639723244e-06
get_duckie_state_min2.86102294921875e-06
get_robot_state_max0.012667160050061023
get_robot_state_mean0.012086967941525577
get_robot_state_median0.01213060608513647
get_robot_state_min0.011419499545768338
get_state_dump_max0.017854817999491186
get_state_dump_mean0.017165457130371778
get_state_dump_median0.01730233842784618
get_state_dump_min0.016202333666303574
get_ui_image_max0.061465773554666155
get_ui_image_mean0.052433091139019186
get_ui_image_median0.05174228968370169
get_ui_image_min0.044782011634007184
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 28.624567824583956, "get_ui_image": 0.04793064897999379, "step_physics": 0.2165639690316587, "survival_time": 59.99999999999873, "driven_lanedir": 28.054611418691916, "get_state_dump": 0.016782512077185435, "get_robot_state": 0.012667160050061023, "sim_render-ego0": 0.010017294967105048, "get_duckie_state": 2.87491911952442e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.40329986466453, "agent_compute-ego0": 0.03268477402559228, "complete-iteration": 0.37412523468964104, "set_robot_commands": 0.007486195885867104, "deviation-center-line": 2.4583881986797462, "driven_lanedir_consec": 28.054611418691916, "sim_compute_sim_state": 0.023074794669234684, "sim_compute_performance-ego0": 0.006726578014478596}, "LF-norm-zigzag-000-ego0": {"driven_any": 27.83662791232365, "get_ui_image": 0.061465773554666155, "step_physics": 0.2877558998819394, "survival_time": 59.99999999999873, "driven_lanedir": 27.416346657481363, "get_state_dump": 0.017854817999491186, "get_robot_state": 0.012610526207980269, "sim_render-ego0": 0.010381173134644164, "get_duckie_state": 2.9465836549579452e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.72869978922029, "agent_compute-ego0": 0.03380012532058703, "complete-iteration": 0.47115746862584607, "set_robot_commands": 0.008433514888042415, "deviation-center-line": 2.413517544562213, "driven_lanedir_consec": 27.416346657481363, "sim_compute_sim_state": 0.03232504922484081, "sim_compute_performance-ego0": 0.006337653389580542}, "LF-norm-techtrack-000-ego0": {"driven_any": 28.343077973505643, "get_ui_image": 0.0555539303874096, "step_physics": 0.26015218787149624, "survival_time": 59.99999999999873, "driven_lanedir": 27.918421144537636, "get_state_dump": 0.017822164778506924, "get_robot_state": 0.011419499545768338, "sim_render-ego0": 0.009851631177255852, "get_duckie_state": 2.8961604084202294e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.432111531529086, "agent_compute-ego0": 0.03463720501114387, "complete-iteration": 0.432391855142992, "set_robot_commands": 0.007457809583233556, "deviation-center-line": 2.5293011530900125, "driven_lanedir_consec": 27.918421144537636, "sim_compute_sim_state": 0.029590925308786563, "sim_compute_performance-ego0": 0.005709583812907375}, "LF-norm-small_loop-000-ego0": {"driven_any": 28.406065582086, "get_ui_image": 0.044782011634007184, "step_physics": 0.18635302121990627, "survival_time": 59.99999999999873, "driven_lanedir": 28.225778035276495, "get_state_dump": 0.016202333666303574, "get_robot_state": 0.011650685962292674, "sim_render-ego0": 0.009754373667936935, "get_duckie_state": 2.86102294921875e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.339780145547371, "agent_compute-ego0": 0.031079072142322296, "complete-iteration": 0.33030552034274824, "set_robot_commands": 0.007214162470796126, "deviation-center-line": 1.6195481578247903, "driven_lanedir_consec": 28.225778035276495, "sim_compute_sim_state": 0.016452072065736133, "sim_compute_performance-ego0": 0.006625863733537787}}
set_robot_commands_max0.008433514888042415
set_robot_commands_mean0.0076479207069848
set_robot_commands_median0.00747200273455033
set_robot_commands_min0.007214162470796126
sim_compute_performance-ego0_max0.006726578014478596
sim_compute_performance-ego0_mean0.0063499197376260755
sim_compute_performance-ego0_median0.006481758561559164
sim_compute_performance-ego0_min0.005709583812907375
sim_compute_sim_state_max0.03232504922484081
sim_compute_sim_state_mean0.025360710317149544
sim_compute_sim_state_median0.026332859989010624
sim_compute_sim_state_min0.016452072065736133
sim_render-ego0_max0.010381173134644164
sim_render-ego0_mean0.0100011182367355
sim_render-ego0_median0.00993446307218045
sim_render-ego0_min0.009754373667936935
simulation-passed1
step_physics_max0.2877558998819394
step_physics_mean0.23770626950125015
step_physics_median0.23835807845157747
step_physics_min0.18635302121990627
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6226613595Andras Beresfsf+ilaido-LF-sim-validation347successyesreg031:06:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median26.415171908597543
survival_time_median59.99999999999873
deviation-center-line_median3.857676466962904
in-drivable-lane_median1.5999999999999748


other stats
agent_compute-ego0_max0.1281520172916384
agent_compute-ego0_mean0.11744024562994508
agent_compute-ego0_median0.11540852160775394
agent_compute-ego0_min0.11079192201263402
complete-iteration_max0.5794268281731776
complete-iteration_mean0.48239867514515794
complete-iteration_median0.46221438415044547
complete-iteration_min0.4257391041065632
deviation-center-line_max4.09883963327209
deviation-center-line_mean3.895094957883597
deviation-center-line_min3.766187264336489
deviation-heading_max10.263972988362337
deviation-heading_mean9.086792544726569
deviation-heading_median9.401533137691136
deviation-heading_min7.280130915161667
driven_any_max31.04953387551965
driven_any_mean28.601355771541087
driven_any_median27.99927827850854
driven_any_min27.357332653627612
driven_lanedir_consec_max30.516267184022865
driven_lanedir_consec_mean27.337145133724732
driven_lanedir_consec_min26.001969533680978
driven_lanedir_max30.516267184022865
driven_lanedir_mean27.337145133724732
driven_lanedir_median26.415171908597543
driven_lanedir_min26.001969533680978
get_duckie_state_max2.8902049068606563e-06
get_duckie_state_mean2.7844947541782403e-06
get_duckie_state_median2.7667275078588483e-06
get_duckie_state_min2.714319094134608e-06
get_robot_state_max0.01356006958998808
get_robot_state_mean0.012212734734585244
get_robot_state_median0.011982413950212592
get_robot_state_min0.01132604144792771
get_state_dump_max0.022929381172821783
get_state_dump_mean0.018387414235854327
get_state_dump_median0.017382493821111546
get_state_dump_min0.015855288128372433
get_ui_image_max0.06407442517721286
get_ui_image_mean0.05368325315248361
get_ui_image_median0.0517773555776261
get_ui_image_min0.04710387627746938
in-drivable-lane_max4.949999999999896
in-drivable-lane_mean2.0374999999999615
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 31.04953387551965, "get_ui_image": 0.049113591247355315, "step_physics": 0.18153609562476017, "survival_time": 59.99999999999873, "driven_lanedir": 30.516267184022865, "get_state_dump": 0.017249418238021254, "get_robot_state": 0.012112692333478711, "sim_render-ego0": 0.009976231783851796, "get_duckie_state": 2.714319094134608e-06, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 7.280130915161667, "agent_compute-ego0": 0.11992593212588244, "complete-iteration": 0.4257391041065632, "set_robot_commands": 0.005523047578225624, "deviation-center-line": 3.766187264336489, "driven_lanedir_consec": 30.516267184022865, "sim_compute_sim_state": 0.023502198583776012, "sim_compute_performance-ego0": 0.006625101826371598}, "LF-norm-zigzag-000-ego0": {"driven_any": 27.625769392152748, "get_ui_image": 0.06407442517721286, "step_physics": 0.2916595223146513, "survival_time": 59.99999999999873, "driven_lanedir": 26.001969533680978, "get_state_dump": 0.022929381172821783, "get_robot_state": 0.01356006958998808, "sim_render-ego0": 0.010707905449339196, "get_duckie_state": 2.778837027696646e-06, "in-drivable-lane": 2.799999999999944, "deviation-heading": 10.263972988362337, "agent_compute-ego0": 0.1281520172916384, "complete-iteration": 0.5794268281731776, "set_robot_commands": 0.006897493167086307, "deviation-center-line": 3.925413626245063, "driven_lanedir_consec": 26.001969533680978, "sim_compute_sim_state": 0.03384989286640304, "sim_compute_performance-ego0": 0.007418607097184231}, "LF-norm-techtrack-000-ego0": {"driven_any": 28.372787164864334, "get_ui_image": 0.05444111990789688, "step_physics": 0.2530484130043074, "survival_time": 59.99999999999873, "driven_lanedir": 26.06887960631038, "get_state_dump": 0.015855288128372433, "get_robot_state": 0.01185213556694647, "sim_render-ego0": 0.01002762756379419, "get_duckie_state": 2.7546179880210503e-06, "in-drivable-lane": 4.949999999999896, "deviation-heading": 8.690621677988325, "agent_compute-ego0": 0.11079192201263402, "complete-iteration": 0.4959850611039542, "set_robot_commands": 0.005304717699951375, "deviation-center-line": 4.09883963327209, "driven_lanedir_consec": 26.06887960631038, "sim_compute_sim_state": 0.02871532602969256, "sim_compute_performance-ego0": 0.0057656403683702916}, "LF-norm-small_loop-000-ego0": {"driven_any": 27.357332653627612, "get_ui_image": 0.04710387627746938, "step_physics": 0.203331557241308, "survival_time": 59.99999999999873, "driven_lanedir": 26.76146421088471, "get_state_dump": 0.01751556940420184, "get_robot_state": 0.01132604144792771, "sim_render-ego0": 0.009901055487665308, "get_duckie_state": 2.8902049068606563e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.112444597393948, "agent_compute-ego0": 0.11089111108962545, "complete-iteration": 0.4284437071969368, "set_robot_commands": 0.005423458887079574, "deviation-center-line": 3.7899393076807457, "driven_lanedir_consec": 26.76146421088471, "sim_compute_sim_state": 0.01655037694926266, "sim_compute_performance-ego0": 0.006216078574810298}}
set_robot_commands_max0.006897493167086307
set_robot_commands_mean0.0057871793330857195
set_robot_commands_median0.005473253232652599
set_robot_commands_min0.005304717699951375
sim_compute_performance-ego0_max0.007418607097184231
sim_compute_performance-ego0_mean0.006506356966684105
sim_compute_performance-ego0_median0.006420590200590949
sim_compute_performance-ego0_min0.0057656403683702916
sim_compute_sim_state_max0.03384989286640304
sim_compute_sim_state_mean0.02565444860728357
sim_compute_sim_state_median0.026108762306734284
sim_compute_sim_state_min0.01655037694926266
sim_render-ego0_max0.010707905449339196
sim_render-ego0_mean0.010153205071162625
sim_render-ego0_median0.010001929673822992
sim_render-ego0_min0.009901055487665308
simulation-passed1
step_physics_max0.2916595223146513
step_physics_mean0.2323938970462567
step_physics_median0.2281899851228077
step_physics_min0.18153609562476017
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6226313618Raphael Jeanmobile-segmentation-pedestrianaido-LFV-sim-validation354successyesreg030:32:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median7.224999999999982
in-drivable-lane_median0.1999999999999993
driven_lanedir_consec_median2.4759152167420613
deviation-center-line_median0.4099244123253293


other stats
agent_compute-ego0_max0.1408869098214542
agent_compute-ego0_mean0.06146207324892456
agent_compute-ego0_median0.0351770117517102
agent_compute-ego0_min0.03460735967082362
agent_compute-npc0_max0.08006147876862557
agent_compute-npc0_mean0.06729911617799204
agent_compute-npc0_median0.06388190337767177
agent_compute-npc0_min0.06137117918799905
complete-iteration_max1.9089408028541897
complete-iteration_mean1.257688894252515
complete-iteration_median1.2018922062938222
complete-iteration_min0.7180303615682265
deviation-center-line_max1.2129182795722533
deviation-center-line_mean0.5848011094280516
deviation-center-line_min0.3064373334892948
deviation-heading_max4.653109692936553
deviation-heading_mean2.111287204888218
deviation-heading_median1.402864542450153
deviation-heading_min0.9863100417160116
driven_any_max10.250228845955672
driven_any_mean4.345353352703115
driven_any_median2.7352074758298413
driven_any_min1.6607696131971066
driven_lanedir_consec_max9.803064348200822
driven_lanedir_consec_mean4.090326174052562
driven_lanedir_consec_min1.606409914525303
driven_lanedir_max9.803064348200822
driven_lanedir_mean4.090326174052562
driven_lanedir_median2.4759152167420613
driven_lanedir_min1.606409914525303
get_duckie_state_max3.573820763027545e-06
get_duckie_state_mean3.297938317750024e-06
get_duckie_state_median3.2802824232762573e-06
get_duckie_state_min3.057367661420037e-06
get_robot_state_max0.05934880318180207
get_robot_state_mean0.04553902090172019
get_robot_state_median0.04999168320804832
get_robot_state_min0.02282391400898204
get_state_dump_max0.03381658369495023
get_state_dump_mean0.02843896507073311
get_state_dump_median0.02856320436106964
get_state_dump_min0.022812867865842933
get_ui_image_max0.0936831649568781
get_ui_image_mean0.07932238739266705
get_ui_image_median0.08261164660306322
get_ui_image_min0.05838309140766368
in-drivable-lane_max0.849999999999997
in-drivable-lane_mean0.3124999999999989
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 1.6607696131971066, "get_ui_image": 0.07528002729120943, "step_physics": 0.5078980627748155, "survival_time": 4.799999999999991, "driven_lanedir": 1.606409914525303, "get_state_dump": 0.025770364348421393, "get_robot_state": 0.04400868514149459, "sim_render-ego0": 0.00960381006457142, "sim_render-npc0": 0.0092644789784225, "sim_render-npc1": 0.010106738080683445, "sim_render-npc2": 0.00936637219694472, "get_duckie_state": 3.573820763027545e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.9863100417160116, "agent_compute-ego0": 0.03539788600095769, "agent_compute-npc0": 0.0627944076184145, "agent_compute-npc1": 0.06425997891376928, "agent_compute-npc2": 0.0797876746384139, "complete-iteration": 1.0301799626694512, "set_robot_commands": 0.006487497349375302, "deviation-center-line": 0.3064373334892948, "driven_lanedir_consec": 1.606409914525303, "sim_compute_sim_state": 0.0476014982793749, "sim_compute_performance-ego0": 0.005222003484509655, "sim_compute_performance-npc0": 0.006092440221727509, "sim_compute_performance-npc1": 0.005335080254938185, "sim_compute_performance-npc2": 0.005312283014513783}, "LFV-norm-zigzag-000-ego0": {"driven_any": 10.250228845955672, "get_ui_image": 0.0936831649568781, "step_physics": 1.2011586371388523, "survival_time": 24.30000000000021, "driven_lanedir": 9.803064348200822, "get_state_dump": 0.03135604437371788, "get_robot_state": 0.055974681274602055, "sim_render-ego0": 0.009407647091750002, "sim_render-npc0": 0.009182428187658164, "sim_render-npc1": 0.009519548141980808, "sim_render-npc2": 0.010019076678297602, "sim_render-npc3": 0.00953325011157402, "get_duckie_state": 3.333454014584269e-06, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 4.653109692936553, "agent_compute-ego0": 0.034956137502462716, "agent_compute-npc0": 0.06496939913692905, "agent_compute-npc1": 0.06986265309782244, "agent_compute-npc2": 0.07096290490465731, "agent_compute-npc3": 0.06642137513757976, "complete-iteration": 1.9089408028541897, "set_robot_commands": 0.007556569160132438, "deviation-center-line": 1.2129182795722533, "driven_lanedir_consec": 9.803064348200822, "sim_compute_sim_state": 0.10577377058886894, "sim_compute_performance-ego0": 0.006423549730430148, "sim_compute_performance-npc0": 0.005344094192222893, "sim_compute_performance-npc1": 0.005438546625250908, "sim_compute_performance-npc2": 0.0061500909636887195, "sim_compute_performance-npc3": 0.005544280614206678}, "LFV-norm-techtrack-000-ego0": {"driven_any": 2.941591099822759, "get_ui_image": 0.089943265914917, "step_physics": 0.6294338380136798, "survival_time": 7.699999999999981, "driven_lanedir": 2.4593622951197185, "get_state_dump": 0.03381658369495023, "get_robot_state": 0.05934880318180207, "sim_render-ego0": 0.010315144446588332, "sim_render-npc0": 0.010778768600956086, "sim_render-npc1": 0.00938335234119046, "sim_render-npc2": 0.008770559680077337, "sim_render-npc3": 0.009876475795622794, "get_duckie_state": 3.227110831968246e-06, "in-drivable-lane": 0.849999999999997, "deviation-heading": 1.6575278243853162, "agent_compute-ego0": 0.03460735967082362, "agent_compute-npc0": 0.08006147876862557, "agent_compute-npc1": 0.07662856348099246, "agent_compute-npc2": 0.07954491492240659, "agent_compute-npc3": 0.08056075342239873, "complete-iteration": 1.3736044499181932, "set_robot_commands": 0.0071769422100436304, "deviation-center-line": 0.4167208730952399, "driven_lanedir_consec": 2.4593622951197185, "sim_compute_sim_state": 0.09702515602111816, "sim_compute_performance-ego0": 0.005759723724857453, "sim_compute_performance-npc0": 0.006121732342627741, "sim_compute_performance-npc1": 0.0053171050164007375, "sim_compute_performance-npc2": 0.005624480401315996, "sim_compute_performance-npc3": 0.0057955495772823214}, "LFV-norm-small_loop-000-ego0": {"driven_any": 2.5288238518369233, "get_ui_image": 0.05838309140766368, "step_physics": 0.3331872768261853, "survival_time": 6.749999999999984, "driven_lanedir": 2.492468138364404, "get_state_dump": 0.022812867865842933, "get_robot_state": 0.02282391400898204, "sim_render-ego0": 0.00949839809361626, "sim_render-npc0": 0.011949169285157149, "get_duckie_state": 3.057367661420037e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1482012605149896, "agent_compute-ego0": 0.1408869098214542, "agent_compute-npc0": 0.06137117918799905, "complete-iteration": 0.7180303615682265, "set_robot_commands": 0.008424834293477675, "deviation-center-line": 0.4031279515554187, "driven_lanedir_consec": 2.492468138364404, "sim_compute_sim_state": 0.024723361520206228, "sim_compute_performance-ego0": 0.006826172856723561, "sim_compute_performance-npc0": 0.0076125737498788275}}
set_robot_commands_max0.008424834293477675
set_robot_commands_mean0.007411460753257261
set_robot_commands_median0.007366755685088034
set_robot_commands_min0.006487497349375302
sim_compute_performance-ego0_max0.006826172856723561
sim_compute_performance-ego0_mean0.006057862449130204
sim_compute_performance-ego0_median0.0060916367276438
sim_compute_performance-ego0_min0.005222003484509655
sim_compute_performance-npc0_max0.0076125737498788275
sim_compute_performance-npc0_mean0.0062927101266142425
sim_compute_performance-npc0_median0.006107086282177624
sim_compute_performance-npc0_min0.005344094192222893
sim_compute_sim_state_max0.10577377058886894
sim_compute_sim_state_mean0.06878094660239205
sim_compute_sim_state_median0.07231332715024653
sim_compute_sim_state_min0.024723361520206228
sim_render-ego0_max0.010315144446588332
sim_render-ego0_mean0.009706249924131504
sim_render-ego0_median0.00955110407909384
sim_render-ego0_min0.009407647091750002
sim_render-npc0_max0.011949169285157149
sim_render-npc0_mean0.010293711263048474
sim_render-npc0_median0.010021623789689292
sim_render-npc0_min0.009182428187658164
simulation-passed1
step_physics_max1.2011586371388523
step_physics_mean0.6679194536883832
step_physics_median0.5686659503942477
step_physics_min0.3331872768261853
survival_time_max24.30000000000021
survival_time_mean10.887500000000042
survival_time_min4.799999999999991
No reset possible
6225613639Raphael Jeanmobile-segmentationaido-LFV_multi-sim-validation356abortednoreg030:08:27
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6225213640Jean-Sébastien Grondin 🇨🇦exercise_ros_templateaido-LF-sim-testing348failednoreg030:03:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6225013611Raphael Jeanmobile-segmentation-pedestrianaido-LF-sim-validation347failednoreg030:03:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6222413718Frank (Chude) Qian 🇨🇦CBC Net v1aido-LFP_full-sim-validation352successnoreg030:11:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.699999999999989
in-drivable-lane_median1.5749999999999988
driven_lanedir_consec_median2.291111110702868
deviation-center-line_median0.4648421678477903


other stats
agent_compute-ego0_max0.1504630446434021
agent_compute-ego0_mean0.1148484684166737
agent_compute-ego0_median0.10578568454664831
agent_compute-ego0_min0.09735945992999606
complete-iteration_max0.6134590387344361
complete-iteration_mean0.5443993012822608
complete-iteration_median0.5581318760875155
complete-iteration_min0.44787441421957574
deviation-center-line_max0.7078137642898634
deviation-center-line_mean0.4391237950051311
deviation-center-line_min0.11899708003508044
deviation-heading_max3.0237332822901872
deviation-heading_mean1.9313450344435432
deviation-heading_median2.2246188543706653
deviation-heading_min0.25240914674265574
driven_any_max4.280384978304062
driven_any_mean2.8775116884900207
driven_any_median3.3624498293990115
driven_any_min0.5047621168579981
driven_lanedir_consec_max3.289245593489835
driven_lanedir_consec_mean2.092022349499431
driven_lanedir_consec_min0.4966215831021543
driven_lanedir_max3.289245593489835
driven_lanedir_mean2.092022349499431
driven_lanedir_median2.291111110702868
driven_lanedir_min0.4966215831021543
get_duckie_state_max0.10989237427711487
get_duckie_state_mean0.06651694325816604
get_duckie_state_median0.06989410551108978
get_duckie_state_min0.016387187733369717
get_robot_state_max0.015559168422923368
get_robot_state_mean0.011984443224650964
get_robot_state_median0.011129532488198824
get_robot_state_min0.010119539499282838
get_state_dump_max0.04828646779060364
get_state_dump_mean0.03332454872725661
get_state_dump_median0.02937425565583683
get_state_dump_min0.026263215806749132
get_ui_image_max0.06614096760749817
get_ui_image_mean0.06023643512409333
get_ui_image_median0.06147602718365408
get_ui_image_min0.051852718521566955
in-drivable-lane_max2.0999999999999925
in-drivable-lane_mean1.3124999999999976
in-drivable-lane_min0.0
per-episodes
details{"LFP-full-loop-000-ego0": {"driven_any": 0.5047621168579981, "get_ui_image": 0.06614096760749817, "step_physics": 0.15246357321739196, "survival_time": 1.950000000000001, "driven_lanedir": 0.4966215831021543, "get_state_dump": 0.04828646779060364, "get_robot_state": 0.010119539499282838, "sim_render-ego0": 0.018544965982437135, "get_duckie_state": 0.10989237427711487, "in-drivable-lane": 0.0, "deviation-heading": 0.25240914674265574, "agent_compute-ego0": 0.1504630446434021, "complete-iteration": 0.6134590387344361, "set_robot_commands": 0.007872289419174195, "deviation-center-line": 0.11899708003508044, "driven_lanedir_consec": 0.4966215831021543, "sim_compute_sim_state": 0.03498367667198181, "sim_compute_performance-ego0": 0.014455533027648926}, "LFP-full-zigzag-000-ego0": {"driven_any": 4.280384978304062, "get_ui_image": 0.06372338244568408, "step_physics": 0.24951131543398955, "survival_time": 11.300000000000026, "driven_lanedir": 3.289245593489835, "get_state_dump": 0.02678564256508445, "get_robot_state": 0.01171896636223478, "sim_render-ego0": 0.010202938239479905, "get_duckie_state": 0.06925063196257873, "in-drivable-lane": 1.5500000000000034, "deviation-heading": 3.0237332822901872, "agent_compute-ego0": 0.10331798124943536, "complete-iteration": 0.5806354068974566, "set_robot_commands": 0.0070324458739831055, "deviation-center-line": 0.7078137642898634, "driven_lanedir_consec": 3.289245593489835, "sim_compute_sim_state": 0.03262271650037051, "sim_compute_performance-ego0": 0.006224805563031839}, "LFP-full-techtrack-000-ego0": {"driven_any": 3.537953887785479, "get_ui_image": 0.05922867192162408, "step_physics": 0.21549581421746147, "survival_time": 8.949999999999992, "driven_lanedir": 2.3179206994455788, "get_state_dump": 0.026263215806749132, "get_robot_state": 0.01054009861416287, "sim_render-ego0": 0.010470034016503227, "get_duckie_state": 0.07053757905960083, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 2.2734299053064904, "agent_compute-ego0": 0.09735945992999606, "complete-iteration": 0.5356283452775743, "set_robot_commands": 0.007668034235636393, "deviation-center-line": 0.5049856744020254, "driven_lanedir_consec": 2.3179206994455788, "sim_compute_sim_state": 0.031398312250773115, "sim_compute_performance-ego0": 0.006421555413140191}, "LFP-full-small_loop-000-ego0": {"driven_any": 3.1869457710125437, "get_ui_image": 0.051852718521566955, "step_physics": 0.1763617613736321, "survival_time": 8.449999999999985, "driven_lanedir": 2.2643015219601574, "get_state_dump": 0.03196286874658921, "get_robot_state": 0.015559168422923368, "sim_render-ego0": 0.012092037761912628, "get_duckie_state": 0.016387187733369717, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 2.17580780343484, "agent_compute-ego0": 0.10825338784386128, "complete-iteration": 0.44787441421957574, "set_robot_commands": 0.011658006555893842, "deviation-center-line": 0.42469866129355527, "driven_lanedir_consec": 2.2643015219601574, "sim_compute_sim_state": 0.01703458533567541, "sim_compute_performance-ego0": 0.006484413146972656}}
set_robot_commands_max0.011658006555893842
set_robot_commands_mean0.008557694021171885
set_robot_commands_median0.007770161827405294
set_robot_commands_min0.0070324458739831055
sim_compute_performance-ego0_max0.014455533027648926
sim_compute_performance-ego0_mean0.008396576787698402
sim_compute_performance-ego0_median0.0064529842800564235
sim_compute_performance-ego0_min0.006224805563031839
sim_compute_sim_state_max0.03498367667198181
sim_compute_sim_state_mean0.02900982268970021
sim_compute_sim_state_median0.032010514375571814
sim_compute_sim_state_min0.01703458533567541
sim_render-ego0_max0.018544965982437135
sim_render-ego0_mean0.012827494000083223
sim_render-ego0_median0.011281035889207928
sim_render-ego0_min0.010202938239479905
simulation-passed1
step_physics_max0.24951131543398955
step_physics_mean0.1984581160606188
step_physics_median0.1959287877955468
step_physics_min0.15246357321739196
survival_time_max11.300000000000026
survival_time_mean7.6625
survival_time_min1.950000000000001
No reset possible
6221613710Frank (Chude) Qian 🇨🇦CBC Net v1aido-LFP_full-sim-validation352successnoreg030:09:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median5.4999999999999885
in-drivable-lane_median2.524999999999993
driven_lanedir_consec_median0.7953470318297542
deviation-center-line_median0.23348203947172785


other stats
agent_compute-ego0_max0.11130531348846032
agent_compute-ego0_mean0.10406494402734193
agent_compute-ego0_median0.10398845032696084
agent_compute-ego0_min0.09697756196698572
complete-iteration_max0.5720552263806045
complete-iteration_mean0.4787680729390338
complete-iteration_median0.4951650600928766
complete-iteration_min0.3526869451897776
deviation-center-line_max0.240311195377145
deviation-center-line_mean0.2000192562286464
deviation-center-line_min0.09280175059398504
deviation-heading_max1.7117012768764812
deviation-heading_mean1.1453249855917254
deviation-heading_median1.2449051433462608
deviation-heading_min0.3797883787978987
driven_any_max4.086233945769502
driven_any_mean2.055714727795002
driven_any_median1.7052033367332815
driven_any_min0.7262182919439427
driven_lanedir_consec_max1.7201388272425344
driven_lanedir_consec_mean0.9345474131275292
driven_lanedir_consec_min0.4273567616080736
driven_lanedir_max1.7201388272425344
driven_lanedir_mean0.9345474131275292
driven_lanedir_median0.7953470318297542
driven_lanedir_min0.4273567616080736
get_duckie_state_max0.0919137651270086
get_duckie_state_mean0.06306748080363295
get_duckie_state_median0.07341486124815319
get_duckie_state_min0.01352643559121678
get_robot_state_max0.014271074454689866
get_robot_state_mean0.012074289630266667
get_robot_state_median0.011812792534647697
get_robot_state_min0.01040049899708141
get_state_dump_max0.03147516376646605
get_state_dump_mean0.02704684895661863
get_state_dump_median0.02828985437170252
get_state_dump_min0.02013252331660344
get_ui_image_max0.07221066479115759
get_ui_image_mean0.05820419041603839
get_ui_image_median0.057271715882536656
get_ui_image_min0.04606266510792267
in-drivable-lane_max6.700000000000021
in-drivable-lane_mean3.300000000000001
in-drivable-lane_min1.449999999999998
per-episodes
details{"LFP-full-loop-000-ego0": {"driven_any": 0.7262182919439427, "get_ui_image": 0.05540503155101429, "step_physics": 0.12093074971979316, "survival_time": 2.6999999999999984, "driven_lanedir": 0.4273567616080736, "get_state_dump": 0.029605371301824397, "get_robot_state": 0.01040049899708141, "sim_render-ego0": 0.010553784803910688, "get_duckie_state": 0.0919137651270086, "in-drivable-lane": 1.449999999999998, "deviation-heading": 0.3797883787978987, "agent_compute-ego0": 0.1061559026891535, "complete-iteration": 0.4631298368627375, "set_robot_commands": 0.009720867330377752, "deviation-center-line": 0.09280175059398504, "driven_lanedir_consec": 0.4273567616080736, "sim_compute_sim_state": 0.02049547108736905, "sim_compute_performance-ego0": 0.007703928513960405}, "LFP-full-zigzag-000-ego0": {"driven_any": 4.086233945769502, "get_ui_image": 0.07221066479115759, "step_physics": 0.2033328190774119, "survival_time": 11.300000000000026, "driven_lanedir": 1.7201388272425344, "get_state_dump": 0.03147516376646605, "get_robot_state": 0.014271074454689866, "sim_render-ego0": 0.012390821515726095, "get_duckie_state": 0.0746173942666747, "in-drivable-lane": 6.700000000000021, "deviation-heading": 1.27373049508981, "agent_compute-ego0": 0.11130531348846032, "complete-iteration": 0.5720552263806045, "set_robot_commands": 0.008310436677302559, "deviation-center-line": 0.2285906868641777, "driven_lanedir_consec": 1.7201388272425344, "sim_compute_sim_state": 0.03743290271002816, "sim_compute_performance-ego0": 0.0064615520611733595}, "LFP-full-techtrack-000-ego0": {"driven_any": 1.5771963706853036, "get_ui_image": 0.059138400214059014, "step_physics": 0.19996544292994908, "survival_time": 5.1999999999999895, "driven_lanedir": 0.8131636214628908, "get_state_dump": 0.02697433744158064, "get_robot_state": 0.012180480502900624, "sim_render-ego0": 0.010165250869024369, "get_duckie_state": 0.0722123282296317, "in-drivable-lane": 1.8999999999999944, "deviation-heading": 1.7117012768764812, "agent_compute-ego0": 0.10182099796476818, "complete-iteration": 0.5272002833230155, "set_robot_commands": 0.007169235320318313, "deviation-center-line": 0.240311195377145, "driven_lanedir_consec": 0.8131636214628908, "sim_compute_sim_state": 0.03032314209710984, "sim_compute_performance-ego0": 0.007001699720110212}, "LFP-full-small_loop-000-ego0": {"driven_any": 1.83321030278126, "get_ui_image": 0.04606266510792267, "step_physics": 0.1186390228760548, "survival_time": 5.799999999999987, "driven_lanedir": 0.7775304421966176, "get_state_dump": 0.02013252331660344, "get_robot_state": 0.011445104566394772, "sim_render-ego0": 0.011382565539107364, "get_duckie_state": 0.01352643559121678, "in-drivable-lane": 3.149999999999991, "deviation-heading": 1.2160797916027113, "agent_compute-ego0": 0.09697756196698572, "complete-iteration": 0.3526869451897776, "set_robot_commands": 0.0106865605737409, "deviation-center-line": 0.238373392079278, "driven_lanedir_consec": 0.7775304421966176, "sim_compute_sim_state": 0.01635095604464539, "sim_compute_performance-ego0": 0.007247121925027962}}
set_robot_commands_max0.0106865605737409
set_robot_commands_mean0.00897177497543488
set_robot_commands_median0.009015652003840156
set_robot_commands_min0.007169235320318313
sim_compute_performance-ego0_max0.007703928513960405
sim_compute_performance-ego0_mean0.007103575555067985
sim_compute_performance-ego0_median0.007124410822569087
sim_compute_performance-ego0_min0.0064615520611733595
sim_compute_sim_state_max0.03743290271002816
sim_compute_sim_state_mean0.026150617984788113
sim_compute_sim_state_median0.025409306592239445
sim_compute_sim_state_min0.01635095604464539
sim_render-ego0_max0.012390821515726095
sim_render-ego0_mean0.011123105681942127
sim_render-ego0_median0.010968175171509026
sim_render-ego0_min0.010165250869024369
simulation-passed1
step_physics_max0.2033328190774119
step_physics_mean0.16071700865080224
step_physics_median0.16044809632487111
step_physics_min0.1186390228760548
survival_time_max11.300000000000026
survival_time_mean6.25
survival_time_min2.6999999999999984
No reset possible
6221013703Frank (Chude) Qian 🇨🇦BC Net V2aido-LF-sim-validation347host-errornoreg030:00:41
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, reg03_25c5c0f2133c-job62210-18832, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'reg03_25c5c0f2133c-job62210-18832', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6220013702Frank (Chude) Qian 🇨🇦BC Net V2aido-LF-sim-validation347host-errornoreg030:00:41
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, reg03_25c5c0f2133c-job62200-245632, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'reg03_25c5c0f2133c-job62200-245632', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6219913702Frank (Chude) Qian 🇨🇦BC Net V2aido-LF-sim-validation347host-errornoreg030:00:40
Error while running [...]
Error while running Docker Compose:

Could not run command
│    cmd: [docker-compose, -p, reg03_25c5c0f2133c-job62199-641111, up, -d]
│ stdout: ''
│  sderr: ''
│      e: Command '['docker-compose', '-p', 'reg03_25c5c0f2133c-job62199-641111', 'up', '-d']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6219113700Frank (Chude) Qian 🇨🇦BC Net V2aido-LF-sim-validation347host-errornoreg030:01:03
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     limit_gpu_memory()
              ||   File "solution.py", line 29, in limit_gpu_memory
              ||     logical_gpus = tf.config.experimental.list_logical_devices('GPU')
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/config.py", line 439, in list_logical_devices
              ||     return context.context().list_logical_devices(device_type=device_type)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 1368, in list_logical_devices
              ||     self.ensure_initialized()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 526, in ensure_initialized
              ||     context_handle = pywrap_tfe.TFE_NewContext(opts)
              || tensorflow.python.framework.errors_impl.InternalError: cudaGetDevice() failed. Status: CUDA driver version is insufficient for CUDA runtime version
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     limit_gpu_memory()
              || |   File "solution.py", line 29, in limit_gpu_memory
              || |     logical_gpus = tf.config.experimental.list_logical_devices('GPU')
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/config.py", line 439, in list_logical_devices
              || |     return context.context().list_logical_devices(device_type=device_type)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 1368, in list_logical_devices
              || |     self.ensure_initialized()
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 526, in ensure_initialized
              || |     context_handle = pywrap_tfe.TFE_NewContext(opts)
              || | tensorflow.python.framework.errors_impl.InternalError: cudaGetDevice() failed. Status: CUDA driver version is insufficient for CUDA runtime version
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     limit_gpu_memory()
              ||   File "solution.py", line 29, in limit_gpu_memory
              ||     logical_gpus = tf.config.experimental.list_logical_devices('GPU')
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/config.py", line 439, in list_logical_devices
              ||     return context.context().list_logical_devices(device_type=device_type)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 1368, in list_logical_devices
              ||     self.ensure_initialized()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 526, in ensure_initialized
              ||     context_handle = pywrap_tfe.TFE_NewContext(opts)
              || tensorflow.python.framework.errors_impl.InternalError: cudaGetDevice() failed. Status: CUDA driver version is insufficient for CUDA runtime version
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     limit_gpu_memory()
              || |   File "solution.py", line 29, in limit_gpu_memory
              || |     logical_gpus = tf.config.experimental.list_logical_devices('GPU')
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/config.py", line 439, in list_logical_devices
              || |     return context.context().list_logical_devices(device_type=device_type)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 1368, in list_logical_devices
              || |     self.ensure_initialized()
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 526, in ensure_initialized
              || |     context_handle = pywrap_tfe.TFE_NewContext(opts)
              || | tensorflow.python.framework.errors_impl.InternalError: cudaGetDevice() failed. Status: CUDA driver version is insufficient for CUDA runtime version
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6219013700Frank (Chude) Qian 🇨🇦BC Net V2aido-LF-sim-validation347host-errornoreg030:01:07
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     limit_gpu_memory()
              ||   File "solution.py", line 29, in limit_gpu_memory
              ||     logical_gpus = tf.config.experimental.list_logical_devices('GPU')
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/config.py", line 439, in list_logical_devices
              ||     return context.context().list_logical_devices(device_type=device_type)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 1368, in list_logical_devices
              ||     self.ensure_initialized()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 526, in ensure_initialized
              ||     context_handle = pywrap_tfe.TFE_NewContext(opts)
              || tensorflow.python.framework.errors_impl.InternalError: cudaGetDevice() failed. Status: CUDA driver version is insufficient for CUDA runtime version
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     limit_gpu_memory()
              || |   File "solution.py", line 29, in limit_gpu_memory
              || |     logical_gpus = tf.config.experimental.list_logical_devices('GPU')
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/config.py", line 439, in list_logical_devices
              || |     return context.context().list_logical_devices(device_type=device_type)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 1368, in list_logical_devices
              || |     self.ensure_initialized()
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 526, in ensure_initialized
              || |     context_handle = pywrap_tfe.TFE_NewContext(opts)
              || | tensorflow.python.framework.errors_impl.InternalError: cudaGetDevice() failed. Status: CUDA driver version is insufficient for CUDA runtime version
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     limit_gpu_memory()
              ||   File "solution.py", line 29, in limit_gpu_memory
              ||     logical_gpus = tf.config.experimental.list_logical_devices('GPU')
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/config.py", line 439, in list_logical_devices
              ||     return context.context().list_logical_devices(device_type=device_type)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 1368, in list_logical_devices
              ||     self.ensure_initialized()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 526, in ensure_initialized
              ||     context_handle = pywrap_tfe.TFE_NewContext(opts)
              || tensorflow.python.framework.errors_impl.InternalError: cudaGetDevice() failed. Status: CUDA driver version is insufficient for CUDA runtime version
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     limit_gpu_memory()
              || |   File "solution.py", line 29, in limit_gpu_memory
              || |     logical_gpus = tf.config.experimental.list_logical_devices('GPU')
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/config.py", line 439, in list_logical_devices
              || |     return context.context().list_logical_devices(device_type=device_type)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 1368, in list_logical_devices
              || |     self.ensure_initialized()
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/eager/context.py", line 526, in ensure_initialized
              || |     context_handle = pywrap_tfe.TFE_NewContext(opts)
              || | tensorflow.python.framework.errors_impl.InternalError: cudaGetDevice() failed. Status: CUDA driver version is insufficient for CUDA runtime version
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6218313699Frank (Chude) Qian 🇨🇦BC Net V2aido-LF-sim-validation347failednoreg030:01:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model = cbcNet.get_inference("cbcNet.h5")
              ||   File "/submission/cbcNet.py", line 93, in get_inference
              ||     (driving_cmd, anomaly_detection) = cbcNet.build_cbc_net(rgb_input)
              ||   File "/submission/cbcNet.py", line 66, in build_cbc_net
              ||     prediction = Switch(Less_equal(anomaly, 0.5), anomaly_controller(prediction),
              || TypeError: switch() got an unexpected keyword argument 'name'
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
              ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
              || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method DuckieChallenger.init of <__main__.DuckieChallenger object at 0x7fb488a63df0>>.
              || │       f: <bound method DuckieChallenger.init of <__main__.DuckieChallenger object at 0x7fb488a63df0>>
              || │    args: {context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7fb470c99430>}
              || │ argspec: ([self, context], None, None, None, [], None, {context: <class 'zuper_nodes_wrapper.interface.Context'>} )
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 339, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model = cbcNet.get_inference("cbcNet.h5")
              || |   File "/submission/cbcNet.py", line 93, in get_inference
              || |     (driving_cmd, anomaly_detection) = cbcNet.build_cbc_net(rgb_input)
              || |   File "/submission/cbcNet.py", line 66, in build_cbc_net
              || |     prediction = Switch(Less_equal(anomaly, 0.5), anomaly_controller(prediction),
              || | TypeError: switch() got an unexpected keyword argument 'name'
              || |
              || | The above exception was the direct cause of the following exception:
              || |
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
              || |     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
              || | zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method DuckieChallenger.init of <__main__.DuckieChallenger object at 0x7fb488a63df0>>.
              || | │       f: <bound method DuckieChallenger.init of <__main__.DuckieChallenger object at 0x7fb488a63df0>>
              || | │    args: {context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7fb470c99430>}
              || | │ argspec: ([self, context], None, None, None, [], None, {context: <class 'zuper_nodes_wrapper.interface.Context'>} )
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6216113505András Kalapos 🇭🇺real-v1.0-3091-310aido-LF-sim-validation347successnoreg030:58:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median28.830079765880484
survival_time_median59.99999999999873
deviation-center-line_median2.4819214877637505
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.04059938427609865
agent_compute-ego0_mean0.038157094775588186
agent_compute-ego0_median0.03828406879844316
agent_compute-ego0_min0.03546085722936778
complete-iteration_max0.4874913666667192
complete-iteration_mean0.4081338705567893
complete-iteration_median0.40145016322028726
complete-iteration_min0.3421437891198634
deviation-center-line_max2.6176298250667513
deviation-center-line_mean2.2792188368848656
deviation-center-line_min1.5354025469452108
deviation-heading_max8.115181731650567
deviation-heading_mean7.163082551508408
deviation-heading_median7.278152420997955
deviation-heading_min5.980843632387155
driven_any_max31.13810851228165
driven_any_mean29.453355327603933
driven_any_median29.06257420586115
driven_any_min28.55016438641179
driven_lanedir_consec_max30.80098077424877
driven_lanedir_consec_mean29.15528662630676
driven_lanedir_consec_min28.160006199217285
driven_lanedir_max30.80098077424877
driven_lanedir_mean29.15528662630676
driven_lanedir_median28.830079765880484
driven_lanedir_min28.160006199217285
get_duckie_state_max3.1425196562678887e-06
get_duckie_state_mean3.0444027680739272e-06
get_duckie_state_median3.0182481903914705e-06
get_duckie_state_min2.9985950352448805e-06
get_robot_state_max0.015404692299657815
get_robot_state_mean0.014461156232073146
get_robot_state_median0.014490296203429058
get_robot_state_min0.013459340221776653
get_state_dump_max0.025030600637520085
get_state_dump_mean0.021979177226432656
get_state_dump_median0.021874224613548616
get_state_dump_min0.0191376590411133
get_ui_image_max0.06586952114184631
get_ui_image_mean0.05615624405760054
get_ui_image_median0.055318091433808565
get_ui_image_min0.04811927222093873
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 31.13810851228165, "get_ui_image": 0.05276376401057946, "step_physics": 0.17793696091435135, "survival_time": 59.99999999999873, "driven_lanedir": 30.80098077424877, "get_state_dump": 0.02406614944400835, "get_robot_state": 0.014682046181951135, "sim_render-ego0": 0.013087390960007286, "get_duckie_state": 3.0242036919510432e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.019223141786035, "agent_compute-ego0": 0.03945319737919562, "complete-iteration": 0.3677698120685739, "set_robot_commands": 0.010579433766729528, "deviation-center-line": 2.4818624186604197, "driven_lanedir_consec": 30.80098077424877, "sim_compute_sim_state": 0.027016211508910523, "sim_compute_performance-ego0": 0.007972075083571409}, "LF-norm-zigzag-000-ego0": {"driven_any": 28.55016438641179, "get_ui_image": 0.06586952114184631, "step_physics": 0.26943520423673173, "survival_time": 59.99999999999873, "driven_lanedir": 28.160006199217285, "get_state_dump": 0.025030600637520085, "get_robot_state": 0.015404692299657815, "sim_render-ego0": 0.014056831275692192, "get_duckie_state": 3.012292688831898e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.115181731650567, "agent_compute-ego0": 0.04059938427609865, "complete-iteration": 0.4874913666667192, "set_robot_commands": 0.011409640014419749, "deviation-center-line": 2.4819805568670814, "driven_lanedir_consec": 28.160006199217285, "sim_compute_sim_state": 0.03713138375453012, "sim_compute_performance-ego0": 0.008339869985969537}, "LF-norm-techtrack-000-ego0": {"driven_any": 29.21013797064922, "get_ui_image": 0.05787241885703767, "step_physics": 0.24673909589114737, "survival_time": 59.99999999999873, "driven_lanedir": 28.89946471501918, "get_state_dump": 0.01968229978308888, "get_robot_state": 0.013459340221776653, "sim_render-ego0": 0.011425252361758164, "get_duckie_state": 2.9985950352448805e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.537081700209875, "agent_compute-ego0": 0.037114940217690705, "complete-iteration": 0.43513051437200057, "set_robot_commands": 0.00942925986004908, "deviation-center-line": 2.6176298250667513, "driven_lanedir_consec": 28.89946471501918, "sim_compute_sim_state": 0.031514254338933866, "sim_compute_performance-ego0": 0.007690850542943543}, "LF-norm-small_loop-000-ego0": {"driven_any": 28.91501044107308, "get_ui_image": 0.04811927222093873, "step_physics": 0.17645043814609093, "survival_time": 59.99999999999873, "driven_lanedir": 28.76069481674179, "get_state_dump": 0.0191376590411133, "get_robot_state": 0.01429854622490698, "sim_render-ego0": 0.011940308752703133, "get_duckie_state": 3.1425196562678887e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.980843632387155, "agent_compute-ego0": 0.03546085722936778, "complete-iteration": 0.3421437891198634, "set_robot_commands": 0.00903662674432988, "deviation-center-line": 1.5354025469452108, "driven_lanedir_consec": 28.76069481674179, "sim_compute_sim_state": 0.019512597170598694, "sim_compute_performance-ego0": 0.00797404159018638}}
set_robot_commands_max0.011409640014419749
set_robot_commands_mean0.010113740096382058
set_robot_commands_median0.010004346813389305
set_robot_commands_min0.00903662674432988
sim_compute_performance-ego0_max0.008339869985969537
sim_compute_performance-ego0_mean0.007994209300667717
sim_compute_performance-ego0_median0.007973058336878894
sim_compute_performance-ego0_min0.007690850542943543
sim_compute_sim_state_max0.03713138375453012
sim_compute_sim_state_mean0.028793611693243303
sim_compute_sim_state_median0.02926523292392219
sim_compute_sim_state_min0.019512597170598694
sim_render-ego0_max0.014056831275692192
sim_render-ego0_mean0.012627445837540193
sim_render-ego0_median0.01251384985635521
sim_render-ego0_min0.011425252361758164
simulation-passed1
step_physics_max0.26943520423673173
step_physics_mean0.21764042479708037
step_physics_median0.21233802840274937
step_physics_min0.17645043814609093
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6214713534András Kalapos 🇭🇺3090aido-LF-sim-testing348successnoreg031:00:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median27.72498804107508
survival_time_median59.99999999999873
deviation-center-line_median2.4272221888648637
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.04078275536021821
agent_compute-ego0_mean0.038719995085345425
agent_compute-ego0_median0.0389435582117276
agent_compute-ego0_min0.03621010855770826
complete-iteration_max0.4874163251633847
complete-iteration_mean0.41887531456204874
complete-iteration_median0.4172757062983453
complete-iteration_min0.35353352048811965
deviation-center-line_max2.5915617977936476
deviation-center-line_mean2.4321646136411657
deviation-center-line_min2.2826522790412875
deviation-heading_max12.52678046389238
deviation-heading_mean10.361790829113788
deviation-heading_median10.4106638757878
deviation-heading_min8.099055100987162
driven_any_max28.910635271019483
driven_any_mean28.209352364754757
driven_any_median28.244311944191317
driven_any_min27.43815029961692
driven_lanedir_consec_max28.380782756999665
driven_lanedir_consec_mean27.62011908308073
driven_lanedir_consec_min26.6497174931731
driven_lanedir_max28.380782756999665
driven_lanedir_mean27.62011908308073
driven_lanedir_median27.72498804107508
driven_lanedir_min26.6497174931731
get_duckie_state_max3.0510034489691208e-06
get_duckie_state_mean2.962713138348455e-06
get_duckie_state_median2.9485688221444697e-06
get_duckie_state_min2.9027114601357593e-06
get_robot_state_max0.014630420122615104
get_robot_state_mean0.01321339999309289
get_robot_state_median0.013052518719141926
get_robot_state_min0.012118142411472596
get_state_dump_max0.02396364116748108
get_state_dump_mean0.01996342933346687
get_state_dump_median0.019329580538080295
get_state_dump_min0.017230915090225816
get_ui_image_max0.06379777207958212
get_ui_image_mean0.05545624328791153
get_ui_image_median0.055137128258227905
get_ui_image_min0.04775294455560816
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 28.910635271019483, "get_ui_image": 0.05252325981483174, "step_physics": 0.20940897903474143, "survival_time": 59.99999999999873, "driven_lanedir": 28.380782756999665, "get_state_dump": 0.02396364116748108, "get_robot_state": 0.014630420122615104, "sim_render-ego0": 0.010879141007930807, "get_duckie_state": 2.9027114601357593e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.792716955064307, "agent_compute-ego0": 0.03970926687381945, "complete-iteration": 0.3929145731199393, "set_robot_commands": 0.009875170892720218, "deviation-center-line": 2.2826522790412875, "driven_lanedir_consec": 28.380782756999665, "sim_compute_sim_state": 0.02490662774078852, "sim_compute_performance-ego0": 0.006823996917889775}, "LF-norm-zigzag-000-ego0": {"driven_any": 27.94830892362956, "get_ui_image": 0.06379777207958212, "step_physics": 0.28795358104372304, "survival_time": 59.99999999999873, "driven_lanedir": 27.558629075932192, "get_state_dump": 0.020366233949558027, "get_robot_state": 0.012724699922445713, "sim_render-ego0": 0.01056081587627071, "get_duckie_state": 2.9096595452885942e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.099055100987162, "agent_compute-ego0": 0.04078275536021821, "complete-iteration": 0.4874163251633847, "set_robot_commands": 0.010574752543986984, "deviation-center-line": 2.351642107206853, "driven_lanedir_consec": 27.558629075932192, "sim_compute_sim_state": 0.032972261173143474, "sim_compute_performance-ego0": 0.007480375375676215}, "LF-norm-techtrack-000-ego0": {"driven_any": 28.540314964753073, "get_ui_image": 0.05775099670162408, "step_physics": 0.25353269275280954, "survival_time": 59.99999999999873, "driven_lanedir": 27.891347006217963, "get_state_dump": 0.01829292712660257, "get_robot_state": 0.01338033751583814, "sim_render-ego0": 0.011470061158458954, "get_duckie_state": 3.0510034489691208e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.028610796511291, "agent_compute-ego0": 0.03817784954963576, "complete-iteration": 0.44163683947675136, "set_robot_commands": 0.009803737232230486, "deviation-center-line": 2.5915617977936476, "driven_lanedir_consec": 27.891347006217963, "sim_compute_sim_state": 0.031896659277757936, "sim_compute_performance-ego0": 0.007116970869027804}, "LF-norm-small_loop-000-ego0": {"driven_any": 27.43815029961692, "get_ui_image": 0.04775294455560816, "step_physics": 0.19675692729807015, "survival_time": 59.99999999999873, "driven_lanedir": 26.6497174931731, "get_state_dump": 0.017230915090225816, "get_robot_state": 0.012118142411472596, "sim_render-ego0": 0.01148436607468833, "get_duckie_state": 2.987478099000345e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.52678046389238, "agent_compute-ego0": 0.03621010855770826, "complete-iteration": 0.35353352048811965, "set_robot_commands": 0.008100255343638094, "deviation-center-line": 2.502802270522874, "driven_lanedir_consec": 26.6497174931731, "sim_compute_sim_state": 0.017025855260526607, "sim_compute_performance-ego0": 0.006652097717907705}}
set_robot_commands_max0.010574752543986984
set_robot_commands_mean0.009588479003143947
set_robot_commands_median0.009839454062475352
set_robot_commands_min0.008100255343638094
sim_compute_performance-ego0_max0.007480375375676215
sim_compute_performance-ego0_mean0.007018360220125376
sim_compute_performance-ego0_median0.006970483893458789
sim_compute_performance-ego0_min0.006652097717907705
sim_compute_sim_state_max0.032972261173143474
sim_compute_sim_state_mean0.026700350863054133
sim_compute_sim_state_median0.028401643509273225
sim_compute_sim_state_min0.017025855260526607
sim_render-ego0_max0.01148436607468833
sim_render-ego0_mean0.011098596029337202
sim_render-ego0_median0.01117460108319488
sim_render-ego0_min0.01056081587627071
simulation-passed1
step_physics_max0.28795358104372304
step_physics_mean0.23691304503233604
step_physics_median0.23147083589377548
step_physics_min0.19675692729807015
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
6211513578Márton Tim 🇭🇺3626aido-LFV_multi-sim-validation356successnoreg031:26:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median23.200000000000195
in-drivable-lane_median0.32500000000000107
driven_lanedir_consec_median6.5549358915067355
deviation-center-line_median1.547413430912079


other stats
agent_compute-ego0_max0.08858402867183507
agent_compute-ego0_mean0.08688713452809385
agent_compute-ego0_median0.0874363650246622
agent_compute-ego0_min0.08487993080703042
agent_compute-ego1_max0.09383528586297596
agent_compute-ego1_mean0.08861902522449497
agent_compute-ego1_median0.08702395757039388
agent_compute-ego1_min0.08609690231697581
complete-iteration_max1.5580918772198329
complete-iteration_mean1.350909739012526
complete-iteration_median1.494114522529705
complete-iteration_min0.7036871538561364
deviation-center-line_max3.58910551321615
deviation-center-line_mean1.6966158482572102
deviation-center-line_min0.4128592429526293
deviation-heading_max9.806603228498922
deviation-heading_mean5.260995323034602
deviation-heading_median5.142833619367243
deviation-heading_min1.811610977491286
driven_any_max27.933765816752988
driven_any_mean9.560937169828566
driven_any_median7.261436438658971
driven_any_min1.8042128596372464
driven_lanedir_consec_max27.402190747727033
driven_lanedir_consec_mean8.939529884583347
driven_lanedir_consec_min1.5068466413925474
driven_lanedir_max27.402190747727033
driven_lanedir_mean8.939529884583347
driven_lanedir_median6.5549358915067355
driven_lanedir_min1.5068466413925474
get_duckie_state_max3.5500972070426585e-06
get_duckie_state_mean3.4669087849282917e-06
get_duckie_state_median3.5291076988302253e-06
get_duckie_state_min3.369918171041052e-06
get_robot_state_max0.05264371897673561
get_robot_state_mean0.04847789452375194
get_robot_state_median0.05205743184653661
get_robot_state_min0.02620622629792374
get_state_dump_max0.03348515264449581
get_state_dump_mean0.031219233551445826
get_state_dump_median0.03205640405137962
get_state_dump_min0.023475825308904196
get_ui_image_max0.08373394692055533
get_ui_image_mean0.07547303316260016
get_ui_image_median0.078712301217522
get_ui_image_min0.05392233537757174
in-drivable-lane_max19.900000000000244
in-drivable-lane_mean2.4857142857143137
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 5.356869240088156, "get_ui_image": 0.07474820024223738, "step_physics": 0.6494325776253977, "survival_time": 23.200000000000195, "driven_lanedir": 5.267686713886854, "get_state_dump": 0.03348515264449581, "get_robot_state": 0.05205743184653661, "sim_render-ego0": 0.011053607797109953, "sim_render-ego1": 0.012633507226103097, "sim_render-ego2": 0.009824366210609354, "sim_render-ego3": 0.011185542486047232, "get_duckie_state": 3.5291076988302253e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.9751905771321434, "agent_compute-ego0": 0.08564461174831596, "agent_compute-ego1": 0.08702395757039388, "agent_compute-ego2": 0.09194005432949272, "agent_compute-ego3": 0.09342963823708154, "complete-iteration": 1.3241341098662345, "set_robot_commands": 0.009028921332410587, "deviation-center-line": 1.8013741904723823, "driven_lanedir_consec": 5.267686713886854, "sim_compute_sim_state": 0.045773211345877696, "sim_compute_performance-ego0": 0.006701018220634871, "sim_compute_performance-ego1": 0.007349016845867198, "sim_compute_performance-ego2": 0.00744788569788779, "sim_compute_performance-ego3": 0.007026705177881384}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 7.789785527378343, "get_ui_image": 0.07474820024223738, "step_physics": 0.6494325776253977, "survival_time": 23.200000000000195, "driven_lanedir": 7.689586441709319, "get_state_dump": 0.03348515264449581, "get_robot_state": 0.05205743184653661, "sim_render-ego0": 0.011053607797109953, "sim_render-ego1": 0.012633507226103097, "sim_render-ego2": 0.009824366210609354, "sim_render-ego3": 0.011185542486047232, "get_duckie_state": 3.5291076988302253e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.792473583746492, "agent_compute-ego0": 0.08564461174831596, "agent_compute-ego1": 0.08702395757039388, "agent_compute-ego2": 0.09194005432949272, "agent_compute-ego3": 0.09342963823708154, "complete-iteration": 1.3241341098662345, "set_robot_commands": 0.009028921332410587, "deviation-center-line": 1.4171013372992145, "driven_lanedir_consec": 7.689586441709319, "sim_compute_sim_state": 0.045773211345877696, "sim_compute_performance-ego0": 0.006701018220634871, "sim_compute_performance-ego1": 0.007349016845867198, "sim_compute_performance-ego2": 0.00744788569788779, "sim_compute_performance-ego3": 0.007026705177881384}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 5.478167598103866, "get_ui_image": 0.07474820024223738, "step_physics": 0.6494325776253977, "survival_time": 23.200000000000195, "driven_lanedir": 5.420285341304153, "get_state_dump": 0.03348515264449581, "get_robot_state": 0.05205743184653661, "sim_render-ego0": 0.011053607797109953, "sim_render-ego1": 0.012633507226103097, "sim_render-ego2": 0.009824366210609354, "sim_render-ego3": 0.011185542486047232, "get_duckie_state": 3.5291076988302253e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.5119391759623872, "agent_compute-ego0": 0.08564461174831596, "agent_compute-ego1": 0.08702395757039388, "agent_compute-ego2": 0.09194005432949272, "agent_compute-ego3": 0.09342963823708154, "complete-iteration": 1.3241341098662345, "set_robot_commands": 0.009028921332410587, "deviation-center-line": 1.6645650791883535, "driven_lanedir_consec": 5.420285341304153, "sim_compute_sim_state": 0.045773211345877696, "sim_compute_performance-ego0": 0.006701018220634871, "sim_compute_performance-ego1": 0.007349016845867198, "sim_compute_performance-ego2": 0.00744788569788779, "sim_compute_performance-ego3": 0.007026705177881384}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 11.367728869283878, "get_ui_image": 0.07474820024223738, "step_physics": 0.6494325776253977, "survival_time": 23.200000000000195, "driven_lanedir": 11.220583289160649, "get_state_dump": 0.03348515264449581, "get_robot_state": 0.05205743184653661, "sim_render-ego0": 0.011053607797109953, "sim_render-ego1": 0.012633507226103097, "sim_render-ego2": 0.009824366210609354, "sim_render-ego3": 0.011185542486047232, "get_duckie_state": 3.5291076988302253e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.0794995839580688, "agent_compute-ego0": 0.08564461174831596, "agent_compute-ego1": 0.08702395757039388, "agent_compute-ego2": 0.09194005432949272, "agent_compute-ego3": 0.09342963823708154, "complete-iteration": 1.3241341098662345, "set_robot_commands": 0.009028921332410587, "deviation-center-line": 1.154380590728063, "driven_lanedir_consec": 11.220583289160649, "sim_compute_sim_state": 0.045773211345877696, "sim_compute_performance-ego0": 0.006701018220634871, "sim_compute_performance-ego1": 0.007349016845867198, "sim_compute_performance-ego2": 0.00744788569788779, "sim_compute_performance-ego3": 0.007026705177881384}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.8538521755902235, "get_ui_image": 0.08373394692055533, "step_physics": 0.8727625296494671, "survival_time": 21.35000000000017, "driven_lanedir": 1.6165912108540368, "get_state_dump": 0.03205640405137962, "get_robot_state": 0.05186836686089774, "sim_render-ego0": 0.0112823543147506, "sim_render-ego1": 0.011811811790288052, "sim_render-ego2": 0.01093822717666626, "sim_render-ego3": 0.01139416538666342, "get_duckie_state": 3.5500972070426585e-06, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 8.62412885814695, "agent_compute-ego0": 0.08858402867183507, "agent_compute-ego1": 0.08609690231697581, "agent_compute-ego2": 0.09426194150871206, "agent_compute-ego3": 0.08964606311833748, "complete-iteration": 1.5580918772198329, "set_robot_commands": 0.008911475956997025, "deviation-center-line": 1.8026618497075255, "driven_lanedir_consec": 1.6165912108540368, "sim_compute_sim_state": 0.04995649941613741, "sim_compute_performance-ego0": 0.007865750901052885, "sim_compute_performance-ego1": 0.007069832810731692, "sim_compute_performance-ego2": 0.007066402479866955, "sim_compute_performance-ego3": 0.00626131530119994}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 6.733087349939599, "get_ui_image": 0.08373394692055533, "step_physics": 0.8727625296494671, "survival_time": 21.35000000000017, "driven_lanedir": 5.271109878982928, "get_state_dump": 0.03205640405137962, "get_robot_state": 0.05186836686089774, "sim_render-ego0": 0.0112823543147506, "sim_render-ego1": 0.011811811790288052, "sim_render-ego2": 0.01093822717666626, "sim_render-ego3": 0.01139416538666342, "get_duckie_state": 3.5500972070426585e-06, "in-drivable-lane": 2.250000000000001, "deviation-heading": 7.027380481771888, "agent_compute-ego0": 0.08858402867183507, "agent_compute-ego1": 0.08609690231697581, "agent_compute-ego2": 0.09426194150871206, "agent_compute-ego3": 0.08964606311833748, "complete-iteration": 1.5580918772198329, "set_robot_commands": 0.008911475956997025, "deviation-center-line": 1.7003697830887987, "driven_lanedir_consec": 5.271109878982928, "sim_compute_sim_state": 0.04995649941613741, "sim_compute_performance-ego0": 0.007865750901052885, "sim_compute_performance-ego1": 0.007069832810731692, "sim_compute_performance-ego2": 0.007066402479866955, "sim_compute_performance-ego3": 0.00626131530119994}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 9.777235057351124, "get_ui_image": 0.08373394692055533, "step_physics": 0.8727625296494671, "survival_time": 21.35000000000017, "driven_lanedir": 8.577163290279838, "get_state_dump": 0.03205640405137962, "get_robot_state": 0.05186836686089774, "sim_render-ego0": 0.0112823543147506, "sim_render-ego1": 0.011811811790288052, "sim_render-ego2": 0.01093822717666626, "sim_render-ego3": 0.01139416538666342, "get_duckie_state": 3.5500972070426585e-06, "in-drivable-lane": 2.3000000000000247, "deviation-heading": 4.949321412002788, "agent_compute-ego0": 0.08858402867183507, "agent_compute-ego1": 0.08609690231697581, "agent_compute-ego2": 0.09426194150871206, "agent_compute-ego3": 0.08964606311833748, "complete-iteration": 1.5580918772198329, "set_robot_commands": 0.008911475956997025, "deviation-center-line": 1.3815495815938803, "driven_lanedir_consec": 8.577163290279838, "sim_compute_sim_state": 0.04995649941613741, "sim_compute_performance-ego0": 0.007865750901052885, "sim_compute_performance-ego1": 0.007069832810731692, "sim_compute_performance-ego2": 0.007066402479866955, "sim_compute_performance-ego3": 0.00626131530119994}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.8042128596372464, "get_ui_image": 0.08373394692055533, "step_physics": 0.8727625296494671, "survival_time": 21.35000000000017, "driven_lanedir": 1.5068466413925474, "get_state_dump": 0.03205640405137962, "get_robot_state": 0.05186836686089774, "sim_render-ego0": 0.0112823543147506, "sim_render-ego1": 0.011811811790288052, "sim_render-ego2": 0.01093822717666626, "sim_render-ego3": 0.01139416538666342, "get_duckie_state": 3.5500972070426585e-06, "in-drivable-lane": 0.4499999999999984, "deviation-heading": 6.218274183011506, "agent_compute-ego0": 0.08858402867183507, "agent_compute-ego1": 0.08609690231697581, "agent_compute-ego2": 0.09426194150871206, "agent_compute-ego3": 0.08964606311833748, "complete-iteration": 1.5580918772198329, "set_robot_commands": 0.008911475956997025, "deviation-center-line": 2.544616694404326, "driven_lanedir_consec": 1.5068466413925474, "sim_compute_sim_state": 0.04995649941613741, "sim_compute_performance-ego0": 0.007865750901052885, "sim_compute_performance-ego1": 0.007069832810731692, "sim_compute_performance-ego2": 0.007066402479866955, "sim_compute_performance-ego3": 0.00626131530119994}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.633481807808629, "get_ui_image": 0.078712301217522, "step_physics": 0.7882254762226906, "survival_time": 25.900000000000233, "driven_lanedir": 8.152189985058246, "get_state_dump": 0.031987848079732845, "get_robot_state": 0.05264371897673561, "sim_render-ego0": 0.011637930236110795, "sim_render-ego1": 0.011041161641909209, "sim_render-ego2": 0.011294341960164624, "sim_render-ego3": 0.010725982846092856, "get_duckie_state": 3.370016755855612e-06, "in-drivable-lane": 8.050000000000113, "deviation-heading": 5.3363458267317, "agent_compute-ego0": 0.0874363650246622, "agent_compute-ego1": 0.09383528586297596, "agent_compute-ego2": 0.09827162948417296, "agent_compute-ego3": 0.09559603830752804, "complete-iteration": 1.494114522529705, "set_robot_commands": 0.008918676762222555, "deviation-center-line": 1.3486890141596573, "driven_lanedir_consec": 8.152189985058246, "sim_compute_sim_state": 0.05644919647187397, "sim_compute_performance-ego0": 0.008900647907587834, "sim_compute_performance-ego1": 0.006929096688654611, "sim_compute_performance-ego2": 0.007241855466985978, "sim_compute_performance-ego3": 0.00677322881988937}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.757334327886377, "get_ui_image": 0.078712301217522, "step_physics": 0.7882254762226906, "survival_time": 25.900000000000233, "driven_lanedir": 2.2541811135836167, "get_state_dump": 0.031987848079732845, "get_robot_state": 0.05264371897673561, "sim_render-ego0": 0.011637930236110795, "sim_render-ego1": 0.011041161641909209, "sim_render-ego2": 0.011294341960164624, "sim_render-ego3": 0.010725982846092856, "get_duckie_state": 3.370016755855612e-06, "in-drivable-lane": 19.900000000000244, "deviation-heading": 2.756319450527469, "agent_compute-ego0": 0.0874363650246622, "agent_compute-ego1": 0.09383528586297596, "agent_compute-ego2": 0.09827162948417296, "agent_compute-ego3": 0.09559603830752804, "complete-iteration": 1.494114522529705, "set_robot_commands": 0.008918676762222555, "deviation-center-line": 0.4128592429526293, "driven_lanedir_consec": 2.2541811135836167, "sim_compute_sim_state": 0.05644919647187397, "sim_compute_performance-ego0": 0.008900647907587834, "sim_compute_performance-ego1": 0.006929096688654611, "sim_compute_performance-ego2": 0.007241855466985978, "sim_compute_performance-ego3": 0.00677322881988937}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 4.002773274968244, "get_ui_image": 0.078712301217522, "step_physics": 0.7882254762226906, "survival_time": 25.900000000000233, "driven_lanedir": 3.9432595193168463, "get_state_dump": 0.031987848079732845, "get_robot_state": 0.05264371897673561, "sim_render-ego0": 0.011637930236110795, "sim_render-ego1": 0.011041161641909209, "sim_render-ego2": 0.011294341960164624, "sim_render-ego3": 0.010725982846092856, "get_duckie_state": 3.370016755855612e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.811610977491286, "agent_compute-ego0": 0.0874363650246622, "agent_compute-ego1": 0.09383528586297596, "agent_compute-ego2": 0.09827162948417296, "agent_compute-ego3": 0.09559603830752804, "complete-iteration": 1.494114522529705, "set_robot_commands": 0.008918676762222555, "deviation-center-line": 0.8673884414191289, "driven_lanedir_consec": 3.9432595193168463, "sim_compute_sim_state": 0.05644919647187397, "sim_compute_performance-ego0": 0.008900647907587834, "sim_compute_performance-ego1": 0.006929096688654611, "sim_compute_performance-ego2": 0.007241855466985978, "sim_compute_performance-ego3": 0.00677322881988937}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.51837742665236, "get_ui_image": 0.078712301217522, "step_physics": 0.7882254762226906, "survival_time": 25.900000000000233, "driven_lanedir": 11.54198982453608, "get_state_dump": 0.031987848079732845, "get_robot_state": 0.05264371897673561, "sim_render-ego0": 0.011637930236110795, "sim_render-ego1": 0.011041161641909209, "sim_render-ego2": 0.011294341960164624, "sim_render-ego3": 0.010725982846092856, "get_duckie_state": 3.370016755855612e-06, "in-drivable-lane": 1.200000000000017, "deviation-heading": 5.34962922228917, "agent_compute-ego0": 0.0874363650246622, "agent_compute-ego1": 0.09383528586297596, "agent_compute-ego2": 0.09827162948417296, "agent_compute-ego3": 0.09559603830752804, "complete-iteration": 1.494114522529705, "set_robot_commands": 0.008918676762222555, "deviation-center-line": 1.4302617826358044, "driven_lanedir_consec": 11.54198982453608, "sim_compute_sim_state": 0.05644919647187397, "sim_compute_performance-ego0": 0.008900647907587834, "sim_compute_performance-ego1": 0.006929096688654611, "sim_compute_performance-ego2": 0.007241855466985978, "sim_compute_performance-ego3": 0.00677322881988937}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 27.933765816752988, "get_ui_image": 0.05392233537757174, "step_physics": 0.34940477173347506, "survival_time": 56.09999999999895, "driven_lanedir": 27.402190747727033, "get_state_dump": 0.023475825308904196, "get_robot_state": 0.02620622629792374, "sim_render-ego0": 0.01101289173374193, "sim_render-ego1": 0.011188477994285306, "get_duckie_state": 3.369918171041052e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.415217961213674, "agent_compute-ego0": 0.08487993080703042, "agent_compute-ego1": 0.08642088507077361, "complete-iteration": 0.7036871538561364, "set_robot_commands": 0.007969191959683425, "deviation-center-line": 3.58910551321615, "driven_lanedir_consec": 27.402190747727033, "sim_compute_sim_state": 0.02615609088330426, "sim_compute_performance-ego0": 0.007193984671140078, "sim_compute_performance-ego1": 0.007007038391602432}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 25.846449046158884, "get_ui_image": 0.05392233537757174, "step_physics": 0.34940477173347506, "survival_time": 56.09999999999895, "driven_lanedir": 25.2897543863747, "get_state_dump": 0.023475825308904196, "get_robot_state": 0.02620622629792374, "sim_render-ego0": 0.01101289173374193, "sim_render-ego1": 0.011188477994285306, "get_duckie_state": 3.369918171041052e-06, "in-drivable-lane": 0.25000000000000355, "deviation-heading": 9.806603228498922, "agent_compute-ego0": 0.08487993080703042, "agent_compute-ego1": 0.08642088507077361, "complete-iteration": 0.7036871538561364, "set_robot_commands": 0.007969191959683425, "deviation-center-line": 2.6376987747350307, "driven_lanedir_consec": 25.2897543863747, "sim_compute_sim_state": 0.02615609088330426, "sim_compute_performance-ego0": 0.007193984671140078, "sim_compute_performance-ego1": 0.007007038391602432}}
set_robot_commands_max0.009028921332410587
set_robot_commands_mean0.008812477151849107
set_robot_commands_median0.008918676762222555
set_robot_commands_min0.007969191959683425
sim_compute_performance-ego0_max0.008900647907587834
sim_compute_performance-ego0_mean0.007732688389955894
sim_compute_performance-ego0_median0.007865750901052885
sim_compute_performance-ego0_min0.006701018220634871
sim_compute_performance-ego1_max0.007349016845867198
sim_compute_performance-ego1_mean0.0071004187260156355
sim_compute_performance-ego1_median0.007069832810731692
sim_compute_performance-ego1_min0.006929096688654611
sim_compute_sim_state_max0.05644919647187397
sim_compute_sim_state_mean0.04721627219301178
sim_compute_sim_state_median0.04995649941613741
sim_compute_sim_state_min0.02615609088330426
sim_render-ego0_max0.011637930236110795
sim_render-ego0_mean0.011280096632812087
sim_render-ego0_median0.0112823543147506
sim_render-ego0_min0.01101289173374193
sim_render-ego1_max0.012633507226103097
sim_render-ego1_mean0.011737348472983716
sim_render-ego1_median0.011811811790288052
sim_render-ego1_min0.011041161641909209
simulation-passed1
step_physics_max0.8727625296494671
step_physics_mean0.7100351341040837
step_physics_median0.7882254762226906
step_physics_min0.34940477173347506
survival_time_max56.09999999999895
survival_time_mean28.142857142857164
survival_time_min21.35000000000017
No reset possible
6208013593Andras Beres202-1aido-LFV_multi-sim-validation356successnoreg032:08:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median48.099999999999405
in-drivable-lane_median0.8249999999999775
driven_lanedir_consec_median11.24945630082728
deviation-center-line_median3.5277656208580748


other stats
agent_compute-ego0_max0.16530507004520975
agent_compute-ego0_mean0.14212139750806987
agent_compute-ego0_median0.14769655632805992
agent_compute-ego0_min0.1188771546997639
agent_compute-ego1_max0.13735119501749674
agent_compute-ego1_mean0.12082389076912269
agent_compute-ego1_median0.1279688706764808
agent_compute-ego1_min0.099689211164202
complete-iteration_max2.004817672483894
complete-iteration_mean1.601487025075233
complete-iteration_median1.6510869533448786
complete-iteration_min0.7147099320192515
deviation-center-line_max4.685258885331869
deviation-center-line_mean3.0426271518368098
deviation-center-line_min0.46580390692958307
deviation-heading_max14.88277701798551
deviation-heading_mean6.322111661266745
deviation-heading_median6.233915208011564
deviation-heading_min1.1525089054371125
driven_any_max29.20828378181021
driven_any_mean14.110970101674184
driven_any_median11.883478357218692
driven_any_min3.222519519891979
driven_lanedir_consec_max28.706154623169397
driven_lanedir_consec_mean13.589882170274077
driven_lanedir_consec_min3.060634333986818
driven_lanedir_max28.706154623169397
driven_lanedir_mean13.589882170274077
driven_lanedir_median11.24945630082728
driven_lanedir_min3.060634333986818
get_duckie_state_max6.24494119123979e-06
get_duckie_state_mean5.143031309278026e-06
get_duckie_state_median4.818294846148407e-06
get_duckie_state_min4.620566917728412e-06
get_robot_state_max0.06392154837199338
get_robot_state_mean0.05461528978505048
get_robot_state_median0.06263587504000097
get_robot_state_min0.0225176411385862
get_state_dump_max0.06036328823766976
get_state_dump_mean0.042512298782613936
get_state_dump_median0.04317080307673741
get_state_dump_min0.025753663933795433
get_ui_image_max0.10957153464898638
get_ui_image_mean0.0880638301080795
get_ui_image_median0.0864875324956187
get_ui_image_min0.053927317909572434
in-drivable-lane_max7.0000000000000995
in-drivable-lane_mean1.2571428571428611
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 23.51849450538836, "get_ui_image": 0.0864875324956187, "step_physics": 0.7537210446137649, "survival_time": 57.14999999999889, "driven_lanedir": 22.95129863414075, "get_state_dump": 0.04317080307673741, "get_robot_state": 0.06263587504000097, "sim_render-ego0": 0.011428422235942388, "sim_render-ego1": 0.010208649026764023, "sim_render-ego2": 0.010639146908179863, "sim_render-ego3": 0.011578824345048491, "get_duckie_state": 6.24494119123979e-06, "in-drivable-lane": 0.7499999999999956, "deviation-heading": 5.836490774739006, "agent_compute-ego0": 0.14769655632805992, "agent_compute-ego1": 0.1279688706764808, "agent_compute-ego2": 0.1298599868387609, "agent_compute-ego3": 0.13256980280776123, "complete-iteration": 1.6510869533448786, "set_robot_commands": 0.009578250713281698, "deviation-center-line": 4.618808585950046, "driven_lanedir_consec": 22.95129863414075, "sim_compute_sim_state": 0.058252138691348626, "sim_compute_performance-ego0": 0.008446869525042448, "sim_compute_performance-ego1": 0.0057178960813509, "sim_compute_performance-ego2": 0.006718705792527099, "sim_compute_performance-ego3": 0.006245054981925271}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 25.744558861163444, "get_ui_image": 0.0864875324956187, "step_physics": 0.7537210446137649, "survival_time": 57.14999999999889, "driven_lanedir": 25.24639331623892, "get_state_dump": 0.04317080307673741, "get_robot_state": 0.06263587504000097, "sim_render-ego0": 0.011428422235942388, "sim_render-ego1": 0.010208649026764023, "sim_render-ego2": 0.010639146908179863, "sim_render-ego3": 0.011578824345048491, "get_duckie_state": 6.24494119123979e-06, "in-drivable-lane": 0.5500000000000043, "deviation-heading": 5.832214683695627, "agent_compute-ego0": 0.14769655632805992, "agent_compute-ego1": 0.1279688706764808, "agent_compute-ego2": 0.1298599868387609, "agent_compute-ego3": 0.13256980280776123, "complete-iteration": 1.6510869533448786, "set_robot_commands": 0.009578250713281698, "deviation-center-line": 4.3898458000283105, "driven_lanedir_consec": 25.24639331623892, "sim_compute_sim_state": 0.058252138691348626, "sim_compute_performance-ego0": 0.008446869525042448, "sim_compute_performance-ego1": 0.0057178960813509, "sim_compute_performance-ego2": 0.006718705792527099, "sim_compute_performance-ego3": 0.006245054981925271}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 22.86534595524438, "get_ui_image": 0.0864875324956187, "step_physics": 0.7537210446137649, "survival_time": 57.14999999999889, "driven_lanedir": 22.2395083974466, "get_state_dump": 0.04317080307673741, "get_robot_state": 0.06263587504000097, "sim_render-ego0": 0.011428422235942388, "sim_render-ego1": 0.010208649026764023, "sim_render-ego2": 0.010639146908179863, "sim_render-ego3": 0.011578824345048491, "get_duckie_state": 6.24494119123979e-06, "in-drivable-lane": 0.8999999999999595, "deviation-heading": 8.309142689338856, "agent_compute-ego0": 0.14769655632805992, "agent_compute-ego1": 0.1279688706764808, "agent_compute-ego2": 0.1298599868387609, "agent_compute-ego3": 0.13256980280776123, "complete-iteration": 1.6510869533448786, "set_robot_commands": 0.009578250713281698, "deviation-center-line": 4.262418335816962, "driven_lanedir_consec": 22.2395083974466, "sim_compute_sim_state": 0.058252138691348626, "sim_compute_performance-ego0": 0.008446869525042448, "sim_compute_performance-ego1": 0.0057178960813509, "sim_compute_performance-ego2": 0.006718705792527099, "sim_compute_performance-ego3": 0.006245054981925271}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 29.20828378181021, "get_ui_image": 0.0864875324956187, "step_physics": 0.7537210446137649, "survival_time": 57.14999999999889, "driven_lanedir": 28.706154623169397, "get_state_dump": 0.04317080307673741, "get_robot_state": 0.06263587504000097, "sim_render-ego0": 0.011428422235942388, "sim_render-ego1": 0.010208649026764023, "sim_render-ego2": 0.010639146908179863, "sim_render-ego3": 0.011578824345048491, "get_duckie_state": 6.24494119123979e-06, "in-drivable-lane": 0.39999999999997726, "deviation-heading": 6.854436321029747, "agent_compute-ego0": 0.14769655632805992, "agent_compute-ego1": 0.1279688706764808, "agent_compute-ego2": 0.1298599868387609, "agent_compute-ego3": 0.13256980280776123, "complete-iteration": 1.6510869533448786, "set_robot_commands": 0.009578250713281698, "deviation-center-line": 3.746403378710675, "driven_lanedir_consec": 28.706154623169397, "sim_compute_sim_state": 0.058252138691348626, "sim_compute_performance-ego0": 0.008446869525042448, "sim_compute_performance-ego1": 0.0057178960813509, "sim_compute_performance-ego2": 0.006718705792527099, "sim_compute_performance-ego3": 0.006245054981925271}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 22.4584202936406, "get_ui_image": 0.10957153464898638, "step_physics": 0.9630887746068176, "survival_time": 48.099999999999405, "driven_lanedir": 21.08988072347855, "get_state_dump": 0.06036328823766976, "get_robot_state": 0.06392154837199338, "sim_render-ego0": 0.01373268535451602, "sim_render-ego1": 0.01033455090111785, "sim_render-ego2": 0.011251350305781062, "sim_render-ego3": 0.011453701823423708, "get_duckie_state": 4.620566917728412e-06, "in-drivable-lane": 2.599999999999987, "deviation-heading": 7.488414182630852, "agent_compute-ego0": 0.16530507004520975, "agent_compute-ego1": 0.13735119501749674, "agent_compute-ego2": 0.14489576378344005, "agent_compute-ego3": 0.14760318178749282, "complete-iteration": 2.004817672483894, "set_robot_commands": 0.01492683612668997, "deviation-center-line": 3.5117593562722984, "driven_lanedir_consec": 21.08988072347855, "sim_compute_sim_state": 0.08519932909299033, "sim_compute_performance-ego0": 0.011180515972624686, "sim_compute_performance-ego1": 0.006615780100520403, "sim_compute_performance-ego2": 0.006866799708096037, "sim_compute_performance-ego3": 0.0068686171855510585}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 11.600709578828434, "get_ui_image": 0.10957153464898638, "step_physics": 0.9630887746068176, "survival_time": 48.099999999999405, "driven_lanedir": 10.92528890466095, "get_state_dump": 0.06036328823766976, "get_robot_state": 0.06392154837199338, "sim_render-ego0": 0.01373268535451602, "sim_render-ego1": 0.01033455090111785, "sim_render-ego2": 0.011251350305781062, "sim_render-ego3": 0.011453701823423708, "get_duckie_state": 4.620566917728412e-06, "in-drivable-lane": 1.2500000000000044, "deviation-heading": 14.88277701798551, "agent_compute-ego0": 0.16530507004520975, "agent_compute-ego1": 0.13735119501749674, "agent_compute-ego2": 0.14489576378344005, "agent_compute-ego3": 0.14760318178749282, "complete-iteration": 2.004817672483894, "set_robot_commands": 0.01492683612668997, "deviation-center-line": 4.685258885331869, "driven_lanedir_consec": 10.92528890466095, "sim_compute_sim_state": 0.08519932909299033, "sim_compute_performance-ego0": 0.011180515972624686, "sim_compute_performance-ego1": 0.006615780100520403, "sim_compute_performance-ego2": 0.006866799708096037, "sim_compute_performance-ego3": 0.0068686171855510585}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.882625929480804, "get_ui_image": 0.10957153464898638, "step_physics": 0.9630887746068176, "survival_time": 48.099999999999405, "driven_lanedir": 14.082195873383895, "get_state_dump": 0.06036328823766976, "get_robot_state": 0.06392154837199338, "sim_render-ego0": 0.01373268535451602, "sim_render-ego1": 0.01033455090111785, "sim_render-ego2": 0.011251350305781062, "sim_render-ego3": 0.011453701823423708, "get_duckie_state": 4.620566917728412e-06, "in-drivable-lane": 1.4500000000000108, "deviation-heading": 6.631339641284122, "agent_compute-ego0": 0.16530507004520975, "agent_compute-ego1": 0.13735119501749674, "agent_compute-ego2": 0.14489576378344005, "agent_compute-ego3": 0.14760318178749282, "complete-iteration": 2.004817672483894, "set_robot_commands": 0.01492683612668997, "deviation-center-line": 3.3761229140722087, "driven_lanedir_consec": 14.082195873383895, "sim_compute_sim_state": 0.08519932909299033, "sim_compute_performance-ego0": 0.011180515972624686, "sim_compute_performance-ego1": 0.006615780100520403, "sim_compute_performance-ego2": 0.006866799708096037, "sim_compute_performance-ego3": 0.0068686171855510585}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 11.288432337203725, "get_ui_image": 0.10957153464898638, "step_physics": 0.9630887746068176, "survival_time": 48.099999999999405, "driven_lanedir": 10.909233457179283, "get_state_dump": 0.06036328823766976, "get_robot_state": 0.06392154837199338, "sim_render-ego0": 0.01373268535451602, "sim_render-ego1": 0.01033455090111785, "sim_render-ego2": 0.011251350305781062, "sim_render-ego3": 0.011453701823423708, "get_duckie_state": 4.620566917728412e-06, "in-drivable-lane": 0.3500000000000032, "deviation-heading": 10.291517953394273, "agent_compute-ego0": 0.16530507004520975, "agent_compute-ego1": 0.13735119501749674, "agent_compute-ego2": 0.14489576378344005, "agent_compute-ego3": 0.14760318178749282, "complete-iteration": 2.004817672483894, "set_robot_commands": 0.01492683612668997, "deviation-center-line": 3.973005565851766, "driven_lanedir_consec": 10.909233457179283, "sim_compute_sim_state": 0.08519932909299033, "sim_compute_performance-ego0": 0.011180515972624686, "sim_compute_performance-ego1": 0.006615780100520403, "sim_compute_performance-ego2": 0.006866799708096037, "sim_compute_performance-ego3": 0.0068686171855510585}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.289474282206614, "get_ui_image": 0.08520067927888694, "step_physics": 0.8194532590369655, "survival_time": 25.500000000000227, "driven_lanedir": 8.76615241756709, "get_state_dump": 0.032382122457843936, "get_robot_state": 0.053337270266389195, "sim_render-ego0": 0.011745809342296624, "sim_render-ego1": 0.009738564257985692, "sim_render-ego2": 0.009280128721621638, "sim_render-ego3": 0.0093292326843202, "get_duckie_state": 4.818294846148407e-06, "in-drivable-lane": 7.0000000000000995, "deviation-heading": 3.355866733742272, "agent_compute-ego0": 0.12498468755509289, "agent_compute-ego1": 0.1077189464158508, "agent_compute-ego2": 0.10894612183542868, "agent_compute-ego3": 0.10911616513873731, "complete-iteration": 1.591944995924918, "set_robot_commands": 0.007333363105639552, "deviation-center-line": 1.1572362815813495, "driven_lanedir_consec": 8.76615241756709, "sim_compute_sim_state": 0.06129986152723577, "sim_compute_performance-ego0": 0.007586980285943137, "sim_compute_performance-ego1": 0.005160069512294464, "sim_compute_performance-ego2": 0.004905901776367904, "sim_compute_performance-ego3": 0.005195179097573118}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 3.634422435690906, "get_ui_image": 0.08520067927888694, "step_physics": 0.8194532590369655, "survival_time": 25.500000000000227, "driven_lanedir": 3.060634333986818, "get_state_dump": 0.032382122457843936, "get_robot_state": 0.053337270266389195, "sim_render-ego0": 0.011745809342296624, "sim_render-ego1": 0.009738564257985692, "sim_render-ego2": 0.009280128721621638, "sim_render-ego3": 0.0093292326843202, "get_duckie_state": 4.818294846148407e-06, "in-drivable-lane": 1.3000000000000007, "deviation-heading": 9.103409844428269, "agent_compute-ego0": 0.12498468755509289, "agent_compute-ego1": 0.1077189464158508, "agent_compute-ego2": 0.10894612183542868, "agent_compute-ego3": 0.10911616513873731, "complete-iteration": 1.591944995924918, "set_robot_commands": 0.007333363105639552, "deviation-center-line": 3.5437718854438516, "driven_lanedir_consec": 3.060634333986818, "sim_compute_sim_state": 0.06129986152723577, "sim_compute_performance-ego0": 0.007586980285943137, "sim_compute_performance-ego1": 0.005160069512294464, "sim_compute_performance-ego2": 0.004905901776367904, "sim_compute_performance-ego3": 0.005195179097573118}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 4.131995111470532, "get_ui_image": 0.08520067927888694, "step_physics": 0.8194532590369655, "survival_time": 25.500000000000227, "driven_lanedir": 4.082488962295669, "get_state_dump": 0.032382122457843936, "get_robot_state": 0.053337270266389195, "sim_render-ego0": 0.011745809342296624, "sim_render-ego1": 0.009738564257985692, "sim_render-ego2": 0.009280128721621638, "sim_render-ego3": 0.0093292326843202, "get_duckie_state": 4.818294846148407e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.200506294096474, "agent_compute-ego0": 0.12498468755509289, "agent_compute-ego1": 0.1077189464158508, "agent_compute-ego2": 0.10894612183542868, "agent_compute-ego3": 0.10911616513873731, "complete-iteration": 1.591944995924918, "set_robot_commands": 0.007333363105639552, "deviation-center-line": 2.793224769868812, "driven_lanedir_consec": 4.082488962295669, "sim_compute_sim_state": 0.06129986152723577, "sim_compute_performance-ego0": 0.007586980285943137, "sim_compute_performance-ego1": 0.005160069512294464, "sim_compute_performance-ego2": 0.004905901776367904, "sim_compute_performance-ego3": 0.005195179097573118}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 12.166247135608948, "get_ui_image": 0.08520067927888694, "step_physics": 0.8194532590369655, "survival_time": 25.500000000000227, "driven_lanedir": 11.573623696993607, "get_state_dump": 0.032382122457843936, "get_robot_state": 0.053337270266389195, "sim_render-ego0": 0.011745809342296624, "sim_render-ego1": 0.009738564257985692, "sim_render-ego2": 0.009280128721621638, "sim_render-ego3": 0.0093292326843202, "get_duckie_state": 4.818294846148407e-06, "in-drivable-lane": 1.050000000000015, "deviation-heading": 3.939493375876067, "agent_compute-ego0": 0.12498468755509289, "agent_compute-ego1": 0.1077189464158508, "agent_compute-ego2": 0.10894612183542868, "agent_compute-ego3": 0.10911616513873731, "complete-iteration": 1.591944995924918, "set_robot_commands": 0.007333363105639552, "deviation-center-line": 1.548662468903218, "driven_lanedir_consec": 11.573623696993607, "sim_compute_sim_state": 0.06129986152723577, "sim_compute_performance-ego0": 0.007586980285943137, "sim_compute_performance-ego1": 0.005160069512294464, "sim_compute_performance-ego2": 0.004905901776367904, "sim_compute_performance-ego3": 0.005195179097573118}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 3.542051695809606, "get_ui_image": 0.053927317909572434, "step_physics": 0.3281351053936881, "survival_time": 7.99999999999998, "driven_lanedir": 3.485589746288337, "get_state_dump": 0.025753663933795433, "get_robot_state": 0.0225176411385862, "sim_render-ego0": 0.010932110851595862, "sim_render-ego1": 0.008101438143238517, "get_duckie_state": 4.633613254712976e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1525089054371125, "agent_compute-ego0": 0.1188771546997639, "agent_compute-ego1": 0.099689211164202, "complete-iteration": 0.7147099320192515, "set_robot_commands": 0.005436190907259165, "deviation-center-line": 0.5244579909543857, "driven_lanedir_consec": 3.485589746288337, "sim_compute_sim_state": 0.02277100308341269, "sim_compute_performance-ego0": 0.007261101503549896, "sim_compute_performance-ego1": 0.005451057268225629}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 3.222519519891979, "get_ui_image": 0.053927317909572434, "step_physics": 0.3281351053936881, "survival_time": 7.99999999999998, "driven_lanedir": 3.1399072970072126, "get_state_dump": 0.025753663933795433, "get_robot_state": 0.0225176411385862, "sim_render-ego0": 0.010932110851595862, "sim_render-ego1": 0.008101438143238517, "get_duckie_state": 4.633613254712976e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.6314448400562316, "agent_compute-ego0": 0.1188771546997639, "agent_compute-ego1": 0.099689211164202, "complete-iteration": 0.7147099320192515, "set_robot_commands": 0.005436190907259165, "deviation-center-line": 0.46580390692958307, "driven_lanedir_consec": 3.1399072970072126, "sim_compute_sim_state": 0.02277100308341269, "sim_compute_performance-ego0": 0.007261101503549896, "sim_compute_performance-ego1": 0.005451057268225629}}
set_robot_commands_max0.01492683612668997
set_robot_commands_mean0.009873298685497372
set_robot_commands_median0.009578250713281698
set_robot_commands_min0.005436190907259165
sim_compute_performance-ego0_max0.011180515972624686
sim_compute_performance-ego0_mean0.008812833295824348
sim_compute_performance-ego0_median0.008446869525042448
sim_compute_performance-ego0_min0.007261101503549896
sim_compute_performance-ego1_max0.006615780100520403
sim_compute_performance-ego1_mean0.0057769355223653085
sim_compute_performance-ego1_median0.0057178960813509
sim_compute_performance-ego1_min0.005160069512294464
sim_compute_sim_state_max0.08519932909299033
sim_compute_sim_state_mean0.0617533802437946
sim_compute_sim_state_median0.06129986152723577
sim_compute_sim_state_min0.02277100308341269
sim_render-ego0_max0.01373268535451602
sim_render-ego0_mean0.012106563531015134
sim_render-ego0_median0.011745809342296624
sim_render-ego0_min0.010932110851595862
sim_render-ego1_max0.01033455090111785
sim_render-ego1_mean0.009809280930710524
sim_render-ego1_median0.010208649026764023
sim_render-ego1_min0.008101438143238517
simulation-passed1
step_physics_max0.9630887746068176
step_physics_mean0.7715230374155405
step_physics_median0.8194532590369655
step_physics_min0.3281351053936881
survival_time_max57.14999999999889
survival_time_mean38.49999999999958
survival_time_min7.99999999999998
No reset possible
6206213639Raphael Jeanmobile-segmentationaido-LFV_multi-sim-validation356errornoreg032:49:20
Waited 10008 seconds [...]
Waited 10008 seconds for container to finish. Giving up. 
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6206113639Raphael Jeanmobile-segmentationaido-LFV_multi-sim-validation356failednoreg030:04:28
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
6205213587Andras Beres202-1aido-LFV-sim-validation354successnoreg030:43:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median8.524999999999995
in-drivable-lane_median0.0
driven_lanedir_consec_median3.6655885557347503
deviation-center-line_median0.561404032951045


other stats
agent_compute-ego0_max0.1564383103567011
agent_compute-ego0_mean0.1310693295865017
agent_compute-ego0_median0.12333137264636083
agent_compute-ego0_min0.12117626269658406
agent_compute-npc0_max0.0967991054058075
agent_compute-npc0_mean0.07576833651637757
agent_compute-npc0_median0.07159127267550874
agent_compute-npc0_min0.0630916953086853
complete-iteration_max2.051701421835988
complete-iteration_mean1.365953343411738
complete-iteration_median1.320882819047991
complete-iteration_min0.7703463137149811
deviation-center-line_max1.7067743099232109
deviation-center-line_mean0.8116043547453097
deviation-center-line_min0.4168350431559376
deviation-heading_max4.608679350641589
deviation-heading_mean2.044830491238747
deviation-heading_median1.251482515828595
deviation-heading_min1.0676775826562095
driven_any_max10.874501238463385
driven_any_mean5.249939646161333
driven_any_median3.726872532931462
driven_any_min2.671512280319025
driven_lanedir_consec_max10.514424432001343
driven_lanedir_consec_mean5.114923934723175
driven_lanedir_consec_min2.6140941954218517
driven_lanedir_max10.514424432001343
driven_lanedir_mean5.114923934723175
driven_lanedir_median3.6655885557347503
driven_lanedir_min2.6140941954218517
get_duckie_state_max3.729653112667123e-06
get_duckie_state_mean3.6061476155137006e-06
get_duckie_state_median3.611921665057465e-06
get_duckie_state_min3.471094019272748e-06
get_robot_state_max0.06922783605831186
get_robot_state_mean0.050376114381935566
get_robot_state_median0.0549207279829923
get_robot_state_min0.022435165503445792
get_state_dump_max0.04490419228871664
get_state_dump_mean0.03438457367037977
get_state_dump_median0.034287640034754104
get_state_dump_min0.02405882232329425
get_ui_image_max0.0989572598762119
get_ui_image_mean0.08283628547589864
get_ui_image_median0.08482604740902008
get_ui_image_min0.0627357872093425
in-drivable-lane_max0.2499999999999991
in-drivable-lane_mean0.06249999999999978
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 4.429951760108944, "get_ui_image": 0.07897277213820261, "step_physics": 0.4488741944183656, "survival_time": 9.900000000000006, "driven_lanedir": 4.350176139677783, "get_state_dump": 0.03208093307725149, "get_robot_state": 0.04999930654937897, "sim_render-ego0": 0.009322436011616309, "sim_render-npc0": 0.009646999177022195, "sim_render-npc1": 0.012508478595982845, "sim_render-npc2": 0.009491606573363644, "get_duckie_state": 3.5283553540407114e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.4015627548552732, "agent_compute-ego0": 0.12517250961993806, "agent_compute-npc0": 0.07269236550259231, "agent_compute-npc1": 0.07656040742768715, "agent_compute-npc2": 0.08902679855500034, "complete-iteration": 1.1228075099350818, "set_robot_commands": 0.008996749044063702, "deviation-center-line": 0.6753594460530977, "driven_lanedir_consec": 4.350176139677783, "sim_compute_sim_state": 0.052183496293111066, "sim_compute_performance-ego0": 0.006356695788589555, "sim_compute_performance-npc0": 0.006317725732697913, "sim_compute_performance-npc1": 0.006155148223416889, "sim_compute_performance-npc2": 0.006104965305807603}, "LFV-norm-zigzag-000-ego0": {"driven_any": 10.874501238463385, "get_ui_image": 0.0989572598762119, "step_physics": 1.1821513062899875, "survival_time": 24.20000000000021, "driven_lanedir": 10.514424432001343, "get_state_dump": 0.03649434699225672, "get_robot_state": 0.06922783605831186, "sim_render-ego0": 0.011047259065293774, "sim_render-npc0": 0.010451740579506786, "sim_render-npc1": 0.010930966839347918, "sim_render-npc2": 0.010013794161609768, "sim_render-npc3": 0.01129887718515298, "get_duckie_state": 3.729653112667123e-06, "in-drivable-lane": 0.2499999999999991, "deviation-heading": 4.608679350641589, "agent_compute-ego0": 0.1214902356727836, "agent_compute-npc0": 0.07049017984842516, "agent_compute-npc1": 0.07645027760377865, "agent_compute-npc2": 0.07865417962221755, "agent_compute-npc3": 0.07385204846097022, "complete-iteration": 2.051701421835988, "set_robot_commands": 0.008008012083387866, "deviation-center-line": 1.7067743099232109, "driven_lanedir_consec": 10.514424432001343, "sim_compute_sim_state": 0.11251937286140992, "sim_compute_performance-ego0": 0.00857779168591057, "sim_compute_performance-npc0": 0.005727453821713162, "sim_compute_performance-npc1": 0.006965089090091666, "sim_compute_performance-npc2": 0.006903379479634393, "sim_compute_performance-npc3": 0.007147460622885793}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.02379330575398, "get_ui_image": 0.09067932267983754, "step_physics": 0.5796169125371509, "survival_time": 7.149999999999983, "driven_lanedir": 2.981000971791718, "get_state_dump": 0.04490419228871664, "get_robot_state": 0.05984214941660563, "sim_render-ego0": 0.012876356641451515, "sim_render-npc0": 0.00748185482290056, "sim_render-npc1": 0.016988509231143527, "sim_render-npc2": 0.011505999498897128, "sim_render-npc3": 0.011907415257559882, "get_duckie_state": 3.695487976074219e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.0676775826562095, "agent_compute-ego0": 0.12117626269658406, "agent_compute-npc0": 0.0967991054058075, "agent_compute-npc1": 0.09294695655504864, "agent_compute-npc2": 0.09391943944825068, "agent_compute-npc3": 0.0945046991109848, "complete-iteration": 1.5189581281609006, "set_robot_commands": 0.010095477104187012, "deviation-center-line": 0.4168350431559376, "driven_lanedir_consec": 2.981000971791718, "sim_compute_sim_state": 0.10183250904083252, "sim_compute_performance-ego0": 0.007541259129842122, "sim_compute_performance-npc0": 0.007981772224108378, "sim_compute_performance-npc1": 0.00693288611041175, "sim_compute_performance-npc2": 0.007058560848236084, "sim_compute_performance-npc3": 0.005281069212489658}, "LFV-norm-small_loop-000-ego0": {"driven_any": 2.671512280319025, "get_ui_image": 0.0627357872093425, "step_physics": 0.36741719175787535, "survival_time": 6.749999999999984, "driven_lanedir": 2.6140941954218517, "get_state_dump": 0.02405882232329425, "get_robot_state": 0.022435165503445792, "sim_render-ego0": 0.010001645368688248, "sim_render-npc0": 0.009273846359813915, "get_duckie_state": 3.471094019272748e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1014022768019167, "agent_compute-ego0": 0.1564383103567011, "agent_compute-npc0": 0.0630916953086853, "complete-iteration": 0.7703463137149811, "set_robot_commands": 0.00812964404330534, "deviation-center-line": 0.4474486198489922, "driven_lanedir_consec": 2.6140941954218517, "sim_compute_sim_state": 0.027625676463632023, "sim_compute_performance-ego0": 0.006514572045382331, "sim_compute_performance-npc0": 0.006721803370644064}}
set_robot_commands_max0.010095477104187012
set_robot_commands_mean0.00880747056873598
set_robot_commands_median0.008563196543684521
set_robot_commands_min0.008008012083387866
sim_compute_performance-ego0_max0.00857779168591057
sim_compute_performance-ego0_mean0.007247579662431144
sim_compute_performance-ego0_median0.007027915587612227
sim_compute_performance-ego0_min0.006356695788589555
sim_compute_performance-npc0_max0.007981772224108378
sim_compute_performance-npc0_mean0.0066871887872908785
sim_compute_performance-npc0_median0.006519764551670989
sim_compute_performance-npc0_min0.005727453821713162
sim_compute_sim_state_max0.11251937286140992
sim_compute_sim_state_mean0.07354026366474638
sim_compute_sim_state_median0.07700800266697179
sim_compute_sim_state_min0.027625676463632023
sim_render-ego0_max0.012876356641451515
sim_render-ego0_mean0.01081192427176246
sim_render-ego0_median0.01052445221699101
sim_render-ego0_min0.009322436011616309
sim_render-npc0_max0.010451740579506786
sim_render-npc0_mean0.009213610234810864
sim_render-npc0_median0.009460422768418054
sim_render-npc0_min0.00748185482290056
simulation-passed1
step_physics_max1.1821513062899875
step_physics_mean0.6445149012508449
step_physics_median0.5142455534777582
step_physics_min0.36741719175787535
survival_time_max24.20000000000021
survival_time_mean12.000000000000046
survival_time_min6.749999999999984
No reset possible