Duckietown Challenges Home Challenges Submissions

Evaluator 4852

ID4852
evaluatorgpu-prod-01
ownerI don't have one 😀
machinegpu_f38713608d77
processgpu-prod-01_f38713608d77
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success42 53433
# timeout2 52755
# failed6 55206
# error16 52855
# aborted20 52728
# host-error10 52718
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
581359360Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutyesgpu-prod-01----No reset possible
581229374Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:10:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.46113229971088454
survival_time_median10.600000000000048
deviation-center-line_median0.1634829568198553
in-drivable-lane_median8.250000000000043


other stats
agent_compute-ego0_max0.013652091497903342
agent_compute-ego0_mean0.013159345543633672
agent_compute-ego0_median0.01309910952502677
agent_compute-ego0_min0.012787071626577804
complete-iteration_max0.24739942003469
complete-iteration_mean0.19046659201003033
complete-iteration_median0.18212845275025497
complete-iteration_min0.15021004250492137
deviation-center-line_max0.27091689859837204
deviation-center-line_mean0.16945319315548615
deviation-center-line_min0.07992996038386191
deviation-heading_max1.483408358622085
deviation-heading_mean0.9143120567470934
deviation-heading_median0.8565777124474154
deviation-heading_min0.4606844434714577
driven_any_max12.159280072220424
driven_any_mean4.200946966245074
driven_any_median2.1600308013332667
driven_any_min0.32444619009334047
driven_lanedir_consec_max0.8893886666380376
driven_lanedir_consec_mean0.49543757604369254
driven_lanedir_consec_min0.17009703811496335
driven_lanedir_max0.8893886666380376
driven_lanedir_mean0.49543757604369254
driven_lanedir_median0.46113229971088454
driven_lanedir_min0.17009703811496335
get_duckie_state_max1.9021086640410371e-06
get_duckie_state_mean1.786821862084891e-06
get_duckie_state_median1.8514654206371944e-06
get_duckie_state_min1.542247943024137e-06
get_robot_state_max0.0035965704655909277
get_robot_state_mean0.0035501811934654133
get_robot_state_median0.0035442580096831586
get_robot_state_min0.003515638288904409
get_state_dump_max0.004689965929303851
get_state_dump_mean0.004494833794098474
get_state_dump_median0.004489371060554009
get_state_dump_min0.004310627125982029
get_ui_image_max0.03632886292504483
get_ui_image_mean0.03101098532493652
get_ui_image_median0.030866505627712697
get_ui_image_min0.025982067119275865
in-drivable-lane_max48.1499999999992
in-drivable-lane_mean16.53749999999982
in-drivable-lane_min1.499999999999997
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.260473346139455, "get_ui_image": 0.02833801169893635, "step_physics": 0.10138071686474244, "survival_time": 16.700000000000102, "driven_lanedir": 0.28020879076193855, "get_state_dump": 0.004310627125982029, "get_robot_state": 0.0035460237246840746, "sim_render-ego0": 0.003660726547241211, "get_duckie_state": 1.542247943024137e-06, "in-drivable-lane": 14.50000000000009, "deviation-heading": 1.483408358622085, "agent_compute-ego0": 0.012787071626577804, "complete-iteration": 0.16786790107613178, "set_robot_commands": 0.002090239880689934, "deviation-center-line": 0.22820725077036297, "driven_lanedir_consec": 0.28020879076193855, "sim_compute_sim_state": 0.009812878138983428, "sim_compute_performance-ego0": 0.0018718335165906308}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.32444619009334047, "get_ui_image": 0.03632886292504483, "step_physics": 0.17236258944527047, "survival_time": 2.9999999999999973, "driven_lanedir": 0.17009703811496335, "get_state_dump": 0.0044799554543417, "get_robot_state": 0.003515638288904409, "sim_render-ego0": 0.003732751627437404, "get_duckie_state": 1.8291786068775616e-06, "in-drivable-lane": 1.499999999999997, "deviation-heading": 0.8938852598550348, "agent_compute-ego0": 0.013209417218067608, "complete-iteration": 0.24739942003469, "set_robot_commands": 0.002280219656522157, "deviation-center-line": 0.09875866286934765, "driven_lanedir_consec": 0.17009703811496335, "sim_compute_sim_state": 0.00952976258074651, "sim_compute_performance-ego0": 0.0018833230753413969}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0595882565270782, "get_ui_image": 0.033394999556489044, "step_physics": 0.1249861350426307, "survival_time": 4.499999999999992, "driven_lanedir": 0.6420558086598305, "get_state_dump": 0.004689965929303851, "get_robot_state": 0.0035965704655909277, "sim_render-ego0": 0.0038047334650060634, "get_duckie_state": 1.9021086640410371e-06, "in-drivable-lane": 1.999999999999993, "deviation-heading": 0.4606844434714577, "agent_compute-ego0": 0.013652091497903342, "complete-iteration": 0.19638900442437812, "set_robot_commands": 0.002115178894210648, "deviation-center-line": 0.07992996038386191, "driven_lanedir_consec": 0.6420558086598305, "sim_compute_sim_state": 0.00811466279920641, "sim_compute_performance-ego0": 0.0019515975491031185}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.159280072220424, "get_ui_image": 0.025982067119275865, "step_physics": 0.08920734848526639, "survival_time": 51.39999999999922, "driven_lanedir": 0.8893886666380376, "get_state_dump": 0.004498786666766316, "get_robot_state": 0.0035424922946822425, "sim_render-ego0": 0.003736061072094679, "get_duckie_state": 1.873752234396828e-06, "in-drivable-lane": 48.1499999999992, "deviation-heading": 0.819270165039796, "agent_compute-ego0": 0.012988801831985933, "complete-iteration": 0.15021004250492137, "set_robot_commands": 0.002151474892455936, "deviation-center-line": 0.27091689859837204, "driven_lanedir_consec": 0.8893886666380376, "sim_compute_sim_state": 0.006129768545819905, "sim_compute_performance-ego0": 0.0018948873810911784}}
set_robot_commands_max0.002280219656522157
set_robot_commands_mean0.002159278330969669
set_robot_commands_median0.002133326893333292
set_robot_commands_min0.002090239880689934
sim_compute_performance-ego0_max0.0019515975491031185
sim_compute_performance-ego0_mean0.001900410380531581
sim_compute_performance-ego0_median0.001889105228216287
sim_compute_performance-ego0_min0.0018718335165906308
sim_compute_sim_state_max0.009812878138983428
sim_compute_sim_state_mean0.008396768016189063
sim_compute_sim_state_median0.00882221268997646
sim_compute_sim_state_min0.006129768545819905
sim_render-ego0_max0.0038047334650060634
sim_render-ego0_mean0.003733568177944839
sim_render-ego0_median0.0037344063497660417
sim_render-ego0_min0.003660726547241211
simulation-passed1
step_physics_max0.17236258944527047
step_physics_mean0.1219841974594775
step_physics_median0.11318342595368658
step_physics_min0.08920734848526639
survival_time_max51.39999999999922
survival_time_mean18.899999999999828
survival_time_min2.9999999999999973
No reset possible
581159759Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:04:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 168 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
580809784Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:40:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0459970517857482
survival_time_median59.99999999999873
deviation-center-line_median3.3149562778321577
in-drivable-lane_median27.099999999999408


other stats
agent_compute-ego0_max0.01169534765810494
agent_compute-ego0_mean0.011313017063792005
agent_compute-ego0_median0.011230095042277136
agent_compute-ego0_min0.0110965305125088
complete-iteration_max0.3160396174129896
complete-iteration_mean0.26434835893327646
complete-iteration_median0.26535151840546645
complete-iteration_min0.21065078150918343
deviation-center-line_max3.497357075702119
deviation-center-line_mean3.1690619604786896
deviation-center-line_min2.5489782105483227
deviation-heading_max25.805764659865662
deviation-heading_mean24.406973234545617
deviation-heading_median25.625319053816817
deviation-heading_min20.571490170683177
driven_any_max3.2030292102568043
driven_any_mean2.889016263785712
driven_any_median2.8361483709740147
driven_any_min2.6807391029380145
driven_lanedir_consec_max1.1417585735293485
driven_lanedir_consec_mean0.94025343182887
driven_lanedir_consec_min0.5272610502146349
driven_lanedir_max1.1417585735293485
driven_lanedir_mean1.049406253463037
driven_lanedir_median1.0459970517857482
driven_lanedir_min0.9638723367513036
get_duckie_state_max1.1478236672483215e-06
get_duckie_state_mean1.0987900377411726e-06
get_duckie_state_median1.0975989374292582e-06
get_duckie_state_min1.0521386088578529e-06
get_robot_state_max0.003674757470695502
get_robot_state_mean0.0035896552889472144
get_robot_state_median0.00356734076904119
get_robot_state_min0.0035491821470109747
get_state_dump_max0.004530894567726256
get_state_dump_mean0.00451893353839401
get_state_dump_median0.004521185015758607
get_state_dump_min0.004502469554332571
get_ui_image_max0.03637809380206538
get_ui_image_mean0.030642912101983825
get_ui_image_median0.030309367934234135
get_ui_image_min0.025574818737401653
in-drivable-lane_max33.34999999999934
in-drivable-lane_mean28.39999999999941
in-drivable-lane_min26.04999999999947
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6807391029380145, "get_ui_image": 0.0281237841248016, "step_physics": 0.18352277411906348, "survival_time": 59.99999999999873, "driven_lanedir": 0.9897146638570612, "get_state_dump": 0.004530894567726256, "get_robot_state": 0.003674757470695502, "sim_render-ego0": 0.003661316102192265, "get_duckie_state": 1.135317113973219e-06, "in-drivable-lane": 26.849999999999447, "deviation-heading": 25.805764659865662, "agent_compute-ego0": 0.0110965305125088, "complete-iteration": 0.24744808564674448, "set_robot_commands": 0.0022131699904315576, "deviation-center-line": 3.140859176900409, "driven_lanedir_consec": 0.9897146638570612, "sim_compute_sim_state": 0.00862186238926515, "sim_compute_performance-ego0": 0.001922836510168325}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.2030292102568043, "get_ui_image": 0.03637809380206538, "step_physics": 0.24056918317332657, "survival_time": 59.99999999999873, "driven_lanedir": 0.9638723367513036, "get_state_dump": 0.004502469554332571, "get_robot_state": 0.0035844158868210004, "sim_render-ego0": 0.003662288238563506, "get_duckie_state": 1.0598807608852971e-06, "in-drivable-lane": 33.34999999999934, "deviation-heading": 20.571490170683177, "agent_compute-ego0": 0.011312986988509128, "complete-iteration": 0.3160396174129896, "set_robot_commands": 0.0022970641483176656, "deviation-center-line": 3.497357075702119, "driven_lanedir_consec": 0.5272610502146349, "sim_compute_sim_state": 0.011743041696794625, "sim_compute_performance-ego0": 0.001917868033733892}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.9664306682153683, "get_ui_image": 0.03249495174366668, "step_physics": 0.21423932416155175, "survival_time": 59.99999999999873, "driven_lanedir": 1.1417585735293485, "get_state_dump": 0.004526249077993071, "get_robot_state": 0.00355026565126138, "sim_render-ego0": 0.0036510956674491632, "get_duckie_state": 1.1478236672483215e-06, "in-drivable-lane": 27.34999999999937, "deviation-heading": 25.621441722727543, "agent_compute-ego0": 0.01169534765810494, "complete-iteration": 0.2832549511641884, "set_robot_commands": 0.002190032072805743, "deviation-center-line": 2.5489782105483227, "driven_lanedir_consec": 1.1417585735293485, "sim_compute_sim_state": 0.008927632926604234, "sim_compute_performance-ego0": 0.0019028339655969063}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.705866073732661, "get_ui_image": 0.025574818737401653, "step_physics": 0.1519916301762234, "survival_time": 59.99999999999873, "driven_lanedir": 1.102279439714435, "get_state_dump": 0.004516120953524143, "get_robot_state": 0.0035491821470109747, "sim_render-ego0": 0.003618549248459535, "get_duckie_state": 1.0521386088578529e-06, "in-drivable-lane": 26.04999999999947, "deviation-heading": 25.629196384906088, "agent_compute-ego0": 0.011147203096045144, "complete-iteration": 0.21065078150918343, "set_robot_commands": 0.0022417824036076502, "deviation-center-line": 3.489053378763907, "driven_lanedir_consec": 1.102279439714435, "sim_compute_sim_state": 0.006069095406703012, "sim_compute_performance-ego0": 0.0018718328007452693}}
set_robot_commands_max0.0022970641483176656
set_robot_commands_mean0.002235512153790654
set_robot_commands_median0.0022274761970196037
set_robot_commands_min0.002190032072805743
sim_compute_performance-ego0_max0.001922836510168325
sim_compute_performance-ego0_mean0.0019038428275610984
sim_compute_performance-ego0_median0.0019103509996653992
sim_compute_performance-ego0_min0.0018718328007452693
sim_compute_sim_state_max0.011743041696794625
sim_compute_sim_state_mean0.008840408104841754
sim_compute_sim_state_median0.008774747657934692
sim_compute_sim_state_min0.006069095406703012
sim_render-ego0_max0.003662288238563506
sim_render-ego0_mean0.0036483123141661175
sim_render-ego0_median0.003656205884820714
sim_render-ego0_min0.003618549248459535
simulation-passed1
step_physics_max0.24056918317332657
step_physics_mean0.1975807279075413
step_physics_median0.19888104914030763
step_physics_min0.1519916301762234
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5805610027Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:33:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.528099667407542
survival_time_median59.99999999999873
deviation-center-line_median2.0384446917859957
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012695047083147162
agent_compute-ego0_mean0.012234517725977076
agent_compute-ego0_median0.0122556774741307
agent_compute-ego0_min0.011731668872499743
complete-iteration_max0.19052610806283307
complete-iteration_mean0.16791446207961275
complete-iteration_median0.16914714415007884
complete-iteration_min0.1428374519554602
deviation-center-line_max2.3818410066490796
deviation-center-line_mean1.9700434448298751
deviation-center-line_min1.4214433890984288
deviation-heading_max9.404008110144376
deviation-heading_mean7.570906818101499
deviation-heading_median8.789691658400464
deviation-heading_min3.3002358454606933
driven_any_max5.720240096153672
driven_any_mean5.598115505498163
driven_any_median5.644015317872493
driven_any_min5.384191290093996
driven_lanedir_consec_max5.6213110340082135
driven_lanedir_consec_mean4.690129464066025
driven_lanedir_consec_min2.083007487440806
driven_lanedir_max5.6213110340082135
driven_lanedir_mean4.690129464066025
driven_lanedir_median5.528099667407542
driven_lanedir_min2.083007487440806
get_duckie_state_max1.1954676797249035e-06
get_duckie_state_mean1.183457418246432e-06
get_duckie_state_median1.1873284942601544e-06
get_duckie_state_min1.1637050047405155e-06
get_robot_state_max0.003570754164760059
get_robot_state_mean0.0035236696716549987
get_robot_state_median0.003515180798990343
get_robot_state_min0.0034935629238792504
get_state_dump_max0.004448289775927795
get_state_dump_mean0.004424207960933968
get_state_dump_median0.004422427613371914
get_state_dump_min0.00440368684106425
get_ui_image_max0.03636891994746301
get_ui_image_mean0.030794803744847332
get_ui_image_median0.030464837394288735
get_ui_image_min0.025880620243348845
in-drivable-lane_max37.94999999999855
in-drivable-lane_mean9.487499999999638
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.384191290093996, "get_ui_image": 0.028302924420613235, "step_physics": 0.0969373052265126, "survival_time": 59.99999999999873, "driven_lanedir": 2.083007487440806, "get_state_dump": 0.00440368684106425, "get_robot_state": 0.003570754164760059, "sim_render-ego0": 0.003668100808085649, "get_duckie_state": 1.1637050047405155e-06, "in-drivable-lane": 37.94999999999855, "deviation-heading": 3.3002358454606933, "agent_compute-ego0": 0.012695047083147162, "complete-iteration": 0.16374999061412954, "set_robot_commands": 0.0020986121461155213, "deviation-center-line": 1.4214433890984288, "driven_lanedir_consec": 2.083007487440806, "sim_compute_sim_state": 0.010135098162737615, "sim_compute_performance-ego0": 0.0018643864386286167}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.678416334680083, "get_ui_image": 0.03636891994746301, "step_physics": 0.11447232053440676, "survival_time": 59.99999999999873, "driven_lanedir": 5.563840305333231, "get_state_dump": 0.004448289775927795, "get_robot_state": 0.0035312916218092996, "sim_render-ego0": 0.0036437179921171648, "get_duckie_state": 1.1877255276974592e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.015390221916835, "agent_compute-ego0": 0.012253181622685442, "complete-iteration": 0.19052610806283307, "set_robot_commands": 0.002123481129527985, "deviation-center-line": 2.3818410066490796, "driven_lanedir_consec": 5.563840305333231, "sim_compute_sim_state": 0.011714652217893575, "sim_compute_performance-ego0": 0.0018918315734990333}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.720240096153672, "get_ui_image": 0.03262675036796424, "step_physics": 0.10119528893527142, "survival_time": 59.99999999999873, "driven_lanedir": 5.6213110340082135, "get_state_dump": 0.004420088093842594, "get_robot_state": 0.0034990699761713873, "sim_render-ego0": 0.0036133074145035184, "get_duckie_state": 1.1869314608228495e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.563993094884092, "agent_compute-ego0": 0.012258173325575956, "complete-iteration": 0.17454429768602814, "set_robot_commands": 0.002060109232982728, "deviation-center-line": 2.1027776049124105, "driven_lanedir_consec": 5.6213110340082135, "sim_compute_sim_state": 0.012941947487569869, "sim_compute_performance-ego0": 0.001854971981763244}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.609614301064903, "get_ui_image": 0.025880620243348845, "step_physics": 0.08374743497341897, "survival_time": 59.99999999999873, "driven_lanedir": 5.492359029481852, "get_state_dump": 0.004424767132901232, "get_robot_state": 0.0034935629238792504, "sim_render-ego0": 0.0035677313506851387, "get_duckie_state": 1.1954676797249035e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.404008110144376, "agent_compute-ego0": 0.011731668872499743, "complete-iteration": 0.1428374519554602, "set_robot_commands": 0.002041521517065145, "deviation-center-line": 1.9741117786595812, "driven_lanedir_consec": 5.492359029481852, "sim_compute_sim_state": 0.006029309877051005, "sim_compute_performance-ego0": 0.001845862843611159}}
set_robot_commands_max0.002123481129527985
set_robot_commands_mean0.0020809310064228447
set_robot_commands_median0.0020793606895491245
set_robot_commands_min0.002041521517065145
sim_compute_performance-ego0_max0.0018918315734990333
sim_compute_performance-ego0_mean0.0018642632093755131
sim_compute_performance-ego0_median0.0018596792101959305
sim_compute_performance-ego0_min0.001845862843611159
sim_compute_sim_state_max0.012941947487569869
sim_compute_sim_state_mean0.010205251936313015
sim_compute_sim_state_median0.010924875190315595
sim_compute_sim_state_min0.006029309877051005
sim_render-ego0_max0.003668100808085649
sim_render-ego0_mean0.003623214391347868
sim_render-ego0_median0.003628512703310342
sim_render-ego0_min0.0035677313506851387
simulation-passed1
step_physics_max0.11447232053440676
step_physics_mean0.09908808741740244
step_physics_median0.099066297080892
step_physics_min0.08374743497341897
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5804310031Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:30:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.267481933171939
survival_time_median59.99999999999873
deviation-center-line_median2.37403258408529
in-drivable-lane_median11.099999999999651


other stats
agent_compute-ego0_max0.012838584164303724
agent_compute-ego0_mean0.01235734601613016
agent_compute-ego0_median0.01229201079804534
agent_compute-ego0_min0.01200677830412624
complete-iteration_max0.17756390452484208
complete-iteration_mean0.16052149688407913
complete-iteration_median0.16266359624486426
complete-iteration_min0.13919489052174588
deviation-center-line_max2.621757829509542
deviation-center-line_mean2.1596514565839344
deviation-center-line_min1.2687828286556146
deviation-heading_max14.461318524759504
deviation-heading_mean9.053151988956424
deviation-heading_median9.86898932673984
deviation-heading_min2.013310777586514
driven_any_max5.646166381728718
driven_any_mean5.07309502038136
driven_any_median5.3940917188440025
driven_any_min3.858030262108717
driven_lanedir_consec_max5.480999575839112
driven_lanedir_consec_mean3.5209157986225565
driven_lanedir_consec_min2.067699752307237
driven_lanedir_max5.480999575839112
driven_lanedir_mean4.001806819837634
driven_lanedir_median4.229263975602095
driven_lanedir_min2.067699752307237
get_duckie_state_max1.1976513636300803e-06
get_duckie_state_mean1.166193973030719e-06
get_duckie_state_median1.1711493816899816e-06
get_duckie_state_min1.1248257651128324e-06
get_robot_state_max0.0034880868675223253
get_robot_state_mean0.003444277879779703
get_robot_state_median0.003433844032732275
get_robot_state_min0.003421336586131938
get_state_dump_max0.004289056935179343
get_state_dump_mean0.004202159841822055
get_state_dump_median0.004178970282917515
get_state_dump_min0.004161641866273848
get_ui_image_max0.03508262491345306
get_ui_image_mean0.029838142292551932
get_ui_image_median0.029644885021019897
get_ui_image_min0.024980174214714868
in-drivable-lane_max22.79999999999948
in-drivable-lane_mean11.249999999999696
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.858030262108717, "get_ui_image": 0.027542727256662063, "step_physics": 0.09358512989083248, "survival_time": 43.89999999999964, "driven_lanedir": 2.067699752307237, "get_state_dump": 0.004161641866273848, "get_robot_state": 0.0034880868675223253, "sim_render-ego0": 0.003578111715826701, "get_duckie_state": 1.1248257651128324e-06, "in-drivable-lane": 22.79999999999948, "deviation-heading": 2.013310777586514, "agent_compute-ego0": 0.012838584164303724, "complete-iteration": 0.15902935115957423, "set_robot_commands": 0.0020339472708848557, "deviation-center-line": 1.2687828286556146, "driven_lanedir_consec": 2.067699752307237, "sim_compute_sim_state": 0.009887798383103025, "sim_compute_performance-ego0": 0.001843291337986448}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.646166381728718, "get_ui_image": 0.03508262491345306, "step_physics": 0.10369540829146336, "survival_time": 59.99999999999873, "driven_lanedir": 5.480999575839112, "get_state_dump": 0.004289056935179343, "get_robot_state": 0.0034365739353888237, "sim_render-ego0": 0.003551042248664748, "get_duckie_state": 1.1690649561441312e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.404534159970538, "agent_compute-ego0": 0.012238750449823005, "complete-iteration": 0.17756390452484208, "set_robot_commands": 0.0020343346162997713, "deviation-center-line": 2.5177303694952937, "driven_lanedir_consec": 5.480999575839112, "sim_compute_sim_state": 0.011329541893227707, "sim_compute_performance-ego0": 0.001833777344296318}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.46433140605651, "get_ui_image": 0.031747042785377724, "step_physics": 0.09764148234129943, "survival_time": 59.99999999999873, "driven_lanedir": 4.102286275270503, "get_state_dump": 0.0041787743469162055, "get_robot_state": 0.003421336586131938, "sim_render-ego0": 0.0035315669644980703, "get_duckie_state": 1.1732338072358322e-06, "in-drivable-lane": 14.649999999999352, "deviation-heading": 8.333444493509143, "agent_compute-ego0": 0.012345271146267676, "complete-iteration": 0.16629784133015427, "set_robot_commands": 0.002019845873588924, "deviation-center-line": 2.621757829509542, "driven_lanedir_consec": 2.178722190410192, "sim_compute_sim_state": 0.009525482104680225, "sim_compute_performance-ego0": 0.0018169117609130453}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.323852031631496, "get_ui_image": 0.024980174214714868, "step_physics": 0.08129247479593625, "survival_time": 59.99999999999873, "driven_lanedir": 4.356241675933686, "get_state_dump": 0.004179166218918825, "get_robot_state": 0.003431114130075726, "sim_render-ego0": 0.003547163033465561, "get_duckie_state": 1.1976513636300803e-06, "in-drivable-lane": 7.549999999999955, "deviation-heading": 14.461318524759504, "agent_compute-ego0": 0.01200677830412624, "complete-iteration": 0.13919489052174588, "set_robot_commands": 0.002024887007142384, "deviation-center-line": 2.230334798675287, "driven_lanedir_consec": 4.356241675933686, "sim_compute_sim_state": 0.005847662315082788, "sim_compute_performance-ego0": 0.001813899666740932}}
set_robot_commands_max0.0020343346162997713
set_robot_commands_mean0.0020282536919789835
set_robot_commands_median0.0020294171390136196
set_robot_commands_min0.002019845873588924
sim_compute_performance-ego0_max0.001843291337986448
sim_compute_performance-ego0_mean0.001826970027484186
sim_compute_performance-ego0_median0.0018253445526046816
sim_compute_performance-ego0_min0.001813899666740932
sim_compute_sim_state_max0.011329541893227707
sim_compute_sim_state_mean0.009147621174023436
sim_compute_sim_state_median0.009706640243891625
sim_compute_sim_state_min0.005847662315082788
sim_render-ego0_max0.003578111715826701
sim_render-ego0_mean0.00355197099061377
sim_render-ego0_median0.0035491026410651542
sim_render-ego0_min0.0035315669644980703
simulation-passed1
step_physics_max0.10369540829146336
step_physics_mean0.09405362382988287
step_physics_median0.09561330611606596
step_physics_min0.08129247479593625
survival_time_max59.99999999999873
survival_time_mean55.97499999999896
survival_time_min43.89999999999964
No reset possible
5801710025Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:35:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.543166130907488
survival_time_median59.99999999999873
deviation-center-line_median2.6344838093522323
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012515586182834902
agent_compute-ego0_mean0.012304515415782437
agent_compute-ego0_median0.01232849320801569
agent_compute-ego0_min0.012045489064263464
complete-iteration_max0.1871577287891525
complete-iteration_mean0.16730012613768186
complete-iteration_median0.16675369646229612
complete-iteration_min0.14853538283698267
deviation-center-line_max4.097865898664677
deviation-center-line_mean2.853646225817903
deviation-center-line_min2.0477513859024694
deviation-heading_max11.728280471614012
deviation-heading_mean9.784792326354417
deviation-heading_median10.30524607469281
deviation-heading_min6.800396684418034
driven_any_max5.953858394616479
driven_any_mean5.724087020027701
driven_any_median5.686902186732409
driven_any_min5.5686853120295075
driven_lanedir_consec_max5.867151743936579
driven_lanedir_consec_mean5.590380441416515
driven_lanedir_consec_min5.408037759914503
driven_lanedir_max5.867151743936579
driven_lanedir_mean5.590380441416515
driven_lanedir_median5.543166130907488
driven_lanedir_min5.408037759914503
get_duckie_state_max1.2435087256387906e-06
get_duckie_state_mean1.1912988286332028e-06
get_duckie_state_median1.2411265250149614e-06
get_duckie_state_min1.0394335388640975e-06
get_robot_state_max0.0036033271849899864
get_robot_state_mean0.0035835966083231216
get_robot_state_median0.0035954279069797283
get_robot_state_min0.003540203434343044
get_state_dump_max0.004649302445283838
get_state_dump_mean0.004504395613166116
get_state_dump_median0.004568640338094109
get_state_dump_min0.00423099933119241
get_ui_image_max0.03602437909497111
get_ui_image_mean0.030409195887655345
get_ui_image_median0.029992011365644344
get_ui_image_min0.025628381724361576
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.953858394616479, "get_ui_image": 0.02739481624218943, "step_physics": 0.08881887984613296, "survival_time": 59.99999999999873, "driven_lanedir": 5.867151743936579, "get_state_dump": 0.00423099933119241, "get_robot_state": 0.003540203434343044, "sim_render-ego0": 0.0035652167394099685, "get_duckie_state": 1.0394335388640975e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.800396684418034, "agent_compute-ego0": 0.012045489064263464, "complete-iteration": 0.1536952069558073, "set_robot_commands": 0.0020857961052760396, "deviation-center-line": 4.097865898664677, "driven_lanedir_consec": 5.867151743936579, "sim_compute_sim_state": 0.010094238657637698, "sim_compute_performance-ego0": 0.0018455444227944405}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.669182837457745, "get_ui_image": 0.03602437909497111, "step_physics": 0.1107134991740307, "survival_time": 59.99999999999873, "driven_lanedir": 5.506247773518766, "get_state_dump": 0.004649302445283838, "get_robot_state": 0.0036023566367524946, "sim_render-ego0": 0.003753400662856535, "get_duckie_state": 1.2435087256387906e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.728280471614012, "agent_compute-ego0": 0.012435214307087845, "complete-iteration": 0.1871577287891525, "set_robot_commands": 0.0021741715795690073, "deviation-center-line": 2.8699939020906338, "driven_lanedir_consec": 5.506247773518766, "sim_compute_sim_state": 0.011762091956666665, "sim_compute_performance-ego0": 0.001960360735878162}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.704621536007074, "get_ui_image": 0.03258920648909926, "step_physics": 0.1057055979148236, "survival_time": 59.99999999999873, "driven_lanedir": 5.58008448829621, "get_state_dump": 0.004544239457104228, "get_robot_state": 0.003588499177206962, "sim_render-ego0": 0.0037439701261369513, "get_duckie_state": 1.2415235584522665e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.814919816805112, "agent_compute-ego0": 0.012515586182834902, "complete-iteration": 0.17981218596878495, "set_robot_commands": 0.002124060004279576, "deviation-center-line": 2.3989737166138307, "driven_lanedir_consec": 5.58008448829621, "sim_compute_sim_state": 0.012988792668770592, "sim_compute_performance-ego0": 0.0019293470644732495}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.5686853120295075, "get_ui_image": 0.025628381724361576, "step_physics": 0.08845231356370657, "survival_time": 59.99999999999873, "driven_lanedir": 5.408037759914503, "get_state_dump": 0.0045930412190839905, "get_robot_state": 0.0036033271849899864, "sim_render-ego0": 0.0037402096239355183, "get_duckie_state": 1.2407294915776563e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.795572332580509, "agent_compute-ego0": 0.012221772108943535, "complete-iteration": 0.14853538283698267, "set_robot_commands": 0.002190452928249286, "deviation-center-line": 2.0477513859024694, "driven_lanedir_consec": 5.408037759914503, "sim_compute_sim_state": 0.006073485206902573, "sim_compute_performance-ego0": 0.0019486520212953235}}
set_robot_commands_max0.002190452928249286
set_robot_commands_mean0.002143620154343477
set_robot_commands_median0.002149115791924292
set_robot_commands_min0.0020857961052760396
sim_compute_performance-ego0_max0.001960360735878162
sim_compute_performance-ego0_mean0.001920976061110294
sim_compute_performance-ego0_median0.0019389995428842864
sim_compute_performance-ego0_min0.0018455444227944405
sim_compute_sim_state_max0.012988792668770592
sim_compute_sim_state_mean0.01022965212249438
sim_compute_sim_state_median0.010928165307152182
sim_compute_sim_state_min0.006073485206902573
sim_render-ego0_max0.003753400662856535
sim_render-ego0_mean0.0037006992880847423
sim_render-ego0_median0.003742089875036235
sim_render-ego0_min0.0035652167394099685
simulation-passed1
step_physics_max0.1107134991740307
step_physics_mean0.09842257262467348
step_physics_median0.09726223888047827
step_physics_min0.08845231356370657
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5800712732Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5800010066Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:14:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.92922874359408
survival_time_median18.57500000000013
deviation-center-line_median0.8633978329399582
in-drivable-lane_median8.375000000000092


other stats
agent_compute-ego0_max0.012748268810478415
agent_compute-ego0_mean0.011939363189855593
agent_compute-ego0_median0.011828981211712244
agent_compute-ego0_min0.011351221525519465
complete-iteration_max0.18809992713031817
complete-iteration_mean0.16043212702381027
complete-iteration_median0.1571561969851173
complete-iteration_min0.13931618699468828
deviation-center-line_max3.673791962589675
deviation-center-line_mean1.4376711432269245
deviation-center-line_min0.3500969444381059
deviation-heading_max5.119880135567113
deviation-heading_mean3.2683400990534777
deviation-heading_median3.3071215797613447
deviation-heading_min1.3392371011241089
driven_any_max9.452321062710178
driven_any_mean4.816379108745923
driven_any_median3.5315826908836083
driven_any_min2.7500299905062953
driven_lanedir_consec_max6.193921988060037
driven_lanedir_consec_mean2.792894415849819
driven_lanedir_consec_min1.119198188151079
driven_lanedir_max6.193921988060037
driven_lanedir_mean2.817278278807836
driven_lanedir_median1.9779964695101135
driven_lanedir_min1.119198188151079
get_duckie_state_max1.0676463777550095e-06
get_duckie_state_mean1.0398027606149985e-06
get_duckie_state_median1.0471575755369529e-06
get_duckie_state_min9.972495136310786e-07
get_robot_state_max0.0035376568525535626
get_robot_state_mean0.003496752762625257
get_robot_state_median0.0034974119949836907
get_robot_state_min0.0034545302079800836
get_state_dump_max0.004272099282290484
get_state_dump_mean0.004235444359033359
get_state_dump_median0.004233383802055045
get_state_dump_min0.0042029105497328615
get_ui_image_max0.035199846362320625
get_ui_image_mean0.03005607157917243
get_ui_image_median0.029900707118685997
get_ui_image_min0.02522302571699709
in-drivable-lane_max16.749999999999858
in-drivable-lane_mean10.062500000000036
in-drivable-lane_min6.750000000000096
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.5123288521650724, "get_ui_image": 0.02779752905197565, "step_physics": 0.08254216652548774, "survival_time": 18.05000000000012, "driven_lanedir": 2.2603613610521953, "get_state_dump": 0.0042029105497328615, "get_robot_state": 0.0035376568525535626, "sim_render-ego0": 0.003586028162287085, "get_duckie_state": 1.0327080995338397e-06, "in-drivable-lane": 6.750000000000096, "deviation-heading": 1.3392371011241089, "agent_compute-ego0": 0.01224831059492754, "complete-iteration": 0.1479684061766988, "set_robot_commands": 0.002093303928059109, "deviation-center-line": 0.8126077843279242, "driven_lanedir_consec": 2.2603613610521953, "sim_compute_sim_state": 0.01002815744494865, "sim_compute_performance-ego0": 0.001862215073727771}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.5508365296021447, "get_ui_image": 0.035199846362320625, "step_physics": 0.11568854060558986, "survival_time": 19.100000000000136, "driven_lanedir": 1.6956315779680315, "get_state_dump": 0.004216901316032708, "get_robot_state": 0.0034545302079800836, "sim_render-ego0": 0.0035695768211902587, "get_duckie_state": 9.972495136310786e-07, "in-drivable-lane": 8.550000000000122, "deviation-heading": 4.4588979126241375, "agent_compute-ego0": 0.011409651828496948, "complete-iteration": 0.18809992713031817, "set_robot_commands": 0.0020291680766770484, "deviation-center-line": 0.9141878815519922, "driven_lanedir_consec": 1.598096126135964, "sim_compute_sim_state": 0.010643108084058635, "sim_compute_performance-ego0": 0.0018195682655115352}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.7500299905062953, "get_ui_image": 0.03200388518539635, "step_physics": 0.0956122641627853, "survival_time": 14.750000000000076, "driven_lanedir": 1.119198188151079, "get_state_dump": 0.004272099282290484, "get_robot_state": 0.0034962956969802443, "sim_render-ego0": 0.003798374453106442, "get_duckie_state": 1.0616070515400654e-06, "in-drivable-lane": 8.200000000000063, "deviation-heading": 2.155345246898552, "agent_compute-ego0": 0.012748268810478415, "complete-iteration": 0.1663439877935358, "set_robot_commands": 0.002222178755579768, "deviation-center-line": 0.3500969444381059, "driven_lanedir_consec": 1.119198188151079, "sim_compute_sim_state": 0.010199815840334506, "sim_compute_performance-ego0": 0.0019200629479176289}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.452321062710178, "get_ui_image": 0.02522302571699709, "step_physics": 0.0815658798776411, "survival_time": 47.749999999999424, "driven_lanedir": 6.193921988060037, "get_state_dump": 0.004249866288077382, "get_robot_state": 0.003498528292987137, "sim_render-ego0": 0.0035623768383488993, "get_duckie_state": 1.0676463777550095e-06, "in-drivable-lane": 16.749999999999858, "deviation-heading": 5.119880135567113, "agent_compute-ego0": 0.011351221525519465, "complete-iteration": 0.13931618699468828, "set_robot_commands": 0.002106411686502241, "deviation-center-line": 3.673791962589675, "driven_lanedir_consec": 6.193921988060037, "sim_compute_sim_state": 0.0058485252089081445, "sim_compute_performance-ego0": 0.0018412777569503465}}
set_robot_commands_max0.002222178755579768
set_robot_commands_mean0.0021127656117045416
set_robot_commands_median0.002099857807280675
set_robot_commands_min0.0020291680766770484
sim_compute_performance-ego0_max0.0019200629479176289
sim_compute_performance-ego0_mean0.0018607810110268205
sim_compute_performance-ego0_median0.0018517464153390588
sim_compute_performance-ego0_min0.0018195682655115352
sim_compute_sim_state_max0.010643108084058635
sim_compute_sim_state_mean0.009179901644562484
sim_compute_sim_state_median0.010113986642641576
sim_compute_sim_state_min0.0058485252089081445
sim_render-ego0_max0.003798374453106442
sim_render-ego0_mean0.0036290890687331713
sim_render-ego0_median0.003577802491738672
sim_render-ego0_min0.0035623768383488993
simulation-passed1
step_physics_max0.11568854060558986
step_physics_mean0.093852212792876
step_physics_median0.08907721534413651
step_physics_min0.0815658798776411
survival_time_max47.749999999999424
survival_time_mean24.912499999999937
survival_time_min14.750000000000076
No reset possible
5798312731Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5797510060Raphael Jeansim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:11:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2793296721394496
survival_time_median20.90000000000016
deviation-center-line_median0.4282125091815885
in-drivable-lane_median13.90000000000015


other stats
agent_compute-ego0_max0.012594940701151282
agent_compute-ego0_mean0.012403388880678564
agent_compute-ego0_median0.012438641180298624
agent_compute-ego0_min0.012141332460965723
complete-iteration_max0.22701075165360063
complete-iteration_mean0.1862394194372771
complete-iteration_median0.1813165248238652
complete-iteration_min0.1553138764477773
deviation-center-line_max0.47803608401383335
deviation-center-line_mean0.43009401039350714
deviation-center-line_min0.38591493919701825
deviation-heading_max4.2194113943136875
deviation-heading_mean2.691728547434204
deviation-heading_median2.43309237762149
deviation-heading_min1.6813180401801475
driven_any_max6.862279441194016
driven_any_mean4.474331759175945
driven_any_median4.927535714466617
driven_any_min1.1799761665765305
driven_lanedir_consec_max2.115374111158261
driven_lanedir_consec_mean1.3746395211687004
driven_lanedir_consec_min0.8245246292376412
driven_lanedir_max2.115374111158261
driven_lanedir_mean1.3746395211687004
driven_lanedir_median1.2793296721394496
driven_lanedir_min0.8245246292376412
get_duckie_state_max1.434043601707176e-06
get_duckie_state_mean1.3086084099387562e-06
get_duckie_state_median1.3289551286331867e-06
get_duckie_state_min1.1424797807814758e-06
get_robot_state_max0.0035483579602391046
get_robot_state_mean0.003540672783001949
get_robot_state_median0.0035441018486195245
get_robot_state_min0.003526129474529641
get_state_dump_max0.00449013613103851
get_state_dump_mean0.004414621498863973
get_state_dump_median0.004452890615368492
get_state_dump_min0.0042625686336803985
get_ui_image_max0.03589292808815285
get_ui_image_mean0.030569533782393084
get_ui_image_median0.030197947772016787
get_ui_image_min0.025989311497385908
in-drivable-lane_max21.950000000000212
in-drivable-lane_mean12.437500000000128
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.168026473298973, "get_ui_image": 0.027784628675163136, "step_physics": 0.10732057397765232, "survival_time": 17.25000000000011, "driven_lanedir": 2.115374111158261, "get_state_dump": 0.0042625686336803985, "get_robot_state": 0.003526129474529641, "sim_render-ego0": 0.0035624669466404555, "get_duckie_state": 1.1424797807814758e-06, "in-drivable-lane": 8.250000000000117, "deviation-heading": 1.6813180401801475, "agent_compute-ego0": 0.012141332460965723, "complete-iteration": 0.17268980583014515, "set_robot_commands": 0.002093076016861579, "deviation-center-line": 0.4632772545436013, "driven_lanedir_consec": 2.115374111158261, "sim_compute_sim_state": 0.01009910023970411, "sim_compute_performance-ego0": 0.0018296613858614357}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.1799761665765305, "get_ui_image": 0.03589292808815285, "step_physics": 0.1526998007739032, "survival_time": 6.699999999999984, "driven_lanedir": 1.1252867099143788, "get_state_dump": 0.00445285196657534, "get_robot_state": 0.0035446290616635923, "sim_render-ego0": 0.0036746289994981553, "get_duckie_state": 1.434043601707176e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.842021770843398, "agent_compute-ego0": 0.012587729206791631, "complete-iteration": 0.22701075165360063, "set_robot_commands": 0.0021841790941026476, "deviation-center-line": 0.47803608401383335, "driven_lanedir_consec": 1.1252867099143788, "sim_compute_sim_state": 0.009952728836624711, "sim_compute_performance-ego0": 0.0019371350606282552}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.687044955634262, "get_ui_image": 0.032611266868870434, "step_physics": 0.11777146948062309, "survival_time": 24.550000000000217, "driven_lanedir": 0.8245246292376412, "get_state_dump": 0.00449013613103851, "get_robot_state": 0.003543574635575457, "sim_render-ego0": 0.003700769529110048, "get_duckie_state": 1.337470077886814e-06, "in-drivable-lane": 19.550000000000185, "deviation-heading": 4.2194113943136875, "agent_compute-ego0": 0.012594940701151282, "complete-iteration": 0.1899432438175853, "set_robot_commands": 0.0021679018571124815, "deviation-center-line": 0.38591493919701825, "driven_lanedir_consec": 0.8245246292376412, "sim_compute_sim_state": 0.011095403655757749, "sim_compute_performance-ego0": 0.001889056306544358}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.862279441194016, "get_ui_image": 0.025989311497385908, "step_physics": 0.09529550565659792, "survival_time": 28.650000000000272, "driven_lanedir": 1.4333726343645203, "get_state_dump": 0.004452929264161645, "get_robot_state": 0.0035483579602391046, "sim_render-ego0": 0.003668847815084956, "get_duckie_state": 1.3204401793795595e-06, "in-drivable-lane": 21.950000000000212, "deviation-heading": 3.024162984399582, "agent_compute-ego0": 0.012289553153805616, "complete-iteration": 0.1553138764477773, "set_robot_commands": 0.002147400420717246, "deviation-center-line": 0.3931477638195757, "driven_lanedir_consec": 1.4333726343645203, "sim_compute_sim_state": 0.005937047536364831, "sim_compute_performance-ego0": 0.001903886994418367}}
set_robot_commands_max0.0021841790941026476
set_robot_commands_mean0.002148139347198489
set_robot_commands_median0.002157651138914864
set_robot_commands_min0.002093076016861579
sim_compute_performance-ego0_max0.0019371350606282552
sim_compute_performance-ego0_mean0.001889934936863104
sim_compute_performance-ego0_median0.0018964716504813624
sim_compute_performance-ego0_min0.0018296613858614357
sim_compute_sim_state_max0.011095403655757749
sim_compute_sim_state_mean0.009271070067112853
sim_compute_sim_state_median0.010025914538164413
sim_compute_sim_state_min0.005937047536364831
sim_render-ego0_max0.003700769529110048
sim_render-ego0_mean0.003651678322583404
sim_render-ego0_median0.003671738407291555
sim_render-ego0_min0.0035624669466404555
simulation-passed1
step_physics_max0.1526998007739032
step_physics_mean0.11827183747219414
step_physics_median0.11254602172913768
step_physics_min0.09529550565659792
survival_time_max28.650000000000272
survival_time_mean19.287500000000147
survival_time_min6.699999999999984
No reset possible
5795910719Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:15:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7074240797873823
survival_time_median23.050000000000193
deviation-center-line_median0.6484075498163668
in-drivable-lane_median12.625000000000153


other stats
agent_compute-ego0_max0.013034823652985809
agent_compute-ego0_mean0.012733736048289084
agent_compute-ego0_median0.012675709740198963
agent_compute-ego0_min0.012548701059772594
complete-iteration_max0.22073613513599744
complete-iteration_mean0.18002825138154296
complete-iteration_median0.16900618126615363
complete-iteration_min0.16136450785786713
deviation-center-line_max0.9367330836521782
deviation-center-line_mean0.5967977452770544
deviation-center-line_min0.15364279782330567
deviation-heading_max5.533127002871957
deviation-heading_mean3.302484249599723
deviation-heading_median3.1990978575153077
deviation-heading_min1.278614280496319
driven_any_max9.315279863859695
driven_any_mean4.118809983949828
driven_any_median3.4347281884565373
driven_any_min0.2905036950265395
driven_lanedir_consec_max3.247056967536651
driven_lanedir_consec_mean1.6980002013529192
driven_lanedir_consec_min0.1300956783002616
driven_lanedir_max3.247056967536651
driven_lanedir_mean1.7329283904178538
driven_lanedir_median1.777280457917252
driven_lanedir_min0.1300956783002616
get_duckie_state_max1.261060722029529e-06
get_duckie_state_mean1.1831965930508162e-06
get_duckie_state_median1.1866697796937168e-06
get_duckie_state_min1.0983860907863029e-06
get_robot_state_max0.003633718986015815
get_robot_state_mean0.0035503673294762306
get_robot_state_median0.0035401755768036487
get_robot_state_min0.003487399178281811
get_state_dump_max0.004649610354982573
get_state_dump_mean0.004410337249772281
get_state_dump_median0.004372809445002271
get_state_dump_min0.00424611975410201
get_ui_image_max0.035881364500367795
get_ui_image_mean0.03069685638617504
get_ui_image_median0.0303500629018135
get_ui_image_min0.02620593524070535
in-drivable-lane_max43.44999999999917
in-drivable-lane_mean17.537499999999863
in-drivable-lane_min1.4499999999999948
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.3914392606875947, "get_ui_image": 0.02836006494303841, "step_physics": 0.09704858153613644, "survival_time": 20.05000000000015, "driven_lanedir": 1.9983052152949616, "get_state_dump": 0.004272068910930881, "get_robot_state": 0.003518392197528289, "sim_render-ego0": 0.003652038265816608, "get_duckie_state": 1.0983860907863029e-06, "in-drivable-lane": 10.800000000000152, "deviation-heading": 1.278614280496319, "agent_compute-ego0": 0.012620510153509491, "complete-iteration": 0.16378156344095865, "set_robot_commands": 0.0020975461646692076, "deviation-center-line": 0.3994474796147239, "driven_lanedir_consec": 1.9983052152949616, "sim_compute_sim_state": 0.010257325955291292, "sim_compute_performance-ego0": 0.0018797620611997383}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2905036950265395, "get_ui_image": 0.035881364500367795, "step_physics": 0.14598045720682515, "survival_time": 3.7999999999999945, "driven_lanedir": 0.1300956783002616, "get_state_dump": 0.004473549979073661, "get_robot_state": 0.003633718986015815, "sim_render-ego0": 0.0036788234462985744, "get_duckie_state": 1.235441728071733e-06, "in-drivable-lane": 1.4499999999999948, "deviation-heading": 1.6610947234786555, "agent_compute-ego0": 0.013034823652985809, "complete-iteration": 0.22073613513599744, "set_robot_commands": 0.002085329650284408, "deviation-center-line": 0.15364279782330567, "driven_lanedir_consec": 0.1300956783002616, "sim_compute_sim_state": 0.010008790276267311, "sim_compute_performance-ego0": 0.001879085193980824}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.315279863859695, "get_ui_image": 0.03234006086058859, "step_physics": 0.1010063691103488, "survival_time": 59.99999999999873, "driven_lanedir": 3.247056967536651, "get_state_dump": 0.00424611975410201, "get_robot_state": 0.003487399178281811, "sim_render-ego0": 0.003622633928462528, "get_duckie_state": 1.1378978313157004e-06, "in-drivable-lane": 43.44999999999917, "deviation-heading": 4.7371009915519595, "agent_compute-ego0": 0.01273090932688844, "complete-iteration": 0.17423079909134864, "set_robot_commands": 0.0020851910263175867, "deviation-center-line": 0.9367330836521782, "driven_lanedir_consec": 3.247056967536651, "sim_compute_sim_state": 0.012803043751395016, "sim_compute_performance-ego0": 0.0018356209690624432}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.4780171162254803, "get_ui_image": 0.02620593524070535, "step_physics": 0.1005203481834967, "survival_time": 26.050000000000235, "driven_lanedir": 1.5562557005395423, "get_state_dump": 0.004649610354982573, "get_robot_state": 0.003561958956079008, "sim_render-ego0": 0.0037012529555865174, "get_duckie_state": 1.261060722029529e-06, "in-drivable-lane": 14.450000000000149, "deviation-heading": 5.533127002871957, "agent_compute-ego0": 0.012548701059772594, "complete-iteration": 0.16136450785786713, "set_robot_commands": 0.0021399200190986255, "deviation-center-line": 0.8973676200180097, "driven_lanedir_consec": 1.4165429442798032, "sim_compute_sim_state": 0.0060770662351586355, "sim_compute_performance-ego0": 0.001880059297057404}}
set_robot_commands_max0.0021399200190986255
set_robot_commands_mean0.002101996715092457
set_robot_commands_median0.002091437907476808
set_robot_commands_min0.0020851910263175867
sim_compute_performance-ego0_max0.001880059297057404
sim_compute_performance-ego0_mean0.0018686318803251025
sim_compute_performance-ego0_median0.0018794236275902813
sim_compute_performance-ego0_min0.0018356209690624432
sim_compute_sim_state_max0.012803043751395016
sim_compute_sim_state_mean0.009786556554528064
sim_compute_sim_state_median0.010133058115779303
sim_compute_sim_state_min0.0060770662351586355
sim_render-ego0_max0.0037012529555865174
sim_render-ego0_mean0.003663687149041057
sim_render-ego0_median0.003665430856057591
sim_render-ego0_min0.003622633928462528
simulation-passed1
step_physics_max0.14598045720682515
step_physics_mean0.11113893900920176
step_physics_median0.10076335864692276
step_physics_min0.09704858153613644
survival_time_max59.99999999999873
survival_time_mean27.474999999999778
survival_time_min3.7999999999999945
No reset possible
5795210726Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:06:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5794110738Dishank Bansal 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:23:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.449102107204245
survival_time_median53.699999999999086
deviation-center-line_median2.2240170009268914
in-drivable-lane_median1.450000000000002


other stats
agent_compute-ego0_max0.012923770480685765
agent_compute-ego0_mean0.012267156304185949
agent_compute-ego0_median0.01221893342581909
agent_compute-ego0_min0.011706987884419843
complete-iteration_max0.22426645717923605
complete-iteration_mean0.17046263399297795
complete-iteration_median0.15972547389702024
complete-iteration_min0.13813313099863528
deviation-center-line_max4.507933751695632
deviation-center-line_mean2.26455496268841
deviation-center-line_min0.10225209720422272
deviation-heading_max10.660689272527492
deviation-heading_mean6.097199364848016
deviation-heading_median6.297626984030909
deviation-heading_min1.1328542188027533
driven_any_max8.338069146308921
driven_any_mean5.859109853657045
driven_any_median7.4052318412203535
driven_any_min0.2879065858785484
driven_lanedir_consec_max8.106879722772375
driven_lanedir_consec_mean4.782415596214744
driven_lanedir_consec_min0.12457844767811156
driven_lanedir_max8.106879722772375
driven_lanedir_mean4.782415596214744
driven_lanedir_median5.449102107204245
driven_lanedir_min0.12457844767811156
get_duckie_state_max1.1126200358072915e-06
get_duckie_state_mean1.0799353249254958e-06
get_duckie_state_median1.0981370662582713e-06
get_duckie_state_min1.0108471313781484e-06
get_robot_state_max0.0034460574760722877
get_robot_state_mean0.003426293085466552
get_robot_state_median0.0034227661822239007
get_robot_state_min0.003413582501346118
get_state_dump_max0.004238025433415676
get_state_dump_mean0.004191341337769063
get_state_dump_median0.004194849415199655
get_state_dump_min0.004137641087261267
get_ui_image_max0.03556014242626372
get_ui_image_mean0.03006109278918039
get_ui_image_median0.029685548259117137
get_ui_image_min0.025313132212223557
in-drivable-lane_max24.799999999999795
in-drivable-lane_mean7.149999999999937
in-drivable-lane_min0.8999999999999488
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.331165551043027, "get_ui_image": 0.027480889121062748, "step_physics": 0.08526836604897327, "survival_time": 59.99999999999873, "driven_lanedir": 8.106879722772375, "get_state_dump": 0.004137641087261267, "get_robot_state": 0.0034460574760722877, "sim_render-ego0": 0.0035368826466734265, "get_duckie_state": 1.0108471313781484e-06, "in-drivable-lane": 0.8999999999999488, "deviation-heading": 6.663275948505493, "agent_compute-ego0": 0.011816479185042432, "complete-iteration": 0.14895332584174645, "set_robot_commands": 0.002040101526976624, "deviation-center-line": 2.837169670047046, "driven_lanedir_consec": 8.106879722772375, "sim_compute_sim_state": 0.009320252146153127, "sim_compute_performance-ego0": 0.001838061930634993}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2879065858785484, "get_ui_image": 0.03556014242626372, "step_physics": 0.15140326439388216, "survival_time": 3.099999999999997, "driven_lanedir": 0.12457844767811156, "get_state_dump": 0.00420636222476051, "get_robot_state": 0.003417121039496528, "sim_render-ego0": 0.003566673823765346, "get_duckie_state": 1.1126200358072915e-06, "in-drivable-lane": 1.4999999999999962, "deviation-heading": 1.1328542188027533, "agent_compute-ego0": 0.012923770480685765, "complete-iteration": 0.22426645717923605, "set_robot_commands": 0.0020596981048583984, "deviation-center-line": 0.10225209720422272, "driven_lanedir_consec": 0.12457844767811156, "sim_compute_sim_state": 0.009257218194386315, "sim_compute_performance-ego0": 0.0018022779434446305}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.47929813139768, "get_ui_image": 0.03189020739717152, "step_physics": 0.0998480450617124, "survival_time": 47.39999999999944, "driven_lanedir": 2.9499961335764344, "get_state_dump": 0.0041833366056388, "get_robot_state": 0.003413582501346118, "sim_render-ego0": 0.0035766070459363835, "get_duckie_state": 1.0978811282126746e-06, "in-drivable-lane": 24.799999999999795, "deviation-heading": 5.9319780195563245, "agent_compute-ego0": 0.012621387666595749, "complete-iteration": 0.17049762195229404, "set_robot_commands": 0.0020048947429757475, "deviation-center-line": 1.610864331806737, "driven_lanedir_consec": 2.9499961335764344, "sim_compute_sim_state": 0.011076566668029078, "sim_compute_performance-ego0": 0.0018135616977800184}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.338069146308921, "get_ui_image": 0.025313132212223557, "step_physics": 0.08007445899175665, "survival_time": 59.99999999999873, "driven_lanedir": 7.948208080832056, "get_state_dump": 0.004238025433415676, "get_robot_state": 0.0034284113249512735, "sim_render-ego0": 0.0035245388771076185, "get_duckie_state": 1.098393004303868e-06, "in-drivable-lane": 1.4000000000000077, "deviation-heading": 10.660689272527492, "agent_compute-ego0": 0.011706987884419843, "complete-iteration": 0.13813313099863528, "set_robot_commands": 0.002026413203675384, "deviation-center-line": 4.507933751695632, "driven_lanedir_consec": 7.948208080832056, "sim_compute_sim_state": 0.005940446647180308, "sim_compute_performance-ego0": 0.0018121459700483568}}
set_robot_commands_max0.0020596981048583984
set_robot_commands_mean0.0020327768946215383
set_robot_commands_median0.002033257365326004
set_robot_commands_min0.0020048947429757475
sim_compute_performance-ego0_max0.001838061930634993
sim_compute_performance-ego0_mean0.0018165118854769997
sim_compute_performance-ego0_median0.0018128538339141872
sim_compute_performance-ego0_min0.0018022779434446305
sim_compute_sim_state_max0.011076566668029078
sim_compute_sim_state_mean0.008898620913937207
sim_compute_sim_state_median0.00928873517026972
sim_compute_sim_state_min0.005940446647180308
sim_render-ego0_max0.0035766070459363835
sim_render-ego0_mean0.0035511755983706934
sim_render-ego0_median0.0035517782352193863
sim_render-ego0_min0.0035245388771076185
simulation-passed1
step_physics_max0.15140326439388216
step_physics_mean0.10414853362408112
step_physics_median0.09255820555534285
step_physics_min0.08007445899175665
survival_time_max59.99999999999873
survival_time_mean42.624999999999226
survival_time_min3.099999999999997
No reset possible
5792810752Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:18:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.673667075270156
survival_time_median34.424999999999486
deviation-center-line_median1.3181111569516413
in-drivable-lane_median2.4750000000000223


other stats
agent_compute-ego0_max0.012303806486583892
agent_compute-ego0_mean0.011771867166743484
agent_compute-ego0_median0.011947580653845746
agent_compute-ego0_min0.010888500872698551
complete-iteration_max0.2377400284721738
complete-iteration_mean0.18771240555720745
complete-iteration_median0.18096297075705092
complete-iteration_min0.15118365224255412
deviation-center-line_max3.068398065970239
deviation-center-line_mean1.4503606196298071
deviation-center-line_min0.09682209864570816
deviation-heading_max11.622616292587894
deviation-heading_mean5.290303186077152
deviation-heading_median4.197902921347675
deviation-heading_min1.142790609025362
driven_any_max8.337893608882053
driven_any_mean4.4876348099299435
driven_any_median4.66237090148873
driven_any_min0.28790382786026236
driven_lanedir_consec_max8.127085173964316
driven_lanedir_consec_mean3.8971204652077023
driven_lanedir_consec_min0.11406253632618446
driven_lanedir_max8.127085173964316
driven_lanedir_mean3.8971204652077023
driven_lanedir_median3.673667075270156
driven_lanedir_min0.11406253632618446
get_duckie_state_max1.2455896438221209e-06
get_duckie_state_mean1.1856116919612031e-06
get_duckie_state_median1.1761048621364044e-06
get_duckie_state_min1.1446473997498828e-06
get_robot_state_max0.003591165736370289
get_robot_state_mean0.00349425057716739
get_robot_state_median0.0034665728757269617
get_robot_state_min0.0034526908208453466
get_state_dump_max0.00448436640176672
get_state_dump_mean0.0043918767890101925
get_state_dump_median0.0043772491971475515
get_state_dump_min0.004328642359978948
get_ui_image_max0.035838691015092156
get_ui_image_mean0.030639514006390874
get_ui_image_median0.03052251363064594
get_ui_image_min0.025674337749179457
in-drivable-lane_max11.049999999999372
in-drivable-lane_mean3.9999999999998543
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.751063836019021, "get_ui_image": 0.02809583445741094, "step_physics": 0.0980558740797818, "survival_time": 56.54999999999893, "driven_lanedir": 6.202396839597305, "get_state_dump": 0.00448436640176672, "get_robot_state": 0.003591165736370289, "sim_render-ego0": 0.003688248644448001, "get_duckie_state": 1.2455896438221209e-06, "in-drivable-lane": 11.049999999999372, "deviation-heading": 6.427510743986503, "agent_compute-ego0": 0.0116611308428087, "complete-iteration": 0.16341870012215928, "set_robot_commands": 0.0022499283295216916, "deviation-center-line": 2.1993998696291013, "driven_lanedir_consec": 6.202396839597305, "sim_compute_sim_state": 0.00959967640179206, "sim_compute_performance-ego0": 0.0019126639770534772}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.28790382786026236, "get_ui_image": 0.035838691015092156, "step_physics": 0.16492467077951584, "survival_time": 3.099999999999997, "driven_lanedir": 0.11406253632618446, "get_state_dump": 0.0043510520269000345, "get_robot_state": 0.0034526908208453466, "sim_render-ego0": 0.0035847557915581595, "get_duckie_state": 1.1504642547123015e-06, "in-drivable-lane": 1.5499999999999965, "deviation-heading": 1.142790609025362, "agent_compute-ego0": 0.012303806486583892, "complete-iteration": 0.2377400284721738, "set_robot_commands": 0.002049188765268477, "deviation-center-line": 0.09682209864570816, "driven_lanedir_consec": 0.11406253632618446, "sim_compute_sim_state": 0.00934374900091262, "sim_compute_performance-ego0": 0.001816329501924061}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.5736779669584384, "get_ui_image": 0.03294919280388094, "step_physics": 0.12882186526711653, "survival_time": 12.30000000000004, "driven_lanedir": 1.144937310943007, "get_state_dump": 0.004403446367395069, "get_robot_state": 0.0034630588191723534, "sim_render-ego0": 0.003670208849887616, "get_duckie_state": 1.2017454695605073e-06, "in-drivable-lane": 3.4000000000000483, "deviation-heading": 1.9682950987088457, "agent_compute-ego0": 0.012234030464882792, "complete-iteration": 0.19850724139194256, "set_robot_commands": 0.0020403813736641456, "deviation-center-line": 0.4368224442741813, "driven_lanedir_consec": 1.144937310943007, "sim_compute_sim_state": 0.009009148910460684, "sim_compute_performance-ego0": 0.0018422748395788525}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.337893608882053, "get_ui_image": 0.025674337749179457, "step_physics": 0.09331983372531864, "survival_time": 59.99999999999873, "driven_lanedir": 8.127085173964316, "get_state_dump": 0.004328642359978948, "get_robot_state": 0.0034700869322815703, "sim_render-ego0": 0.0035373166042204007, "get_duckie_state": 1.1446473997498828e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.622616292587894, "agent_compute-ego0": 0.010888500872698551, "complete-iteration": 0.15118365224255412, "set_robot_commands": 0.0020502667740719405, "deviation-center-line": 3.068398065970239, "driven_lanedir_consec": 8.127085173964316, "sim_compute_sim_state": 0.00601853458807927, "sim_compute_performance-ego0": 0.0018213460288575845}}
set_robot_commands_max0.0022499283295216916
set_robot_commands_mean0.0020974413106315637
set_robot_commands_median0.002049727769670209
set_robot_commands_min0.0020403813736641456
sim_compute_performance-ego0_max0.0019126639770534772
sim_compute_performance-ego0_mean0.0018481535868534937
sim_compute_performance-ego0_median0.0018318104342182184
sim_compute_performance-ego0_min0.001816329501924061
sim_compute_sim_state_max0.00959967640179206
sim_compute_sim_state_mean0.00849277722531116
sim_compute_sim_state_median0.009176448955686652
sim_compute_sim_state_min0.00601853458807927
sim_render-ego0_max0.003688248644448001
sim_render-ego0_mean0.003620132472528544
sim_render-ego0_median0.003627482320722888
sim_render-ego0_min0.0035373166042204007
simulation-passed1
step_physics_max0.16492467077951584
step_physics_mean0.1212805609629332
step_physics_median0.11343886967344916
step_physics_min0.09331983372531864
survival_time_max59.99999999999873
survival_time_mean32.98749999999942
survival_time_min3.099999999999997
No reset possible
5791210764Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:24:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4277644035845363
survival_time_median46.22499999999951
deviation-center-line_median1.3688490540967178
in-drivable-lane_median15.025000000000198


other stats
agent_compute-ego0_max0.01286794680739124
agent_compute-ego0_mean0.012417233488855674
agent_compute-ego0_median0.012507970947143662
agent_compute-ego0_min0.011785045253744133
complete-iteration_max0.1839549820969414
complete-iteration_mean0.16469627841853135
complete-iteration_median0.16763876182787285
complete-iteration_min0.13955260792143837
deviation-center-line_max2.9384067123245003
deviation-center-line_mean1.563373374393882
deviation-center-line_min0.5773886770575932
deviation-heading_max10.230869302459482
deviation-heading_mean5.655220684874429
deviation-heading_median5.232108115782822
deviation-heading_min1.9257972054725925
driven_any_max7.669322209765842
driven_any_mean5.565874382471828
driven_any_median5.585227144024602
driven_any_min3.423721032072268
driven_lanedir_consec_max7.523985732788813
driven_lanedir_consec_mean3.598467450381578
driven_lanedir_consec_min2.0143552615684266
driven_lanedir_max7.523985732788813
driven_lanedir_mean3.598467450381578
driven_lanedir_median2.4277644035845363
driven_lanedir_min2.0143552615684266
get_duckie_state_max1.2122667752779446e-06
get_duckie_state_mean1.1993628027340954e-06
get_duckie_state_median1.1992257457771197e-06
get_duckie_state_min1.186732944104197e-06
get_robot_state_max0.003537909434391902
get_robot_state_mean0.0035051330088279476
get_robot_state_median0.0035000078684086604
get_robot_state_min0.0034826068641025686
get_state_dump_max0.00440851064828726
get_state_dump_mean0.004354090180265883
get_state_dump_median0.004345857035011971
get_state_dump_min0.004316136002752328
get_ui_image_max0.03576238244295544
get_ui_image_mean0.030472602025115415
get_ui_image_median0.030279628854844552
get_ui_image_min0.02556876794781713
in-drivable-lane_max37.549999999999095
in-drivable-lane_mean16.89999999999987
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.081092392475396, "get_ui_image": 0.028203120965224045, "step_physics": 0.09538974798642672, "survival_time": 32.450000000000294, "driven_lanedir": 2.0143552615684266, "get_state_dump": 0.00440851064828726, "get_robot_state": 0.003537909434391902, "sim_render-ego0": 0.0037069621452918418, "get_duckie_state": 1.2122667752779446e-06, "in-drivable-lane": 19.15000000000024, "deviation-heading": 1.9257972054725925, "agent_compute-ego0": 0.012561979293823244, "complete-iteration": 0.16239529389601487, "set_robot_commands": 0.002094232119046725, "deviation-center-line": 0.5773886770575932, "driven_lanedir_consec": 2.0143552615684266, "sim_compute_sim_state": 0.01053238428556002, "sim_compute_performance-ego0": 0.0018882659765390249}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.423721032072268, "get_ui_image": 0.03576238244295544, "step_physics": 0.10880586859599736, "survival_time": 28.100000000000264, "driven_lanedir": 2.0473028611906425, "get_state_dump": 0.004316136002752328, "get_robot_state": 0.0034826068641025686, "sim_render-ego0": 0.003654188627036384, "get_duckie_state": 1.21072596385678e-06, "in-drivable-lane": 10.900000000000157, "deviation-heading": 4.5566024127694895, "agent_compute-ego0": 0.012453962600464084, "complete-iteration": 0.1839549820969414, "set_robot_commands": 0.0021222514327000133, "deviation-center-line": 1.2165390840982089, "driven_lanedir_consec": 2.0473028611906425, "sim_compute_sim_state": 0.011405351953862192, "sim_compute_performance-ego0": 0.0018823921786320149}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.089361895573807, "get_ui_image": 0.03235613674446506, "step_physics": 0.10043949469440087, "survival_time": 59.99999999999873, "driven_lanedir": 2.8082259459784304, "get_state_dump": 0.0043298809057866205, "get_robot_state": 0.0034997572410513616, "sim_render-ego0": 0.0036578146643086737, "get_duckie_state": 1.1877255276974592e-06, "in-drivable-lane": 37.549999999999095, "deviation-heading": 5.907613818796153, "agent_compute-ego0": 0.01286794680739124, "complete-iteration": 0.17288222975973086, "set_robot_commands": 0.0020538291565881583, "deviation-center-line": 1.5211590240952266, "driven_lanedir_consec": 2.8082259459784304, "sim_compute_sim_state": 0.011751484414322192, "sim_compute_performance-ego0": 0.0018564167864415968}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.669322209765842, "get_ui_image": 0.02556876794781713, "step_physics": 0.08062923778403709, "survival_time": 59.99999999999873, "driven_lanedir": 7.523985732788813, "get_state_dump": 0.0043618331642373215, "get_robot_state": 0.003500258495765959, "sim_render-ego0": 0.0035683151883546954, "get_duckie_state": 1.186732944104197e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.230869302459482, "agent_compute-ego0": 0.011785045253744133, "complete-iteration": 0.13955260792143837, "set_robot_commands": 0.002106989154609217, "deviation-center-line": 2.9384067123245003, "driven_lanedir_consec": 7.523985732788813, "sim_compute_sim_state": 0.00610911359794928, "sim_compute_performance-ego0": 0.00185190112664241}}
set_robot_commands_max0.0021222514327000133
set_robot_commands_mean0.002094325465736028
set_robot_commands_median0.0021006106368279707
set_robot_commands_min0.0020538291565881583
sim_compute_performance-ego0_max0.0018882659765390249
sim_compute_performance-ego0_mean0.0018697440170637617
sim_compute_performance-ego0_median0.0018694044825368055
sim_compute_performance-ego0_min0.00185190112664241
sim_compute_sim_state_max0.011751484414322192
sim_compute_sim_state_mean0.00994958356292342
sim_compute_sim_state_median0.010968868119711104
sim_compute_sim_state_min0.00610911359794928
sim_render-ego0_max0.0037069621452918418
sim_render-ego0_mean0.0036468201562478986
sim_render-ego0_median0.0036560016456725288
sim_render-ego0_min0.0035683151883546954
simulation-passed1
step_physics_max0.10880586859599736
step_physics_mean0.09631608726521552
step_physics_median0.0979146213404138
step_physics_min0.08062923778403709
survival_time_max59.99999999999873
survival_time_mean45.137499999999505
survival_time_min28.100000000000264
No reset possible
5789310776Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:18:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2743131208965828
survival_time_median31.87500000000002
deviation-center-line_median1.085502518195078
in-drivable-lane_median17.87499999999973


other stats
agent_compute-ego0_max0.013048273371899222
agent_compute-ego0_mean0.012547483715169123
agent_compute-ego0_median0.01249170984636024
agent_compute-ego0_min0.012158241796056794
complete-iteration_max0.1992608984624307
complete-iteration_mean0.16627730196865873
complete-iteration_median0.1585759882132297
complete-iteration_min0.14869633298574478
deviation-center-line_max2.1725763935791145
deviation-center-line_mean1.235979155541324
deviation-center-line_min0.6003351921960253
deviation-heading_max6.836427654595743
deviation-heading_mean3.091423027296532
deviation-heading_median2.082561839049347
deviation-heading_min1.3641407764916895
driven_any_max11.673324250225528
driven_any_mean6.5004589853827675
driven_any_median6.028427327730304
driven_any_min2.271657035844937
driven_lanedir_consec_max6.571018390806573
driven_lanedir_consec_mean3.268530721867962
driven_lanedir_consec_min1.9544782548721105
driven_lanedir_max6.579711927204363
driven_lanedir_mean3.2707041059674093
driven_lanedir_median2.2743131208965828
driven_lanedir_min1.9544782548721105
get_duckie_state_max1.2978929819076406e-06
get_duckie_state_mean1.155147587807492e-06
get_duckie_state_median1.1429920516786e-06
get_duckie_state_min1.0367132659651277e-06
get_robot_state_max0.003578025561112624
get_robot_state_mean0.00353634444108008
get_robot_state_median0.003556537372683083
get_robot_state_min0.0034542774578415285
get_state_dump_max0.004550284007276387
get_state_dump_mean0.0043761720515290954
get_state_dump_median0.004365452414639136
get_state_dump_min0.004223499369561722
get_ui_image_max0.03637779134465015
get_ui_image_mean0.030538257262065625
get_ui_image_median0.02996068373368617
get_ui_image_min0.025853870236240004
in-drivable-lane_max27.99999999999977
in-drivable-lane_mean16.399999999999814
in-drivable-lane_min1.8500000000000263
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.355537595629821, "get_ui_image": 0.027865009430127267, "step_physics": 0.0829715998763712, "survival_time": 23.350000000000197, "driven_lanedir": 2.221554053739814, "get_state_dump": 0.004244703512925368, "get_robot_state": 0.003578025561112624, "sim_render-ego0": 0.00363616148630778, "get_duckie_state": 1.0367132659651277e-06, "in-drivable-lane": 11.500000000000163, "deviation-heading": 1.3641407764916895, "agent_compute-ego0": 0.012382322906428931, "complete-iteration": 0.14921577363951594, "set_robot_commands": 0.002101454979334122, "deviation-center-line": 0.6003351921960253, "driven_lanedir_consec": 2.221554053739814, "sim_compute_sim_state": 0.010510738588805892, "sim_compute_performance-ego0": 0.0018577346434959995}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.271657035844937, "get_ui_image": 0.03637779134465015, "step_physics": 0.1230732352714839, "survival_time": 12.650000000000045, "driven_lanedir": 1.9544782548721105, "get_state_dump": 0.004486201316352904, "get_robot_state": 0.003556874793345534, "sim_render-ego0": 0.0037577584033875954, "get_duckie_state": 1.1564239742249016e-06, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 2.7861857098538745, "agent_compute-ego0": 0.013048273371899222, "complete-iteration": 0.1992608984624307, "set_robot_commands": 0.0021500906606358805, "deviation-center-line": 0.6371364992970897, "driven_lanedir_consec": 1.9544782548721105, "sim_compute_sim_state": 0.010822233252637968, "sim_compute_performance-ego0": 0.0019125750684362696}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.673324250225528, "get_ui_image": 0.03205635803724507, "step_physics": 0.0970442392347655, "survival_time": 59.99999999999873, "driven_lanedir": 6.579711927204363, "get_state_dump": 0.004223499369561722, "get_robot_state": 0.0034542774578415285, "sim_render-ego0": 0.003566839018034796, "get_duckie_state": 1.1295601291322986e-06, "in-drivable-lane": 24.249999999999297, "deviation-heading": 6.836427654595743, "agent_compute-ego0": 0.012158241796056794, "complete-iteration": 0.1679362027869435, "set_robot_commands": 0.0020314118546510516, "deviation-center-line": 2.1725763935791145, "driven_lanedir_consec": 6.571018390806573, "sim_compute_sim_state": 0.011510230817961554, "sim_compute_performance-ego0": 0.0018233220642750508}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.701317059830786, "get_ui_image": 0.025853870236240004, "step_physics": 0.08820732857005116, "survival_time": 40.39999999999984, "driven_lanedir": 2.327072188053351, "get_state_dump": 0.004550284007276387, "get_robot_state": 0.0035561999520206332, "sim_render-ego0": 0.003671124190718341, "get_duckie_state": 1.2978929819076406e-06, "in-drivable-lane": 27.99999999999977, "deviation-heading": 1.3789379682448195, "agent_compute-ego0": 0.012601096786291548, "complete-iteration": 0.14869633298574478, "set_robot_commands": 0.002156277964230079, "deviation-center-line": 1.5338685370930665, "driven_lanedir_consec": 2.327072188053351, "sim_compute_sim_state": 0.006110056958475572, "sim_compute_performance-ego0": 0.0019130913082542464}}
set_robot_commands_max0.002156277964230079
set_robot_commands_mean0.0021098088647127835
set_robot_commands_median0.0021257728199850015
set_robot_commands_min0.0020314118546510516
sim_compute_performance-ego0_max0.0019130913082542464
sim_compute_performance-ego0_mean0.0018766807711153915
sim_compute_performance-ego0_median0.0018851548559661348
sim_compute_performance-ego0_min0.0018233220642750508
sim_compute_sim_state_max0.011510230817961554
sim_compute_sim_state_mean0.009738314904470248
sim_compute_sim_state_median0.010666485920721927
sim_compute_sim_state_min0.006110056958475572
sim_render-ego0_max0.0037577584033875954
sim_render-ego0_mean0.003657970774612128
sim_render-ego0_median0.003653642838513061
sim_render-ego0_min0.003566839018034796
simulation-passed1
step_physics_max0.1230732352714839
step_physics_mean0.09782410073816794
step_physics_median0.09262578390240832
step_physics_min0.0829715998763712
survival_time_max59.99999999999873
survival_time_mean34.0999999999997
survival_time_min12.650000000000045
No reset possible
5786910788Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:17:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.4107176768710503
survival_time_median27.62499999999978
deviation-center-line_median1.0571652910690177
in-drivable-lane_median8.299999999999775


other stats
agent_compute-ego0_max0.01238830924639242
agent_compute-ego0_mean0.01199754542952462
agent_compute-ego0_median0.012055604309192808
agent_compute-ego0_min0.011490663853320447
complete-iteration_max0.1981875429448393
complete-iteration_mean0.17141655419387278
complete-iteration_median0.1712327683262726
complete-iteration_min0.14501313717810663
deviation-center-line_max2.9745848631070615
deviation-center-line_mean1.3319614880673456
deviation-center-line_min0.2389305070242855
deviation-heading_max16.324108873477886
deviation-heading_mean7.452280808561
deviation-heading_median6.1734082827513035
deviation-heading_min1.1381977952635036
driven_any_max10.376458597403536
driven_any_mean5.260303963701258
driven_any_median4.6077785093465335
driven_any_min1.4492002387084288
driven_lanedir_consec_max7.484610966452427
driven_lanedir_consec_mean3.2424119404596743
driven_lanedir_consec_min0.6636014416441682
driven_lanedir_max7.706298707236943
driven_lanedir_mean3.613697043120888
driven_lanedir_median3.0421426243472585
driven_lanedir_min0.6642042165520916
get_duckie_state_max1.6047869842064563e-06
get_duckie_state_mean1.55537629307975e-06
get_duckie_state_median1.54813931997681e-06
get_duckie_state_min1.5204395481589237e-06
get_robot_state_max0.003505445737624347
get_robot_state_mean0.00346893467284177
get_robot_state_median0.0034633843183274364
get_robot_state_min0.003443524317087861
get_state_dump_max0.004230865498179013
get_state_dump_mean0.0042039500332832136
get_state_dump_median0.0042126526201922395
get_state_dump_min0.004159629394569365
get_ui_image_max0.03531161288625186
get_ui_image_mean0.030064382267826317
get_ui_image_median0.02977227134955547
get_ui_image_min0.025401373485942465
in-drivable-lane_max11.39999999999966
in-drivable-lane_mean8.287499999999806
in-drivable-lane_min5.150000000000013
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.376458597403536, "get_ui_image": 0.027647596910335345, "step_physics": 0.10031249977766128, "survival_time": 59.99999999999873, "driven_lanedir": 7.706298707236943, "get_state_dump": 0.004159629394569365, "get_robot_state": 0.003505445737624347, "sim_render-ego0": 0.0035664183611079717, "get_duckie_state": 1.5204395481589237e-06, "in-drivable-lane": 11.39999999999954, "deviation-heading": 16.324108873477886, "agent_compute-ego0": 0.01199260976888258, "complete-iteration": 0.16434239050827854, "set_robot_commands": 0.002082094165506609, "deviation-center-line": 2.9745848631070615, "driven_lanedir_consec": 7.484610966452427, "sim_compute_sim_state": 0.009167670211029688, "sim_compute_performance-ego0": 0.001838745622214032}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4492002387084288, "get_ui_image": 0.03531161288625186, "step_physics": 0.1260564536163487, "survival_time": 9.650000000000002, "driven_lanedir": 0.6642042165520916, "get_state_dump": 0.004230865498179013, "get_robot_state": 0.003459017301343151, "sim_render-ego0": 0.0035707987460893453, "get_duckie_state": 1.5460338789163177e-06, "in-drivable-lane": 5.20000000000001, "deviation-heading": 1.481472219884901, "agent_compute-ego0": 0.012118598849503035, "complete-iteration": 0.1981875429448393, "set_robot_commands": 0.0020444085917522, "deviation-center-line": 0.2744924450448112, "driven_lanedir_consec": 0.6636014416441682, "sim_compute_sim_state": 0.009506687675554728, "sim_compute_performance-ego0": 0.0018187921071789927}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4660372074736023, "get_ui_image": 0.0318969457887756, "step_physics": 0.11038914912848304, "survival_time": 9.800000000000004, "driven_lanedir": 0.6896169274228904, "get_state_dump": 0.004205944574423853, "get_robot_state": 0.003443524317087861, "sim_render-ego0": 0.003586160349966911, "get_duckie_state": 1.6047869842064563e-06, "in-drivable-lane": 5.150000000000013, "deviation-heading": 1.1381977952635036, "agent_compute-ego0": 0.01238830924639242, "complete-iteration": 0.17812314614426666, "set_robot_commands": 0.0020097100795223024, "deviation-center-line": 0.2389305070242855, "driven_lanedir_consec": 0.6878889448794888, "sim_compute_sim_state": 0.008320795097931993, "sim_compute_performance-ego0": 0.001812597216688437}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.749519811219464, "get_ui_image": 0.025401373485942465, "step_physics": 0.0871825553558685, "survival_time": 45.449999999999555, "driven_lanedir": 5.394668321271626, "get_state_dump": 0.004219360665960626, "get_robot_state": 0.003467751335311722, "sim_render-ego0": 0.0035868057837853064, "get_duckie_state": 1.5502447610373023e-06, "in-drivable-lane": 11.39999999999966, "deviation-heading": 10.865344345617704, "agent_compute-ego0": 0.011490663853320447, "complete-iteration": 0.14501313717810663, "set_robot_commands": 0.0020683285954234366, "deviation-center-line": 1.8398381370932244, "driven_lanedir_consec": 4.133546408862612, "sim_compute_sim_state": 0.005667738338093181, "sim_compute_performance-ego0": 0.001855581147330148}}
set_robot_commands_max0.002082094165506609
set_robot_commands_mean0.002051135358051137
set_robot_commands_median0.002056368593587818
set_robot_commands_min0.0020097100795223024
sim_compute_performance-ego0_max0.001855581147330148
sim_compute_performance-ego0_mean0.0018314290233529024
sim_compute_performance-ego0_median0.0018287688646965125
sim_compute_performance-ego0_min0.001812597216688437
sim_compute_sim_state_max0.009506687675554728
sim_compute_sim_state_mean0.008165722830652398
sim_compute_sim_state_median0.00874423265448084
sim_compute_sim_state_min0.005667738338093181
sim_render-ego0_max0.0035868057837853064
sim_render-ego0_mean0.0035775458102373834
sim_render-ego0_median0.003578479548028128
sim_render-ego0_min0.0035664183611079717
simulation-passed1
step_physics_max0.1260564536163487
step_physics_mean0.1059851644695904
step_physics_median0.10535082445307216
step_physics_min0.0871825553558685
survival_time_max59.99999999999873
survival_time_mean31.224999999999575
survival_time_min9.650000000000002
No reset possible
5782010808Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:25:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.013068950514842
survival_time_median59.99999999999873
deviation-center-line_median1.7609925196825535
in-drivable-lane_median38.84999999999887


other stats
agent_compute-ego0_max0.013360497927424884
agent_compute-ego0_mean0.012657286467137627
agent_compute-ego0_median0.012800548197724837
agent_compute-ego0_min0.011667551545675949
complete-iteration_max0.20300368588380135
complete-iteration_mean0.17765921290928888
complete-iteration_median0.18287037612000273
complete-iteration_min0.14189241351334875
deviation-center-line_max3.408374482082527
deviation-center-line_mean1.7797492722655648
deviation-center-line_min0.18863756761462488
deviation-heading_max7.048683603660454
deviation-heading_mean4.48051458789896
deviation-heading_median4.3612798516689555
deviation-heading_min2.150815044597477
driven_any_max4.169103830667414
driven_any_mean3.193388512289739
driven_any_median4.167355203086295
driven_any_min0.26973981231895305
driven_lanedir_consec_max1.5110666276355778
driven_lanedir_consec_mean0.9120864475279598
driven_lanedir_consec_min0.1111412614465772
driven_lanedir_max1.5110666276355778
driven_lanedir_mean0.9120864475279598
driven_lanedir_median1.013068950514842
driven_lanedir_min0.1111412614465772
get_duckie_state_max1.2224659534616336e-06
get_duckie_state_mean1.1748470062273055e-06
get_duckie_state_median1.1652931384897352e-06
get_duckie_state_min1.1463357944681189e-06
get_robot_state_max0.0036506468211482904
get_robot_state_mean0.003601856266339644
get_robot_state_median0.0036049233586663114
get_robot_state_min0.003546931526877663
get_state_dump_max0.004506855299978545
get_state_dump_mean0.004484452900330569
get_state_dump_median0.004498134048455562
get_state_dump_min0.004434688204432605
get_ui_image_max0.035921944512261286
get_ui_image_mean0.030612989638380873
get_ui_image_median0.03040969123649756
get_ui_image_min0.025710631568267084
in-drivable-lane_max47.29999999999874
in-drivable-lane_mean31.78749999999912
in-drivable-lane_min2.1499999999999924
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.165614507043369, "get_ui_image": 0.02824005735208351, "step_physics": 0.11576365551086984, "survival_time": 59.99999999999873, "driven_lanedir": 0.7941475254571646, "get_state_dump": 0.004434688204432605, "get_robot_state": 0.0036506468211482904, "sim_render-ego0": 0.003799519868417147, "get_duckie_state": 1.157749503180943e-06, "in-drivable-lane": 47.29999999999874, "deviation-heading": 4.532301082067102, "agent_compute-ego0": 0.012657277093739632, "complete-iteration": 0.18370827489054073, "set_robot_commands": 0.002205734546734431, "deviation-center-line": 1.4981578689652113, "driven_lanedir_consec": 0.7941475254571646, "sim_compute_sim_state": 0.010938650960231402, "sim_compute_performance-ego0": 0.0019405495614235248}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.26973981231895305, "get_ui_image": 0.035921944512261286, "step_physics": 0.12767103224089651, "survival_time": 4.899999999999991, "driven_lanedir": 0.1111412614465772, "get_state_dump": 0.004506855299978545, "get_robot_state": 0.003546931526877663, "sim_render-ego0": 0.003744563671073528, "get_duckie_state": 1.1463357944681189e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 2.150815044597477, "agent_compute-ego0": 0.013360497927424884, "complete-iteration": 0.20300368588380135, "set_robot_commands": 0.002144250002774326, "deviation-center-line": 0.18863756761462488, "driven_lanedir_consec": 0.1111412614465772, "sim_compute_sim_state": 0.010167565008606574, "sim_compute_performance-ego0": 0.001867465298585217}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.169103830667414, "get_ui_image": 0.03257932512091161, "step_physics": 0.10990487645805924, "survival_time": 59.99999999999873, "driven_lanedir": 1.2319903755725194, "get_state_dump": 0.0044906756760774305, "get_robot_state": 0.0035721807059002956, "sim_render-ego0": 0.003705792581906029, "get_duckie_state": 1.1728367737985273e-06, "in-drivable-lane": 40.1999999999987, "deviation-heading": 7.048683603660454, "agent_compute-ego0": 0.01294381930171004, "complete-iteration": 0.18203247734946473, "set_robot_commands": 0.002201363208589705, "deviation-center-line": 2.023827170399896, "driven_lanedir_consec": 1.2319903755725194, "sim_compute_sim_state": 0.01065991105485419, "sim_compute_performance-ego0": 0.0018955456227883016}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.16909589912922, "get_ui_image": 0.025710631568267084, "step_physics": 0.08234436684702953, "survival_time": 59.99999999999873, "driven_lanedir": 1.5110666276355778, "get_state_dump": 0.004505592420833693, "get_robot_state": 0.0036376660114323263, "sim_render-ego0": 0.0036612660759791646, "get_duckie_state": 1.2224659534616336e-06, "in-drivable-lane": 37.49999999999905, "deviation-heading": 4.19025862127081, "agent_compute-ego0": 0.011667551545675949, "complete-iteration": 0.14189241351334875, "set_robot_commands": 0.0022790193756255977, "deviation-center-line": 3.408374482082527, "driven_lanedir_consec": 1.5110666276355778, "sim_compute_sim_state": 0.006121003955329685, "sim_compute_performance-ego0": 0.0018923987357642232}}
set_robot_commands_max0.0022790193756255977
set_robot_commands_mean0.0022075917834310146
set_robot_commands_median0.0022035488776620676
set_robot_commands_min0.002144250002774326
sim_compute_performance-ego0_max0.0019405495614235248
sim_compute_performance-ego0_mean0.0018989898046403168
sim_compute_performance-ego0_median0.0018939721792762623
sim_compute_performance-ego0_min0.001867465298585217
sim_compute_sim_state_max0.010938650960231402
sim_compute_sim_state_mean0.009471782744755464
sim_compute_sim_state_median0.01041373803173038
sim_compute_sim_state_min0.006121003955329685
sim_render-ego0_max0.003799519868417147
sim_render-ego0_mean0.0037277855493439674
sim_render-ego0_median0.0037251781264897783
sim_render-ego0_min0.0036612660759791646
simulation-passed1
step_physics_max0.12767103224089651
step_physics_mean0.10892098276421378
step_physics_median0.11283426598446455
step_physics_min0.08234436684702953
survival_time_max59.99999999999873
survival_time_mean46.22499999999904
survival_time_min4.899999999999991
No reset possible
5780010822Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:11:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6000938767738913
survival_time_median10.425000000000011
deviation-center-line_median0.22104028217959543
in-drivable-lane_median6.32500000000002


other stats
agent_compute-ego0_max0.012323850079586631
agent_compute-ego0_mean0.012248157791138824
agent_compute-ego0_median0.012237520668883362
agent_compute-ego0_min0.01219373974720193
complete-iteration_max0.1861580218139448
complete-iteration_mean0.16943224502824494
complete-iteration_median0.1726378261062474
complete-iteration_min0.14629530608654023
deviation-center-line_max0.9022164546239522
deviation-center-line_mean0.38921173933057784
deviation-center-line_min0.21254993833916844
deviation-heading_max4.978350087273197
deviation-heading_mean2.1620244929710557
deviation-heading_median1.3234511436015546
deviation-heading_min1.0228455974079156
driven_any_max4.7543396808958915
driven_any_mean2.266683731638339
driven_any_median1.6029733346686237
driven_any_min1.106448576320218
driven_lanedir_consec_max1.418893265880577
driven_lanedir_consec_mean0.7925828623944886
driven_lanedir_consec_min0.5512504301495948
driven_lanedir_max1.418893265880577
driven_lanedir_mean0.7925828623944886
driven_lanedir_median0.6000938767738913
driven_lanedir_min0.5512504301495948
get_duckie_state_max1.1058230149118525e-06
get_duckie_state_mean1.0856396091312472e-06
get_duckie_state_median1.089144463423688e-06
get_duckie_state_min1.05844649476576e-06
get_robot_state_max0.0035141235903689734
get_robot_state_mean0.0034627652347432487
get_robot_state_median0.003462508485803967
get_robot_state_min0.003411920376996088
get_state_dump_max0.004437380715420372
get_state_dump_mean0.004281407692007879
get_state_dump_median0.0042352532957519225
get_state_dump_min0.0042177434611073
get_ui_image_max0.035118181612238536
get_ui_image_mean0.030012380525282698
get_ui_image_median0.02985092732961051
get_ui_image_min0.025229485829671223
in-drivable-lane_max18.750000000000263
in-drivable-lane_mean8.775000000000073
in-drivable-lane_min3.699999999999987
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.7543396808958915, "get_ui_image": 0.027456414740803337, "step_physics": 0.09581830344810618, "survival_time": 28.850000000000275, "driven_lanedir": 1.418893265880577, "get_state_dump": 0.0042177434611073, "get_robot_state": 0.0034955504856307613, "sim_render-ego0": 0.003573090559883514, "get_duckie_state": 1.05844649476576e-06, "in-drivable-lane": 18.750000000000263, "deviation-heading": 4.978350087273197, "agent_compute-ego0": 0.012207229244667763, "complete-iteration": 0.16059098936694716, "set_robot_commands": 0.0020366742124194506, "deviation-center-line": 0.9022164546239522, "driven_lanedir_consec": 1.418893265880577, "sim_compute_sim_state": 0.009894837970139658, "sim_compute_performance-ego0": 0.0018242717201734497}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.327943878656055, "get_ui_image": 0.035118181612238536, "step_physics": 0.11272075722337437, "survival_time": 8.899999999999991, "driven_lanedir": 0.586005437995075, "get_state_dump": 0.004221818966572511, "get_robot_state": 0.003411920376996088, "sim_render-ego0": 0.003587376472004299, "get_duckie_state": 1.0855371059652146e-06, "in-drivable-lane": 4.849999999999998, "deviation-heading": 1.4478951157572777, "agent_compute-ego0": 0.01219373974720193, "complete-iteration": 0.18468466284554763, "set_robot_commands": 0.0019984884635030225, "deviation-center-line": 0.21254993833916844, "driven_lanedir_consec": 0.586005437995075, "sim_compute_sim_state": 0.009553144763967843, "sim_compute_performance-ego0": 0.0018108130833290144}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.106448576320218, "get_ui_image": 0.03224543991841768, "step_physics": 0.1177616276239094, "survival_time": 7.549999999999981, "driven_lanedir": 0.5512504301495948, "get_state_dump": 0.004437380715420372, "get_robot_state": 0.0035141235903689734, "sim_render-ego0": 0.003673774631399857, "get_duckie_state": 1.1058230149118525e-06, "in-drivable-lane": 3.699999999999987, "deviation-heading": 1.1990071714458317, "agent_compute-ego0": 0.012323850079586631, "complete-iteration": 0.1861580218139448, "set_robot_commands": 0.0021072657484757272, "deviation-center-line": 0.22398298781274023, "driven_lanedir_consec": 0.5512504301495948, "sim_compute_sim_state": 0.008120345441918624, "sim_compute_performance-ego0": 0.0019022163591886825}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8780027906811925, "get_ui_image": 0.025229485829671223, "step_physics": 0.08877135713895162, "survival_time": 11.950000000000037, "driven_lanedir": 0.6141823155527075, "get_state_dump": 0.004248687624931335, "get_robot_state": 0.003429466485977173, "sim_render-ego0": 0.003561954696973165, "get_duckie_state": 1.0927518208821614e-06, "in-drivable-lane": 7.800000000000042, "deviation-heading": 1.0228455974079156, "agent_compute-ego0": 0.01226781209309896, "complete-iteration": 0.14629530608654023, "set_robot_commands": 0.002004097898801168, "deviation-center-line": 0.21809757654645057, "driven_lanedir_consec": 0.6141823155527075, "sim_compute_sim_state": 0.004890620708465576, "sim_compute_performance-ego0": 0.00182321568330129}}
set_robot_commands_max0.0021072657484757272
set_robot_commands_mean0.002036631580799842
set_robot_commands_median0.002020386055610309
set_robot_commands_min0.0019984884635030225
sim_compute_performance-ego0_max0.0019022163591886825
sim_compute_performance-ego0_mean0.001840129211498109
sim_compute_performance-ego0_median0.0018237437017373697
sim_compute_performance-ego0_min0.0018108130833290144
sim_compute_sim_state_max0.009894837970139658
sim_compute_sim_state_mean0.008114737221122926
sim_compute_sim_state_median0.008836745102943234
sim_compute_sim_state_min0.004890620708465576
sim_render-ego0_max0.003673774631399857
sim_render-ego0_mean0.0035990490900652088
sim_render-ego0_median0.0035802335159439065
sim_render-ego0_min0.003561954696973165
simulation-passed1
step_physics_max0.1177616276239094
step_physics_mean0.1037680113585854
step_physics_median0.10426953033574028
step_physics_min0.08877135713895162
survival_time_max28.850000000000275
survival_time_mean14.312500000000073
survival_time_min7.549999999999981
No reset possible
5775310845Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:30:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.078833658823175
survival_time_median59.99999999999873
deviation-center-line_median3.7628589227309126
in-drivable-lane_median15.349999999999556


other stats
agent_compute-ego0_max0.012696156196054274
agent_compute-ego0_mean0.012448279574666668
agent_compute-ego0_median0.012478906921536154
agent_compute-ego0_min0.012139148259540085
complete-iteration_max0.1938662741404588
complete-iteration_mean0.16835476529606813
complete-iteration_median0.1657430310395961
complete-iteration_min0.14806672496462145
deviation-center-line_max4.028073655860842
deviation-center-line_mean3.3479811609904897
deviation-center-line_min1.8381331426392904
deviation-heading_max25.753746675959835
deviation-heading_mean16.903561775771678
deviation-heading_median16.51603460025769
deviation-heading_min8.828431226611501
driven_any_max11.31198233310368
driven_any_mean9.541551442018203
driven_any_median9.69558373737852
driven_any_min7.463055960212102
driven_lanedir_consec_max7.027836229535972
driven_lanedir_consec_mean5.423377616736243
driven_lanedir_consec_min2.5080069197626504
driven_lanedir_max8.104247981020896
driven_lanedir_mean6.5171060394808995
driven_lanedir_median6.567908674034628
driven_lanedir_min4.828358828833449
get_duckie_state_max1.1220164938235064e-06
get_duckie_state_mean1.0965047827818997e-06
get_duckie_state_median1.0973957953210653e-06
get_duckie_state_min1.0692110466619614e-06
get_robot_state_max0.0036372111486247566
get_robot_state_mean0.0035363190920870676
get_robot_state_median0.0035206547982488245
get_robot_state_min0.003466755623225864
get_state_dump_max0.004437253635987751
get_state_dump_mean0.004360684979039626
get_state_dump_median0.004391763005364372
get_state_dump_min0.00422196026944201
get_ui_image_max0.03591610251814995
get_ui_image_mean0.030509894748922534
get_ui_image_median0.030179756894920293
get_ui_image_min0.02576396268769962
in-drivable-lane_max19.099999999999586
in-drivable-lane_mean15.76249999999964
in-drivable-lane_min13.249999999999869
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.31198233310368, "get_ui_image": 0.027962951636334245, "step_physics": 0.08854620978794527, "survival_time": 59.99999999999873, "driven_lanedir": 7.26488975991828, "get_state_dump": 0.00422196026944201, "get_robot_state": 0.003466755623225864, "sim_render-ego0": 0.0036126261051251034, "get_duckie_state": 1.0692110466619614e-06, "in-drivable-lane": 15.899999999999396, "deviation-heading": 18.992695618318788, "agent_compute-ego0": 0.012696156196054274, "complete-iteration": 0.1538964032531281, "set_robot_commands": 0.002092867866344595, "deviation-center-line": 3.893690011736698, "driven_lanedir_consec": 6.921584952900291, "sim_compute_sim_state": 0.009359079832637635, "sim_compute_performance-ego0": 0.0018654357980034137}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.18086868872517, "get_ui_image": 0.03591610251814995, "step_physics": 0.1175014127005546, "survival_time": 59.99999999999873, "driven_lanedir": 4.828358828833449, "get_state_dump": 0.004381872831435128, "get_robot_state": 0.003529080939630386, "sim_render-ego0": 0.003669831873872298, "get_duckie_state": 1.111098074297623e-06, "in-drivable-lane": 19.099999999999586, "deviation-heading": 25.753746675959835, "agent_compute-ego0": 0.012451000356555084, "complete-iteration": 0.1938662741404588, "set_robot_commands": 0.0020712218018594532, "deviation-center-line": 4.028073655860842, "driven_lanedir_consec": 2.5080069197626504, "sim_compute_sim_state": 0.012384807338921056, "sim_compute_performance-ego0": 0.001890037180879134}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.463055960212102, "get_ui_image": 0.032396562153506336, "step_physics": 0.10546149474847828, "survival_time": 39.649999999999885, "driven_lanedir": 5.870927588150977, "get_state_dump": 0.004401653179293616, "get_robot_state": 0.0036372111486247566, "sim_render-ego0": 0.003772585157783566, "get_duckie_state": 1.0836935163445077e-06, "in-drivable-lane": 13.249999999999869, "deviation-heading": 8.828431226611501, "agent_compute-ego0": 0.012506813486517226, "complete-iteration": 0.1775896588260641, "set_robot_commands": 0.002221612846220771, "deviation-center-line": 1.8381331426392904, "driven_lanedir_consec": 5.236082364746059, "sim_compute_sim_state": 0.01114882329849512, "sim_compute_performance-ego0": 0.0019710316165568544}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.21029878603187, "get_ui_image": 0.02576396268769962, "step_physics": 0.08822055144869814, "survival_time": 59.99999999999873, "driven_lanedir": 8.104247981020896, "get_state_dump": 0.004437253635987751, "get_robot_state": 0.0035122286568672633, "sim_render-ego0": 0.003675901522545096, "get_duckie_state": 1.1220164938235064e-06, "in-drivable-lane": 14.799999999999718, "deviation-heading": 14.03937358219659, "agent_compute-ego0": 0.012139148259540085, "complete-iteration": 0.14806672496462145, "set_robot_commands": 0.0021387546088276655, "deviation-center-line": 3.632027833725127, "driven_lanedir_consec": 7.027836229535972, "sim_compute_sim_state": 0.006190299392242813, "sim_compute_performance-ego0": 0.0019134309865552917}}
set_robot_commands_max0.002221612846220771
set_robot_commands_mean0.002131114280813122
set_robot_commands_median0.00211581123758613
set_robot_commands_min0.0020712218018594532
sim_compute_performance-ego0_max0.0019710316165568544
sim_compute_performance-ego0_mean0.0019099838954986731
sim_compute_performance-ego0_median0.0019017340837172128
sim_compute_performance-ego0_min0.0018654357980034137
sim_compute_sim_state_max0.012384807338921056
sim_compute_sim_state_mean0.009770752465574156
sim_compute_sim_state_median0.01025395156556638
sim_compute_sim_state_min0.006190299392242813
sim_render-ego0_max0.003772585157783566
sim_render-ego0_mean0.003682736164831516
sim_render-ego0_median0.003672866698208697
sim_render-ego0_min0.0036126261051251034
simulation-passed1
step_physics_max0.1175014127005546
step_physics_mean0.09993241717141908
step_physics_median0.09700385226821176
step_physics_min0.08822055144869814
survival_time_max59.99999999999873
survival_time_mean54.912499999999014
survival_time_min39.649999999999885
No reset possible
5774810846Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 6 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5774310850Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:08:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8620068368358367
survival_time_median11.925000000000034
deviation-center-line_median0.2985942839385983
in-drivable-lane_median6.875000000000037


other stats
agent_compute-ego0_max0.01290924975901474
agent_compute-ego0_mean0.012595021201340297
agent_compute-ego0_median0.012807028903138978
agent_compute-ego0_min0.011856777240068485
complete-iteration_max0.1664436349162349
complete-iteration_mean0.1598495531094699
complete-iteration_median0.16557630568399315
complete-iteration_min0.14180196615365837
deviation-center-line_max0.420112173787609
deviation-center-line_mean0.30846525528511554
deviation-center-line_min0.2165602794756565
deviation-heading_max3.1924743994485394
deviation-heading_mean1.8525164082090375
deviation-heading_median1.504711131059237
deviation-heading_min1.2081689712691377
driven_any_max4.223608798731008
driven_any_mean2.958753305310407
driven_any_median3.0426036219635524
driven_any_min1.526197178583515
driven_lanedir_consec_max1.2205547124924916
driven_lanedir_consec_mean0.8660194101310439
driven_lanedir_consec_min0.5195092543600106
driven_lanedir_max1.2205547124924916
driven_lanedir_mean0.8660194101310439
driven_lanedir_median0.8620068368358367
driven_lanedir_min0.5195092543600106
get_duckie_state_max1.1660683322960222e-06
get_duckie_state_mean1.1210446449668575e-06
get_duckie_state_median1.1178302320289167e-06
get_duckie_state_min1.0824497835135754e-06
get_robot_state_max0.0035434780698834043
get_robot_state_mean0.003506043730888592
get_robot_state_median0.003514910113229024
get_robot_state_min0.0034508766272129156
get_state_dump_max0.004286989359788491
get_state_dump_mean0.0042526826225999965
get_state_dump_median0.004261945132856016
get_state_dump_min0.004199850864899464
get_ui_image_max0.03537060081222911
get_ui_image_mean0.03039324015704265
get_ui_image_median0.030192581815084635
get_ui_image_min0.025817196185772235
in-drivable-lane_max13.550000000000098
in-drivable-lane_mean7.625000000000041
in-drivable-lane_min3.1999999999999913
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.526197178583515, "get_ui_image": 0.028184739026156334, "step_physics": 0.10073999925093216, "survival_time": 6.549999999999985, "driven_lanedir": 0.7662314436335209, "get_state_dump": 0.004279792308807373, "get_robot_state": 0.0035434780698834043, "sim_render-ego0": 0.0036475062370300297, "get_duckie_state": 1.1108138344504617e-06, "in-drivable-lane": 3.1999999999999913, "deviation-heading": 1.2081689712691377, "agent_compute-ego0": 0.01285184874679103, "complete-iteration": 0.16567538001320578, "set_robot_commands": 0.0021209987727078524, "deviation-center-line": 0.35988982786013374, "driven_lanedir_consec": 0.7662314436335209, "sim_compute_sim_state": 0.00836369666186246, "sim_compute_performance-ego0": 0.0018708218227733264}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.223608798731008, "get_ui_image": 0.03537060081222911, "step_physics": 0.0922155291945846, "survival_time": 16.150000000000095, "driven_lanedir": 0.5195092543600106, "get_state_dump": 0.0042440979569046584, "get_robot_state": 0.003525163656399574, "sim_render-ego0": 0.003680677325637252, "get_duckie_state": 1.0824497835135754e-06, "in-drivable-lane": 13.550000000000098, "deviation-heading": 1.5102257155019092, "agent_compute-ego0": 0.01290924975901474, "complete-iteration": 0.1664436349162349, "set_robot_commands": 0.0021812702402656463, "deviation-center-line": 0.2165602794756565, "driven_lanedir_consec": 0.5195092543600106, "sim_compute_sim_state": 0.010380691216315753, "sim_compute_performance-ego0": 0.0018647857654241868}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.664550860808927, "get_ui_image": 0.032200424604012935, "step_physics": 0.09375303060236112, "survival_time": 14.150000000000066, "driven_lanedir": 0.9577822300381524, "get_state_dump": 0.004286989359788491, "get_robot_state": 0.0035046565700584736, "sim_render-ego0": 0.00366706327653267, "get_duckie_state": 1.1660683322960222e-06, "in-drivable-lane": 9.100000000000062, "deviation-heading": 3.1924743994485394, "agent_compute-ego0": 0.012762209059486926, "complete-iteration": 0.1654772313547806, "set_robot_commands": 0.00207336855606294, "deviation-center-line": 0.420112173787609, "driven_lanedir_consec": 0.9577822300381524, "sim_compute_sim_state": 0.011302539160553838, "sim_compute_performance-ego0": 0.0018537884027185576}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.420656383118177, "get_ui_image": 0.025817196185772235, "step_physics": 0.08349543106861604, "survival_time": 9.700000000000005, "driven_lanedir": 1.2205547124924916, "get_state_dump": 0.004199850864899464, "get_robot_state": 0.0034508766272129156, "sim_render-ego0": 0.003526916259374374, "get_duckie_state": 1.1248466296073718e-06, "in-drivable-lane": 4.650000000000013, "deviation-heading": 1.4991965466165649, "agent_compute-ego0": 0.011856777240068485, "complete-iteration": 0.14180196615365837, "set_robot_commands": 0.002033835190993089, "deviation-center-line": 0.2372987400170629, "driven_lanedir_consec": 1.2205547124924916, "sim_compute_sim_state": 0.0055206922384408805, "sim_compute_performance-ego0": 0.0018288025489220253}}
set_robot_commands_max0.0021812702402656463
set_robot_commands_mean0.002102368190007382
set_robot_commands_median0.0020971836643853964
set_robot_commands_min0.002033835190993089
sim_compute_performance-ego0_max0.0018708218227733264
sim_compute_performance-ego0_mean0.001854549634959524
sim_compute_performance-ego0_median0.001859287084071372
sim_compute_performance-ego0_min0.0018288025489220253
sim_compute_sim_state_max0.011302539160553838
sim_compute_sim_state_mean0.008891904819293233
sim_compute_sim_state_median0.009372193939089106
sim_compute_sim_state_min0.0055206922384408805
sim_render-ego0_max0.003680677325637252
sim_render-ego0_mean0.0036305407746435817
sim_render-ego0_median0.0036572847567813496
sim_render-ego0_min0.003526916259374374
simulation-passed1
step_physics_max0.10073999925093216
step_physics_mean0.09255099752912348
step_physics_median0.09298427989847284
step_physics_min0.08349543106861604
survival_time_max16.150000000000095
survival_time_mean11.637500000000038
survival_time_min6.549999999999985
No reset possible
5768111426Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-testingLFP-simsuccessyesgpu-prod-010:38:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1444239954198214
survival_time_median59.99999999999873
deviation-center-line_median1.5846892921117213
in-drivable-lane_median27.79999999999943


other stats
agent_compute-ego0_max0.012700593781527617
agent_compute-ego0_mean0.012324263546865048
agent_compute-ego0_median0.012240827331733546
agent_compute-ego0_min0.012114805742465488
complete-iteration_max0.35145237026961024
complete-iteration_mean0.29481057872788136
complete-iteration_median0.30694090921432227
complete-iteration_min0.21390812621327063
deviation-center-line_max2.993920008126081
deviation-center-line_mean1.7659566624405678
deviation-center-line_min0.9005280574127476
deviation-heading_max22.94135614059514
deviation-heading_mean15.85196766415866
deviation-heading_median15.75062669826463
deviation-heading_min8.965261119510231
driven_any_max10.086209762979518
driven_any_mean8.145589480756318
driven_any_median9.6140072427978
driven_any_min3.268133674450149
driven_lanedir_consec_max4.317183770171016
driven_lanedir_consec_mean2.39767767405615
driven_lanedir_consec_min0.9846789352139398
driven_lanedir_max4.317183770171016
driven_lanedir_mean2.4189801899220815
driven_lanedir_median2.1444239954198214
driven_lanedir_min1.069888998677667
get_duckie_state_max0.024480098810038105
get_duckie_state_mean0.01709935332652656
get_duckie_state_median0.01995244728933266
get_duckie_state_min0.004012419917402816
get_robot_state_max0.003567224980527909
get_robot_state_mean0.003528926753267186
get_robot_state_median0.0035255250089075247
get_robot_state_min0.003497432014725786
get_state_dump_max0.008291446852627657
get_state_dump_mean0.007112920397843453
get_state_dump_median0.007567041422504866
get_state_dump_min0.005026151893736421
get_ui_image_max0.038441153192003995
get_ui_image_mean0.03266320618678438
get_ui_image_median0.033359724834430796
get_ui_image_min0.025492221886271937
in-drivable-lane_max48.39999999999874
in-drivable-lane_mean28.274999999999416
in-drivable-lane_min9.100000000000064
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 3.268133674450149, "get_ui_image": 0.03154197088651905, "step_physics": 0.196689044330137, "survival_time": 21.100000000000165, "driven_lanedir": 1.2422557845063824, "get_state_dump": 0.008291446852627657, "get_robot_state": 0.003567224980527909, "sim_render-ego0": 0.003601160455257335, "get_duckie_state": 0.024480098810038105, "in-drivable-lane": 9.100000000000064, "deviation-heading": 8.965261119510231, "agent_compute-ego0": 0.012700593781527617, "complete-iteration": 0.29174849271210657, "set_robot_commands": 0.0021186866940617844, "deviation-center-line": 0.9005280574127476, "driven_lanedir_consec": 1.2422557845063824, "sim_compute_sim_state": 0.006829261779785156, "sim_compute_performance-ego0": 0.0018562487112996709}, "LFP-norm-zigzag-000-ego0": {"driven_any": 10.086209762979518, "get_ui_image": 0.038441153192003995, "step_physics": 0.24934459407561824, "survival_time": 59.99999999999873, "driven_lanedir": 1.069888998677667, "get_state_dump": 0.007563137194199129, "get_robot_state": 0.0035271952293199067, "sim_render-ego0": 0.003544169996898438, "get_duckie_state": 0.019916832000389385, "in-drivable-lane": 48.39999999999874, "deviation-heading": 10.749597485978942, "agent_compute-ego0": 0.012350514369840726, "complete-iteration": 0.35145237026961024, "set_robot_commands": 0.002073153369531941, "deviation-center-line": 1.217986115536477, "driven_lanedir_consec": 0.9846789352139398, "sim_compute_sim_state": 0.0127786392971042, "sim_compute_performance-ego0": 0.0018404413520247613}, "LFP-norm-techtrack-000-ego0": {"driven_any": 9.699926899914528, "get_ui_image": 0.035177478782342536, "step_physics": 0.22619777873195676, "survival_time": 59.99999999999873, "driven_lanedir": 3.0465922063332607, "get_state_dump": 0.007570945650810604, "get_robot_state": 0.0035238547884951423, "sim_render-ego0": 0.003547126903422766, "get_duckie_state": 0.019988062578275935, "in-drivable-lane": 31.399999999999302, "deviation-heading": 20.75165591055032, "agent_compute-ego0": 0.012131140293626363, "complete-iteration": 0.322133325716538, "set_robot_commands": 0.002086465106617898, "deviation-center-line": 1.9513924686869657, "driven_lanedir_consec": 3.0465922063332607, "sim_compute_sim_state": 0.009990116043154343, "sim_compute_performance-ego0": 0.0018454886395964992}, "LFP-norm-small_loop-000-ego0": {"driven_any": 9.528087585681073, "get_ui_image": 0.025492221886271937, "step_physics": 0.14980575444795607, "survival_time": 59.99999999999873, "driven_lanedir": 4.317183770171016, "get_state_dump": 0.005026151893736421, "get_robot_state": 0.003497432014725786, "sim_render-ego0": 0.003500773845167581, "get_duckie_state": 0.004012419917402816, "in-drivable-lane": 24.199999999999555, "deviation-heading": 22.94135614059514, "agent_compute-ego0": 0.012114805742465488, "complete-iteration": 0.21390812621327063, "set_robot_commands": 0.0020699518904102334, "deviation-center-line": 2.993920008126081, "driven_lanedir_consec": 4.317183770171016, "sim_compute_sim_state": 0.006486780339732556, "sim_compute_performance-ego0": 0.001829911429717281}}
set_robot_commands_max0.0021186866940617844
set_robot_commands_mean0.0020870642651554644
set_robot_commands_median0.0020798092380749193
set_robot_commands_min0.0020699518904102334
sim_compute_performance-ego0_max0.0018562487112996709
sim_compute_performance-ego0_mean0.001843022533159553
sim_compute_performance-ego0_median0.0018429649958106305
sim_compute_performance-ego0_min0.001829911429717281
sim_compute_sim_state_max0.0127786392971042
sim_compute_sim_state_mean0.009021199364944063
sim_compute_sim_state_median0.00840968891146975
sim_compute_sim_state_min0.006486780339732556
sim_render-ego0_max0.003601160455257335
sim_render-ego0_mean0.00354830780018653
sim_render-ego0_median0.003545648450160602
sim_render-ego0_min0.003500773845167581
simulation-passed1
step_physics_max0.24934459407561824
step_physics_mean0.20550929289641703
step_physics_median0.2114434115310469
step_physics_min0.14980575444795607
survival_time_max59.99999999999873
survival_time_mean50.27499999999909
survival_time_min21.100000000000165
No reset possible
5748511313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessyesgpu-prod-011:31:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.981998860164378
survival_time_median59.99999999999873
deviation-center-line_median3.005694071175435
in-drivable-lane_median0.6750000000000034


other stats
agent_compute-ego0_max0.012678140406803129
agent_compute-ego0_mean0.012551528952939952
agent_compute-ego0_median0.01253961305832684
agent_compute-ego0_min0.012463404078169925
agent_compute-ego1_max0.012106312204657944
agent_compute-ego1_mean0.01190690374750486
agent_compute-ego1_median0.011927994165094965
agent_compute-ego1_min0.011744786658751578
agent_compute-ego2_max0.012125599692008776
agent_compute-ego2_mean0.01199948493222743
agent_compute-ego2_median0.012074317066596013
agent_compute-ego2_min0.011798538038077502
agent_compute-ego3_max0.012165696495875627
agent_compute-ego3_mean0.01207628119101036
agent_compute-ego3_median0.012074982891670373
agent_compute-ego3_min0.011988164185485078
complete-iteration_max0.7290378127070292
complete-iteration_mean0.622143877762641
complete-iteration_median0.6751531579909377
complete-iteration_min0.2886145026595504
deviation-center-line_max3.3816429260795777
deviation-center-line_mean2.6155986499463895
deviation-center-line_min0.2075314128275519
deviation-heading_max17.554849608991095
deviation-heading_mean12.491286453020978
deviation-heading_median13.827409611221585
deviation-heading_min1.1045475745701203
driven_any_max10.78927886654006
driven_any_mean8.65840067445235
driven_any_median9.711169470221776
driven_any_min1.1994404939293988
driven_lanedir_consec_max9.937095412010413
driven_lanedir_consec_mean8.01133768851779
driven_lanedir_consec_min1.0701523471111591
driven_lanedir_max9.937095412010413
driven_lanedir_mean8.01133768851779
driven_lanedir_median8.981998860164378
driven_lanedir_min1.0701523471111591
get_duckie_state_max1.219885236119152e-06
get_duckie_state_mean1.2059813632247515e-06
get_duckie_state_median1.2157163850274512e-06
get_duckie_state_min1.1626585030261382e-06
get_robot_state_max0.01385851446337545
get_robot_state_mean0.012729321242155697
get_robot_state_median0.01364329633466608
get_robot_state_min0.00684687532024619
get_state_dump_max0.009139211251277111
get_state_dump_mean0.008656657336053067
get_state_dump_median0.009116908890520107
get_state_dump_min0.005880517724119586
get_ui_image_max0.04983678745488938
get_ui_image_mean0.044093861402903535
get_ui_image_median0.046713248379125286
get_ui_image_min0.030252172623151614
in-drivable-lane_max4.749999999999927
in-drivable-lane_mean1.0714285714285618
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 10.78927886654006, "get_ui_image": 0.0426523927645719, "step_physics": 0.45442679263868496, "survival_time": 59.99999999999873, "driven_lanedir": 9.033576837727434, "get_state_dump": 0.009101921672328725, "get_robot_state": 0.01362737588938031, "sim_render-ego0": 0.0035490971818553916, "sim_render-ego1": 0.0034960032899016445, "sim_render-ego2": 0.003461909433090121, "sim_render-ego3": 0.003474164068649254, "get_duckie_state": 1.2157163850274512e-06, "in-drivable-lane": 4.749999999999927, "deviation-heading": 17.396097784803036, "agent_compute-ego0": 0.012463404078169925, "agent_compute-ego1": 0.011927994165094965, "agent_compute-ego2": 0.011798538038077502, "agent_compute-ego3": 0.011988164185485078, "complete-iteration": 0.6290053501415015, "set_robot_commands": 0.002056616529834757, "deviation-center-line": 3.136987301332599, "driven_lanedir_consec": 9.033576837727434, "sim_compute_sim_state": 0.031438888856314504, "sim_compute_performance-ego0": 0.0018362457011760424, "sim_compute_performance-ego1": 0.001804086786821224, "sim_compute_performance-ego2": 0.001797079742202949, "sim_compute_performance-ego3": 0.0018014641824511068}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 10.450149529659072, "get_ui_image": 0.0426523927645719, "step_physics": 0.45442679263868496, "survival_time": 59.99999999999873, "driven_lanedir": 9.291924419550764, "get_state_dump": 0.009101921672328725, "get_robot_state": 0.01362737588938031, "sim_render-ego0": 0.0035490971818553916, "sim_render-ego1": 0.0034960032899016445, "sim_render-ego2": 0.003461909433090121, "sim_render-ego3": 0.003474164068649254, "get_duckie_state": 1.2157163850274512e-06, "in-drivable-lane": 2.1500000000000306, "deviation-heading": 17.40296405607593, "agent_compute-ego0": 0.012463404078169925, "agent_compute-ego1": 0.011927994165094965, "agent_compute-ego2": 0.011798538038077502, "agent_compute-ego3": 0.011988164185485078, "complete-iteration": 0.6290053501415015, "set_robot_commands": 0.002056616529834757, "deviation-center-line": 3.1783663520616185, "driven_lanedir_consec": 9.291924419550764, "sim_compute_sim_state": 0.031438888856314504, "sim_compute_performance-ego0": 0.0018362457011760424, "sim_compute_performance-ego1": 0.001804086786821224, "sim_compute_performance-ego2": 0.001797079742202949, "sim_compute_performance-ego3": 0.0018014641824511068}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 10.18348375050304, "get_ui_image": 0.0426523927645719, "step_physics": 0.45442679263868496, "survival_time": 59.99999999999873, "driven_lanedir": 9.937095412010413, "get_state_dump": 0.009101921672328725, "get_robot_state": 0.01362737588938031, "sim_render-ego0": 0.0035490971818553916, "sim_render-ego1": 0.0034960032899016445, "sim_render-ego2": 0.003461909433090121, "sim_render-ego3": 0.003474164068649254, "get_duckie_state": 1.2157163850274512e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.965549780574012, "agent_compute-ego0": 0.012463404078169925, "agent_compute-ego1": 0.011927994165094965, "agent_compute-ego2": 0.011798538038077502, "agent_compute-ego3": 0.011988164185485078, "complete-iteration": 0.6290053501415015, "set_robot_commands": 0.002056616529834757, "deviation-center-line": 2.148249641196662, "driven_lanedir_consec": 9.937095412010413, "sim_compute_sim_state": 0.031438888856314504, "sim_compute_performance-ego0": 0.0018362457011760424, "sim_compute_performance-ego1": 0.001804086786821224, "sim_compute_performance-ego2": 0.001797079742202949, "sim_compute_performance-ego3": 0.0018014641824511068}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 10.507435431456496, "get_ui_image": 0.0426523927645719, "step_physics": 0.45442679263868496, "survival_time": 59.99999999999873, "driven_lanedir": 9.285885857444942, "get_state_dump": 0.009101921672328725, "get_robot_state": 0.01362737588938031, "sim_render-ego0": 0.0035490971818553916, "sim_render-ego1": 0.0034960032899016445, "sim_render-ego2": 0.003461909433090121, "sim_render-ego3": 0.003474164068649254, "get_duckie_state": 1.2157163850274512e-06, "in-drivable-lane": 2.199999999999875, "deviation-heading": 17.554849608991095, "agent_compute-ego0": 0.012463404078169925, "agent_compute-ego1": 0.011927994165094965, "agent_compute-ego2": 0.011798538038077502, "agent_compute-ego3": 0.011988164185485078, "complete-iteration": 0.6290053501415015, "set_robot_commands": 0.002056616529834757, "deviation-center-line": 3.293010553175821, "driven_lanedir_consec": 9.285885857444942, "sim_compute_sim_state": 0.031438888856314504, "sim_compute_performance-ego0": 0.0018362457011760424, "sim_compute_performance-ego1": 0.001804086786821224, "sim_compute_performance-ego2": 0.001797079742202949, "sim_compute_performance-ego3": 0.0018014641824511068}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 10.19422099944084, "get_ui_image": 0.04983678745488938, "step_physics": 0.5305015060129412, "survival_time": 59.99999999999873, "driven_lanedir": 9.751404361304772, "get_state_dump": 0.009139211251277111, "get_robot_state": 0.01385851446337545, "sim_render-ego0": 0.003593924639127733, "sim_render-ego1": 0.003541996437345913, "sim_render-ego2": 0.0035202987585139216, "sim_render-ego3": 0.00351027862713994, "get_duckie_state": 1.219885236119152e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.128765596735656, "agent_compute-ego0": 0.012678140406803129, "agent_compute-ego1": 0.011744786658751578, "agent_compute-ego2": 0.012074317066596013, "agent_compute-ego3": 0.012165696495875627, "complete-iteration": 0.7290378127070292, "set_robot_commands": 0.002086411904137299, "deviation-center-line": 2.9505091687177707, "driven_lanedir_consec": 9.751404361304772, "sim_compute_sim_state": 0.04696841779894674, "sim_compute_performance-ego0": 0.0018807450103124513, "sim_compute_performance-ego1": 0.001834467189893635, "sim_compute_performance-ego2": 0.0018241588122441708, "sim_compute_performance-ego3": 0.001821008153402438}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 10.203202438215534, "get_ui_image": 0.04983678745488938, "step_physics": 0.5305015060129412, "survival_time": 59.99999999999873, "driven_lanedir": 9.517856153496975, "get_state_dump": 0.009139211251277111, "get_robot_state": 0.01385851446337545, "sim_render-ego0": 0.003593924639127733, "sim_render-ego1": 0.003541996437345913, "sim_render-ego2": 0.0035202987585139216, "sim_render-ego3": 0.00351027862713994, "get_duckie_state": 1.219885236119152e-06, "in-drivable-lane": 0.7499999999999973, "deviation-heading": 15.362403385939476, "agent_compute-ego0": 0.012678140406803129, "agent_compute-ego1": 0.011744786658751578, "agent_compute-ego2": 0.012074317066596013, "agent_compute-ego3": 0.012165696495875627, "complete-iteration": 0.7290378127070292, "set_robot_commands": 0.002086411904137299, "deviation-center-line": 3.3816429260795777, "driven_lanedir_consec": 9.517856153496975, "sim_compute_sim_state": 0.04696841779894674, "sim_compute_performance-ego0": 0.0018807450103124513, "sim_compute_performance-ego1": 0.001834467189893635, "sim_compute_performance-ego2": 0.0018241588122441708, "sim_compute_performance-ego3": 0.001821008153402438}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 9.163063596450392, "get_ui_image": 0.04983678745488938, "step_physics": 0.5305015060129412, "survival_time": 59.99999999999873, "driven_lanedir": 8.668153621943082, "get_state_dump": 0.009139211251277111, "get_robot_state": 0.01385851446337545, "sim_render-ego0": 0.003593924639127733, "sim_render-ego1": 0.003541996437345913, "sim_render-ego2": 0.0035202987585139216, "sim_render-ego3": 0.00351027862713994, "get_duckie_state": 1.219885236119152e-06, "in-drivable-lane": 0.8499999999999979, "deviation-heading": 11.599051480377987, "agent_compute-ego0": 0.012678140406803129, "agent_compute-ego1": 0.011744786658751578, "agent_compute-ego2": 0.012074317066596013, "agent_compute-ego3": 0.012165696495875627, "complete-iteration": 0.7290378127070292, "set_robot_commands": 0.002086411904137299, "deviation-center-line": 2.4570926038714136, "driven_lanedir_consec": 8.668153621943082, "sim_compute_sim_state": 0.04696841779894674, "sim_compute_performance-ego0": 0.0018807450103124513, "sim_compute_performance-ego1": 0.001834467189893635, "sim_compute_performance-ego2": 0.0018241588122441708, "sim_compute_performance-ego3": 0.001821008153402438}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 9.362219744004546, "get_ui_image": 0.04983678745488938, "step_physics": 0.5305015060129412, "survival_time": 59.99999999999873, "driven_lanedir": 8.930420882601323, "get_state_dump": 0.009139211251277111, "get_robot_state": 0.01385851446337545, "sim_render-ego0": 0.003593924639127733, "sim_render-ego1": 0.003541996437345913, "sim_render-ego2": 0.0035202987585139216, "sim_render-ego3": 0.00351027862713994, "get_duckie_state": 1.219885236119152e-06, "in-drivable-lane": 0.4000000000000057, "deviation-heading": 13.98981754872116, "agent_compute-ego0": 0.012678140406803129, "agent_compute-ego1": 0.011744786658751578, "agent_compute-ego2": 0.012074317066596013, "agent_compute-ego3": 0.012165696495875627, "complete-iteration": 0.7290378127070292, "set_robot_commands": 0.002086411904137299, "deviation-center-line": 3.3410555772712263, "driven_lanedir_consec": 8.930420882601323, "sim_compute_sim_state": 0.04696841779894674, "sim_compute_performance-ego0": 0.0018807450103124513, "sim_compute_performance-ego1": 0.001834467189893635, "sim_compute_performance-ego2": 0.0018241588122441708, "sim_compute_performance-ego3": 0.001821008153402438}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 9.248069339355968, "get_ui_image": 0.046713248379125286, "step_physics": 0.48255117985727786, "survival_time": 59.99999999999873, "driven_lanedir": 8.794299074133717, "get_state_dump": 0.009116908890520107, "get_robot_state": 0.01364329633466608, "sim_render-ego0": 0.0035715803913430907, "sim_render-ego1": 0.003501543097452359, "sim_render-ego2": 0.0034915066877074484, "sim_render-ego3": 0.0034781862158858707, "get_duckie_state": 1.204003898626958e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.665001673722006, "agent_compute-ego0": 0.01253961305832684, "agent_compute-ego1": 0.012106312204657944, "agent_compute-ego2": 0.012125599692008776, "agent_compute-ego3": 0.012074982891670373, "complete-iteration": 0.6751531579909377, "set_robot_commands": 0.00205901282514561, "deviation-center-line": 3.019908244775759, "driven_lanedir_consec": 8.794299074133717, "sim_compute_sim_state": 0.04466983876954904, "sim_compute_performance-ego0": 0.0018407238413154037, "sim_compute_performance-ego1": 0.0018030161861575312, "sim_compute_performance-ego2": 0.0017994234305833598, "sim_compute_performance-ego3": 0.0017979347537101854}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 9.5119208082605, "get_ui_image": 0.046713248379125286, "step_physics": 0.48255117985727786, "survival_time": 59.99999999999873, "driven_lanedir": 9.073958255009792, "get_state_dump": 0.009116908890520107, "get_robot_state": 0.01364329633466608, "sim_render-ego0": 0.0035715803913430907, "sim_render-ego1": 0.003501543097452359, "sim_render-ego2": 0.0034915066877074484, "sim_render-ego3": 0.0034781862158858707, "get_duckie_state": 1.204003898626958e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.895994198082196, "agent_compute-ego0": 0.01253961305832684, "agent_compute-ego1": 0.012106312204657944, "agent_compute-ego2": 0.012125599692008776, "agent_compute-ego3": 0.012074982891670373, "complete-iteration": 0.6751531579909377, "set_robot_commands": 0.00205901282514561, "deviation-center-line": 2.8146246388783296, "driven_lanedir_consec": 9.073958255009792, "sim_compute_sim_state": 0.04466983876954904, "sim_compute_performance-ego0": 0.0018407238413154037, "sim_compute_performance-ego1": 0.0018030161861575312, "sim_compute_performance-ego2": 0.0017994234305833598, "sim_compute_performance-ego3": 0.0017979347537101854}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 9.143291556877108, "get_ui_image": 0.046713248379125286, "step_physics": 0.48255117985727786, "survival_time": 59.99999999999873, "driven_lanedir": 8.775830349237314, "get_state_dump": 0.009116908890520107, "get_robot_state": 0.01364329633466608, "sim_render-ego0": 0.0035715803913430907, "sim_render-ego1": 0.003501543097452359, "sim_render-ego2": 0.0034915066877074484, "sim_render-ego3": 0.0034781862158858707, "get_duckie_state": 1.204003898626958e-06, "in-drivable-lane": 0.6500000000000092, "deviation-heading": 12.357274593223096, "agent_compute-ego0": 0.01253961305832684, "agent_compute-ego1": 0.012106312204657944, "agent_compute-ego2": 0.012125599692008776, "agent_compute-ego3": 0.012074982891670373, "complete-iteration": 0.6751531579909377, "set_robot_commands": 0.00205901282514561, "deviation-center-line": 3.290427580369817, "driven_lanedir_consec": 8.775830349237314, "sim_compute_sim_state": 0.04466983876954904, "sim_compute_performance-ego0": 0.0018407238413154037, "sim_compute_performance-ego1": 0.0018030161861575312, "sim_compute_performance-ego2": 0.0017994234305833598, "sim_compute_performance-ego3": 0.0017979347537101854}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 9.910418132183052, "get_ui_image": 0.046713248379125286, "step_physics": 0.48255117985727786, "survival_time": 59.99999999999873, "driven_lanedir": 8.69367146586659, "get_state_dump": 0.009116908890520107, "get_robot_state": 0.01364329633466608, "sim_render-ego0": 0.0035715803913430907, "sim_render-ego1": 0.003501543097452359, "sim_render-ego2": 0.0034915066877074484, "sim_render-ego3": 0.0034781862158858707, "get_duckie_state": 1.204003898626958e-06, "in-drivable-lane": 2.5500000000000274, "deviation-heading": 14.448349843787875, "agent_compute-ego0": 0.01253961305832684, "agent_compute-ego1": 0.012106312204657944, "agent_compute-ego2": 0.012125599692008776, "agent_compute-ego3": 0.012074982891670373, "complete-iteration": 0.6751531579909377, "set_robot_commands": 0.00205901282514561, "deviation-center-line": 2.991479897575111, "driven_lanedir_consec": 8.69367146586659, "sim_compute_sim_state": 0.04466983876954904, "sim_compute_performance-ego0": 0.0018407238413154037, "sim_compute_performance-ego1": 0.0018030161861575312, "sim_compute_performance-ego2": 0.0017994234305833598, "sim_compute_performance-ego3": 0.0017979347537101854}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.1994404939293988, "get_ui_image": 0.030252172623151614, "step_physics": 0.19684058942912536, "survival_time": 8.04999999999998, "driven_lanedir": 1.0701523471111591, "get_state_dump": 0.005880517724119586, "get_robot_state": 0.00684687532024619, "sim_render-ego0": 0.003640118940376941, "sim_render-ego1": 0.003580511352162302, "get_duckie_state": 1.1626585030261382e-06, "in-drivable-lane": 0.6999999999999975, "deviation-heading": 2.007343216690023, "agent_compute-ego0": 0.012498387583979854, "agent_compute-ego1": 0.011790140175525054, "complete-iteration": 0.2886145026595504, "set_robot_commands": 0.0020997906908576873, "deviation-center-line": 0.40749520111620074, "driven_lanedir_consec": 1.0701523471111591, "sim_compute_sim_state": 0.009236372547385132, "sim_compute_performance-ego0": 0.0018632102895666052, "sim_compute_performance-ego1": 0.0018576589631445616}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.3514147554568967, "get_ui_image": 0.030252172623151614, "step_physics": 0.19684058942912536, "survival_time": 8.04999999999998, "driven_lanedir": 1.3344986018107792, "get_state_dump": 0.005880517724119586, "get_robot_state": 0.00684687532024619, "sim_render-ego0": 0.003640118940376941, "sim_render-ego1": 0.003580511352162302, "get_duckie_state": 1.1626585030261382e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.1045475745701203, "agent_compute-ego0": 0.012498387583979854, "agent_compute-ego1": 0.011790140175525054, "complete-iteration": 0.2886145026595504, "set_robot_commands": 0.0020997906908576873, "deviation-center-line": 0.2075314128275519, "driven_lanedir_consec": 1.3344986018107792, "sim_compute_sim_state": 0.009236372547385132, "sim_compute_performance-ego0": 0.0018632102895666052, "sim_compute_performance-ego1": 0.0018576589631445616}}
set_robot_commands_max0.0020997906908576873
set_robot_commands_mean0.002071981887013289
set_robot_commands_median0.00205901282514561
set_robot_commands_min0.002056616529834757
sim_compute_performance-ego0_max0.0018807450103124513
sim_compute_performance-ego0_mean0.0018540913421677715
sim_compute_performance-ego0_median0.0018407238413154037
sim_compute_performance-ego0_min0.0018362457011760424
sim_compute_performance-ego1_max0.0018576589631445616
sim_compute_performance-ego1_mean0.0018201141841270487
sim_compute_performance-ego1_median0.001804086786821224
sim_compute_performance-ego1_min0.0018030161861575312
sim_compute_performance-ego2_max0.0018241588122441708
sim_compute_performance-ego2_mean0.0018068873283434929
sim_compute_performance-ego2_median0.0017994234305833598
sim_compute_performance-ego2_min0.001797079742202949
sim_compute_performance-ego3_max0.001821008153402438
sim_compute_performance-ego3_mean0.00180680236318791
sim_compute_performance-ego3_median0.0018014641824511068
sim_compute_performance-ego3_min0.0017979347537101854
sim_compute_sim_state_max0.04696841779894674
sim_compute_sim_state_mean0.03648438048528653
sim_compute_sim_state_median0.04466983876954904
sim_compute_sim_state_min0.009236372547385132
sim_render-ego0_max0.003640118940376941
sim_render-ego0_mean0.0035813319092899095
sim_render-ego0_median0.0035715803913430907
sim_render-ego0_min0.0035490971818553916
sim_render-ego1_max0.003580511352162302
sim_render-ego1_mean0.003522799571651734
sim_render-ego1_median0.003501543097452359
sim_render-ego1_min0.0034960032899016445
sim_render-ego2_max0.0035202987585139216
sim_render-ego2_mean0.0034912382931038314
sim_render-ego2_median0.0034915066877074484
sim_render-ego2_min0.003461909433090121
sim_render-ego3_max0.00351027862713994
sim_render-ego3_mean0.0034875429705583556
sim_render-ego3_median0.0034781862158858707
sim_render-ego3_min0.003474164068649254
simulation-passed1
step_physics_max0.5305015060129412
step_physics_mean0.4473999352067047
step_physics_median0.48255117985727786
step_physics_min0.19684058942912536
survival_time_max59.99999999999873
survival_time_mean52.57857142857034
survival_time_min8.04999999999998
No reset possible
5734111281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:19:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8307268912193891
survival_time_median37.3749999999994
deviation-center-line_median0.8132002534947951
in-drivable-lane_median23.574999999999513


other stats
agent_compute-ego0_max0.013969388362523672
agent_compute-ego0_mean0.012943848638146524
agent_compute-ego0_median0.012711674393602186
agent_compute-ego0_min0.01238265740285805
complete-iteration_max0.1880976194920747
complete-iteration_mean0.15866281547594813
complete-iteration_median0.15794164036900743
complete-iteration_min0.1306703616737029
deviation-center-line_max1.44952239632473
deviation-center-line_mean0.7964324099305707
deviation-center-line_min0.1098067364079629
deviation-heading_max11.156146562217511
deviation-heading_mean5.65981662794594
deviation-heading_median5.256653751586482
deviation-heading_min0.9698124463932836
driven_any_max7.664115403767157
driven_any_mean4.132506324199416
driven_any_median4.12813242518509
driven_any_min0.6096450426603264
driven_lanedir_consec_max1.7767183635344104
driven_lanedir_consec_mean0.9045485317059266
driven_lanedir_consec_min0.18002198085051768
driven_lanedir_max1.7767183635344104
driven_lanedir_mean0.9143510184565934
driven_lanedir_median0.8503318647207229
driven_lanedir_min0.18002198085051768
get_duckie_state_max1.20659132261534e-06
get_duckie_state_mean1.118606703830748e-06
get_duckie_state_median1.102786265599263e-06
get_duckie_state_min1.0622629615091265e-06
get_robot_state_max0.0035790623845280826
get_robot_state_mean0.0035441760439748737
get_robot_state_median0.0035483133741953344
get_robot_state_min0.0035010150429807436
get_state_dump_max0.004396726956238618
get_state_dump_mean0.004313875608410571
get_state_dump_median0.004301912651311279
get_state_dump_min0.004254950174781107
get_ui_image_max0.03493503383968188
get_ui_image_mean0.029683409140764654
get_ui_image_median0.02944774883088036
get_ui_image_min0.024903105061616033
in-drivable-lane_max51.39999999999886
in-drivable-lane_mean25.34999999999947
in-drivable-lane_min2.8499999999999908
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.414331206454579, "get_ui_image": 0.027274710054103778, "step_physics": 0.08803409700290447, "survival_time": 59.99999999999873, "driven_lanedir": 0.5943387160118068, "get_state_dump": 0.004268053866345916, "get_robot_state": 0.0035627217812899447, "sim_render-ego0": 0.003668407317899248, "get_duckie_state": 1.0622629615091265e-06, "in-drivable-lane": 51.39999999999886, "deviation-heading": 7.038314367943698, "agent_compute-ego0": 0.01247953415711059, "complete-iteration": 0.1523368023118806, "set_robot_commands": 0.002189543721677858, "deviation-center-line": 0.9314023136591728, "driven_lanedir_consec": 0.5551287690091393, "sim_compute_sim_state": 0.008879003278619542, "sim_compute_performance-ego0": 0.0019028631475545483}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6096450426603264, "get_ui_image": 0.03493503383968188, "step_physics": 0.11459409413130386, "survival_time": 4.549999999999992, "driven_lanedir": 0.18002198085051768, "get_state_dump": 0.004335771436276643, "get_robot_state": 0.003533904967100724, "sim_render-ego0": 0.0036653150682863984, "get_duckie_state": 1.109164694081182e-06, "in-drivable-lane": 2.8499999999999908, "deviation-heading": 0.9698124463932836, "agent_compute-ego0": 0.012943814630093782, "complete-iteration": 0.1880976194920747, "set_robot_commands": 0.0021001515181168265, "deviation-center-line": 0.1098067364079629, "driven_lanedir_consec": 0.18002198085051768, "sim_compute_sim_state": 0.010055832240892492, "sim_compute_performance-ego0": 0.0018543056819749916}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.841933643915599, "get_ui_image": 0.03162078760765694, "step_physics": 0.092150614873783, "survival_time": 14.750000000000076, "driven_lanedir": 1.106325013429639, "get_state_dump": 0.004396726956238618, "get_robot_state": 0.0035790623845280826, "sim_render-ego0": 0.003809692891868385, "get_duckie_state": 1.20659132261534e-06, "in-drivable-lane": 5.450000000000055, "deviation-heading": 3.474993135229265, "agent_compute-ego0": 0.013969388362523672, "complete-iteration": 0.16354647842613426, "set_robot_commands": 0.0022879218732988513, "deviation-center-line": 0.6949981933304171, "driven_lanedir_consec": 1.106325013429639, "sim_compute_sim_state": 0.009668326055681385, "sim_compute_performance-ego0": 0.001982088024551804}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.664115403767157, "get_ui_image": 0.024903105061616033, "step_physics": 0.07211957565453725, "survival_time": 59.99999999999873, "driven_lanedir": 1.7767183635344104, "get_state_dump": 0.004254950174781107, "get_robot_state": 0.0035010150429807436, "sim_render-ego0": 0.003560394768313901, "get_duckie_state": 1.0964078371173437e-06, "in-drivable-lane": 41.69999999999897, "deviation-heading": 11.156146562217511, "agent_compute-ego0": 0.01238265740285805, "complete-iteration": 0.1306703616737029, "set_robot_commands": 0.0020872542105745415, "deviation-center-line": 1.44952239632473, "driven_lanedir_consec": 1.7767183635344104, "sim_compute_sim_state": 0.005944075532797274, "sim_compute_performance-ego0": 0.001839954787547344}}
set_robot_commands_max0.0022879218732988513
set_robot_commands_mean0.002166217830917019
set_robot_commands_median0.0021448476198973423
set_robot_commands_min0.0020872542105745415
sim_compute_performance-ego0_max0.001982088024551804
sim_compute_performance-ego0_mean0.0018948029104071723
sim_compute_performance-ego0_median0.00187858441476477
sim_compute_performance-ego0_min0.001839954787547344
sim_compute_sim_state_max0.010055832240892492
sim_compute_sim_state_mean0.008636809276997674
sim_compute_sim_state_median0.009273664667150464
sim_compute_sim_state_min0.005944075532797274
sim_render-ego0_max0.003809692891868385
sim_render-ego0_mean0.0036759525115919833
sim_render-ego0_median0.0036668611930928234
sim_render-ego0_min0.003560394768313901
simulation-passed1
step_physics_max0.11459409413130386
step_physics_mean0.09172459541563216
step_physics_median0.09009235593834376
step_physics_min0.07211957565453725
survival_time_max59.99999999999873
survival_time_mean34.82499999999938
survival_time_min4.549999999999992
No reset possible
5721211283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:32:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.7109028074228751
survival_time_median59.99999999999873
deviation-center-line_median3.8747542857671937
in-drivable-lane_median5.4749999999998895


other stats
agent_compute-ego0_max0.02312396706192817
agent_compute-ego0_mean0.01767326522925613
agent_compute-ego0_median0.017632133954768377
agent_compute-ego0_min0.012304825945559587
complete-iteration_max0.1670687166876241
complete-iteration_mean0.1490556201668802
complete-iteration_median0.1448162675003128
complete-iteration_min0.1395212289792711
deviation-center-line_max4.03695550730385
deviation-center-line_mean3.887581275426606
deviation-center-line_min3.763861022868188
deviation-heading_max42.08656923486086
deviation-heading_mean41.82943924360994
deviation-heading_median41.79683528249483
deviation-heading_min41.63751717458923
driven_any_max2.4908418276801174
driven_any_mean2.3555974153478605
driven_any_median2.3453782381406816
driven_any_min2.240791357429962
driven_lanedir_consec_max-0.6467548873487114
driven_lanedir_consec_mean-0.6999096592420848
driven_lanedir_consec_min-0.7310781347738775
driven_lanedir_max-1.3512845518444307
driven_lanedir_mean-1.4154492887691963
driven_lanedir_median-1.389754711907825
driven_lanedir_min-1.5310031794167036
get_duckie_state_max1.5563710742350124e-06
get_duckie_state_mean1.5390504905325885e-06
get_duckie_state_median1.5466437550210438e-06
get_duckie_state_min1.5065433778532538e-06
get_robot_state_max0.0034786221586000313
get_robot_state_mean0.0034696587317194372
get_robot_state_median0.0034727420933935464
get_robot_state_min0.003454528581490624
get_state_dump_max0.004257879487481542
get_state_dump_mean0.0042070128538527155
get_state_dump_median0.004203188627784595
get_state_dump_min0.00416379467236013
get_ui_image_max0.03475925884675622
get_ui_image_mean0.029627803610723084
get_ui_image_median0.029508302054933263
get_ui_image_min0.02473535148626958
in-drivable-lane_max5.54999999999983
in-drivable-lane_mean5.2749999999998805
in-drivable-lane_min4.599999999999912
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.3619324643048647, "get_ui_image": 0.027325738379599947, "step_physics": 0.07705259878966929, "survival_time": 59.99999999999873, "driven_lanedir": -1.3809228007135368, "get_state_dump": 0.00416379467236013, "get_robot_state": 0.0034681557616425196, "sim_render-ego0": 0.003607936743197096, "get_duckie_state": 1.5065433778532538e-06, "in-drivable-lane": 5.499999999999894, "deviation-heading": 41.709781511055496, "agent_compute-ego0": 0.012641419776770395, "complete-iteration": 0.14028772227869343, "set_robot_commands": 0.0021042488298249383, "deviation-center-line": 3.8311210046139217, "driven_lanedir_consec": -0.7310781347738775, "sim_compute_sim_state": 0.007989750019616628, "sim_compute_performance-ego0": 0.0018636600659550676}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.240791357429962, "get_ui_image": 0.03475925884675622, "step_physics": 0.08322823950889009, "survival_time": 59.99999999999873, "driven_lanedir": -1.3512845518444307, "get_state_dump": 0.004194155223760676, "get_robot_state": 0.0034786221586000313, "sim_render-ego0": 0.003572152913559684, "get_duckie_state": 1.5539888736111834e-06, "in-drivable-lane": 5.54999999999983, "deviation-heading": 41.88388905393417, "agent_compute-ego0": 0.02262284813276635, "complete-iteration": 0.1670687166876241, "set_robot_commands": 0.0020894970524618765, "deviation-center-line": 4.03695550730385, "driven_lanedir_consec": -0.6467548873487114, "sim_compute_sim_state": 0.011211480427344177, "sim_compute_performance-ego0": 0.0018431610310702992}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.3288240119764985, "get_ui_image": 0.03169086573026659, "step_physics": 0.08157356454371215, "survival_time": 59.99999999999873, "driven_lanedir": -1.3985866231021131, "get_state_dump": 0.004257879487481542, "get_robot_state": 0.003454528581490624, "sim_render-ego0": 0.0035544855211497744, "get_duckie_state": 1.539298636430904e-06, "in-drivable-lane": 5.449999999999886, "deviation-heading": 42.08656923486086, "agent_compute-ego0": 0.012304825945559587, "complete-iteration": 0.14934481272193215, "set_robot_commands": 0.002069233656922149, "deviation-center-line": 3.9183875669204657, "driven_lanedir_consec": -0.7221761785457139, "sim_compute_sim_state": 0.00854217440361385, "sim_compute_performance-ego0": 0.0018265420054515932}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.4908418276801174, "get_ui_image": 0.02473535148626958, "step_physics": 0.07059061159996267, "survival_time": 59.99999999999873, "driven_lanedir": -1.5310031794167036, "get_state_dump": 0.004212222031808515, "get_robot_state": 0.0034773284251445736, "sim_render-ego0": 0.0035294936558884645, "get_duckie_state": 1.5563710742350124e-06, "in-drivable-lane": 4.599999999999912, "deviation-heading": 41.63751717458923, "agent_compute-ego0": 0.02312396706192817, "complete-iteration": 0.1395212289792711, "set_robot_commands": 0.0020830976675193973, "deviation-center-line": 3.763861022868188, "driven_lanedir_consec": -0.6996294363000364, "sim_compute_sim_state": 0.005854899440577981, "sim_compute_performance-ego0": 0.001843581092446968}}
set_robot_commands_max0.0021042488298249383
set_robot_commands_mean0.00208651930168209
set_robot_commands_median0.002086297359990637
set_robot_commands_min0.002069233656922149
sim_compute_performance-ego0_max0.0018636600659550676
sim_compute_performance-ego0_mean0.001844236048730982
sim_compute_performance-ego0_median0.0018433710617586337
sim_compute_performance-ego0_min0.0018265420054515932
sim_compute_sim_state_max0.011211480427344177
sim_compute_sim_state_mean0.00839957607278816
sim_compute_sim_state_median0.00826596221161524
sim_compute_sim_state_min0.005854899440577981
sim_render-ego0_max0.003607936743197096
sim_render-ego0_mean0.003566017208448755
sim_render-ego0_median0.0035633192173547294
sim_render-ego0_min0.0035294936558884645
simulation-passed1
step_physics_max0.08322823950889009
step_physics_mean0.07811125361055854
step_physics_median0.07931308166669071
step_physics_min0.07059061159996267
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5717711284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:08:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.30394575566137205
survival_time_median11.350000000000026
deviation-center-line_median0.19153736615067216
in-drivable-lane_median8.10000000000003


other stats
agent_compute-ego0_max0.013393594794077417
agent_compute-ego0_mean0.012755961612231083
agent_compute-ego0_median0.012596688926347029
agent_compute-ego0_min0.012436873802152868
complete-iteration_max0.2900023130270151
complete-iteration_mean0.22423578449944395
complete-iteration_median0.2114185134332786
complete-iteration_min0.18410379810420344
deviation-center-line_max0.35196221004602857
deviation-center-line_mean0.2162939521563586
deviation-center-line_min0.1301388662780615
deviation-heading_max3.640291209441264
deviation-heading_mean1.8894041681709837
deviation-heading_median1.3433791011335998
deviation-heading_min1.2305672609754712
driven_any_max2.5906098838373572
driven_any_mean1.4568182836943897
driven_any_median1.2705666804053752
driven_any_min0.69552989012945
driven_lanedir_consec_max-0.2498146069199352
driven_lanedir_consec_mean-0.2968801816743663
driven_lanedir_consec_min-0.3298146084547859
driven_lanedir_max-0.2498146069199352
driven_lanedir_mean-0.2968801816743663
driven_lanedir_median-0.30394575566137205
driven_lanedir_min-0.3298146084547859
get_duckie_state_max1.285718456250892e-06
get_duckie_state_mean1.1947929900839458e-06
get_duckie_state_median1.1753269506513594e-06
get_duckie_state_min1.142799602782173e-06
get_robot_state_max0.0035777473014239306
get_robot_state_mean0.00347663060901588
get_robot_state_median0.003446519333787955
get_robot_state_min0.0034357364670636785
get_state_dump_max0.004327372328875816
get_state_dump_mean0.004247036814570049
get_state_dump_median0.00423536719465639
get_state_dump_min0.004190040540091599
get_ui_image_max0.03456934225330475
get_ui_image_mean0.03006133086026068
get_ui_image_median0.030264264527311815
get_ui_image_min0.02514745213311433
in-drivable-lane_max19.250000000000163
in-drivable-lane_mean9.662500000000051
in-drivable-lane_min3.1999999999999886
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.2092368329578185, "get_ui_image": 0.028507386168388472, "step_physics": 0.11936714768954064, "survival_time": 10.90000000000002, "driven_lanedir": -0.29378450863411887, "get_state_dump": 0.004327372328875816, "get_robot_state": 0.0035777473014239306, "sim_render-ego0": 0.003759470160149004, "get_duckie_state": 1.285718456250892e-06, "in-drivable-lane": 7.800000000000023, "deviation-heading": 1.444078428880683, "agent_compute-ego0": 0.013393594794077417, "complete-iteration": 0.18410379810420344, "set_robot_commands": 0.002159256913346243, "deviation-center-line": 0.2233122471765186, "driven_lanedir_consec": -0.29378450863411887, "sim_compute_sim_state": 0.007036129633585612, "sim_compute_performance-ego0": 0.0019040902455647784}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.5906098838373572, "get_ui_image": 0.03456934225330475, "step_physics": 0.15673559001768067, "survival_time": 23.4000000000002, "driven_lanedir": -0.2498146069199352, "get_state_dump": 0.004235829879988486, "get_robot_state": 0.0034498599038195253, "sim_render-ego0": 0.003628757716750285, "get_duckie_state": 1.1493910604448462e-06, "in-drivable-lane": 19.250000000000163, "deviation-heading": 3.640291209441264, "agent_compute-ego0": 0.012523695349947477, "complete-iteration": 0.23299845246109627, "set_robot_commands": 0.00203427780411645, "deviation-center-line": 0.35196221004602857, "driven_lanedir_consec": -0.2498146069199352, "sim_compute_sim_state": 0.013922254668115808, "sim_compute_performance-ego0": 0.0018298285348074775}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.69552989012945, "get_ui_image": 0.032021142886235164, "step_physics": 0.22238521575927733, "survival_time": 6.449999999999985, "driven_lanedir": -0.31410700268862524, "get_state_dump": 0.004234904509324294, "get_robot_state": 0.0034431787637563853, "sim_render-ego0": 0.003516083497267503, "get_duckie_state": 1.2012628408578726e-06, "in-drivable-lane": 3.1999999999999886, "deviation-heading": 1.2305672609754712, "agent_compute-ego0": 0.012669682502746582, "complete-iteration": 0.2900023130270151, "set_robot_commands": 0.0020223635893601636, "deviation-center-line": 0.1597624851248258, "driven_lanedir_consec": -0.31410700268862524, "sim_compute_sim_state": 0.007814739300654485, "sim_compute_performance-ego0": 0.001826649445753831}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3318965278529322, "get_ui_image": 0.02514745213311433, "step_physics": 0.1306152313570433, "survival_time": 11.800000000000033, "driven_lanedir": -0.3298146084547859, "get_state_dump": 0.004190040540091599, "get_robot_state": 0.0034357364670636785, "sim_render-ego0": 0.003542141572332583, "get_duckie_state": 1.142799602782173e-06, "in-drivable-lane": 8.400000000000038, "deviation-heading": 1.2426797733865167, "agent_compute-ego0": 0.012436873802152868, "complete-iteration": 0.18983857440546092, "set_robot_commands": 0.0020077117887730336, "deviation-center-line": 0.1301388662780615, "driven_lanedir_consec": -0.3298146084547859, "sim_compute_sim_state": 0.006590204399849292, "sim_compute_performance-ego0": 0.001805066056392364}}
set_robot_commands_max0.002159256913346243
set_robot_commands_mean0.0020559025238989725
set_robot_commands_median0.002028320696738307
set_robot_commands_min0.0020077117887730336
sim_compute_performance-ego0_max0.0019040902455647784
sim_compute_performance-ego0_mean0.001841408570629613
sim_compute_performance-ego0_median0.0018282389902806544
sim_compute_performance-ego0_min0.001805066056392364
sim_compute_sim_state_max0.013922254668115808
sim_compute_sim_state_mean0.008840832000551298
sim_compute_sim_state_median0.007425434467120049
sim_compute_sim_state_min0.006590204399849292
sim_render-ego0_max0.003759470160149004
sim_render-ego0_mean0.003611613236624844
sim_render-ego0_median0.003585449644541434
sim_render-ego0_min0.003516083497267503
simulation-passed1
step_physics_max0.22238521575927733
step_physics_mean0.1572757962058855
step_physics_median0.143675410687362
step_physics_min0.11936714768954064
survival_time_max23.4000000000002
survival_time_mean13.13750000000006
survival_time_min6.449999999999985
No reset possible
5711611312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simsuccessnogpu-prod-010:10:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.525000000000029
in-drivable-lane_median0.0
driven_lanedir_consec_median1.6441392428583057
deviation-center-line_median0.42800742228014543


other stats
agent_compute-ego0_max0.013585797062626592
agent_compute-ego0_mean0.012415593892305246
agent_compute-ego0_median0.012265986240205806
agent_compute-ego0_min0.011544606026182784
complete-iteration_max0.2910426104510272
complete-iteration_mean0.22157575089531087
complete-iteration_median0.21434395720416727
complete-iteration_min0.16657247872188174
deviation-center-line_max0.9042153477306406
deviation-center-line_mean0.5215528720556051
deviation-center-line_min0.32598129593148883
deviation-heading_max4.0841288183501225
deviation-heading_mean2.2540382645080417
deviation-heading_median1.9991372431766692
deviation-heading_min0.9337497533287046
driven_any_max2.5432513041422737
driven_any_mean1.6187400548182551
driven_any_median1.681709975736677
driven_any_min0.5682889636573929
driven_lanedir_consec_max2.407899441544939
driven_lanedir_consec_mean1.5608192737237745
driven_lanedir_consec_min0.5470991676335472
driven_lanedir_max2.407899441544939
driven_lanedir_mean1.5608192737237745
driven_lanedir_median1.6441392428583057
driven_lanedir_min0.5470991676335472
get_duckie_state_max0.023612476917023353
get_duckie_state_mean0.01715229765201897
get_duckie_state_median0.020450696823579913
get_duckie_state_min0.004095320043892696
get_robot_state_max0.0036228468388686944
get_robot_state_mean0.0035345207724853216
get_robot_state_median0.003515017238156549
get_robot_state_min0.0034852017747594955
get_state_dump_max0.00817934401491855
get_state_dump_mean0.007222646721303131
get_state_dump_median0.007814101579516178
get_state_dump_min0.0050830397112616174
get_ui_image_max0.038420026684984745
get_ui_image_mean0.0326232391628671
get_ui_image_median0.0328618949653943
get_ui_image_min0.026349140035695044
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.1341958937664995, "get_ui_image": 0.03119950497404058, "step_physics": 0.11748926893193672, "survival_time": 11.700000000000031, "driven_lanedir": 2.074891983493592, "get_state_dump": 0.00817934401491855, "get_robot_state": 0.0034852017747594955, "sim_render-ego0": 0.0034964723789945563, "get_duckie_state": 0.023612476917023353, "in-drivable-lane": 0.0, "deviation-heading": 2.4241761539618354, "agent_compute-ego0": 0.011544606026182784, "complete-iteration": 0.21076372735043788, "set_robot_commands": 0.0020196336380978847, "deviation-center-line": 0.4925853375617271, "driven_lanedir_consec": 2.074891983493592, "sim_compute_sim_state": 0.007846935759199427, "sim_compute_performance-ego0": 0.001811252756321684}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5682889636573929, "get_ui_image": 0.038420026684984745, "step_physics": 0.18864982510790412, "survival_time": 3.999999999999994, "driven_lanedir": 0.5470991676335472, "get_state_dump": 0.008122918046550987, "get_robot_state": 0.0036228468388686944, "sim_render-ego0": 0.0037765444060902536, "get_duckie_state": 0.02091952312139817, "in-drivable-lane": 0.0, "deviation-heading": 0.9337497533287046, "agent_compute-ego0": 0.013585797062626592, "complete-iteration": 0.2910426104510272, "set_robot_commands": 0.002208374164722584, "deviation-center-line": 0.32598129593148883, "driven_lanedir_consec": 0.5470991676335472, "sim_compute_sim_state": 0.009650801434928987, "sim_compute_performance-ego0": 0.0020005084850169995}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.2292240577068545, "get_ui_image": 0.03452428495674802, "step_physics": 0.11933032253332304, "survival_time": 11.350000000000026, "driven_lanedir": 1.2133865022230197, "get_state_dump": 0.007505285112481368, "get_robot_state": 0.003497302532196045, "sim_render-ego0": 0.003618505963107996, "get_duckie_state": 0.019981870525761655, "in-drivable-lane": 0.0, "deviation-heading": 1.574098332391503, "agent_compute-ego0": 0.012020055662121687, "complete-iteration": 0.21792418705789665, "set_robot_commands": 0.002051679711592825, "deviation-center-line": 0.3634295069985638, "driven_lanedir_consec": 1.2133865022230197, "sim_compute_sim_state": 0.01348834288747687, "sim_compute_performance-ego0": 0.0018252876766941004}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.5432513041422737, "get_ui_image": 0.026349140035695044, "step_physics": 0.10155319427621776, "survival_time": 14.45000000000007, "driven_lanedir": 2.407899441544939, "get_state_dump": 0.0050830397112616174, "get_robot_state": 0.0035327319441170527, "sim_render-ego0": 0.003583613757429452, "get_duckie_state": 0.004095320043892696, "in-drivable-lane": 0.0, "deviation-heading": 4.0841288183501225, "agent_compute-ego0": 0.012511916818289922, "complete-iteration": 0.16657247872188174, "set_robot_commands": 0.0021339449389227503, "deviation-center-line": 0.9042153477306406, "driven_lanedir_consec": 2.407899441544939, "sim_compute_sim_state": 0.005776440686193006, "sim_compute_performance-ego0": 0.0018731799618951208}}
set_robot_commands_max0.002208374164722584
set_robot_commands_mean0.002103408113334011
set_robot_commands_median0.0020928123252577876
set_robot_commands_min0.0020196336380978847
sim_compute_performance-ego0_max0.0020005084850169995
sim_compute_performance-ego0_mean0.001877557219981976
sim_compute_performance-ego0_median0.0018492338192946105
sim_compute_performance-ego0_min0.001811252756321684
sim_compute_sim_state_max0.01348834288747687
sim_compute_sim_state_mean0.009190630191949573
sim_compute_sim_state_median0.008748868597064207
sim_compute_sim_state_min0.005776440686193006
sim_render-ego0_max0.0037765444060902536
sim_render-ego0_mean0.003618784126405564
sim_render-ego0_median0.0036010598602687236
sim_render-ego0_min0.0034964723789945563
simulation-passed1
step_physics_max0.18864982510790412
step_physics_mean0.1317556527123454
step_physics_median0.11840979573262989
step_physics_min0.10155319427621776
survival_time_max14.45000000000007
survival_time_mean10.37500000000003
survival_time_min3.999999999999994
No reset possible
5699911285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:19:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.9866603047290534
survival_time_median42.29999999999947
deviation-center-line_median1.22968978249703
in-drivable-lane_median23.44999999999996


other stats
agent_compute-ego0_max0.012887985069559228
agent_compute-ego0_mean0.01218952978723808
agent_compute-ego0_median0.0120848556706879
agent_compute-ego0_min0.01170042273801729
complete-iteration_max0.15961312473908398
complete-iteration_mean0.14397805516493972
complete-iteration_median0.14611212913668237
complete-iteration_min0.1240748376473102
deviation-center-line_max2.794206210685274
deviation-center-line_mean1.380699515357005
deviation-center-line_min0.2692122857486858
deviation-heading_max12.485073711004606
deviation-heading_mean7.246080104924203
deviation-heading_median6.949992572694114
deviation-heading_min2.5992615633039766
driven_any_max3.543454956700382
driven_any_mean2.346883466567734
driven_any_median2.4762782020632663
driven_any_min0.8915225054440208
driven_lanedir_consec_max-0.18417133560891763
driven_lanedir_consec_mean-0.9737711436262124
driven_lanedir_consec_min-1.7375926294378254
driven_lanedir_max-0.18417133560891763
driven_lanedir_mean-0.9737711436262124
driven_lanedir_median-0.9866603047290534
driven_lanedir_min-1.7375926294378254
get_duckie_state_max1.123207594135421e-06
get_duckie_state_mean1.0704225959616463e-06
get_duckie_state_median1.063197184718603e-06
get_duckie_state_min1.032088420273958e-06
get_robot_state_max0.0035763149676115618
get_robot_state_mean0.003489835707566822
get_robot_state_median0.0034705099714090184
get_robot_state_min0.0034420079198376886
get_state_dump_max0.004275846185151094
get_state_dump_mean0.0042193262418119435
get_state_dump_median0.004201702134595326
get_state_dump_min0.004198054512906026
get_ui_image_max0.035578206393104536
get_ui_image_mean0.03038934385094031
get_ui_image_median0.03040139768147313
get_ui_image_min0.025176373647710464
in-drivable-lane_max29.39999999999959
in-drivable-lane_mean22.0874999999999
in-drivable-lane_min12.0500000000001
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.8915225054440208, "get_ui_image": 0.028493284438707817, "step_physics": 0.0833146453644178, "survival_time": 16.050000000000093, "driven_lanedir": -0.18417133560891763, "get_state_dump": 0.004275846185151094, "get_robot_state": 0.0035763149676115618, "sim_render-ego0": 0.003696118822749357, "get_duckie_state": 1.05955585929918e-06, "in-drivable-lane": 12.0500000000001, "deviation-heading": 2.5992615633039766, "agent_compute-ego0": 0.012887985069559228, "complete-iteration": 0.14789019830478645, "set_robot_commands": 0.002079791163805849, "deviation-center-line": 0.2692122857486858, "driven_lanedir_consec": -0.18417133560891763, "sim_compute_sim_state": 0.007606435266340741, "sim_compute_performance-ego0": 0.0018875695163418787}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4843337904732712, "get_ui_image": 0.035578206393104536, "step_physics": 0.08469751495376804, "survival_time": 24.600000000000215, "driven_lanedir": -0.31081521386080824, "get_state_dump": 0.004198054512906026, "get_robot_state": 0.0034420079198376886, "sim_render-ego0": 0.0035688195218904505, "get_duckie_state": 1.0668385101380262e-06, "in-drivable-lane": 18.90000000000021, "deviation-heading": 2.917477250102285, "agent_compute-ego0": 0.012172233744035144, "complete-iteration": 0.15961312473908398, "set_robot_commands": 0.002015928709482808, "deviation-center-line": 0.5803321949587811, "driven_lanedir_consec": -0.31081521386080824, "sim_compute_sim_state": 0.012040088433039355, "sim_compute_performance-ego0": 0.0018275620729396116}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.543454956700382, "get_ui_image": 0.03230951092423845, "step_physics": 0.07560170600058931, "survival_time": 59.99999999999873, "driven_lanedir": -1.6625053955972986, "get_state_dump": 0.004201336963091365, "get_robot_state": 0.003461941791315261, "sim_render-ego0": 0.0035873898657831325, "get_duckie_state": 1.123207594135421e-06, "in-drivable-lane": 29.39999999999959, "deviation-heading": 12.485073711004606, "agent_compute-ego0": 0.01170042273801729, "complete-iteration": 0.14433405996857832, "set_robot_commands": 0.0020244758790180545, "deviation-center-line": 2.794206210685274, "driven_lanedir_consec": -1.6625053955972986, "sim_compute_sim_state": 0.00954044947119974, "sim_compute_performance-ego0": 0.0018357309473245765}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.468222613653261, "get_ui_image": 0.025176373647710464, "step_physics": 0.06547435614389742, "survival_time": 59.99999999999873, "driven_lanedir": -1.7375926294378254, "get_state_dump": 0.004202067306099288, "get_robot_state": 0.003479078151502776, "sim_render-ego0": 0.0035668729643936856, "get_duckie_state": 1.032088420273958e-06, "in-drivable-lane": 27.999999999999705, "deviation-heading": 10.982507895285943, "agent_compute-ego0": 0.011997477597340656, "complete-iteration": 0.1240748376473102, "set_robot_commands": 0.002049140588727025, "deviation-center-line": 1.8790473700352792, "driven_lanedir_consec": -1.7375926294378254, "sim_compute_sim_state": 0.006230694368221083, "sim_compute_performance-ego0": 0.0018286361583166575}}
set_robot_commands_max0.002079791163805849
set_robot_commands_mean0.0020423340852584342
set_robot_commands_median0.0020368082338725396
set_robot_commands_min0.002015928709482808
sim_compute_performance-ego0_max0.0018875695163418787
sim_compute_performance-ego0_mean0.001844874673730681
sim_compute_performance-ego0_median0.001832183552820617
sim_compute_performance-ego0_min0.0018275620729396116
sim_compute_sim_state_max0.012040088433039355
sim_compute_sim_state_mean0.00885441688470023
sim_compute_sim_state_median0.00857344236877024
sim_compute_sim_state_min0.006230694368221083
sim_render-ego0_max0.003696118822749357
sim_render-ego0_mean0.003604800293704156
sim_render-ego0_median0.0035781046938367913
sim_render-ego0_min0.0035668729643936856
simulation-passed1
step_physics_max0.08469751495376804
step_physics_mean0.07727205561566813
step_physics_median0.07945817568250355
step_physics_min0.06547435614389742
survival_time_max59.99999999999873
survival_time_mean40.16249999999944
survival_time_min16.050000000000093
No reset possible
5691811287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:19:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-0.42692984555744307
survival_time_median37.474999999999945
deviation-center-line_median0.9099717570845968
in-drivable-lane_median23.77499999999969


other stats
agent_compute-ego0_max0.013227689022920567
agent_compute-ego0_mean0.01215524994141062
agent_compute-ego0_median0.011899567473297136
agent_compute-ego0_min0.011594175796127638
complete-iteration_max0.15567945263215474
complete-iteration_mean0.142654462354684
complete-iteration_median0.14554270515355036
complete-iteration_min0.1238529864794805
deviation-center-line_max2.2114410461770992
deviation-center-line_mean1.1050268006103567
deviation-center-line_min0.3887226420951342
deviation-heading_max10.918721978849772
deviation-heading_mean6.653655240879945
deviation-heading_median6.508256245018545
deviation-heading_min2.6793864946329173
driven_any_max2.7399443971592827
driven_any_mean1.8565574508964509
driven_any_median1.804047744797092
driven_any_min1.0781899168323357
driven_lanedir_consec_max-0.2056708361751789
driven_lanedir_consec_mean-0.5890254940280467
driven_lanedir_consec_min-1.296571448822122
driven_lanedir_max-0.2056708361751789
driven_lanedir_mean-0.5890254940280467
driven_lanedir_median-0.42692984555744307
driven_lanedir_min-1.296571448822122
get_duckie_state_max1.2590865458338717e-06
get_duckie_state_mean1.1979380495182006e-06
get_duckie_state_median1.2080714656785302e-06
get_duckie_state_min1.1165227208818708e-06
get_robot_state_max0.003621109651059521
get_robot_state_mean0.0035099640795230353
get_robot_state_median0.003474234440388869
get_robot_state_min0.0034702777862548827
get_state_dump_max0.004369536711245167
get_state_dump_mean0.004289039041414739
get_state_dump_median0.004293165826090252
get_state_dump_min0.004200287802233287
get_ui_image_max0.035180541553667614
get_ui_image_mean0.030231384901233692
get_ui_image_median0.0302077001334242
get_ui_image_min0.025329597784418748
in-drivable-lane_max38.39999999999961
in-drivable-lane_mean24.912499999999795
in-drivable-lane_min13.700000000000196
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.0781899168323357, "get_ui_image": 0.028273192230536013, "step_physics": 0.07843813312296964, "survival_time": 24.450000000000212, "driven_lanedir": -0.2056708361751789, "get_state_dump": 0.004369536711245167, "get_robot_state": 0.003621109651059521, "sim_render-ego0": 0.003915799393945811, "get_duckie_state": 1.1823615249322386e-06, "in-drivable-lane": 18.800000000000225, "deviation-heading": 3.4745034085341167, "agent_compute-ego0": 0.013227689022920567, "complete-iteration": 0.1437298940152538, "set_robot_commands": 0.00223497419941182, "deviation-center-line": 0.3887226420951342, "driven_lanedir_consec": -0.2056708361751789, "sim_compute_sim_state": 0.007603292562523667, "sim_compute_performance-ego0": 0.001972683595151318}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.2215956011515416, "get_ui_image": 0.035180541553667614, "step_physics": 0.08062332203345639, "survival_time": 44.749999999999595, "driven_lanedir": -0.2638698067294025, "get_state_dump": 0.004302611840622765, "get_robot_state": 0.0034757027668612345, "sim_render-ego0": 0.003627846017479897, "get_duckie_state": 1.1165227208818708e-06, "in-drivable-lane": 38.39999999999961, "deviation-heading": 2.6793864946329173, "agent_compute-ego0": 0.01216069023524012, "complete-iteration": 0.15567945263215474, "set_robot_commands": 0.0020294862666300367, "deviation-center-line": 0.606664817646944, "driven_lanedir_consec": -0.2638698067294025, "sim_compute_sim_state": 0.012369762041739054, "sim_compute_performance-ego0": 0.001837960577436856}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.386499888442643, "get_ui_image": 0.03214220803631239, "step_physics": 0.0788372615152154, "survival_time": 30.200000000000298, "driven_lanedir": -0.5899898843854836, "get_state_dump": 0.004283719811557739, "get_robot_state": 0.0034702777862548827, "sim_render-ego0": 0.003555129579276093, "get_duckie_state": 1.2590865458338717e-06, "in-drivable-lane": 13.700000000000196, "deviation-heading": 9.542009081502972, "agent_compute-ego0": 0.011638444711354154, "complete-iteration": 0.14735551629184693, "set_robot_commands": 0.002043436381442488, "deviation-center-line": 1.2132786965222493, "driven_lanedir_consec": -0.5899898843854836, "sim_compute_sim_state": 0.00949128600191479, "sim_compute_performance-ego0": 0.0018208897803440567}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.7399443971592827, "get_ui_image": 0.025329597784418748, "step_physics": 0.06534797901118626, "survival_time": 59.99999999999873, "driven_lanedir": -1.296571448822122, "get_state_dump": 0.004200287802233287, "get_robot_state": 0.0034727661139165034, "sim_render-ego0": 0.0035666434790669233, "get_duckie_state": 1.2337814064248218e-06, "in-drivable-lane": 28.74999999999915, "deviation-heading": 10.918721978849772, "agent_compute-ego0": 0.011594175796127638, "complete-iteration": 0.1238529864794805, "set_robot_commands": 0.0020331018274769397, "deviation-center-line": 2.2114410461770992, "driven_lanedir_consec": -1.296571448822122, "sim_compute_sim_state": 0.006404099913064288, "sim_compute_performance-ego0": 0.0018325473347075476}}
set_robot_commands_max0.00223497419941182
set_robot_commands_mean0.002085249668740321
set_robot_commands_median0.002038269104459714
set_robot_commands_min0.0020294862666300367
sim_compute_performance-ego0_max0.001972683595151318
sim_compute_performance-ego0_mean0.0018660203219099444
sim_compute_performance-ego0_median0.0018352539560722017
sim_compute_performance-ego0_min0.0018208897803440567
sim_compute_sim_state_max0.012369762041739054
sim_compute_sim_state_mean0.00896711012981045
sim_compute_sim_state_median0.008547289282219228
sim_compute_sim_state_min0.006404099913064288
sim_render-ego0_max0.003915799393945811
sim_render-ego0_mean0.003666354617442181
sim_render-ego0_median0.0035972447482734097
sim_render-ego0_min0.003555129579276093
simulation-passed1
step_physics_max0.08062332203345639
step_physics_mean0.07581167392070692
step_physics_median0.07863769731909252
step_physics_min0.06534797901118626
survival_time_max59.99999999999873
survival_time_mean39.84999999999971
survival_time_min24.450000000000212
No reset possible
5671411311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:34:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.501194001903347
survival_time_median59.99999999999873
deviation-center-line_median3.344888888728483
in-drivable-lane_median0.6749999999999954


other stats
agent_compute-ego0_max0.025556504379005657
agent_compute-ego0_mean0.0171246187673024
agent_compute-ego0_median0.015049721577284635
agent_compute-ego0_min0.012842527535634671
complete-iteration_max0.2065423315113331
complete-iteration_mean0.1810805715688758
complete-iteration_median0.18204157636326415
complete-iteration_min0.15369680203764166
deviation-center-line_max3.4111732440831477
deviation-center-line_mean3.055163751629866
deviation-center-line_min2.1197039849793513
deviation-heading_max19.280535259262308
deviation-heading_mean14.502205212130145
deviation-heading_median14.407081697037768
deviation-heading_min9.914122195182731
driven_any_max10.754231374248086
driven_any_mean9.664202031357144
driven_any_median9.690488735140764
driven_any_min8.52159928089896
driven_lanedir_consec_max10.53805466972804
driven_lanedir_consec_mean8.901674934965357
driven_lanedir_consec_min8.066257066326697
driven_lanedir_max10.53805466972804
driven_lanedir_mean8.901674934965357
driven_lanedir_median8.501194001903347
driven_lanedir_min8.066257066326697
get_duckie_state_max1.116259508982586e-06
get_duckie_state_mean1.0649429372109345e-06
get_duckie_state_median1.061965186431148e-06
get_duckie_state_min1.0195818669988552e-06
get_robot_state_max0.003502327238491036
get_robot_state_mean0.0034924494932335086
get_robot_state_median0.0034931082213351767
get_robot_state_min0.003481254291772644
get_state_dump_max0.0043349375236441355
get_state_dump_mean0.0042795530465322175
get_state_dump_median0.00428614797044257
get_state_dump_min0.004210978721599595
get_ui_image_max0.0348845473137823
get_ui_image_mean0.029703770946404223
get_ui_image_median0.029516667747974
get_ui_image_min0.02489720097588659
in-drivable-lane_max3.8500000000000543
in-drivable-lane_mean1.3000000000000114
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.599728113189618, "get_ui_image": 0.027518011548934036, "step_physics": 0.11116435525816348, "survival_time": 59.99999999999873, "driven_lanedir": 8.855767003962459, "get_state_dump": 0.004210978721599595, "get_robot_state": 0.003481254291772644, "sim_render-ego0": 0.0035536090698369237, "get_duckie_state": 1.0195818669988552e-06, "in-drivable-lane": 3.8500000000000543, "deviation-heading": 19.280535259262308, "agent_compute-ego0": 0.012842527535634671, "complete-iteration": 0.17593765298492406, "set_robot_commands": 0.00207438953313899, "deviation-center-line": 3.3053507877509714, "driven_lanedir_consec": 8.855767003962459, "sim_compute_sim_state": 0.009180174779137604, "sim_compute_performance-ego0": 0.001841764267437861}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.52159928089896, "get_ui_image": 0.0348845473137823, "step_physics": 0.11800080374019728, "survival_time": 59.99999999999873, "driven_lanedir": 8.146620999844233, "get_state_dump": 0.004270069009556957, "get_robot_state": 0.0034939033800517392, "sim_render-ego0": 0.003560842026481025, "get_duckie_state": 1.0249418184024709e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.54268282555354, "agent_compute-ego0": 0.025556504379005657, "complete-iteration": 0.2065423315113331, "set_robot_commands": 0.002084312192804113, "deviation-center-line": 3.4111732440831477, "driven_lanedir_consec": 8.146620999844233, "sim_compute_sim_state": 0.012770951141624229, "sim_compute_performance-ego0": 0.001848692302402112}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.78124935709191, "get_ui_image": 0.031515323947013965, "step_physics": 0.11479336991099692, "survival_time": 59.99999999999873, "driven_lanedir": 8.066257066326697, "get_state_dump": 0.004302226931328182, "get_robot_state": 0.003492313062618614, "sim_render-ego0": 0.0035661243578476473, "get_duckie_state": 1.116259508982586e-06, "in-drivable-lane": 1.3499999999999908, "deviation-heading": 14.271480568521994, "agent_compute-ego0": 0.01325128616441001, "complete-iteration": 0.1881454997416043, "set_robot_commands": 0.002071368704231256, "deviation-center-line": 3.384426989705995, "driven_lanedir_consec": 8.066257066326697, "sim_compute_sim_state": 0.013239900833561856, "sim_compute_performance-ego0": 0.0018414383029858336}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.754231374248086, "get_ui_image": 0.02489720097588659, "step_physics": 0.09052299480454114, "survival_time": 59.99999999999873, "driven_lanedir": 10.53805466972804, "get_state_dump": 0.0043349375236441355, "get_robot_state": 0.003502327238491036, "sim_render-ego0": 0.0035344244141463535, "get_duckie_state": 1.0989885544598251e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.914122195182731, "agent_compute-ego0": 0.016848156990159263, "complete-iteration": 0.15369680203764166, "set_robot_commands": 0.002074436184567873, "deviation-center-line": 2.1197039849793513, "driven_lanedir_consec": 10.53805466972804, "sim_compute_sim_state": 0.00607204933547656, "sim_compute_performance-ego0": 0.0018383380673906388}}
set_robot_commands_max0.002084312192804113
set_robot_commands_mean0.002076126653685558
set_robot_commands_median0.0020744128588534314
set_robot_commands_min0.002071368704231256
sim_compute_performance-ego0_max0.001848692302402112
sim_compute_performance-ego0_mean0.0018425582350541112
sim_compute_performance-ego0_median0.0018416012852118472
sim_compute_performance-ego0_min0.0018383380673906388
sim_compute_sim_state_max0.013239900833561856
sim_compute_sim_state_mean0.010315769022450062
sim_compute_sim_state_median0.010975562960380917
sim_compute_sim_state_min0.00607204933547656
sim_render-ego0_max0.0035661243578476473
sim_render-ego0_mean0.0035537499670779877
sim_render-ego0_median0.0035572255481589746
sim_render-ego0_min0.0035344244141463535
simulation-passed1
step_physics_max0.11800080374019728
step_physics_mean0.1086203809284747
step_physics_median0.1129788625845802
step_physics_min0.09052299480454114
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5640111310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:33:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.59250579011064
survival_time_median59.99999999999873
deviation-center-line_median3.3453252042334967
in-drivable-lane_median0.6749999999999954


other stats
agent_compute-ego0_max0.013522446899985791
agent_compute-ego0_mean0.012944509593969974
agent_compute-ego0_median0.012853636332693742
agent_compute-ego0_min0.012548318810506625
complete-iteration_max0.1953204079134875
complete-iteration_mean0.1775417325895692
complete-iteration_median0.1822017811418671
complete-iteration_min0.15044296016105504
deviation-center-line_max3.4111732440831477
deviation-center-line_mean3.055381909382373
deviation-center-line_min2.1197039849793513
deviation-heading_max18.17533422937177
deviation-heading_mean14.225904954657508
deviation-heading_median14.407081697037768
deviation-heading_min9.914122195182731
driven_any_max10.866396700612215
driven_any_mean9.730869178212794
driven_any_median9.767740365669995
driven_any_min8.52159928089896
driven_lanedir_consec_max10.53805466972804
driven_lanedir_consec_mean8.947330829069005
driven_lanedir_consec_min8.066257066326697
driven_lanedir_max10.53805466972804
driven_lanedir_mean8.947330829069005
driven_lanedir_median8.59250579011064
driven_lanedir_min8.066257066326697
get_duckie_state_max1.1504043845908032e-06
get_duckie_state_mean1.0976981957885845e-06
get_duckie_state_median1.1019663052396117e-06
get_duckie_state_min1.0364557880843112e-06
get_robot_state_max0.0035089233535017003
get_robot_state_mean0.0034898595944927893
get_robot_state_median0.003491546986601335
get_robot_state_min0.003467421051266787
get_state_dump_max0.004305547321964362
get_state_dump_mean0.004270560685839879
get_state_dump_median0.004273340664338708
get_state_dump_min0.004230014092717739
get_ui_image_max0.03524294483175286
get_ui_image_mean0.029860701489508104
get_ui_image_median0.0295953068705423
get_ui_image_min0.02500924738519495
in-drivable-lane_max4.550000000000036
in-drivable-lane_mean1.4750000000000068
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.866396700612215, "get_ui_image": 0.02752573007747196, "step_physics": 0.11227143019264088, "survival_time": 59.99999999999873, "driven_lanedir": 9.038390580377047, "get_state_dump": 0.004305547321964362, "get_robot_state": 0.0035037905052242233, "sim_render-ego0": 0.003552063617182215, "get_duckie_state": 1.0364557880843112e-06, "in-drivable-lane": 4.550000000000036, "deviation-heading": 18.17533422937177, "agent_compute-ego0": 0.01265992749045036, "complete-iteration": 0.17691465103060475, "set_robot_commands": 0.00209438890144291, "deviation-center-line": 3.306223418760999, "driven_lanedir_consec": 9.038390580377047, "sim_compute_sim_state": 0.009080901134024056, "sim_compute_performance-ego0": 0.001848981739777907}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.52159928089896, "get_ui_image": 0.03524294483175286, "step_physics": 0.1191734306818242, "survival_time": 59.99999999999873, "driven_lanedir": 8.146620999844233, "get_state_dump": 0.004273041003351902, "get_robot_state": 0.0035089233535017003, "sim_render-ego0": 0.003568370177485762, "get_duckie_state": 1.1504043845908032e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.54268282555354, "agent_compute-ego0": 0.013047345174937126, "complete-iteration": 0.1953204079134875, "set_robot_commands": 0.002094964996960439, "deviation-center-line": 3.4111732440831477, "driven_lanedir_consec": 8.146620999844233, "sim_compute_sim_state": 0.012502600013167534, "sim_compute_performance-ego0": 0.0018363157775777264}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.78124935709191, "get_ui_image": 0.03166488366361264, "step_physics": 0.11512310995249624, "survival_time": 59.99999999999873, "driven_lanedir": 8.066257066326697, "get_state_dump": 0.004230014092717739, "get_robot_state": 0.0034793034679784464, "sim_render-ego0": 0.0035123096516884735, "get_duckie_state": 1.1107010408603182e-06, "in-drivable-lane": 1.3499999999999908, "deviation-heading": 14.271480568521994, "agent_compute-ego0": 0.012548318810506625, "complete-iteration": 0.18748891125312953, "set_robot_commands": 0.0020527305650671355, "deviation-center-line": 3.384426989705995, "driven_lanedir_consec": 8.066257066326697, "sim_compute_sim_state": 0.012993124899121744, "sim_compute_performance-ego0": 0.0018136628362955796}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.754231374248086, "get_ui_image": 0.02500924738519495, "step_physics": 0.09078155330178345, "survival_time": 59.99999999999873, "driven_lanedir": 10.53805466972804, "get_state_dump": 0.004273640325325514, "get_robot_state": 0.003467421051266787, "sim_render-ego0": 0.0034900503690594143, "get_duckie_state": 1.0932315696189048e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.914122195182731, "agent_compute-ego0": 0.013522446899985791, "complete-iteration": 0.15044296016105504, "set_robot_commands": 0.0020627332269698754, "deviation-center-line": 2.1197039849793513, "driven_lanedir_consec": 10.53805466972804, "sim_compute_sim_state": 0.0059521557587965835, "sim_compute_performance-ego0": 0.001812531688032698}}
set_robot_commands_max0.002094964996960439
set_robot_commands_mean0.00207620442261009
set_robot_commands_median0.0020785610642063924
set_robot_commands_min0.0020527305650671355
sim_compute_performance-ego0_max0.001848981739777907
sim_compute_performance-ego0_mean0.001827873010420978
sim_compute_performance-ego0_median0.0018249893069366531
sim_compute_performance-ego0_min0.001812531688032698
sim_compute_sim_state_max0.012993124899121744
sim_compute_sim_state_mean0.01013219545127748
sim_compute_sim_state_median0.010791750573595797
sim_compute_sim_state_min0.0059521557587965835
sim_render-ego0_max0.003568370177485762
sim_render-ego0_mean0.003530698453853966
sim_render-ego0_median0.003532186634435344
sim_render-ego0_min0.0034900503690594143
simulation-passed1
step_physics_max0.1191734306818242
step_physics_mean0.10933738103218618
step_physics_median0.11369727007256857
step_physics_min0.09078155330178345
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5597511310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:36:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.693229024990114
survival_time_median59.99999999999873
deviation-center-line_median3.3657830886150224
in-drivable-lane_median0.6749999999999954


other stats
agent_compute-ego0_max0.013042540871829015
agent_compute-ego0_mean0.012361252734702791
agent_compute-ego0_median0.012244628132828865
agent_compute-ego0_min0.011913213801324415
complete-iteration_max0.19487469261830095
complete-iteration_mean0.1801352169888899
complete-iteration_median0.1877213652981608
complete-iteration_min0.15022344474093702
deviation-center-line_max3.4111732440831477
deviation-center-line_mean3.065610851573136
deviation-center-line_min2.1197039849793513
deviation-heading_max18.39373962525835
deviation-heading_mean14.280506303629153
deviation-heading_median14.407081697037768
deviation-heading_min9.914122195182731
driven_any_max10.787239469346623
driven_any_mean9.711079870396397
driven_any_median9.767740365669995
driven_any_min8.52159928089896
driven_lanedir_consec_max10.53805466972804
driven_lanedir_consec_mean8.99769244650874
driven_lanedir_consec_min8.066257066326697
driven_lanedir_max10.53805466972804
driven_lanedir_mean8.99769244650874
driven_lanedir_median8.693229024990114
driven_lanedir_min8.066257066326697
get_duckie_state_max1.7675928628811927e-06
get_duckie_state_mean1.7338450207102804e-06
get_duckie_state_median1.7511159752330415e-06
get_duckie_state_min1.6655552694938465e-06
get_robot_state_max0.0035784349751214403
get_robot_state_mean0.003488453103541137
get_robot_state_median0.003463604765867413
get_robot_state_min0.0034481679073082817
get_state_dump_max0.004320641143633662
get_state_dump_mean0.004288375774688467
get_state_dump_median0.004302792207684545
get_state_dump_min0.004227277539751115
get_ui_image_max0.03537861889943195
get_ui_image_mean0.030155846320222952
get_ui_image_median0.029986747992624352
get_ui_image_min0.025271270396211166
in-drivable-lane_max3.3000000000000256
in-drivable-lane_mean1.162500000000004
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.787239469346623, "get_ui_image": 0.02781733386621785, "step_physics": 0.1155732984249042, "survival_time": 59.99999999999873, "driven_lanedir": 9.239837050135993, "get_state_dump": 0.004320641143633662, "get_robot_state": 0.0035784349751214403, "sim_render-ego0": 0.0036551835237196542, "get_duckie_state": 1.7376168383646769e-06, "in-drivable-lane": 3.3000000000000256, "deviation-heading": 18.39373962525835, "agent_compute-ego0": 0.013042540871829015, "complete-iteration": 0.18136136220158583, "set_robot_commands": 0.00215527953752173, "deviation-center-line": 3.34713918752405, "driven_lanedir_consec": 9.239837050135993, "sim_compute_sim_state": 0.009223821856000838, "sim_compute_performance-ego0": 0.0019185862672219764}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.52159928089896, "get_ui_image": 0.03537861889943195, "step_physics": 0.11864793151741124, "survival_time": 59.99999999999873, "driven_lanedir": 8.146620999844233, "get_state_dump": 0.004227277539751115, "get_robot_state": 0.003455618438276026, "sim_render-ego0": 0.003541848939423954, "get_duckie_state": 1.7675928628811927e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.54268282555354, "agent_compute-ego0": 0.012367498070671596, "complete-iteration": 0.19408136839473575, "set_robot_commands": 0.0020201946674635964, "deviation-center-line": 3.4111732440831477, "driven_lanedir_consec": 8.146620999844233, "sim_compute_sim_state": 0.012553048074295085, "sim_compute_performance-ego0": 0.001821627128531196}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.78124935709191, "get_ui_image": 0.03215616211903086, "step_physics": 0.12194970188093224, "survival_time": 59.99999999999873, "driven_lanedir": 8.066257066326697, "get_state_dump": 0.004316253130084569, "get_robot_state": 0.0034715910934587997, "sim_render-ego0": 0.003607932971379441, "get_duckie_state": 1.7646151121014063e-06, "in-drivable-lane": 1.3499999999999908, "deviation-heading": 14.271480568521994, "agent_compute-ego0": 0.012121758194986131, "complete-iteration": 0.19487469261830095, "set_robot_commands": 0.0021014080555810223, "deviation-center-line": 3.384426989705995, "driven_lanedir_consec": 8.066257066326697, "sim_compute_sim_state": 0.01320571744571022, "sim_compute_performance-ego0": 0.0018712070760480769}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.754231374248086, "get_ui_image": 0.025271270396211166, "step_physics": 0.09180737335814922, "survival_time": 59.99999999999873, "driven_lanedir": 10.53805466972804, "get_state_dump": 0.00428933128528452, "get_robot_state": 0.0034481679073082817, "sim_render-ego0": 0.003534830380835998, "get_duckie_state": 1.6655552694938465e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.914122195182731, "agent_compute-ego0": 0.011913213801324415, "complete-iteration": 0.15022344474093702, "set_robot_commands": 0.0020703483282973824, "deviation-center-line": 2.1197039849793513, "driven_lanedir_consec": 10.53805466972804, "sim_compute_sim_state": 0.005991240524431748, "sim_compute_performance-ego0": 0.0018292997997071123}}
set_robot_commands_max0.00215527953752173
set_robot_commands_mean0.0020868076472159327
set_robot_commands_median0.0020858781919392026
set_robot_commands_min0.0020201946674635964
sim_compute_performance-ego0_max0.0019185862672219764
sim_compute_performance-ego0_mean0.0018601800678770904
sim_compute_performance-ego0_median0.0018502534378775947
sim_compute_performance-ego0_min0.001821627128531196
sim_compute_sim_state_max0.01320571744571022
sim_compute_sim_state_mean0.010243456975109472
sim_compute_sim_state_median0.01088843496514796
sim_compute_sim_state_min0.005991240524431748
sim_render-ego0_max0.0036551835237196542
sim_render-ego0_mean0.0035849489538397616
sim_render-ego0_median0.0035748909554016977
sim_render-ego0_min0.003534830380835998
simulation-passed1
step_physics_max0.12194970188093224
step_physics_mean0.11199457629534924
step_physics_median0.11711061497115773
step_physics_min0.09180737335814922
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5549811283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:31:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median-1.5282126454556608
survival_time_median59.99999999999873
deviation-center-line_median2.559375140038207
in-drivable-lane_median15.224999999999795


other stats
agent_compute-ego0_max0.01468508769770734
agent_compute-ego0_mean0.013103753016011127
agent_compute-ego0_median0.013052143125510236
agent_compute-ego0_min0.011625638115316705
complete-iteration_max0.20637079619249635
complete-iteration_mean0.1825578617417343
complete-iteration_median0.1831097947270745
complete-iteration_min0.15764106132029188
deviation-center-line_max3.523199796770986
deviation-center-line_mean2.3653619394071703
deviation-center-line_min0.8194976807812813
deviation-heading_max35.13892468606044
deviation-heading_mean22.62699334195646
deviation-heading_median24.03783182253195
deviation-heading_min7.293385036701487
driven_any_max7.460199807486527
driven_any_mean6.01445972492983
driven_any_median7.243995082399783
driven_any_min2.10964892743323
driven_lanedir_consec_max-0.5158496143519468
driven_lanedir_consec_mean-1.4470700163173904
driven_lanedir_consec_min-2.216005160006293
driven_lanedir_max-0.7210791370873754
driven_lanedir_mean-2.3193349294215055
driven_lanedir_median-2.415153248337632
driven_lanedir_min-3.725954083923383
get_duckie_state_max1.194691463127448e-06
get_duckie_state_mean1.136016385057791e-06
get_duckie_state_median1.1297586458509509e-06
get_duckie_state_min1.0898567854018136e-06
get_robot_state_max0.0036439232995139808
get_robot_state_mean0.0035238035814591628
get_robot_state_median0.00349613649461986
get_robot_state_min0.0034590180370829486
get_state_dump_max0.004524907883896165
get_state_dump_mean0.0043824702140843105
get_state_dump_median0.004358428006962277
get_state_dump_min0.004288116958516524
get_ui_image_max0.035810223824773404
get_ui_image_mean0.030227247267375214
get_ui_image_median0.02989821231533943
get_ui_image_min0.025302340614048596
in-drivable-lane_max41.09999999999868
in-drivable-lane_mean20.049999999999585
in-drivable-lane_min8.650000000000059
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.156757486771473, "get_ui_image": 0.02774760685395837, "step_physics": 0.10999947880626618, "survival_time": 59.99999999999873, "driven_lanedir": -3.725954083923383, "get_state_dump": 0.004387158736102686, "get_robot_state": 0.003507007865683423, "sim_render-ego0": 0.0036011246419965378, "get_duckie_state": 1.0898567854018136e-06, "in-drivable-lane": 14.299999999999994, "deviation-heading": 32.738113191204974, "agent_compute-ego0": 0.01339143896777862, "complete-iteration": 0.17463749294773329, "set_robot_commands": 0.0020778244679218326, "deviation-center-line": 3.523199796770986, "driven_lanedir_consec": -2.216005160006293, "sim_compute_sim_state": 0.007972752819648888, "sim_compute_performance-ego0": 0.001873433242531045}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.460199807486527, "get_ui_image": 0.035810223824773404, "step_physics": 0.13212805385891346, "survival_time": 59.99999999999873, "driven_lanedir": -1.456980323357988, "get_state_dump": 0.0043296972778218675, "get_robot_state": 0.0034590180370829486, "sim_render-ego0": 0.0036046971488654066, "get_duckie_state": 1.0962093203986911e-06, "in-drivable-lane": 41.09999999999868, "deviation-heading": 15.337550453858924, "agent_compute-ego0": 0.011625638115316705, "complete-iteration": 0.20637079619249635, "set_robot_commands": 0.002045816624789909, "deviation-center-line": 1.7995617515765487, "driven_lanedir_consec": -1.075674430919281, "sim_compute_sim_state": 0.01144366141262896, "sim_compute_performance-ego0": 0.0018487736942567597}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.331232678028092, "get_ui_image": 0.03204881777672049, "step_physics": 0.12278640895560818, "survival_time": 59.99999999999873, "driven_lanedir": -3.3733261733172757, "get_state_dump": 0.004288116958516524, "get_robot_state": 0.0034852651235562975, "sim_render-ego0": 0.0036015399389719587, "get_duckie_state": 1.1633079713032109e-06, "in-drivable-lane": 16.149999999999597, "deviation-heading": 35.13892468606044, "agent_compute-ego0": 0.01271284728324185, "complete-iteration": 0.19158209650641575, "set_robot_commands": 0.0021064837310435275, "deviation-center-line": 3.319188528499865, "driven_lanedir_consec": -1.980750859992041, "sim_compute_sim_state": 0.00861097315169691, "sim_compute_performance-ego0": 0.0018654217033163892}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.10964892743323, "get_ui_image": 0.025302340614048596, "step_physics": 0.09510762749965576, "survival_time": 18.300000000000125, "driven_lanedir": -0.7210791370873754, "get_state_dump": 0.004524907883896165, "get_robot_state": 0.0036439232995139808, "sim_render-ego0": 0.0038022072503612215, "get_duckie_state": 1.194691463127448e-06, "in-drivable-lane": 8.650000000000059, "deviation-heading": 7.293385036701487, "agent_compute-ego0": 0.01468508769770734, "complete-iteration": 0.15764106132029188, "set_robot_commands": 0.002168872375904052, "deviation-center-line": 0.8194976807812813, "driven_lanedir_consec": -0.5158496143519468, "sim_compute_sim_state": 0.006317486879936031, "sim_compute_performance-ego0": 0.0019965509627755396}}
set_robot_commands_max0.002168872375904052
set_robot_commands_mean0.0020997492999148305
set_robot_commands_median0.00209215409948268
set_robot_commands_min0.002045816624789909
sim_compute_performance-ego0_max0.0019965509627755396
sim_compute_performance-ego0_mean0.0018960449007199333
sim_compute_performance-ego0_median0.001869427472923717
sim_compute_performance-ego0_min0.0018487736942567597
sim_compute_sim_state_max0.01144366141262896
sim_compute_sim_state_mean0.008586218565977697
sim_compute_sim_state_median0.008291862985672898
sim_compute_sim_state_min0.006317486879936031
sim_render-ego0_max0.0038022072503612215
sim_render-ego0_mean0.003652392245048781
sim_render-ego0_median0.0036031185439186824
sim_render-ego0_min0.0036011246419965378
simulation-passed1
step_physics_max0.13212805385891346
step_physics_mean0.11500539228011088
step_physics_median0.11639294388093718
step_physics_min0.09510762749965576
survival_time_max59.99999999999873
survival_time_mean49.57499999999907
survival_time_min18.300000000000125
No reset possible
5524911436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:13:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4953415167970959
survival_time_median3.8749999999999942
deviation-center-line_median0.10019431734994318
in-drivable-lane_median2.5999999999999948


other stats
agent_compute-ego0_max0.010825108925964713
agent_compute-ego0_mean0.010399750136325697
agent_compute-ego0_median0.010364322042077538
agent_compute-ego0_min0.010045247535183006
complete-iteration_max0.23351083732232816
complete-iteration_mean0.1996941599423771
complete-iteration_median0.2003209182457099
complete-iteration_min0.16462396595576037
deviation-center-line_max1.3347053459531408
deviation-center-line_mean0.3964925199382131
deviation-center-line_min0.050876099099825205
deviation-heading_max7.092505358170257
deviation-heading_mean2.1832773338209277
deviation-heading_median0.6958540662065884
deviation-heading_min0.24889584470027704
driven_any_max32.21451956876099
driven_any_mean9.164620243328644
driven_any_median1.53081754802698
driven_any_min1.3823263084996291
driven_lanedir_consec_max9.151844330275928
driven_lanedir_consec_mean2.6196278682405016
driven_lanedir_consec_min0.3359841090918858
driven_lanedir_max10.09337842757754
driven_lanedir_mean2.85860808999487
driven_lanedir_median0.5025349116550267
driven_lanedir_min0.3359841090918858
get_duckie_state_max1.175762855843322e-06
get_duckie_state_mean1.1522779491890104e-06
get_duckie_state_median1.155596080970683e-06
get_duckie_state_min1.1221567789713542e-06
get_robot_state_max0.0035889444502068997
get_robot_state_mean0.0034967585029268846
get_robot_state_median0.0034828172493172136
get_robot_state_min0.003432455062866211
get_state_dump_max0.004305095207400438
get_state_dump_mean0.004251697723045534
get_state_dump_median0.004253540023181162
get_state_dump_min0.004194615638419373
get_ui_image_max0.036522528020347035
get_ui_image_mean0.031177655525203025
get_ui_image_median0.030924222779677636
get_ui_image_min0.0263396485211098
in-drivable-lane_max39.1499999999992
in-drivable-lane_mean11.612499999999796
in-drivable-lane_min2.0999999999999934
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 32.21451956876099, "get_ui_image": 0.02816626451890931, "step_physics": 0.12102564546488206, "survival_time": 59.99999999999873, "driven_lanedir": 10.09337842757754, "get_state_dump": 0.004279413191503927, "get_robot_state": 0.0035889444502068997, "sim_render-ego0": 0.0036430972303379385, "get_duckie_state": 1.1627124211472537e-06, "in-drivable-lane": 39.1499999999992, "deviation-heading": 7.092505358170257, "agent_compute-ego0": 0.010825108925964713, "complete-iteration": 0.18346790409802796, "set_robot_commands": 0.0021271820767138224, "deviation-center-line": 1.3347053459531408, "driven_lanedir_consec": 9.151844330275928, "sim_compute_sim_state": 0.007826994698212407, "sim_compute_performance-ego0": 0.0019105437593992108}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6253119880518745, "get_ui_image": 0.036522528020347035, "step_physics": 0.16211124164302174, "survival_time": 4.049999999999994, "driven_lanedir": 0.6188196930254084, "get_state_dump": 0.004305095207400438, "get_robot_state": 0.0035134641135611184, "sim_render-ego0": 0.00360007693127888, "get_duckie_state": 1.148479740794112e-06, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 1.1348402688492234, "agent_compute-ego0": 0.010576806417325647, "complete-iteration": 0.23351083732232816, "set_robot_commands": 0.0020357224999404534, "deviation-center-line": 0.14647640362993186, "driven_lanedir_consec": 0.6044329033095468, "sim_compute_sim_state": 0.008926981832922959, "sim_compute_performance-ego0": 0.0018462407879713105}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.436323108002086, "get_ui_image": 0.033682181040445965, "step_physics": 0.15098053614298504, "survival_time": 3.699999999999995, "driven_lanedir": 0.38625013028464505, "get_state_dump": 0.004227666854858398, "get_robot_state": 0.003432455062866211, "sim_render-ego0": 0.0035014788309733072, "get_duckie_state": 1.1221567789713542e-06, "in-drivable-lane": 2.5999999999999943, "deviation-heading": 0.25686786356395347, "agent_compute-ego0": 0.010151837666829429, "complete-iteration": 0.21717393239339192, "set_robot_commands": 0.002009789148966471, "deviation-center-line": 0.050876099099825205, "driven_lanedir_consec": 0.38625013028464505, "sim_compute_sim_state": 0.007285896937052409, "sim_compute_performance-ego0": 0.0018295415242513024}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3823263084996291, "get_ui_image": 0.0263396485211098, "step_physics": 0.108313406983467, "survival_time": 3.599999999999995, "driven_lanedir": 0.3359841090918858, "get_state_dump": 0.004194615638419373, "get_robot_state": 0.0034521703850733092, "sim_render-ego0": 0.003512085300602325, "get_duckie_state": 1.175762855843322e-06, "in-drivable-lane": 2.599999999999995, "deviation-heading": 0.24889584470027704, "agent_compute-ego0": 0.010045247535183006, "complete-iteration": 0.16462396595576037, "set_robot_commands": 0.0020439886067011586, "deviation-center-line": 0.053912231069954485, "driven_lanedir_consec": 0.3359841090918858, "sim_compute_sim_state": 0.004819964709347242, "sim_compute_performance-ego0": 0.0018290134325419389}}
set_robot_commands_max0.0021271820767138224
set_robot_commands_mean0.0020541705830804764
set_robot_commands_median0.002039855553320806
set_robot_commands_min0.002009789148966471
sim_compute_performance-ego0_max0.0019105437593992108
sim_compute_performance-ego0_mean0.0018538348760409405
sim_compute_performance-ego0_median0.0018378911561113063
sim_compute_performance-ego0_min0.0018290134325419389
sim_compute_sim_state_max0.008926981832922959
sim_compute_sim_state_mean0.007214959544383755
sim_compute_sim_state_median0.007556445817632408
sim_compute_sim_state_min0.004819964709347242
sim_render-ego0_max0.0036430972303379385
sim_render-ego0_mean0.0035641845732981127
sim_render-ego0_median0.0035560811159406026
sim_render-ego0_min0.0035014788309733072
simulation-passed1
step_physics_max0.16211124164302174
step_physics_mean0.13560770755858895
step_physics_median0.13600309080393355
step_physics_min0.108313406983467
survival_time_max59.99999999999873
survival_time_mean17.83749999999968
survival_time_min3.599999999999995
No reset possible
5520611305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:33
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 70, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 67, in compute_action
              ||     return action.astype(float)
              || AttributeError: 'Tensor' object has no attribute 'astype'
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5482111356Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:35:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.04548847334859
survival_time_median59.99999999999873
deviation-center-line_median4.050979868643811
in-drivable-lane_median4.4250000000000185


other stats
agent_compute-ego0_max0.01225939837224676
agent_compute-ego0_mean0.012121233416040374
agent_compute-ego0_median0.012213022186793852
agent_compute-ego0_min0.011799490918327032
complete-iteration_max0.19496052529194471
complete-iteration_mean0.17669272581603904
complete-iteration_median0.17775233153201064
complete-iteration_min0.15630571490819012
deviation-center-line_max6.04312735595787
deviation-center-line_mean4.295538170064576
deviation-center-line_min3.037065587012811
deviation-heading_max12.073169702351894
deviation-heading_mean9.133951992414849
deviation-heading_median8.791944878935032
deviation-heading_min6.878748509437431
driven_any_max7.921079897747017
driven_any_mean7.919385315652212
driven_any_median7.920973965251289
driven_any_min7.914513434359254
driven_lanedir_consec_max7.708307989098906
driven_lanedir_consec_mean6.4273049333052725
driven_lanedir_consec_min3.909934797425003
driven_lanedir_max7.708307989098906
driven_lanedir_mean7.193953075891573
driven_lanedir_median7.080249340579268
driven_lanedir_min6.907005633308849
get_duckie_state_max1.579994563754651e-06
get_duckie_state_mean1.5471896759973378e-06
get_duckie_state_median1.5676865271982008e-06
get_duckie_state_min1.4733910858382989e-06
get_robot_state_max0.0036650077190923257
get_robot_state_mean0.0035871381962130607
get_robot_state_median0.0035852739753373755
get_robot_state_min0.0035129971150851666
get_state_dump_max0.00447033902786852
get_state_dump_mean0.0043970755891537885
get_state_dump_median0.004390850650777825
get_state_dump_min0.004336262027190984
get_ui_image_max0.03572457100727675
get_ui_image_mean0.030491548364704392
get_ui_image_median0.030171626017155197
get_ui_image_min0.025898370417230435
in-drivable-lane_max6.399999999999804
in-drivable-lane_mean3.81249999999996
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.914513434359254, "get_ui_image": 0.02795445988517717, "step_physics": 0.09915078966742648, "survival_time": 59.99999999999873, "driven_lanedir": 6.976527367770204, "get_state_dump": 0.004408156047951272, "get_robot_state": 0.003603005786422488, "sim_render-ego0": 0.0037200030041773255, "get_duckie_state": 1.4733910858382989e-06, "in-drivable-lane": 5.600000000000019, "deviation-heading": 6.878748509437431, "agent_compute-ego0": 0.01225939837224676, "complete-iteration": 0.16546188822197577, "set_robot_commands": 0.002187586346831945, "deviation-center-line": 3.037065587012811, "driven_lanedir_consec": 3.909934797425003, "sim_compute_sim_state": 0.010172539805492492, "sim_compute_performance-ego0": 0.0019286254562009483}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.920986730652461, "get_ui_image": 0.03572457100727675, "step_physics": 0.11934495944960924, "survival_time": 59.99999999999873, "driven_lanedir": 7.183971313388332, "get_state_dump": 0.004336262027190984, "get_robot_state": 0.0035675421642522628, "sim_render-ego0": 0.003673119509249901, "get_duckie_state": 1.5563710742350124e-06, "in-drivable-lane": 3.2500000000000187, "deviation-heading": 12.073169702351894, "agent_compute-ego0": 0.011799490918327032, "complete-iteration": 0.19496052529194471, "set_robot_commands": 0.0020789284193942588, "deviation-center-line": 4.443625927039532, "driven_lanedir_consec": 7.183971313388332, "sim_compute_sim_state": 0.01244956031627798, "sim_compute_performance-ego0": 0.0019068833096239784}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.921079897747017, "get_ui_image": 0.032388792149133226, "step_physics": 0.11653930380580624, "survival_time": 59.99999999999873, "driven_lanedir": 7.708307989098906, "get_state_dump": 0.0043735452536043775, "get_robot_state": 0.0035129971150851666, "sim_render-ego0": 0.0036238020008350783, "get_duckie_state": 1.579994563754651e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.196265913613512, "agent_compute-ego0": 0.012241735942754815, "complete-iteration": 0.1900427748420455, "set_robot_commands": 0.0020533007050831053, "deviation-center-line": 3.6583338102480902, "driven_lanedir_consec": 7.708307989098906, "sim_compute_sim_state": 0.013372473077512008, "sim_compute_performance-ego0": 0.0018613050621216936}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920961199850115, "get_ui_image": 0.025898370417230435, "step_physics": 0.09583119984768908, "survival_time": 59.99999999999873, "driven_lanedir": 6.907005633308849, "get_state_dump": 0.00447033902786852, "get_robot_state": 0.0036650077190923257, "sim_render-ego0": 0.0037403900756327736, "get_duckie_state": 1.579001980161389e-06, "in-drivable-lane": 6.399999999999804, "deviation-heading": 7.387623844256552, "agent_compute-ego0": 0.012184308430832888, "complete-iteration": 0.15630571490819012, "set_robot_commands": 0.0022228196896085335, "deviation-center-line": 6.04312735595787, "driven_lanedir_consec": 6.907005633308849, "sim_compute_sim_state": 0.006220417753246603, "sim_compute_performance-ego0": 0.0019962714176987926}}
set_robot_commands_max0.0022228196896085335
set_robot_commands_mean0.0021356587902294608
set_robot_commands_median0.002133257383113102
set_robot_commands_min0.0020533007050831053
sim_compute_performance-ego0_max0.0019962714176987926
sim_compute_performance-ego0_mean0.0019232713114113536
sim_compute_performance-ego0_median0.0019177543829124637
sim_compute_performance-ego0_min0.0018613050621216936
sim_compute_sim_state_max0.013372473077512008
sim_compute_sim_state_mean0.010553747738132273
sim_compute_sim_state_median0.011311050060885236
sim_compute_sim_state_min0.006220417753246603
sim_render-ego0_max0.0037403900756327736
sim_render-ego0_mean0.0036893286474737694
sim_render-ego0_median0.003696561256713613
sim_render-ego0_min0.0036238020008350783
simulation-passed1
step_physics_max0.11934495944960924
step_physics_mean0.10771656319263276
step_physics_median0.10784504673661638
step_physics_min0.09583119984768908
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5464811397Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:25:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3605080242135374
survival_time_median48.074999999999406
deviation-center-line_median0.8806266406632426
in-drivable-lane_median17.72499999999941


other stats
agent_compute-ego0_max0.011480984739419522
agent_compute-ego0_mean0.011137658487607218
agent_compute-ego0_median0.011054307430188525
agent_compute-ego0_min0.010961034350632304
complete-iteration_max0.2512614776690801
complete-iteration_mean0.2158011610445912
complete-iteration_median0.2132880985488701
complete-iteration_min0.18536696941154435
deviation-center-line_max2.5475304861120143
deviation-center-line_mean1.103674243726479
deviation-center-line_min0.10591320746741632
deviation-heading_max10.57549601357752
deviation-heading_mean5.956846807345105
deviation-heading_median5.996512796145388
deviation-heading_min1.2588656235121274
driven_any_max7.91927889891921
driven_any_mean5.404864279455797
driven_any_median6.2852214615588515
driven_any_min1.1297352957862723
driven_lanedir_consec_max2.3817467540771133
driven_lanedir_consec_mean1.3581496287649624
driven_lanedir_consec_min0.3298357125556617
driven_lanedir_max4.24374482861802
driven_lanedir_mean2.0853509670750987
driven_lanedir_median1.8839116635633564
driven_lanedir_min0.3298357125556617
get_duckie_state_max1.635976278414635e-06
get_duckie_state_mean1.522355148522562e-06
get_duckie_state_median1.50356304222036e-06
get_duckie_state_min1.446318231234893e-06
get_robot_state_max0.0035268298828799423
get_robot_state_mean0.003441875241595154
get_robot_state_median0.003445032137220448
get_robot_state_min0.0033506068090597787
get_state_dump_max0.0042521802710057495
get_state_dump_mean0.00419836118285935
get_state_dump_median0.004213959681961495
get_state_dump_min0.004113345096508662
get_ui_image_max0.03442348167300224
get_ui_image_mean0.029749540762809917
get_ui_image_median0.029816159420720505
get_ui_image_min0.024942362536796422
in-drivable-lane_max56.69999999999873
in-drivable-lane_mean23.474999999999373
in-drivable-lane_min1.749999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.654691382258049, "get_ui_image": 0.02775877187265217, "step_physics": 0.122180023575356, "survival_time": 36.15000000000008, "driven_lanedir": 4.24374482861802, "get_state_dump": 0.004229433299428192, "get_robot_state": 0.0035268298828799423, "sim_render-ego0": 0.0035886550476537885, "get_duckie_state": 1.446318231234893e-06, "in-drivable-lane": 1.749999999999936, "deviation-heading": 9.19219298821891, "agent_compute-ego0": 0.010961034350632304, "complete-iteration": 0.18536696941154435, "set_robot_commands": 0.002132444091923329, "deviation-center-line": 1.1985612155974894, "driven_lanedir_consec": 2.3817467540771133, "sim_compute_sim_state": 0.009035758879961888, "sim_compute_performance-ego0": 0.0018826739564126369}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.1297352957862723, "get_ui_image": 0.03442348167300224, "step_physics": 0.1808126506706079, "survival_time": 9.55, "driven_lanedir": 0.7091873260938715, "get_state_dump": 0.004113345096508662, "get_robot_state": 0.0033506068090597787, "sim_render-ego0": 0.0034609436988830566, "get_duckie_state": 1.4839073022206624e-06, "in-drivable-lane": 2.3999999999999915, "deviation-heading": 2.8008326040718656, "agent_compute-ego0": 0.011012755334377289, "complete-iteration": 0.2512614776690801, "set_robot_commands": 0.002255669484535853, "deviation-center-line": 0.5626920657289959, "driven_lanedir_consec": 0.7091873260938715, "sim_compute_sim_state": 0.009975212315718332, "sim_compute_performance-ego0": 0.001780182123184204}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.91927889891921, "get_ui_image": 0.03187354696878883, "step_physics": 0.16275884606856092, "survival_time": 59.99999999999873, "driven_lanedir": 3.0586360010328413, "get_state_dump": 0.004198486064494798, "get_robot_state": 0.0034446966439659254, "sim_render-ego0": 0.0035380255074227086, "get_duckie_state": 1.635976278414635e-06, "in-drivable-lane": 33.04999999999883, "deviation-heading": 10.57549601357752, "agent_compute-ego0": 0.011480984739419522, "complete-iteration": 0.23071474715335283, "set_robot_commands": 0.002100661037168733, "deviation-center-line": 2.5475304861120143, "driven_lanedir_consec": 2.011828722333203, "sim_compute_sim_state": 0.009420004018041913, "sim_compute_performance-ego0": 0.0018296612986517789}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.915751540859655, "get_ui_image": 0.024942362536796422, "step_physics": 0.1386994126436613, "survival_time": 59.99999999999873, "driven_lanedir": 0.3298357125556617, "get_state_dump": 0.0042521802710057495, "get_robot_state": 0.0034453676304749704, "sim_render-ego0": 0.003525288674753969, "get_duckie_state": 1.5232187822200575e-06, "in-drivable-lane": 56.69999999999873, "deviation-heading": 1.2588656235121274, "agent_compute-ego0": 0.011095859525999755, "complete-iteration": 0.19586144994438737, "set_robot_commands": 0.0020274057872686456, "deviation-center-line": 0.10591320746741632, "driven_lanedir_consec": 0.3298357125556617, "sim_compute_sim_state": 0.005998555468480653, "sim_compute_performance-ego0": 0.0018063107696202872}}
set_robot_commands_max0.002255669484535853
set_robot_commands_mean0.00212904510022414
set_robot_commands_median0.0021165525645460313
set_robot_commands_min0.0020274057872686456
sim_compute_performance-ego0_max0.0018826739564126369
sim_compute_performance-ego0_mean0.0018247070369672269
sim_compute_performance-ego0_median0.001817986034136033
sim_compute_performance-ego0_min0.001780182123184204
sim_compute_sim_state_max0.009975212315718332
sim_compute_sim_state_mean0.008607382670550695
sim_compute_sim_state_median0.009227881449001898
sim_compute_sim_state_min0.005998555468480653
sim_render-ego0_max0.0035886550476537885
sim_render-ego0_mean0.0035282282321783807
sim_render-ego0_median0.003531657091088339
sim_render-ego0_min0.0034609436988830566
simulation-passed1
step_physics_max0.1808126506706079
step_physics_mean0.15111273323954652
step_physics_median0.1507291293561111
step_physics_min0.122180023575356
survival_time_max59.99999999999873
survival_time_mean41.424999999999386
survival_time_min9.55
No reset possible
5452811467Thomas Wiggers 🇳🇱ppo_v1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:30:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.351300669549726
survival_time_median59.99999999999873
deviation-center-line_median5.755925543082066
in-drivable-lane_median3.500000000000023


other stats
agent_compute-ego0_max0.04729884272312542
agent_compute-ego0_mean0.034215003279266985
agent_compute-ego0_median0.03471824728269576
agent_compute-ego0_min0.020124675828550976
complete-iteration_max0.20799714639522351
complete-iteration_mean0.17589321054280666
complete-iteration_median0.1722789344579536
complete-iteration_min0.15101782686009593
deviation-center-line_max6.383945150421571
deviation-center-line_mean5.221597232339482
deviation-center-line_min2.9905926927722244
deviation-heading_max15.848609314467376
deviation-heading_mean10.450226305340015
deviation-heading_median10.19226821446856
deviation-heading_min5.567759477955572
driven_any_max11.955724440016963
driven_any_mean7.873617614573798
driven_any_median7.7786468343437
driven_any_min3.981452349590829
driven_lanedir_consec_max11.442518490917578
driven_lanedir_consec_mean7.39335586054132
driven_lanedir_consec_min3.428303612148252
driven_lanedir_max11.442518490917578
driven_lanedir_mean7.39335586054132
driven_lanedir_median7.351300669549726
driven_lanedir_min3.428303612148252
get_duckie_state_max1.8495501893939392e-06
get_duckie_state_mean1.750959568121376e-06
get_duckie_state_median1.7780149906104451e-06
get_duckie_state_min1.5982581018706742e-06
get_robot_state_max0.0035303353460549507
get_robot_state_mean0.0035066961396258093
get_robot_state_median0.0035131855074511677
get_robot_state_min0.00347007819754595
get_state_dump_max0.0043873694609311295
get_state_dump_mean0.004283088753197264
get_state_dump_median0.004303421207907595
get_state_dump_min0.004138143136042738
get_ui_image_max0.03545495731248943
get_ui_image_mean0.030183084897779208
get_ui_image_median0.029929117098987348
get_ui_image_min0.0254191480806527
in-drivable-lane_max5.349999999999831
in-drivable-lane_mean3.687499999999953
in-drivable-lane_min2.399999999999934
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.955724440016963, "get_ui_image": 0.027726837637819517, "step_physics": 0.07904884082689373, "survival_time": 59.99999999999873, "driven_lanedir": 11.442518490917578, "get_state_dump": 0.004138143136042738, "get_robot_state": 0.0035054578471441847, "sim_render-ego0": 0.003575216026528491, "get_duckie_state": 1.5982581018706742e-06, "in-drivable-lane": 5.349999999999831, "deviation-heading": 7.937457682824085, "agent_compute-ego0": 0.020124675828550976, "complete-iteration": 0.15101782686009593, "set_robot_commands": 0.0020526590990484206, "deviation-center-line": 5.319249572871387, "driven_lanedir_consec": 11.442518490917578, "sim_compute_sim_state": 0.008949421724610086, "sim_compute_performance-ego0": 0.001829068329213164}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.530184222038915, "get_ui_image": 0.03545495731248943, "step_physics": 0.09732716506367224, "survival_time": 59.99999999999873, "driven_lanedir": 8.127250006732599, "get_state_dump": 0.004290847953015025, "get_robot_state": 0.0035209131677581508, "sim_render-ego0": 0.0035953476069670335, "get_duckie_state": 1.7703720969423267e-06, "in-drivable-lane": 2.5999999999999837, "deviation-heading": 12.447078746113034, "agent_compute-ego0": 0.04729884272312542, "complete-iteration": 0.20799714639522351, "set_robot_commands": 0.002072430371642609, "deviation-center-line": 6.383945150421571, "driven_lanedir_consec": 8.127250006732599, "sim_compute_sim_state": 0.012506310290639148, "sim_compute_performance-ego0": 0.0018599259664772152}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.981452349590829, "get_ui_image": 0.03213139656015518, "step_physics": 0.09394565134337454, "survival_time": 29.650000000000286, "driven_lanedir": 3.428303612148252, "get_state_dump": 0.0043873694609311295, "get_robot_state": 0.0035303353460549507, "sim_render-ego0": 0.003685495267412077, "get_duckie_state": 1.8495501893939392e-06, "in-drivable-lane": 4.4000000000000625, "deviation-heading": 5.567759477955572, "agent_compute-ego0": 0.022268131124451505, "complete-iteration": 0.17550161872247252, "set_robot_commands": 0.0021374691215027062, "deviation-center-line": 2.9905926927722244, "driven_lanedir_consec": 3.428303612148252, "sim_compute_sim_state": 0.011433668409533774, "sim_compute_performance-ego0": 0.001906726496789592}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.027109446648484, "get_ui_image": 0.0254191480806527, "step_physics": 0.07528995336045036, "survival_time": 59.99999999999873, "driven_lanedir": 6.575351332366854, "get_state_dump": 0.004315994462800165, "get_robot_state": 0.00347007819754595, "sim_render-ego0": 0.0035372685631744867, "get_duckie_state": 1.7856578842785635e-06, "in-drivable-lane": 2.399999999999934, "deviation-heading": 15.848609314467376, "agent_compute-ego0": 0.047168363440940025, "complete-iteration": 0.1690562501934347, "set_robot_commands": 0.002038619004121728, "deviation-center-line": 6.192601513292745, "driven_lanedir_consec": 6.575351332366854, "sim_compute_sim_state": 0.0059060677203608, "sim_compute_performance-ego0": 0.0018400530533230772}}
set_robot_commands_max0.0021374691215027062
set_robot_commands_mean0.002075294399078866
set_robot_commands_median0.002062544735345515
set_robot_commands_min0.002038619004121728
sim_compute_performance-ego0_max0.001906726496789592
sim_compute_performance-ego0_mean0.001858943461450762
sim_compute_performance-ego0_median0.0018499895099001464
sim_compute_performance-ego0_min0.001829068329213164
sim_compute_sim_state_max0.012506310290639148
sim_compute_sim_state_mean0.009698867036285952
sim_compute_sim_state_median0.010191545067071933
sim_compute_sim_state_min0.0059060677203608
sim_render-ego0_max0.003685495267412077
sim_render-ego0_mean0.0035983318660205224
sim_render-ego0_median0.0035852818167477624
sim_render-ego0_min0.0035372685631744867
simulation-passed1
step_physics_max0.09732716506367224
step_physics_mean0.08640290264859771
step_physics_median0.08649724608513414
step_physics_min0.07528995336045036
survival_time_max59.99999999999873
survival_time_mean52.41249999999911
survival_time_min29.650000000000286
No reset possible
5447311512Jean-Sébastien Grondin 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:17:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.885459133661442
survival_time_median26.45000000000024
deviation-center-line_median1.2627202837511604
in-drivable-lane_median6.650000000000078


other stats
agent_compute-ego0_max0.012528661980049444
agent_compute-ego0_mean0.012030534309706771
agent_compute-ego0_median0.01189412471883764
agent_compute-ego0_min0.011805225821102367
complete-iteration_max0.271839676784868
complete-iteration_mean0.22739219615958595
complete-iteration_median0.2229299273649227
complete-iteration_min0.1918692531236304
deviation-center-line_max1.8847070335154452
deviation-center-line_mean1.134534748598351
deviation-center-line_min0.12799139337563817
deviation-heading_max6.798437613840554
deviation-heading_mean4.483479719798054
deviation-heading_median5.075357040551644
deviation-heading_min0.984767184248372
driven_any_max20.832507092934247
driven_any_mean10.060264814807407
driven_any_median8.8647184697148
driven_any_min1.6791152268657832
driven_lanedir_consec_max7.026871911968387
driven_lanedir_consec_mean4.240036653777052
driven_lanedir_consec_min0.1623564358169398
driven_lanedir_max7.259611174631669
driven_lanedir_mean4.549172186158469
driven_lanedir_median5.28950516019901
driven_lanedir_min0.3580672496041881
get_duckie_state_max1.1173646841476212e-06
get_duckie_state_mean1.09510117890612e-06
get_duckie_state_median1.093837483268336e-06
get_duckie_state_min1.0753650649401865e-06
get_robot_state_max0.0036637884721572975
get_robot_state_mean0.0035442721706239813
get_robot_state_median0.003511274340114467
get_robot_state_min0.0034907515301096947
get_state_dump_max0.004366064376668381
get_state_dump_mean0.004335360157302642
get_state_dump_median0.004337165247844995
get_state_dump_min0.0043010457568522
get_ui_image_max0.03540047677625127
get_ui_image_mean0.03021479657770572
get_ui_image_median0.030065410291033517
get_ui_image_min0.025327888952504585
in-drivable-lane_max43.74999999999861
in-drivable-lane_mean15.299999999999686
in-drivable-lane_min4.149999999999986
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.7942978837862364, "get_ui_image": 0.028176398165444577, "step_physics": 0.14303634212469496, "survival_time": 23.4000000000002, "driven_lanedir": 5.423467909430422, "get_state_dump": 0.004366064376668381, "get_robot_state": 0.0036637884721572975, "sim_render-ego0": 0.003742347139793672, "get_duckie_state": 1.1173646841476212e-06, "in-drivable-lane": 6.50000000000008, "deviation-heading": 5.20127449114099, "agent_compute-ego0": 0.012528661980049444, "complete-iteration": 0.2095632969951833, "set_robot_commands": 0.0022369442718115445, "deviation-center-line": 1.244867489373656, "driven_lanedir_consec": 5.423467909430422, "sim_compute_sim_state": 0.009780730774153524, "sim_compute_performance-ego0": 0.0019628137413626795}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6791152268657832, "get_ui_image": 0.03540047677625127, "step_physics": 0.19871702114073167, "survival_time": 5.899999999999987, "driven_lanedir": 0.3580672496041881, "get_state_dump": 0.004314336456170603, "get_robot_state": 0.003506119511708492, "sim_render-ego0": 0.0035716946385487788, "get_duckie_state": 1.0798959171070772e-06, "in-drivable-lane": 4.149999999999986, "deviation-heading": 0.984767184248372, "agent_compute-ego0": 0.011805225821102367, "complete-iteration": 0.271839676784868, "set_robot_commands": 0.0020635368443336806, "deviation-center-line": 0.12799139337563817, "driven_lanedir_consec": 0.1623564358169398, "sim_compute_sim_state": 0.010553011373311532, "sim_compute_performance-ego0": 0.0018367086138044084}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.935139055643363, "get_ui_image": 0.03195442241662246, "step_physics": 0.16391548731202, "survival_time": 29.500000000000284, "driven_lanedir": 7.259611174631669, "get_state_dump": 0.004359994039519386, "get_robot_state": 0.0035164291685204417, "sim_render-ego0": 0.003588833784693994, "get_duckie_state": 1.107779049429595e-06, "in-drivable-lane": 6.800000000000075, "deviation-heading": 6.798437613840554, "agent_compute-ego0": 0.01196180987479118, "complete-iteration": 0.2362965577346621, "set_robot_commands": 0.002126594888780726, "deviation-center-line": 1.8847070335154452, "driven_lanedir_consec": 7.026871911968387, "sim_compute_sim_state": 0.01294810558131907, "sim_compute_performance-ego0": 0.0018523227543193472}, "LF-norm-small_loop-000-ego0": {"driven_any": 20.832507092934247, "get_ui_image": 0.025327888952504585, "step_physics": 0.1333327974308341, "survival_time": 59.99999999999873, "driven_lanedir": 5.155542410967598, "get_state_dump": 0.0043010457568522, "get_robot_state": 0.0034907515301096947, "sim_render-ego0": 0.003540133953491516, "get_duckie_state": 1.0753650649401865e-06, "in-drivable-lane": 43.74999999999861, "deviation-heading": 4.949439589962298, "agent_compute-ego0": 0.0118264395628841, "complete-iteration": 0.1918692531236304, "set_robot_commands": 0.0020736776521859024, "deviation-center-line": 1.2805730781286648, "driven_lanedir_consec": 4.347450357892461, "sim_compute_sim_state": 0.006069017786666019, "sim_compute_performance-ego0": 0.0018360841085670592}}
set_robot_commands_max0.0022369442718115445
set_robot_commands_mean0.002125188414277963
set_robot_commands_median0.0021001362704833144
set_robot_commands_min0.0020635368443336806
sim_compute_performance-ego0_max0.0019628137413626795
sim_compute_performance-ego0_mean0.0018719823045133736
sim_compute_performance-ego0_median0.001844515684061878
sim_compute_performance-ego0_min0.0018360841085670592
sim_compute_sim_state_max0.01294810558131907
sim_compute_sim_state_mean0.009837716378862537
sim_compute_sim_state_median0.010166871073732528
sim_compute_sim_state_min0.006069017786666019
sim_render-ego0_max0.003742347139793672
sim_render-ego0_mean0.00361075237913199
sim_render-ego0_median0.0035802642116213863
sim_render-ego0_min0.003540133953491516
simulation-passed1
step_physics_max0.19871702114073167
step_physics_mean0.1597504120020702
step_physics_median0.15347591471835748
step_physics_min0.1333327974308341
survival_time_max59.99999999999873
survival_time_mean29.6999999999998
survival_time_min5.899999999999987
No reset possible
5436011562Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:40:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012137966489513949
agent_compute-ego0_mean0.011720515508437336
agent_compute-ego0_median0.011703993458235692
agent_compute-ego0_min0.011336108627764014
complete-iteration_max0.33128897216695236
complete-iteration_mean0.27603880258325136
complete-iteration_median0.27634661878574696
complete-iteration_min0.22017300059455916
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.1732338072358322e-06
get_duckie_state_mean1.1201802141759714e-06
get_duckie_state_median1.1258875698372288e-06
get_duckie_state_min1.0557119097935964e-06
get_robot_state_max0.003617320429971077
get_robot_state_mean0.003553382314115043
get_robot_state_median0.003538035135483563
get_robot_state_min0.003520138555521969
get_state_dump_max0.0043805777083626395
get_state_dump_mean0.0043137491394538464
get_state_dump_median0.004355672396390662
get_state_dump_min0.004163074056671422
get_ui_image_max0.03578181052386612
get_ui_image_mean0.030247729981967952
get_ui_image_median0.02973225144522077
get_ui_image_min0.025744606513564135
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.027326643615837, "step_physics": 0.19179733865564808, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004163074056671422, "get_robot_state": 0.0035214348696947693, "sim_render-ego0": 0.003597313716548567, "get_duckie_state": 1.0557119097935964e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012137966489513949, "complete-iteration": 0.2551285482068344, "set_robot_commands": 0.0021880322153820385, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008459882474163986, "sim_compute_performance-ego0": 0.0018698879324526311}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03578181052386612, "step_physics": 0.25636247274381335, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004339226278833902, "get_robot_state": 0.003554635401272357, "sim_render-ego0": 0.0036633370023881466, "get_duckie_state": 1.0888642018085515e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.011808608989731458, "complete-iteration": 0.33128897216695236, "set_robot_commands": 0.0022138691663146515, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.0116062168276975, "sim_compute_performance-ego0": 0.0018888851883607936}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03213785927460454, "step_physics": 0.22928722077464184, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004372118513947422, "get_robot_state": 0.003520138555521969, "sim_render-ego0": 0.0036767668569217017, "get_duckie_state": 1.1732338072358322e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.011599377926739924, "complete-iteration": 0.2975646893646596, "set_robot_commands": 0.0021522434228266607, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00883285449406785, "sim_compute_performance-ego0": 0.0019161224762267812}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.025744606513564135, "step_physics": 0.16099751978293744, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0043805777083626395, "get_robot_state": 0.003617320429971077, "sim_render-ego0": 0.0036766036761789697, "get_duckie_state": 1.162910937865906e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.011336108627764014, "complete-iteration": 0.22017300059455916, "set_robot_commands": 0.0022774443439798095, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006142590266282512, "sim_compute_performance-ego0": 0.0019322174177082451}}
set_robot_commands_max0.0022774443439798095
set_robot_commands_mean0.00220789728712579
set_robot_commands_median0.002200950690848345
set_robot_commands_min0.0021522434228266607
sim_compute_performance-ego0_max0.0019322174177082451
sim_compute_performance-ego0_mean0.001901778253687113
sim_compute_performance-ego0_median0.0019025038322937875
sim_compute_performance-ego0_min0.0018698879324526311
sim_compute_sim_state_max0.0116062168276975
sim_compute_sim_state_mean0.008760386015552964
sim_compute_sim_state_median0.008646368484115919
sim_compute_sim_state_min0.006142590266282512
sim_render-ego0_max0.0036767668569217017
sim_render-ego0_mean0.003653505313009346
sim_render-ego0_median0.003669970339283558
sim_render-ego0_min0.003597313716548567
simulation-passed1
step_physics_max0.25636247274381335
step_physics_mean0.20961113798926015
step_physics_median0.21054227971514497
step_physics_min0.16099751978293744
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5396912644Bea Baselines 🐤template-pytorchaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesgpu-prod-012:10:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5482572865997812
survival_time_median59.99999999999873
deviation-center-line_median0.48908197119536806
in-drivable-lane_median54.99999999999872


other stats
agent_compute-ego0_max0.015692049815791732
agent_compute-ego0_mean0.01408536859282957
agent_compute-ego0_median0.01491167324965046
agent_compute-ego0_min0.011634425259351136
agent_compute-ego1_max0.012709016903155452
agent_compute-ego1_mean0.012025766683501127
agent_compute-ego1_median0.012474702061661872
agent_compute-ego1_min0.010987574611476418
agent_compute-ego2_max0.01233591763403493
agent_compute-ego2_mean0.011618719741499426
agent_compute-ego2_median0.01132575578236957
agent_compute-ego2_min0.01119448580809378
agent_compute-ego3_max0.012176437639971756
agent_compute-ego3_mean0.011741497170551266
agent_compute-ego3_median0.01158225605827287
agent_compute-ego3_min0.011465797813409177
complete-iteration_max1.303675835575291
complete-iteration_mean1.0939845702757915
complete-iteration_median1.229151197913088
complete-iteration_min0.4101242763017437
deviation-center-line_max1.886463674433613
deviation-center-line_mean0.7894874077094801
deviation-center-line_min0.07032012472510785
deviation-heading_max16.613547557195222
deviation-heading_mean6.776038452013834
deviation-heading_median4.089277326573538
deviation-heading_min0.6182685772099469
driven_any_max12.548787111322453
driven_any_mean5.263663435750637
driven_any_median4.8138467184246325
driven_any_min0.17384220550911303
driven_lanedir_consec_max2.5721680945111616
driven_lanedir_consec_mean0.7492611535118575
driven_lanedir_consec_min0.06868086921458616
driven_lanedir_max2.5721680945111616
driven_lanedir_mean0.8118556780556254
driven_lanedir_median0.6966477770815822
driven_lanedir_min0.06868086921458616
get_duckie_state_max1.391800714472152e-06
get_duckie_state_mean1.3503390798050311e-06
get_duckie_state_median1.33105459856451e-06
get_duckie_state_min1.3276798143474189e-06
get_robot_state_max0.014225606219556111
get_robot_state_mean0.012993136101136582
get_robot_state_median0.01391565313347174
get_robot_state_min0.007027882719714874
get_state_dump_max0.009342918189538706
get_state_dump_mean0.008854810811824715
get_state_dump_median0.009334424850247882
get_state_dump_min0.00599497164615882
get_ui_image_max0.05070119495693591
get_ui_image_mean0.04447153999389415
get_ui_image_median0.04648839524147612
get_ui_image_min0.02980290721794846
in-drivable-lane_max58.99999999999873
in-drivable-lane_mean51.62142857142736
in-drivable-lane_min37.14999999999904
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.7594283890537241, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 0.23790481177222889, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 55.999999999998735, "deviation-heading": 2.6971316675518744, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 0.3694733818024503, "driven_lanedir_consec": 0.23790481177222889, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 9.761835698934451, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 1.177562192822179, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 45.0999999999989, "deviation-heading": 14.23951157909658, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 1.680552125281341, "driven_lanedir_consec": 0.8005067941000679, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 7.954868950638018, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 1.029443463523104, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 50.24999999999869, "deviation-heading": 8.9831393501878, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 0.8368336949413437, "driven_lanedir_consec": 0.6870561763513174, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 3.834215122239704, "get_ui_image": 0.0435593461712433, "step_physics": 0.9258994669044742, "survival_time": 59.99999999999873, "driven_lanedir": 0.9219489366761884, "get_state_dump": 0.009334424850247882, "get_robot_state": 0.01382077564109275, "sim_render-ego0": 0.0038010190666764106, "sim_render-ego1": 0.003537334867758517, "sim_render-ego2": 0.003628192396584796, "sim_render-ego3": 0.0035767356720097752, "get_duckie_state": 1.33105459856451e-06, "in-drivable-lane": 54.8499999999987, "deviation-heading": 2.6488211517159796, "agent_compute-ego0": 0.01491167324965046, "agent_compute-ego1": 0.01141267712169841, "agent_compute-ego2": 0.01119448580809378, "agent_compute-ego3": 0.011465797813409177, "complete-iteration": 1.0910568243260188, "set_robot_commands": 0.002166720254534389, "deviation-center-line": 0.49885710215880674, "driven_lanedir_consec": 0.9219489366761884, "sim_compute_sim_state": 0.018609787800429167, "sim_compute_performance-ego0": 0.001889708040159608, "sim_compute_performance-ego1": 0.001886883345769903, "sim_compute_performance-ego2": 0.0018602449828440896, "sim_compute_performance-ego3": 0.0018350444765114764}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 0.8100402168737983, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 0.3424422480073219, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 55.14999999999874, "deviation-heading": 3.4043970129579253, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 0.3134446591074457, "driven_lanedir_consec": 0.3424422480073219, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 8.975573738406133, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 1.194415638290458, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 48.3499999999987, "deviation-heading": 7.890734283372645, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 1.250815663741457, "driven_lanedir_consec": 1.194415638290458, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 11.775462645610958, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 1.6576682549140411, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 44.149999999998954, "deviation-heading": 15.08953624515464, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 1.5187342935996018, "driven_lanedir_consec": 1.5670746727645657, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.5957862294723684, "get_ui_image": 0.05070119495693591, "step_physics": 1.120631117507083, "survival_time": 59.99999999999873, "driven_lanedir": 0.29775120056439164, "get_state_dump": 0.009342918189538706, "get_robot_state": 0.014225606219556111, "sim_render-ego0": 0.003732632240784555, "sim_render-ego1": 0.003659306914482783, "sim_render-ego2": 0.00366498488966968, "sim_render-ego3": 0.0036796211303024864, "get_duckie_state": 1.3276798143474189e-06, "in-drivable-lane": 58.19999999999872, "deviation-heading": 0.7903205282751903, "agent_compute-ego0": 0.012877854379785746, "agent_compute-ego1": 0.012474702061661872, "agent_compute-ego2": 0.01233591763403493, "agent_compute-ego3": 0.012176437639971756, "complete-iteration": 1.303675835575291, "set_robot_commands": 0.0022690826212734506, "deviation-center-line": 0.08932871472392008, "driven_lanedir_consec": 0.29775120056439164, "sim_compute_sim_state": 0.027235567718620204, "sim_compute_performance-ego0": 0.0019336058436385003, "sim_compute_performance-ego1": 0.0019410911150320087, "sim_compute_performance-ego2": 0.0019406567604515971, "sim_compute_performance-ego3": 0.0019327260175414328}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.17384220550911303, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 0.06868086921458616, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 58.89999999999873, "deviation-heading": 0.9271971325356244, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 0.07280774845102436, "driven_lanedir_consec": 0.06868086921458616, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 10.026442667965744, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 2.5721680945111616, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 37.14999999999904, "deviation-heading": 16.613547557195222, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 1.886463674433613, "driven_lanedir_consec": 2.5721680945111616, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 12.548787111322453, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 0.471346617486976, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 55.19999999999894, "deviation-heading": 4.77415764018915, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 0.4793068402319294, "driven_lanedir_consec": 0.40945839684824503, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.3882280886221076, "get_ui_image": 0.04648839524147612, "step_physics": 1.0526259122144968, "survival_time": 59.99999999999873, "driven_lanedir": 0.25482178191944405, "get_state_dump": 0.009317008978520504, "get_robot_state": 0.01391565313347174, "sim_render-ego0": 0.003681660294036484, "sim_render-ego1": 0.003589182273235845, "sim_render-ego2": 0.003590259424951253, "sim_render-ego3": 0.0035935512291799475, "get_duckie_state": 1.391800714472152e-06, "in-drivable-lane": 58.04999999999873, "deviation-heading": 1.096182249417187, "agent_compute-ego0": 0.015692049815791732, "agent_compute-ego1": 0.012709016903155452, "agent_compute-ego2": 0.01132575578236957, "agent_compute-ego3": 0.01158225605827287, "complete-iteration": 1.229151197913088, "set_robot_commands": 0.0021590769638328328, "deviation-center-line": 0.12324640462494246, "driven_lanedir_consec": 0.25482178191944405, "sim_compute_sim_state": 0.024686598360885888, "sim_compute_performance-ego0": 0.001879967817358927, "sim_compute_performance-ego1": 0.0019096168848398223, "sim_compute_performance-ego2": 0.0018757245224977311, "sim_compute_performance-ego3": 0.0018585965000124}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 5.793478314609561, "get_ui_image": 0.02980290721794846, "step_physics": 0.3225102944735385, "survival_time": 59.99999999999873, "driven_lanedir": 1.032553567048866, "get_state_dump": 0.00599497164615882, "get_robot_state": 0.007027882719714874, "sim_render-ego0": 0.003668829364443103, "sim_render-ego1": 0.003568086497094808, "get_duckie_state": 1.3513033038670571e-06, "in-drivable-lane": 42.34999999999868, "deviation-heading": 15.091593353333923, "agent_compute-ego0": 0.011634425259351136, "agent_compute-ego1": 0.010987574611476418, "complete-iteration": 0.4101242763017437, "set_robot_commands": 0.0022555681986177493, "deviation-center-line": 1.862639280109739, "driven_lanedir_consec": 1.0281547121182208, "sim_compute_sim_state": 0.006646283758768531, "sim_compute_performance-ego0": 0.0018970420418135032, "sim_compute_performance-ego1": 0.001859463621039474}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 0.29329872125077594, "get_ui_image": 0.02980290721794846, "step_physics": 0.3225102944735385, "survival_time": 59.99999999999873, "driven_lanedir": 0.10727181602780722, "get_state_dump": 0.00599497164615882, "get_robot_state": 0.007027882719714874, "sim_render-ego0": 0.003668829364443103, "sim_render-ego1": 0.003568086497094808, "get_duckie_state": 1.3513033038670571e-06, "in-drivable-lane": 58.99999999999873, "deviation-heading": 0.6182685772099469, "agent_compute-ego0": 0.011634425259351136, "agent_compute-ego1": 0.010987574611476418, "complete-iteration": 0.4101242763017437, "set_robot_commands": 0.0022555681986177493, "deviation-center-line": 0.07032012472510785, "driven_lanedir_consec": 0.10727181602780722, "sim_compute_sim_state": 0.006646283758768531, "sim_compute_performance-ego0": 0.0018970420418135032, "sim_compute_performance-ego1": 0.001859463621039474}}
set_robot_commands_max0.0022690826212734506
set_robot_commands_mean0.0022064754111284423
set_robot_commands_median0.002166720254534389
set_robot_commands_min0.0021590769638328328
sim_compute_performance-ego0_max0.0019336058436385003
sim_compute_performance-ego0_mean0.0019005150634467964
sim_compute_performance-ego0_median0.001889708040159608
sim_compute_performance-ego0_min0.001879967817358927
sim_compute_performance-ego1_max0.0019410911150320087
sim_compute_performance-ego1_mean0.001904949473188992
sim_compute_performance-ego1_median0.0019096168848398223
sim_compute_performance-ego1_min0.001859463621039474
sim_compute_performance-ego2_max0.0019406567604515971
sim_compute_performance-ego2_mean0.0018922087552644727
sim_compute_performance-ego2_median0.0018757245224977311
sim_compute_performance-ego2_min0.0018602449828440896
sim_compute_performance-ego3_max0.0019327260175414328
sim_compute_performance-ego3_mean0.0018754556646884365
sim_compute_performance-ego3_median0.0018585965000124
sim_compute_performance-ego3_min0.0018350444765114764
sim_compute_sim_state_max0.027235567718620204
sim_compute_sim_state_mean0.021101455931234147
sim_compute_sim_state_median0.024686598360885888
sim_compute_sim_state_min0.006646283758768531
sim_render-ego0_max0.0038010190666764106
sim_render-ego0_mean0.003728493223919715
sim_render-ego0_median0.003732632240784555
sim_render-ego0_min0.003668829364443103
sim_render-ego1_max0.003659306914482783
sim_render-ego1_mean0.0035913906582927288
sim_render-ego1_median0.003589182273235845
sim_render-ego1_min0.003537334867758517
sim_render-ego2_max0.00366498488966968
sim_render-ego2_mean0.003627812237068576
sim_render-ego2_median0.003628192396584796
sim_render-ego2_min0.003590259424951253
sim_render-ego3_max0.0036796211303024864
sim_render-ego3_mean0.003616636010497403
sim_render-ego3_median0.0035935512291799475
sim_render-ego3_min0.0035767356720097752
simulation-passed1
step_physics_max1.120631117507083
step_physics_mean0.9315461839608068
step_physics_median1.0526259122144968
step_physics_min0.3225102944735385
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible
5389011574Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:35:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.331466895604338
survival_time_median59.99999999999873
deviation-center-line_median3.774884706680634
in-drivable-lane_median17.27499999999976


other stats
agent_compute-ego0_max0.014523470660646551
agent_compute-ego0_mean0.014190366978554244
agent_compute-ego0_median0.014143734549999634
agent_compute-ego0_min0.01395052815357116
complete-iteration_max0.24338883944356576
complete-iteration_mean0.21628905053257047
complete-iteration_median0.22718504922376087
complete-iteration_min0.1673972642391945
deviation-center-line_max5.265777486130671
deviation-center-line_mean3.270528332553393
deviation-center-line_min0.266566430721634
deviation-heading_max9.634948711736792
deviation-heading_mean6.759085915640913
deviation-heading_median8.205235916915836
deviation-heading_min0.9909231169951898
driven_any_max19.368235794226575
driven_any_mean13.408398148990422
driven_any_median15.940522626013204
driven_any_min2.384311549708698
driven_lanedir_consec_max15.241943363639896
driven_lanedir_consec_mean9.751297753164188
driven_lanedir_consec_min1.10031385780818
driven_lanedir_max15.241943363639896
driven_lanedir_mean9.751297753164188
driven_lanedir_median11.331466895604338
driven_lanedir_min1.10031385780818
get_duckie_state_max1.0964295979986024e-06
get_duckie_state_mean1.055568462474922e-06
get_duckie_state_median1.0504512167493074e-06
get_duckie_state_min1.0249418184024709e-06
get_robot_state_max0.003552263920551335
get_robot_state_mean0.003504202792474739
get_robot_state_median0.0034955112662144643
get_robot_state_min0.003473524716918693
get_state_dump_max0.004362423885941135
get_state_dump_mean0.004284283634295801
get_state_dump_median0.004268386977399815
get_state_dump_min0.004237936696442438
get_ui_image_max0.03496338243691603
get_ui_image_mean0.029680896451790503
get_ui_image_median0.02939599122135566
get_ui_image_min0.024968220927534653
in-drivable-lane_max56.44999999999874
in-drivable-lane_mean25.499999999999527
in-drivable-lane_min10.999999999999844
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.384311549708698, "get_ui_image": 0.027115645357016025, "step_physics": 0.17440496118340662, "survival_time": 59.99999999999873, "driven_lanedir": 1.10031385780818, "get_state_dump": 0.004237936696442438, "get_robot_state": 0.003552263920551335, "sim_render-ego0": 0.003669185106402928, "get_duckie_state": 1.0249418184024709e-06, "in-drivable-lane": 56.44999999999874, "deviation-heading": 0.9909231169951898, "agent_compute-ego0": 0.01422798246467838, "complete-iteration": 0.2420419971710637, "set_robot_commands": 0.0021233022659644793, "deviation-center-line": 0.266566430721634, "driven_lanedir_consec": 1.10031385780818, "sim_compute_sim_state": 0.010748652196942916, "sim_compute_performance-ego0": 0.0018879704233212436}, "LF-norm-zigzag-000-ego0": {"driven_any": 13.213016643359593, "get_ui_image": 0.03496338243691603, "step_physics": 0.16435516238089307, "survival_time": 48.29999999999939, "driven_lanedir": 9.350724256022104, "get_state_dump": 0.004362423885941135, "get_robot_state": 0.003473524716918693, "sim_render-ego0": 0.0039397871358688025, "get_duckie_state": 1.0964295979986024e-06, "in-drivable-lane": 16.54999999999991, "deviation-heading": 8.377044208203507, "agent_compute-ego0": 0.014523470660646551, "complete-iteration": 0.24338883944356576, "set_robot_commands": 0.002451245762569581, "deviation-center-line": 3.238503512391253, "driven_lanedir_consec": 9.350724256022104, "sim_compute_sim_state": 0.01323409731410282, "sim_compute_performance-ego0": 0.002015135034286988}, "LF-norm-techtrack-000-ego0": {"driven_any": 19.368235794226575, "get_ui_image": 0.03167633708569529, "step_physics": 0.13889910140502065, "survival_time": 59.99999999999873, "driven_lanedir": 13.312209535186572, "get_state_dump": 0.004275659637387646, "get_robot_state": 0.0035029642786411916, "sim_render-ego0": 0.003529227842002189, "get_duckie_state": 1.044197940111756e-06, "in-drivable-lane": 17.999999999999613, "deviation-heading": 8.033427625628166, "agent_compute-ego0": 0.01395052815357116, "complete-iteration": 0.21232810127645804, "set_robot_commands": 0.002027657506467897, "deviation-center-line": 4.311265900970015, "driven_lanedir_consec": 13.312209535186572, "sim_compute_sim_state": 0.012571850783818964, "sim_compute_performance-ego0": 0.001824019850541114}, "LF-norm-small_loop-000-ego0": {"driven_any": 18.66802860866682, "get_ui_image": 0.024968220927534653, "step_physics": 0.10725997250641912, "survival_time": 59.99999999999873, "driven_lanedir": 15.241943363639896, "get_state_dump": 0.004261114317411984, "get_robot_state": 0.003488058253787737, "sim_render-ego0": 0.0034899475373991523, "get_duckie_state": 1.0567044933868589e-06, "in-drivable-lane": 10.999999999999844, "deviation-heading": 9.634948711736792, "agent_compute-ego0": 0.014059486635320887, "complete-iteration": 0.1673972642391945, "set_robot_commands": 0.0020222894158788167, "deviation-center-line": 5.265777486130671, "driven_lanedir_consec": 15.241943363639896, "sim_compute_sim_state": 0.00596774666632939, "sim_compute_performance-ego0": 0.0018105614096000729}}
set_robot_commands_max0.002451245762569581
set_robot_commands_mean0.0021561237377201933
set_robot_commands_median0.002075479886216188
set_robot_commands_min0.0020222894158788167
sim_compute_performance-ego0_max0.002015135034286988
sim_compute_performance-ego0_mean0.0018844216794373547
sim_compute_performance-ego0_median0.001855995136931179
sim_compute_performance-ego0_min0.0018105614096000729
sim_compute_sim_state_max0.01323409731410282
sim_compute_sim_state_mean0.010630586740298525
sim_compute_sim_state_median0.01166025149038094
sim_compute_sim_state_min0.00596774666632939
sim_render-ego0_max0.0039397871358688025
sim_render-ego0_mean0.003657036905418268
sim_render-ego0_median0.003599206474202559
sim_render-ego0_min0.0034899475373991523
simulation-passed1
step_physics_max0.17440496118340662
step_physics_mean0.14622979936893485
step_physics_median0.15162713189295685
step_physics_min0.10725997250641912
survival_time_max59.99999999999873
survival_time_mean57.074999999998894
survival_time_min48.29999999999939
No reset possible
5377112704Bea Baselines 🐤baseline-behavior-cloningaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesgpu-prod-011:42:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.632807814788972
survival_time_median59.99999999999873
deviation-center-line_median3.2190732836826523
in-drivable-lane_median3.074999999999916


other stats
agent_compute-ego0_max0.034441908432184705
agent_compute-ego0_mean0.03328950480602301
agent_compute-ego0_median0.03309058396213026
agent_compute-ego0_min0.032516948777626
agent_compute-ego1_max0.03361608583067577
agent_compute-ego1_mean0.0326325723802509
agent_compute-ego1_median0.032347048334328526
agent_compute-ego1_min0.03182369587468166
agent_compute-ego2_max0.034232969585803026
agent_compute-ego2_mean0.032591030140532266
agent_compute-ego2_median0.031772834673015206
agent_compute-ego2_min0.03176728616277855
agent_compute-ego3_max0.03276934750768962
agent_compute-ego3_mean0.0320288709972493
agent_compute-ego3_median0.031774866437337485
agent_compute-ego3_min0.03154239904672081
complete-iteration_max1.1693066530283245
complete-iteration_mean0.8633581245041931
complete-iteration_median0.93873627731599
complete-iteration_min0.30644881096001303
deviation-center-line_max9.55064681935074
deviation-center-line_mean3.5307536698275483
deviation-center-line_min0.3541514594282031
deviation-heading_max21.273147825297137
deviation-heading_mean10.756594801899851
deviation-heading_median12.947031574766738
deviation-heading_min1.7664968341634726
driven_any_max14.590150510357317
driven_any_mean8.836949192456311
driven_any_median8.86151296298549
driven_any_min0.7116472278204959
driven_lanedir_consec_max13.505508931186018
driven_lanedir_consec_mean7.562509628103653
driven_lanedir_consec_min0.4999602705627586
driven_lanedir_max13.505508931186018
driven_lanedir_mean7.562509628103653
driven_lanedir_median8.632807814788972
driven_lanedir_min0.4999602705627586
get_duckie_state_max1.1275749619457745e-06
get_duckie_state_mean1.1059936715993608e-06
get_duckie_state_median1.1165458035756307e-06
get_duckie_state_min1.0831323684070984e-06
get_robot_state_max0.013865586074001818
get_robot_state_mean0.01279864845488371
get_robot_state_median0.013855224644313942
get_robot_state_min0.0069426771022975
get_state_dump_max0.00930326272206134
get_state_dump_mean0.008723172552046961
get_state_dump_median0.009212913163794169
get_state_dump_min0.005962031639179673
get_ui_image_max0.04886521427557927
get_ui_image_mean0.043591592467778904
get_ui_image_median0.04618880115480447
get_ui_image_min0.029331789836624628
in-drivable-lane_max33.54999999999979
in-drivable-lane_mean5.857142857142766
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.1300569609127766, "get_ui_image": 0.0428506632885301, "step_physics": 0.6975421460278063, "survival_time": 41.44999999999978, "driven_lanedir": 1.7193224622973131, "get_state_dump": 0.00930326272206134, "get_robot_state": 0.013865586074001818, "sim_render-ego0": 0.003687178083212979, "sim_render-ego1": 0.00365182750196342, "sim_render-ego2": 0.003620803787047604, "sim_render-ego3": 0.0035538785428885955, "get_duckie_state": 1.1165458035756307e-06, "in-drivable-lane": 33.54999999999979, "deviation-heading": 2.0395945802439144, "agent_compute-ego0": 0.03309058396213026, "agent_compute-ego1": 0.032347048334328526, "agent_compute-ego2": 0.03176728616277855, "agent_compute-ego3": 0.031774866437337485, "complete-iteration": 0.93873627731599, "set_robot_commands": 0.00209536064101989, "deviation-center-line": 0.3541514594282031, "driven_lanedir_consec": 1.7193224622973131, "sim_compute_sim_state": 0.01531790135854698, "sim_compute_performance-ego0": 0.0018956259072545065, "sim_compute_performance-ego1": 0.001895660377410521, "sim_compute_performance-ego2": 0.001889643324426858, "sim_compute_performance-ego3": 0.0018610101148306608}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.4506534159609745, "get_ui_image": 0.0428506632885301, "step_physics": 0.6975421460278063, "survival_time": 41.44999999999978, "driven_lanedir": 3.2075006332428866, "get_state_dump": 0.00930326272206134, "get_robot_state": 0.013865586074001818, "sim_render-ego0": 0.003687178083212979, "sim_render-ego1": 0.00365182750196342, "sim_render-ego2": 0.003620803787047604, "sim_render-ego3": 0.0035538785428885955, "get_duckie_state": 1.1165458035756307e-06, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 3.982858649835928, "agent_compute-ego0": 0.03309058396213026, "agent_compute-ego1": 0.032347048334328526, "agent_compute-ego2": 0.03176728616277855, "agent_compute-ego3": 0.031774866437337485, "complete-iteration": 0.93873627731599, "set_robot_commands": 0.00209536064101989, "deviation-center-line": 2.796169479670165, "driven_lanedir_consec": 3.2075006332428866, "sim_compute_sim_state": 0.01531790135854698, "sim_compute_performance-ego0": 0.0018956259072545065, "sim_compute_performance-ego1": 0.001895660377410521, "sim_compute_performance-ego2": 0.001889643324426858, "sim_compute_performance-ego3": 0.0018610101148306608}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.4506894840948363, "get_ui_image": 0.0428506632885301, "step_physics": 0.6975421460278063, "survival_time": 41.44999999999978, "driven_lanedir": 3.1096115868792853, "get_state_dump": 0.00930326272206134, "get_robot_state": 0.013865586074001818, "sim_render-ego0": 0.003687178083212979, "sim_render-ego1": 0.00365182750196342, "sim_render-ego2": 0.003620803787047604, "sim_render-ego3": 0.0035538785428885955, "get_duckie_state": 1.1165458035756307e-06, "in-drivable-lane": 1.0499999999999965, "deviation-heading": 21.273147825297137, "agent_compute-ego0": 0.03309058396213026, "agent_compute-ego1": 0.032347048334328526, "agent_compute-ego2": 0.03176728616277855, "agent_compute-ego3": 0.031774866437337485, "complete-iteration": 0.93873627731599, "set_robot_commands": 0.00209536064101989, "deviation-center-line": 3.3939710726093764, "driven_lanedir_consec": 3.1096115868792853, "sim_compute_sim_state": 0.01531790135854698, "sim_compute_performance-ego0": 0.0018956259072545065, "sim_compute_performance-ego1": 0.001895660377410521, "sim_compute_performance-ego2": 0.001889643324426858, "sim_compute_performance-ego3": 0.0018610101148306608}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 9.882565708931155, "get_ui_image": 0.0428506632885301, "step_physics": 0.6975421460278063, "survival_time": 41.44999999999978, "driven_lanedir": 9.54414214340204, "get_state_dump": 0.00930326272206134, "get_robot_state": 0.013865586074001818, "sim_render-ego0": 0.003687178083212979, "sim_render-ego1": 0.00365182750196342, "sim_render-ego2": 0.003620803787047604, "sim_render-ego3": 0.0035538785428885955, "get_duckie_state": 1.1165458035756307e-06, "in-drivable-lane": 0.5499999999999687, "deviation-heading": 6.0628958420690875, "agent_compute-ego0": 0.03309058396213026, "agent_compute-ego1": 0.032347048334328526, "agent_compute-ego2": 0.03176728616277855, "agent_compute-ego3": 0.031774866437337485, "complete-iteration": 0.93873627731599, "set_robot_commands": 0.00209536064101989, "deviation-center-line": 1.7839860896797974, "driven_lanedir_consec": 9.54414214340204, "sim_compute_sim_state": 0.01531790135854698, "sim_compute_performance-ego0": 0.0018956259072545065, "sim_compute_performance-ego1": 0.001895660377410521, "sim_compute_performance-ego2": 0.001889643324426858, "sim_compute_performance-ego3": 0.0018610101148306608}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 0.7116472278204959, "get_ui_image": 0.04886521427557927, "step_physics": 0.9054974167670536, "survival_time": 59.99999999999873, "driven_lanedir": 0.5537943642103853, "get_state_dump": 0.009033912226719029, "get_robot_state": 0.01360312032262848, "sim_render-ego0": 0.003644725861497763, "sim_render-ego1": 0.0035518404843904493, "sim_render-ego2": 0.003565611589163368, "sim_render-ego3": 0.003512013861777682, "get_duckie_state": 1.0852909008728078e-06, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 16.648037901128625, "agent_compute-ego0": 0.034441908432184705, "agent_compute-ego1": 0.03361608583067577, "agent_compute-ego2": 0.034232969585803026, "agent_compute-ego3": 0.03276934750768962, "complete-iteration": 1.1693066530283245, "set_robot_commands": 0.002014245121405583, "deviation-center-line": 8.784571322840401, "driven_lanedir_consec": 0.5537943642103853, "sim_compute_sim_state": 0.027075618828067572, "sim_compute_performance-ego0": 0.001839530557319584, "sim_compute_performance-ego1": 0.00186423278668838, "sim_compute_performance-ego2": 0.0018422214514409176, "sim_compute_performance-ego3": 0.0018448506068627505}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 14.59010033503936, "get_ui_image": 0.04886521427557927, "step_physics": 0.9054974167670536, "survival_time": 59.99999999999873, "driven_lanedir": 12.79419309241376, "get_state_dump": 0.009033912226719029, "get_robot_state": 0.01360312032262848, "sim_render-ego0": 0.003644725861497763, "sim_render-ego1": 0.0035518404843904493, "sim_render-ego2": 0.003565611589163368, "sim_render-ego3": 0.003512013861777682, "get_duckie_state": 1.0852909008728078e-06, "in-drivable-lane": 4.149999999999899, "deviation-heading": 14.594015556073764, "agent_compute-ego0": 0.034441908432184705, "agent_compute-ego1": 0.03361608583067577, "agent_compute-ego2": 0.034232969585803026, "agent_compute-ego3": 0.03276934750768962, "complete-iteration": 1.1693066530283245, "set_robot_commands": 0.002014245121405583, "deviation-center-line": 3.403618581251067, "driven_lanedir_consec": 12.79419309241376, "sim_compute_sim_state": 0.027075618828067572, "sim_compute_performance-ego0": 0.001839530557319584, "sim_compute_performance-ego1": 0.00186423278668838, "sim_compute_performance-ego2": 0.0018422214514409176, "sim_compute_performance-ego3": 0.0018448506068627505}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.870572944504392, "get_ui_image": 0.04886521427557927, "step_physics": 0.9054974167670536, "survival_time": 59.99999999999873, "driven_lanedir": 0.4999602705627586, "get_state_dump": 0.009033912226719029, "get_robot_state": 0.01360312032262848, "sim_render-ego0": 0.003644725861497763, "sim_render-ego1": 0.0035518404843904493, "sim_render-ego2": 0.003565611589163368, "sim_render-ego3": 0.003512013861777682, "get_duckie_state": 1.0852909008728078e-06, "in-drivable-lane": 1.0499999999999996, "deviation-heading": 1.7664968341634726, "agent_compute-ego0": 0.034441908432184705, "agent_compute-ego1": 0.03361608583067577, "agent_compute-ego2": 0.034232969585803026, "agent_compute-ego3": 0.03276934750768962, "complete-iteration": 1.1693066530283245, "set_robot_commands": 0.002014245121405583, "deviation-center-line": 9.55064681935074, "driven_lanedir_consec": 0.4999602705627586, "sim_compute_sim_state": 0.027075618828067572, "sim_compute_performance-ego0": 0.001839530557319584, "sim_compute_performance-ego1": 0.00186423278668838, "sim_compute_performance-ego2": 0.0018422214514409176, "sim_compute_performance-ego3": 0.0018448506068627505}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 14.590150510357317, "get_ui_image": 0.04886521427557927, "step_physics": 0.9054974167670536, "survival_time": 59.99999999999873, "driven_lanedir": 13.505508931186018, "get_state_dump": 0.009033912226719029, "get_robot_state": 0.01360312032262848, "sim_render-ego0": 0.003644725861497763, "sim_render-ego1": 0.0035518404843904493, "sim_render-ego2": 0.003565611589163368, "sim_render-ego3": 0.003512013861777682, "get_duckie_state": 1.0852909008728078e-06, "in-drivable-lane": 1.9999999999999325, "deviation-heading": 13.017211700439349, "agent_compute-ego0": 0.034441908432184705, "agent_compute-ego1": 0.03361608583067577, "agent_compute-ego2": 0.034232969585803026, "agent_compute-ego3": 0.03276934750768962, "complete-iteration": 1.1693066530283245, "set_robot_commands": 0.002014245121405583, "deviation-center-line": 3.260069918069457, "driven_lanedir_consec": 13.505508931186018, "sim_compute_sim_state": 0.027075618828067572, "sim_compute_performance-ego0": 0.001839530557319584, "sim_compute_performance-ego1": 0.00186423278668838, "sim_compute_performance-ego2": 0.0018422214514409176, "sim_compute_performance-ego3": 0.0018448506068627505}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 14.590050989726912, "get_ui_image": 0.04618880115480447, "step_physics": 0.48901246787110136, "survival_time": 59.99999999999873, "driven_lanedir": 12.116567753201528, "get_state_dump": 0.009212913163794169, "get_robot_state": 0.013855224644313942, "sim_render-ego0": 0.0036301904673580326, "sim_render-ego1": 0.003595058963658113, "sim_render-ego2": 0.003576333874171223, "sim_render-ego3": 0.003556187007945344, "get_duckie_state": 1.1275749619457745e-06, "in-drivable-lane": 7.299999999999795, "deviation-heading": 12.87685144909413, "agent_compute-ego0": 0.03272230003795259, "agent_compute-ego1": 0.03233902122853301, "agent_compute-ego2": 0.031772834673015206, "agent_compute-ego3": 0.03154239904672081, "complete-iteration": 0.7604860999403548, "set_robot_commands": 0.0020738033132688093, "deviation-center-line": 2.863580059827014, "driven_lanedir_consec": 12.116567753201528, "sim_compute_sim_state": 0.04352246930855299, "sim_compute_performance-ego0": 0.001883410295777079, "sim_compute_performance-ego1": 0.0018507080411633088, "sim_compute_performance-ego2": 0.0018432152261344916, "sim_compute_performance-ego3": 0.0018314552942382408}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 14.590055393304713, "get_ui_image": 0.04618880115480447, "step_physics": 0.48901246787110136, "survival_time": 59.99999999999873, "driven_lanedir": 10.962673618148632, "get_state_dump": 0.009212913163794169, "get_robot_state": 0.013855224644313942, "sim_render-ego0": 0.0036301904673580326, "sim_render-ego1": 0.003595058963658113, "sim_render-ego2": 0.003576333874171223, "sim_render-ego3": 0.003556187007945344, "get_duckie_state": 1.1275749619457745e-06, "in-drivable-lane": 11.149999999999627, "deviation-heading": 15.30951235175584, "agent_compute-ego0": 0.03272230003795259, "agent_compute-ego1": 0.03233902122853301, "agent_compute-ego2": 0.031772834673015206, "agent_compute-ego3": 0.03154239904672081, "complete-iteration": 0.7604860999403548, "set_robot_commands": 0.0020738033132688093, "deviation-center-line": 3.3091306974244876, "driven_lanedir_consec": 10.962673618148632, "sim_compute_sim_state": 0.04352246930855299, "sim_compute_performance-ego0": 0.001883410295777079, "sim_compute_performance-ego1": 0.0018507080411633088, "sim_compute_performance-ego2": 0.0018432152261344916, "sim_compute_performance-ego3": 0.0018314552942382408}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 14.589986244688284, "get_ui_image": 0.04618880115480447, "step_physics": 0.48901246787110136, "survival_time": 59.99999999999873, "driven_lanedir": 11.87360112305843, "get_state_dump": 0.009212913163794169, "get_robot_state": 0.013855224644313942, "sim_render-ego0": 0.0036301904673580326, "sim_render-ego1": 0.003595058963658113, "sim_render-ego2": 0.003576333874171223, "sim_render-ego3": 0.003556187007945344, "get_duckie_state": 1.1275749619457745e-06, "in-drivable-lane": 7.499999999999868, "deviation-heading": 15.526904713328586, "agent_compute-ego0": 0.03272230003795259, "agent_compute-ego1": 0.03233902122853301, "agent_compute-ego2": 0.031772834673015206, "agent_compute-ego3": 0.03154239904672081, "complete-iteration": 0.7604860999403548, "set_robot_commands": 0.0020738033132688093, "deviation-center-line": 3.2949485042292253, "driven_lanedir_consec": 11.87360112305843, "sim_compute_sim_state": 0.04352246930855299, "sim_compute_performance-ego0": 0.001883410295777079, "sim_compute_performance-ego1": 0.0018507080411633088, "sim_compute_performance-ego2": 0.0018432152261344916, "sim_compute_performance-ego3": 0.0018314552942382408}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 14.590064995510492, "get_ui_image": 0.04618880115480447, "step_physics": 0.48901246787110136, "survival_time": 59.99999999999873, "driven_lanedir": 12.242634198724376, "get_state_dump": 0.009212913163794169, "get_robot_state": 0.013855224644313942, "sim_render-ego0": 0.0036301904673580326, "sim_render-ego1": 0.003595058963658113, "sim_render-ego2": 0.003576333874171223, "sim_render-ego3": 0.003556187007945344, "get_duckie_state": 1.1275749619457745e-06, "in-drivable-lane": 6.349999999999831, "deviation-heading": 14.42981664595696, "agent_compute-ego0": 0.03272230003795259, "agent_compute-ego1": 0.03233902122853301, "agent_compute-ego2": 0.031772834673015206, "agent_compute-ego3": 0.03154239904672081, "complete-iteration": 0.7604860999403548, "set_robot_commands": 0.0020738033132688093, "deviation-center-line": 3.1780766492958485, "driven_lanedir_consec": 12.242634198724376, "sim_compute_sim_state": 0.04352246930855299, "sim_compute_performance-ego0": 0.001883410295777079, "sim_compute_performance-ego1": 0.0018507080411633088, "sim_compute_performance-ego2": 0.0018432152261344916, "sim_compute_performance-ego3": 0.0018314552942382408}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 7.840460217039821, "get_ui_image": 0.029331789836624628, "step_physics": 0.17464138767478332, "survival_time": 33.10000000000026, "driven_lanedir": 7.721473486175902, "get_state_dump": 0.005962031639179673, "get_robot_state": 0.0069426771022975, "sim_render-ego0": 0.003615564890037295, "sim_render-ego1": 0.0035463871819221417, "get_duckie_state": 1.0831323684070984e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.815690160160248, "agent_compute-ego0": 0.032516948777626, "agent_compute-ego1": 0.03182369587468166, "complete-iteration": 0.30644881096001303, "set_robot_commands": 0.002112315970488443, "deviation-center-line": 1.4787033077011915, "driven_lanedir_consec": 7.721473486175902, "sim_compute_sim_state": 0.009982424803628822, "sim_compute_performance-ego0": 0.001885340763972356, "sim_compute_performance-ego1": 0.001861396058831999}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 7.840234266496838, "get_ui_image": 0.029331789836624628, "step_physics": 0.17464138767478332, "survival_time": 33.10000000000026, "driven_lanedir": 6.024151129947824, "get_state_dump": 0.005962031639179673, "get_robot_state": 0.0069426771022975, "sim_render-ego0": 0.003615564890037295, "sim_render-ego1": 0.0035463871819221417, "get_duckie_state": 1.0831323684070984e-06, "in-drivable-lane": 6.4499999999999975, "deviation-heading": 8.249293017050888, "agent_compute-ego0": 0.032516948777626, "agent_compute-ego1": 0.03182369587468166, "complete-iteration": 0.30644881096001303, "set_robot_commands": 0.002112315970488443, "deviation-center-line": 1.978927416208707, "driven_lanedir_consec": 6.024151129947824, "sim_compute_sim_state": 0.009982424803628822, "sim_compute_performance-ego0": 0.001885340763972356, "sim_compute_performance-ego1": 0.001861396058831999}}
set_robot_commands_max0.002112315970488443
set_robot_commands_mean0.0020684477316967155
set_robot_commands_median0.0020738033132688093
set_robot_commands_min0.002014245121405583
sim_compute_performance-ego0_max0.0018956259072545065
sim_compute_performance-ego0_mean0.001874639183524956
sim_compute_performance-ego0_median0.001883410295777079
sim_compute_performance-ego0_min0.001839530557319584
sim_compute_performance-ego1_max0.001895660377410521
sim_compute_performance-ego1_mean0.001868942638479488
sim_compute_performance-ego1_median0.00186423278668838
sim_compute_performance-ego1_min0.0018507080411633088
sim_compute_performance-ego2_max0.001889643324426858
sim_compute_performance-ego2_mean0.0018583600006674224
sim_compute_performance-ego2_median0.0018432152261344916
sim_compute_performance-ego2_min0.0018422214514409176
sim_compute_performance-ego3_max0.0018610101148306608
sim_compute_performance-ego3_mean0.0018457720053105505
sim_compute_performance-ego3_median0.0018448506068627505
sim_compute_performance-ego3_min0.0018314552942382408
sim_compute_sim_state_max0.04352246930855299
sim_compute_sim_state_mean0.02597348625628056
sim_compute_sim_state_median0.027075618828067572
sim_compute_sim_state_min0.009982424803628822
sim_render-ego0_max0.003687178083212979
sim_render-ego0_mean0.00364853624488212
sim_render-ego0_median0.003644725861497763
sim_render-ego0_min0.003615564890037295
sim_render-ego1_max0.00365182750196342
sim_render-ego1_mean0.0035919772974208715
sim_render-ego1_median0.003595058963658113
sim_render-ego1_min0.0035463871819221417
sim_render-ego2_max0.003620803787047604
sim_render-ego2_mean0.0035875830834607315
sim_render-ego2_median0.003576333874171223
sim_render-ego2_min0.003565611589163368
sim_render-ego3_max0.003556187007945344
sim_render-ego3_mean0.003540693137537206
sim_render-ego3_median0.0035538785428885955
sim_render-ego3_min0.003512013861777682
simulation-passed1
step_physics_max0.9054974167670536
step_physics_mean0.6226779212866722
step_physics_median0.6975421460278063
step_physics_min0.17464138767478332
survival_time_max59.99999999999873
survival_time_mean50.85714285714211
survival_time_min33.10000000000026
No reset possible
5376112706Bea Baselines 🐤baseline-behavior-cloningaido5-LFI-sim-testingLFVIv-simsuccessyesgpu-prod-010:06:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3253446029354108
survival_time_median9.025000000000032
deviation-center-line_median0.4314167151374262
in-drivable-lane_median1.8750000000000264


other stats
agent_compute-ego0_max0.03847808920103928
agent_compute-ego0_mean0.0356490345062036
agent_compute-ego0_median0.0356490345062036
agent_compute-ego0_min0.03281997981136792
complete-iteration_max0.2704827066970198
complete-iteration_mean0.2647994849610903
complete-iteration_median0.2647994849610903
complete-iteration_min0.2591162632251608
deviation-center-line_max0.6473323498637884
deviation-center-line_mean0.4314167151374262
deviation-center-line_min0.21550108041106403
deviation-heading_max3.162887497150146
deviation-heading_mean1.963293914336552
deviation-heading_median1.963293914336552
deviation-heading_min0.7637003315229582
driven_any_max3.279421010686501
driven_any_mean1.9527406147262825
driven_any_median1.9527406147262825
driven_any_min0.6260602187660639
driven_lanedir_consec_max2.044636317537031
driven_lanedir_consec_mean1.3253446029354108
driven_lanedir_consec_min0.6060528883337906
driven_lanedir_max2.3643957397571613
driven_lanedir_mean1.4852255529597105
driven_lanedir_median1.4852255529597105
driven_lanedir_min0.6060553661622596
get_duckie_state_max1.2998711572934502e-06
get_duckie_state_mean1.18103351692124e-06
get_duckie_state_median1.18103351692124e-06
get_duckie_state_min1.06219587654903e-06
get_robot_state_max0.0035880199850422062
get_robot_state_mean0.003578113073665239
get_robot_state_median0.003578113073665239
get_robot_state_min0.0035682061622882713
get_state_dump_max0.004461490944640277
get_state_dump_mean0.004387858942200342
get_state_dump_median0.004387858942200342
get_state_dump_min0.004314226939760406
get_ui_image_max0.03794093654580312
get_ui_image_mean0.03770107785428983
get_ui_image_median0.03770107785428983
get_ui_image_min0.03746121916277655
in-drivable-lane_max3.7500000000000537
in-drivable-lane_mean1.8750000000000264
in-drivable-lane_min0.0
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 3.279421010686501, "get_ui_image": 0.03746121916277655, "step_physics": 0.1552731941486227, "survival_time": 14.45000000000007, "driven_lanedir": 2.3643957397571613, "get_state_dump": 0.004314226939760406, "get_robot_state": 0.0035682061622882713, "sim_render-ego0": 0.0035613964343893115, "get_duckie_state": 1.06219587654903e-06, "in-drivable-lane": 3.7500000000000537, "deviation-heading": 3.162887497150146, "agent_compute-ego0": 0.03847808920103928, "complete-iteration": 0.2591162632251608, "set_robot_commands": 0.0021033574794900828, "deviation-center-line": 0.6473323498637884, "driven_lanedir_consec": 2.044636317537031, "sim_compute_sim_state": 0.012424587381297144, "sim_compute_performance-ego0": 0.0018595802372899548}, "LFI-norm-udem1-000-ego0": {"driven_any": 0.6260602187660639, "get_ui_image": 0.03794093654580312, "step_physics": 0.17396696626323543, "survival_time": 3.599999999999995, "driven_lanedir": 0.6060553661622596, "get_state_dump": 0.004461490944640277, "get_robot_state": 0.0035880199850422062, "sim_render-ego0": 0.003662073448912738, "get_duckie_state": 1.2998711572934502e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.7637003315229582, "agent_compute-ego0": 0.03281997981136792, "complete-iteration": 0.2704827066970198, "set_robot_commands": 0.0021466033099448844, "deviation-center-line": 0.21550108041106403, "driven_lanedir_consec": 0.6060528883337906, "sim_compute_sim_state": 0.00982802534756595, "sim_compute_performance-ego0": 0.00198774468408872}}
set_robot_commands_max0.0021466033099448844
set_robot_commands_mean0.002124980394717484
set_robot_commands_median0.002124980394717484
set_robot_commands_min0.0021033574794900828
sim_compute_performance-ego0_max0.00198774468408872
sim_compute_performance-ego0_mean0.0019236624606893376
sim_compute_performance-ego0_median0.0019236624606893376
sim_compute_performance-ego0_min0.0018595802372899548
sim_compute_sim_state_max0.012424587381297144
sim_compute_sim_state_mean0.011126306364431546
sim_compute_sim_state_median0.011126306364431546
sim_compute_sim_state_min0.00982802534756595
sim_render-ego0_max0.003662073448912738
sim_render-ego0_mean0.0036117349416510246
sim_render-ego0_median0.0036117349416510246
sim_render-ego0_min0.0035613964343893115
simulation-passed1
step_physics_max0.17396696626323543
step_physics_mean0.16462008020592905
step_physics_median0.16462008020592905
step_physics_min0.1552731941486227
survival_time_max14.45000000000007
survival_time_mean9.025000000000032
survival_time_min3.599999999999995
No reset possible
5349712674Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesgpu-prod-011:42:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0653124009090247
survival_time_median59.99999999999873
deviation-center-line_median3.5269811335906747
in-drivable-lane_median8.774999999999904


other stats
agent_compute-ego0_max0.01376057119297802
agent_compute-ego0_mean0.01207049405415167
agent_compute-ego0_median0.011660532788571272
agent_compute-ego0_min0.011143876948424124
agent_compute-ego1_max0.011805763848119733
agent_compute-ego1_mean0.011673112881559785
agent_compute-ego1_median0.01179619911409834
agent_compute-ego1_min0.011260593590671069
agent_compute-ego2_max0.01251318651273983
agent_compute-ego2_mean0.012083081460647654
agent_compute-ego2_median0.011946928531006163
agent_compute-ego2_min0.01178912933819697
agent_compute-ego3_max0.011412711465090736
agent_compute-ego3_mean0.0113453077649714
agent_compute-ego3_median0.011316363375288505
agent_compute-ego3_min0.011306848454534958
complete-iteration_max1.166461277725105
complete-iteration_mean0.9560285482629036
complete-iteration_median1.099287197254381
complete-iteration_min0.2741516959177305
deviation-center-line_max6.658525661278727
deviation-center-line_mean2.9922080985742023
deviation-center-line_min0.3487993547739799
deviation-heading_max27.898773454390817
deviation-heading_mean15.873855603124424
deviation-heading_median19.38328696414301
deviation-heading_min2.206078527664331
driven_any_max7.920431501175876
driven_any_mean4.7369239560146665
driven_any_median4.5514912282205575
driven_any_min0.160671805154944
driven_lanedir_consec_max5.602500060828261
driven_lanedir_consec_mean2.731521061487148
driven_lanedir_consec_min0.14746808103183673
driven_lanedir_max5.7266240465529705
driven_lanedir_mean3.170694365755834
driven_lanedir_median3.417872906512262
driven_lanedir_min0.14746808103183673
get_duckie_state_max1.8018827701272225e-06
get_duckie_state_mean1.725975120323046e-06
get_duckie_state_median1.7403960724258105e-06
get_duckie_state_min1.6568205338731396e-06
get_robot_state_max0.0138415809872744
get_robot_state_mean0.012784666016464294
get_robot_state_median0.013813085698962313
get_robot_state_min0.0068853407689969835
get_state_dump_max0.009192049652213955
get_state_dump_mean0.008700306973257367
get_state_dump_median0.009184334212377255
get_state_dump_min0.005873294725810012
get_ui_image_max0.05044645790652768
get_ui_image_mean0.044830890497356675
get_ui_image_median0.04772985328941123
get_ui_image_min0.02988703773446279
in-drivable-lane_max49.24999999999864
in-drivable-lane_mean12.760714285714077
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.160671805154944, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 0.14746808103183673, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 0.0, "deviation-heading": 20.38963322176847, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 5.01805768121352, "driven_lanedir_consec": 0.14746808103183673, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 5.152127725592337, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 3.876487024868991, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 5.600000000000059, "deviation-heading": 14.041142982422402, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 2.775152956893138, "driven_lanedir_consec": 3.1884305453985156, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.9728867243526669, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 1.4675005289315144, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 3.1000000000000085, "deviation-heading": 16.901668181558097, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 2.721012784244379, "driven_lanedir_consec": 1.4675005289315144, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.8997756200461005, "get_ui_image": 0.04378828667757804, "step_physics": 1.004639977500552, "survival_time": 39.84999999999987, "driven_lanedir": 1.3073588183958913, "get_state_dump": 0.009184334212377255, "get_robot_state": 0.013648993986889832, "sim_render-ego0": 0.003644954590570359, "sim_render-ego1": 0.003650173507537459, "sim_render-ego2": 0.003739946169363227, "sim_render-ego3": 0.003653979540468756, "get_duckie_state": 1.8018827701272225e-06, "in-drivable-lane": 28.449999999999815, "deviation-heading": 4.017439501190517, "agent_compute-ego0": 0.01376057119297802, "agent_compute-ego1": 0.01162363532790564, "agent_compute-ego2": 0.011946928531006163, "agent_compute-ego3": 0.011316363375288505, "complete-iteration": 1.166461277725105, "set_robot_commands": 0.002094592665669912, "deviation-center-line": 0.6232606486747951, "driven_lanedir_consec": 0.760029404494907, "sim_compute_sim_state": 0.01565036289673999, "sim_compute_performance-ego0": 0.001860888679523516, "sim_compute_performance-ego1": 0.0018902150610634555, "sim_compute_performance-ego2": 0.0018652241331592837, "sim_compute_performance-ego3": 0.001888312193982882}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 2.098694708375491, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 1.2021005996937888, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 49.24999999999864, "deviation-heading": 4.479160067115061, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 0.6685777393441074, "driven_lanedir_consec": 0.9545128566479312, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 7.906586753557528, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 5.565443751359446, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 8.599999999999866, "deviation-heading": 25.494099881646363, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 4.106553766736716, "driven_lanedir_consec": 3.171366013662516, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 7.913471073902338, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 4.57146845509793, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 17.349999999999767, "deviation-heading": 22.16918242628548, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 3.87448456982687, "driven_lanedir_consec": 4.57146845509793, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 7.913401758913237, "get_ui_image": 0.05044645790652768, "step_physics": 0.9112773281052944, "survival_time": 59.99999999999873, "driven_lanedir": 5.2157658710816595, "get_state_dump": 0.009138043178904563, "get_robot_state": 0.013813085698962313, "sim_render-ego0": 0.0035814538188619874, "sim_render-ego1": 0.003631839545739878, "sim_render-ego2": 0.003712334501852501, "sim_render-ego3": 0.0036324206041753737, "get_duckie_state": 1.6568205338731396e-06, "in-drivable-lane": 13.099999999999795, "deviation-heading": 21.589342506614155, "agent_compute-ego0": 0.011143876948424124, "agent_compute-ego1": 0.01179619911409834, "agent_compute-ego2": 0.01178912933819697, "agent_compute-ego3": 0.011412711465090736, "complete-iteration": 1.099287197254381, "set_robot_commands": 0.002079444165829318, "deviation-center-line": 3.6521403641664008, "driven_lanedir_consec": 3.95946232119375, "sim_compute_sim_state": 0.03789032269874083, "sim_compute_performance-ego0": 0.0018560437735272487, "sim_compute_performance-ego1": 0.001855757909452389, "sim_compute_performance-ego2": 0.001861942300788568, "sim_compute_performance-ego3": 0.001854882450723132}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 7.920421466363552, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 5.7266240465529705, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 8.949999999999942, "deviation-heading": 21.5390492896068, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 3.7659268681008897, "driven_lanedir_consec": 5.602500060828261, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 7.920329828289729, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 4.643283928995383, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 18.04999999999933, "deviation-heading": 18.378638396939017, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 3.4018219030149486, "driven_lanedir_consec": 4.643283928995383, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.950854730848779, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 2.9592587881555334, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 5.450000000000045, "deviation-heading": 27.898773454390817, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 6.658525661278727, "driven_lanedir_consec": 2.9592587881555334, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 7.920431501175876, "get_ui_image": 0.04772985328941123, "step_physics": 0.7557259028797642, "survival_time": 59.99999999999873, "driven_lanedir": 5.3140278758051185, "get_state_dump": 0.009192049652213955, "get_robot_state": 0.0138415809872744, "sim_render-ego0": 0.0036303222824592175, "sim_render-ego1": 0.0036898544686323, "sim_render-ego2": 0.003804211612545779, "sim_render-ego3": 0.0036842823028564457, "get_duckie_state": 1.7403960724258105e-06, "in-drivable-lane": 12.349999999999705, "deviation-heading": 20.387935531347008, "agent_compute-ego0": 0.011660532788571272, "agent_compute-ego1": 0.011805763848119733, "agent_compute-ego2": 0.01251318651273983, "agent_compute-ego3": 0.011306848454534958, "complete-iteration": 0.9432755959818108, "set_robot_commands": 0.002127653156887185, "deviation-center-line": 3.7900592621661313, "driven_lanedir_consec": 5.3140278758051185, "sim_compute_sim_state": 0.03844714978652433, "sim_compute_performance-ego0": 0.001884248036329792, "sim_compute_performance-ego1": 0.001849184028314214, "sim_compute_performance-ego2": 0.001855900047422944, "sim_compute_performance-ego3": 0.0018720466032512576}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.7936922895829552, "get_ui_image": 0.02988703773446279, "step_physics": 0.18357656344975512, "survival_time": 14.550000000000072, "driven_lanedir": 1.6314436480886731, "get_state_dump": 0.005873294725810012, "get_robot_state": 0.0068853407689969835, "sim_render-ego0": 0.003560206661485646, "sim_render-ego1": 0.0035970039563636255, "get_duckie_state": 1.683627089408979e-06, "in-drivable-lane": 0.4999999999999982, "deviation-heading": 2.741834475193422, "agent_compute-ego0": 0.011363496519114872, "agent_compute-ego1": 0.011260593590671069, "complete-iteration": 0.2741516959177305, "set_robot_commands": 0.0020687498458444257, "deviation-center-line": 0.3487993547739799, "driven_lanedir_consec": 0.8664082177196974, "sim_compute_sim_state": 0.01026910461791574, "sim_compute_performance-ego0": 0.0018348024316030007, "sim_compute_performance-ego1": 0.0018260127877535888}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.793589398049799, "get_ui_image": 0.02988703773446279, "step_physics": 0.18357656344975512, "survival_time": 14.550000000000072, "driven_lanedir": 0.7614897025229552, "get_state_dump": 0.005873294725810012, "get_robot_state": 0.0068853407689969835, "sim_render-ego0": 0.003560206661485646, "sim_render-ego1": 0.0035970039563636255, "get_duckie_state": 1.683627089408979e-06, "in-drivable-lane": 7.900000000000079, "deviation-heading": 2.206078527664331, "agent_compute-ego0": 0.011363496519114872, "agent_compute-ego1": 0.011260593590671069, "complete-iteration": 0.2741516959177305, "set_robot_commands": 0.0020687498458444257, "deviation-center-line": 0.48653981960423054, "driven_lanedir_consec": 0.6355777828571864, "sim_compute_sim_state": 0.01026910461791574, "sim_compute_performance-ego0": 0.0018348024316030007, "sim_compute_performance-ego1": 0.0018260127877535888}}
set_robot_commands_max0.002127653156887185
set_robot_commands_mean0.002096018546088179
set_robot_commands_median0.002094592665669912
set_robot_commands_min0.0020687498458444257
sim_compute_performance-ego0_max0.001884248036329792
sim_compute_performance-ego0_mean0.0018624519157663015
sim_compute_performance-ego0_median0.001860888679523516
sim_compute_performance-ego0_min0.0018348024316030007
sim_compute_performance-ego1_max0.0018902150610634555
sim_compute_performance-ego1_mean0.0018594752550591016
sim_compute_performance-ego1_median0.001855757909452389
sim_compute_performance-ego1_min0.0018260127877535888
sim_compute_performance-ego2_max0.0018652241331592837
sim_compute_performance-ego2_mean0.001861022160456932
sim_compute_performance-ego2_median0.001861942300788568
sim_compute_performance-ego2_min0.001855900047422944
sim_compute_performance-ego3_max0.001888312193982882
sim_compute_performance-ego3_mean0.0018717470826524235
sim_compute_performance-ego3_median0.0018720466032512576
sim_compute_performance-ego3_min0.001854882450723132
sim_compute_sim_state_max0.03844714978652433
sim_compute_sim_state_mean0.027749253625989432
sim_compute_sim_state_median0.03789032269874083
sim_compute_sim_state_min0.01026910461791574
sim_render-ego0_max0.003644954590570359
sim_render-ego0_mean0.0036105240064669662
sim_render-ego0_median0.0036303222824592175
sim_render-ego0_min0.003560206661485646
sim_render-ego1_max0.0036898544686323
sim_render-ego1_mean0.003648677000026128
sim_render-ego1_median0.003650173507537459
sim_render-ego1_min0.0035970039563636255
sim_render-ego2_max0.003804211612545779
sim_render-ego2_mean0.003752164094587169
sim_render-ego2_median0.003739946169363227
sim_render-ego2_min0.003712334501852501
sim_render-ego3_max0.0036842823028564457
sim_render-ego3_mean0.0036568941491668585
sim_render-ego3_median0.003653979540468756
sim_render-ego3_min0.0036324206041753737
simulation-passed1
step_physics_max1.004639977500552
step_physics_mean0.7895518543458537
step_physics_median0.9112773281052944
step_physics_min0.18357656344975512
survival_time_max59.99999999999873
survival_time_mean47.749999999999254
survival_time_min14.550000000000072
No reset possible
534709367Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:18:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4803787475750393
survival_time_median21.900000000000176
deviation-center-line_median0.6329685520423263
in-drivable-lane_median13.375000000000156


other stats
agent_compute-ego0_max0.013070530686641765
agent_compute-ego0_mean0.012647995082953936
agent_compute-ego0_median0.012759758203060596
agent_compute-ego0_min0.012001933239052794
complete-iteration_max0.3177083764757429
complete-iteration_mean0.26841907989225344
complete-iteration_median0.27265361458506215
complete-iteration_min0.2106607139231467
deviation-center-line_max0.6993222745444855
deviation-center-line_mean0.5725333961572582
deviation-center-line_min0.3248742059998946
deviation-heading_max5.878141564086586
deviation-heading_mean3.6736122721878894
deviation-heading_median3.594781727789904
deviation-heading_min1.626744069085163
driven_any_max3.0230607461928307
driven_any_mean1.7503493767977174
driven_any_median1.4577218484880516
driven_any_min1.062893064021936
driven_lanedir_consec_max0.6406760173616388
driven_lanedir_consec_mean0.4670833086649802
driven_lanedir_consec_min0.2668997221482037
driven_lanedir_max0.6406760173616388
driven_lanedir_mean0.4670833086649802
driven_lanedir_median0.4803787475750393
driven_lanedir_min0.2668997221482037
get_duckie_state_max1.1760032981451304e-06
get_duckie_state_mean1.1393980613220092e-06
get_duckie_state_median1.1402071463764657e-06
get_duckie_state_min1.1011746543899751e-06
get_robot_state_max0.00353034288605298
get_robot_state_mean0.003508856307606364
get_robot_state_median0.0035164256817390447
get_robot_state_min0.0034722309808943867
get_state_dump_max0.004329334649788197
get_state_dump_mean0.004275231315629531
get_state_dump_median0.004286639597888734
get_state_dump_min0.004198311416952459
get_ui_image_max0.03567781572218065
get_ui_image_mean0.030392160913606324
get_ui_image_median0.030039143097484344
get_ui_image_min0.025812541737275964
in-drivable-lane_max37.7999999999997
in-drivable-lane_mean17.700000000000024
in-drivable-lane_min6.250000000000089
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0230607461928307, "get_ui_image": 0.02778911322086781, "step_physics": 0.18453467563465908, "survival_time": 44.34999999999962, "driven_lanedir": 0.2668997221482037, "get_state_dump": 0.004198311416952459, "get_robot_state": 0.0035169836100157315, "sim_render-ego0": 0.003595285855972015, "get_duckie_state": 1.107518737380569e-06, "in-drivable-lane": 37.7999999999997, "deviation-heading": 5.246279206504482, "agent_compute-ego0": 0.01246875524520874, "complete-iteration": 0.2501823904815021, "set_robot_commands": 0.002055644720524281, "deviation-center-line": 0.6993222745444855, "driven_lanedir_consec": 0.2668997221482037, "sim_compute_sim_state": 0.010068257381250192, "sim_compute_performance-ego0": 0.0018824900055790807}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.269042606354128, "get_ui_image": 0.03567781572218065, "step_physics": 0.24309184767983175, "survival_time": 19.200000000000134, "driven_lanedir": 0.3522920386226194, "get_state_dump": 0.004314377400782201, "get_robot_state": 0.003515867753462358, "sim_render-ego0": 0.003663139838676948, "get_duckie_state": 1.172895555372362e-06, "in-drivable-lane": 11.450000000000095, "deviation-heading": 5.878141564086586, "agent_compute-ego0": 0.013050761160912453, "complete-iteration": 0.3177083764757429, "set_robot_commands": 0.002159297001826299, "deviation-center-line": 0.6742705330320855, "driven_lanedir_consec": 0.3522920386226194, "sim_compute_sim_state": 0.010242847962812943, "sim_compute_performance-ego0": 0.001915529796055385}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.062893064021936, "get_ui_image": 0.032289172974100874, "step_physics": 0.22577418944587005, "survival_time": 16.250000000000096, "driven_lanedir": 0.6406760173616388, "get_state_dump": 0.004258901794995267, "get_robot_state": 0.00353034288605298, "sim_render-ego0": 0.00365241319855298, "get_duckie_state": 1.1760032981451304e-06, "in-drivable-lane": 6.250000000000089, "deviation-heading": 1.9432842490753257, "agent_compute-ego0": 0.013070530686641765, "complete-iteration": 0.2951248386886222, "set_robot_commands": 0.0021141730934564323, "deviation-center-line": 0.3248742059998946, "driven_lanedir_consec": 0.6406760173616388, "sim_compute_sim_state": 0.00849436616605045, "sim_compute_performance-ego0": 0.0018690751374133528}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6464010906219757, "get_ui_image": 0.025812541737275964, "step_physics": 0.15252004724003482, "survival_time": 24.600000000000215, "driven_lanedir": 0.6084654565274592, "get_state_dump": 0.004329334649788197, "get_robot_state": 0.0034722309808943867, "sim_render-ego0": 0.003554254226220307, "get_duckie_state": 1.1011746543899751e-06, "in-drivable-lane": 15.300000000000216, "deviation-heading": 1.626744069085163, "agent_compute-ego0": 0.012001933239052794, "complete-iteration": 0.2106607139231467, "set_robot_commands": 0.0020306719727738636, "deviation-center-line": 0.5916665710525671, "driven_lanedir_consec": 0.6084654565274592, "sim_compute_sim_state": 0.005035087980073074, "sim_compute_performance-ego0": 0.001833412274869412}}
set_robot_commands_max0.002159297001826299
set_robot_commands_mean0.002089946697145219
set_robot_commands_median0.002084908906990357
set_robot_commands_min0.0020306719727738636
sim_compute_performance-ego0_max0.001915529796055385
sim_compute_performance-ego0_mean0.0018751268034793076
sim_compute_performance-ego0_median0.0018757825714962168
sim_compute_performance-ego0_min0.001833412274869412
sim_compute_sim_state_max0.010242847962812943
sim_compute_sim_state_mean0.008460139872546665
sim_compute_sim_state_median0.00928131177365032
sim_compute_sim_state_min0.005035087980073074
sim_render-ego0_max0.003663139838676948
sim_render-ego0_mean0.0036162732798555625
sim_render-ego0_median0.0036238495272624977
sim_render-ego0_min0.003554254226220307
simulation-passed1
step_physics_max0.24309184767983175
step_physics_mean0.20148019000009892
step_physics_median0.20515443254026455
step_physics_min0.15252004724003482
survival_time_max44.34999999999962
survival_time_mean26.100000000000016
survival_time_min16.250000000000096
No reset possible
5343311410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:31:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.19294762660262
survival_time_median51.84999999999919
deviation-center-line_median2.5367041093209797
in-drivable-lane_median9.874999999999966


other stats
agent_compute-ego0_max0.034112058213906525
agent_compute-ego0_mean0.03361836069644791
agent_compute-ego0_median0.03362164308833689
agent_compute-ego0_min0.033118098395211355
complete-iteration_max0.23304043006896977
complete-iteration_mean0.20084220036081696
complete-iteration_median0.19839680421281053
complete-iteration_min0.173534762948677
deviation-center-line_max3.476827181194106
deviation-center-line_mean2.563218883431132
deviation-center-line_min1.702640133888462
deviation-heading_max15.93785490425805
deviation-heading_mean11.4698159983874
deviation-heading_median11.071636075465808
deviation-heading_min7.798136938359929
driven_any_max14.590332032595242
driven_any_mean12.061967555296585
driven_any_median12.511187567302674
driven_any_min8.63516305398574
driven_lanedir_consec_max14.27158126555988
driven_lanedir_consec_mean9.388811600682128
driven_lanedir_consec_min4.897769883963389
driven_lanedir_max14.27158126555988
driven_lanedir_mean9.38947027094801
driven_lanedir_median9.19294762660262
driven_lanedir_min4.900404565026925
get_duckie_state_max1.1836460658482142e-06
get_duckie_state_mean1.1062967789359537e-06
get_duckie_state_median1.1199128437877315e-06
get_duckie_state_min1.0017153623201369e-06
get_robot_state_max0.0035833845924676012
get_robot_state_mean0.003491786207041819
get_robot_state_median0.0034735561535108013
get_robot_state_min0.0034366479286780725
get_state_dump_max0.004480346255655789
get_state_dump_mean0.004305113202343213
get_state_dump_median0.004277385124741064
get_state_dump_min0.0041853363042349346
get_ui_image_max0.03553487614222935
get_ui_image_mean0.030120652168535704
get_ui_image_median0.02965262051662847
get_ui_image_min0.025642491498656515
in-drivable-lane_max13.699999999999656
in-drivable-lane_mean8.449999999999898
in-drivable-lane_min0.350000000000005
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.590332032595242, "get_ui_image": 0.027545601998042506, "step_physics": 0.08720915184529199, "survival_time": 59.99999999999873, "driven_lanedir": 14.27158126555988, "get_state_dump": 0.004230157223271887, "get_robot_state": 0.003479137508001653, "sim_render-ego0": 0.003570067693946959, "get_duckie_state": 1.0017153623201369e-06, "in-drivable-lane": 0.350000000000005, "deviation-heading": 7.798136938359929, "agent_compute-ego0": 0.034112058213906525, "complete-iteration": 0.173534762948677, "set_robot_commands": 0.0020967655435986166, "deviation-center-line": 2.5188493792532385, "driven_lanedir_consec": 14.27158126555988, "sim_compute_sim_state": 0.009365526861592591, "sim_compute_performance-ego0": 0.00185688469034746}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.432559727817305, "get_ui_image": 0.03553487614222935, "step_physics": 0.13600449071611678, "survival_time": 43.699999999999655, "driven_lanedir": 8.032490921554125, "get_state_dump": 0.00432461302621024, "get_robot_state": 0.0034679747990199496, "sim_render-ego0": 0.0035648901803152903, "get_duckie_state": 1.1836460658482142e-06, "in-drivable-lane": 6.999999999999985, "deviation-heading": 12.14891422468017, "agent_compute-ego0": 0.033118098395211355, "complete-iteration": 0.23304043006896977, "set_robot_commands": 0.002059689385550363, "deviation-center-line": 2.554558839388721, "driven_lanedir_consec": 8.032490921554125, "sim_compute_sim_state": 0.013050424030848912, "sim_compute_performance-ego0": 0.0018430442810058593}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.63516305398574, "get_ui_image": 0.031759639035214435, "step_physics": 0.11915343312116768, "survival_time": 36.35000000000007, "driven_lanedir": 4.900404565026925, "get_state_dump": 0.0041853363042349346, "get_robot_state": 0.0034366479286780725, "sim_render-ego0": 0.003534181759907649, "get_duckie_state": 1.124955795623444e-06, "in-drivable-lane": 12.749999999999948, "deviation-heading": 9.994357926251448, "agent_compute-ego0": 0.03396736986034519, "complete-iteration": 0.21246378205634736, "set_robot_commands": 0.0020208250690292528, "deviation-center-line": 1.702640133888462, "driven_lanedir_consec": 4.897769883963389, "sim_compute_sim_state": 0.012516315166766826, "sim_compute_performance-ego0": 0.0018188380278073824}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.589815406788045, "get_ui_image": 0.025642491498656515, "step_physics": 0.10343212112598275, "survival_time": 59.99999999999873, "driven_lanedir": 10.353404331651111, "get_state_dump": 0.004480346255655789, "get_robot_state": 0.0035833845924676012, "sim_render-ego0": 0.003627590096860404, "get_duckie_state": 1.1148698919520191e-06, "in-drivable-lane": 13.699999999999656, "deviation-heading": 15.93785490425805, "agent_compute-ego0": 0.0332759163163286, "complete-iteration": 0.18432982636927367, "set_robot_commands": 0.0021486605930884214, "deviation-center-line": 3.476827181194106, "driven_lanedir_consec": 10.353404331651111, "sim_compute_sim_state": 0.006168611639246754, "sim_compute_performance-ego0": 0.0018992922288194288}}
set_robot_commands_max0.0021486605930884214
set_robot_commands_mean0.0020814851478166635
set_robot_commands_median0.0020782274645744898
set_robot_commands_min0.0020208250690292528
sim_compute_performance-ego0_max0.0018992922288194288
sim_compute_performance-ego0_mean0.001854514806995033
sim_compute_performance-ego0_median0.00184996448567666
sim_compute_performance-ego0_min0.0018188380278073824
sim_compute_sim_state_max0.013050424030848912
sim_compute_sim_state_mean0.01027521942461377
sim_compute_sim_state_median0.010940921014179709
sim_compute_sim_state_min0.006168611639246754
sim_render-ego0_max0.003627590096860404
sim_render-ego0_mean0.0035741824327575754
sim_render-ego0_median0.0035674789371311247
sim_render-ego0_min0.003534181759907649
simulation-passed1
step_physics_max0.13600449071611678
step_physics_mean0.1114497992021398
step_physics_median0.11129277712357524
step_physics_min0.08720915184529199
survival_time_max59.99999999999873
survival_time_mean50.01249999999929
survival_time_min36.35000000000007
No reset possible
5341612567Bea Baselines 🐤straightaido5-LFP-sim-testingLFP-simabortednogpu-prod-010:00:36
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5340012564Bea Baselines 🐤straightaido5-LFV-sim-validationLFVv-simabortednogpu-prod-010:01:11
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5337212572Bea Baselines 🐤straightaido5-LFI-full-sim-validationLFVIv-simabortednogpu-prod-010:47:28
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5336712612Bea Baselines 🐤baseline-duckietownaido5-LFP-sim-testingLFP-simabortednogpu-prod-010:00:46
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5333212569Bea Baselines 🐤straightaido5-LFV_multi-sim-testingLFVmultibodyv-simabortednogpu-prod-010:06:55
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5332112539Bea Baselines 🐤template-rosaido5-LFV_multi-sim-testingLFVmultibodyv-simabortednogpu-prod-010:09:16
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5329812484Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simabortednogpu-prod-010:18:27
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5326912546Bea Baselines 🐤template-rosaido5-LFVI-sim-testingLFVIt-simabortednogpu-prod-010:02:40
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5323012478Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simabortednogpu-prod-010:08:20
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5321712483Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simerrornogpu-prod-010:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140258934992800
- M:video_aido:cmdline(in:/;out:/) 140258935052800
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5320312481Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simerrornogpu-prod-010:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140652991032528
- M:video_aido:cmdline(in:/;out:/) 140652990845520
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5319512485Bea Baselines 🐤straightaido5-LFVI-sim-validationLFVIv-simerrornogpu-prod-010:02:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140657254079072
- M:video_aido:cmdline(in:/;out:/) 140657254143408
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5317512448Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornogpu-prod-010:07:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140354397872528
- M:video_aido:cmdline(in:/;out:/) 140354399065040
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5316812451Bea Baselines 🐤template-tensorflowaido5-LFI-sim-testingLFVIv-simerrornogpu-prod-010:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139696653679056
- M:video_aido:cmdline(in:/;out:/) 139696653676896
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5316112451Bea Baselines 🐤template-tensorflowaido5-LFI-sim-testingLFVIv-simerrornogpu-prod-010:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140536694149184
- M:video_aido:cmdline(in:/;out:/) 140541684836480
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5315512453Bea Baselines 🐤template-tensorflowaido5-LF-sim-testingLFt-simerrornogpu-prod-010:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140380555993248
- M:video_aido:cmdline(in:/;out:/) 140380555995120
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5314612453Bea Baselines 🐤template-tensorflowaido5-LF-sim-testingLFt-simerrornogpu-prod-010:01:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140584115670704
- M:video_aido:cmdline(in:/;out:/) 140584115670320
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5312312454Bea Baselines 🐤template-tensorflowaido5-LFV-sim-testingLFVv-simerrornogpu-prod-010:04:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139640207612368
- M:video_aido:cmdline(in:/;out:/) 139640207610400
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5310712457Bea Baselines 🐤template-tensorflowaido5-LFVI_multi-sim-validationLFVIv-simerrornogpu-prod-010:03:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140322672274496
- M:video_aido:cmdline(in:/;out:/) 140322671513904
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5309012459Bea Baselines 🐤template-pytorchaido5-LFV-sim-validationLFVv-simerrornogpu-prod-010:01:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139737842249680
- M:video_aido:cmdline(in:/;out:/) 139737841678560
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5307712460Bea Baselines 🐤template-pytorchaido5-LFI-full-sim-testingLFVIv-simerrornogpu-prod-010:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139858622500432
- M:video_aido:cmdline(in:/;out:/) 139858622499328
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5302012464Bea Baselines 🐤template-pytorchaido5-LFV_multi-sim-testingLFVmultibodyv-simerrornogpu-prod-010:33:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139754372830160
- M:video_aido:cmdline(in:/;out:/) 139754372765392
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5301712465Bea Baselines 🐤template-pytorchaido5-LFI-sim-validationLFVIv-simerrornogpu-prod-010:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140356827197152
- M:video_aido:cmdline(in:/;out:/) 140356827196432
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5291912471Bea Baselines 🐤template-pytorchaido5-LFVI-sim-testingLFVIt-simerrornogpu-prod-010:19:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139699616159824
- M:video_aido:cmdline(in:/;out:/) 139699616164160
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5285511410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simerrornogpu-prod-010:09:48
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139959653082112
- M:video_aido:cmdline(in:/;out:/) 139959653082928
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5277412397Bea Baselines 🐤baseline-duckietownaido5-LFVI_multi-sim-validationLFVIv-simabortednogpu-prod-010:07:24
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5276212395Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-validationLFVIv-simabortednogpu-prod-010:00:49
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5275512362Bea Baselines 🐤baseline-behavior-cloningaido5-LFI-full-sim-validationLFVIv-simtimeoutnogpu-prod-010:00:39
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5273611772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednogpu-prod-010:00:29
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5273511772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednogpu-prod-010:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5273411772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednogpu-prod-010:00:25
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5273310933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednogpu-prod-010:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5273210933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednogpu-prod-010:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5273110933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednogpu-prod-010:00:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5273011010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednogpu-prod-010:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5272911010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednogpu-prod-010:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5272811012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednogpu-prod-010:01:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5272712236Bea Baselines 🐤baseline-behavior-cloningaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornogpu-prod-010:01:11
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5272612236Bea Baselines 🐤baseline-behavior-cloningaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornogpu-prod-010:01:07
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5272512237Bea Baselines 🐤baseline-behavior-cloningaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-errornogpu-prod-010:01:01
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5272412237Bea Baselines 🐤baseline-behavior-cloningaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-errornogpu-prod-010:00:57
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5272312245Bea Baselines 🐤baseline-behavior-cloningaido5-LFVI_multi-sim-validationLFVIv-simhost-errornogpu-prod-010:02:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5272212296Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornogpu-prod-010:03:25
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5272112296Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornogpu-prod-010:01:00
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5272012297Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-errornogpu-prod-010:01:01
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5271912297Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-errornogpu-prod-010:01:05
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5271812305Bea Baselines 🐤template-tensorflowaido5-LFVI_multi-sim-validationLFVIv-simhost-errornogpu-prod-010:03:42
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible