Duckietown Challenges Home Challenges Submissions

Evaluator 4727

ID4727
evaluatornogpu-prod-01
ownerI don't have one 😀
machinenogpu-prod_7109a145a2d8
processnogpu-prod-01_7109a145a2d8
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success46 53430
# timeout5 47273
# failed24 49836
# error76 47636
# aborted20 47279
# host-error42 48986
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5785210794Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerroryesnogpu-prod-010:22:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 323, in main
    evaluated = read_and_draw(fn, dn_i, pc_name)
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_drawing.py", line 302, in read_and_draw
    draw_static(
  File "/usr/local/lib/python3.8/site-packages/duckietown_world/svg_drawing/misc.py", line 355, in draw_static
    f.write(html)
OSError: [Errno 28] No space left on device

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5784310797Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:03:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 55 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5778510827Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:34:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.733475745817504
survival_time_median59.99999999999873
deviation-center-line_median2.7194580949258462
in-drivable-lane_median2.299999999999964


other stats
agent_compute-ego0_max0.012627641723912324
agent_compute-ego0_mean0.011882361672899308
agent_compute-ego0_median0.01176738411461086
agent_compute-ego0_min0.011367036738463189
complete-iteration_max0.17999595984332667
complete-iteration_mean0.1643953806256176
complete-iteration_median0.1646006344557801
complete-iteration_min0.1483842937475835
deviation-center-line_max4.9503222943841
deviation-center-line_mean3.043393574512205
deviation-center-line_min1.7843358138130272
deviation-heading_max24.63923986879476
deviation-heading_mean14.601270320924693
deviation-heading_median11.44375862785746
deviation-heading_min10.878324159189084
driven_any_max6.422259936838176
driven_any_mean5.6772825874571256
driven_any_median5.897836746073516
driven_any_min4.491196920843295
driven_lanedir_consec_max5.905010187117445
driven_lanedir_consec_mean4.4153289667396205
driven_lanedir_consec_min2.2893541882060284
driven_lanedir_max6.1329345901757275
driven_lanedir_mean5.320934917397905
driven_lanedir_median5.6073517387802525
driven_lanedir_min3.9361016018553854
get_duckie_state_max1.452943863817099e-06
get_duckie_state_mean1.3627180151895718e-06
get_duckie_state_median1.3693683252644282e-06
get_duckie_state_min1.2591915464123322e-06
get_robot_state_max0.003990156465922665
get_robot_state_mean0.0037595368642592618
get_robot_state_median0.00375384037738835
get_robot_state_min0.003540310236337679
get_state_dump_max0.005064203578367718
get_state_dump_mean0.004744698512961128
get_state_dump_median0.004720770846199334
get_state_dump_min0.004473048781078126
get_ui_image_max0.03497123023453203
get_ui_image_mean0.03078362879209177
get_ui_image_median0.03051736015364292
get_ui_image_min0.02712856462654921
in-drivable-lane_max5.299999999999882
in-drivable-lane_mean2.8999999999999284
in-drivable-lane_min1.6999999999999034
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.422259936838176, "get_ui_image": 0.02728611662624083, "step_physics": 0.08396358732180631, "survival_time": 59.99999999999873, "driven_lanedir": 6.1329345901757275, "get_state_dump": 0.004607896026624033, "get_robot_state": 0.0035886125302533128, "sim_render-ego0": 0.0038313663174568066, "get_duckie_state": 1.3189450787267122e-06, "in-drivable-lane": 1.6999999999999034, "deviation-heading": 11.681787709061078, "agent_compute-ego0": 0.011367036738463189, "complete-iteration": 0.1483842937475835, "set_robot_commands": 0.0021153518698991684, "deviation-center-line": 2.43678745847678, "driven_lanedir_consec": 5.905010187117445, "sim_compute_sim_state": 0.009584840787241204, "sim_compute_performance-ego0": 0.0019526420088235184}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.491196920843295, "get_ui_image": 0.03497123023453203, "step_physics": 0.1026677720056386, "survival_time": 59.99999999999873, "driven_lanedir": 3.9361016018553854, "get_state_dump": 0.004473048781078126, "get_robot_state": 0.003540310236337679, "sim_render-ego0": 0.003798739697712843, "get_duckie_state": 1.2591915464123322e-06, "in-drivable-lane": 2.4499999999999176, "deviation-heading": 24.63923986879476, "agent_compute-ego0": 0.011618201083485828, "complete-iteration": 0.17670086857480471, "set_robot_commands": 0.002100770816914148, "deviation-center-line": 4.9503222943841, "driven_lanedir_consec": 2.2893541882060284, "sim_compute_sim_state": 0.01149502423879606, "sim_compute_performance-ego0": 0.0019500051112496585}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.259643436628681, "get_ui_image": 0.033748603681045014, "step_physics": 0.10367993331769423, "survival_time": 59.99999999999873, "driven_lanedir": 5.876420518849589, "get_state_dump": 0.005064203578367718, "get_robot_state": 0.003990156465922665, "sim_render-ego0": 0.004187140834023812, "get_duckie_state": 1.452943863817099e-06, "in-drivable-lane": 5.299999999999882, "deviation-heading": 11.205729546653844, "agent_compute-ego0": 0.012627641723912324, "complete-iteration": 0.17999595984332667, "set_robot_commands": 0.002394783804557603, "deviation-center-line": 1.7843358138130272, "driven_lanedir_consec": 5.067405836793267, "sim_compute_sim_state": 0.01193967985173844, "sim_compute_performance-ego0": 0.002265674883281063}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.53603005551835, "get_ui_image": 0.02712856462654921, "step_physics": 0.08948102521459625, "survival_time": 59.99999999999873, "driven_lanedir": 5.338282958710917, "get_state_dump": 0.004833645665774635, "get_robot_state": 0.003919068224523387, "sim_render-ego0": 0.004127981660765077, "get_duckie_state": 1.419791571802144e-06, "in-drivable-lane": 2.15000000000001, "deviation-heading": 10.878324159189084, "agent_compute-ego0": 0.011916567145735892, "complete-iteration": 0.1525004003367555, "set_robot_commands": 0.002332991108509226, "deviation-center-line": 3.0021287313749125, "driven_lanedir_consec": 4.399545654841742, "sim_compute_sim_state": 0.0065028451066727845, "sim_compute_performance-ego0": 0.0021648788134521688}}
set_robot_commands_max0.002394783804557603
set_robot_commands_mean0.002235974399970036
set_robot_commands_median0.002224171489204197
set_robot_commands_min0.002100770816914148
sim_compute_performance-ego0_max0.002265674883281063
sim_compute_performance-ego0_mean0.0020833002042016024
sim_compute_performance-ego0_median0.0020587604111378436
sim_compute_performance-ego0_min0.0019500051112496585
sim_compute_sim_state_max0.01193967985173844
sim_compute_sim_state_mean0.009880597496112122
sim_compute_sim_state_median0.010539932513018631
sim_compute_sim_state_min0.0065028451066727845
sim_render-ego0_max0.004187140834023812
sim_render-ego0_mean0.003986307127489635
sim_render-ego0_median0.003979673989110942
sim_render-ego0_min0.003798739697712843
simulation-passed1
step_physics_max0.10367993331769423
step_physics_mean0.09494807946493386
step_physics_median0.09607439861011743
step_physics_min0.08396358732180631
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5775910843Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:17:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.374261320629231
survival_time_median17.675000000000118
deviation-center-line_median0.86077522139877
in-drivable-lane_median7.150000000000071


other stats
agent_compute-ego0_max0.014725439273679738
agent_compute-ego0_mean0.012758774711615212
agent_compute-ego0_median0.012220489215700917
agent_compute-ego0_min0.011868681141379275
complete-iteration_max0.19932565733651136
complete-iteration_mean0.18146948033533136
complete-iteration_median0.1836144539851791
complete-iteration_min0.15932335603445594
deviation-center-line_max2.3884279186588646
deviation-center-line_mean1.1062242291760755
deviation-center-line_min0.3149185552478978
deviation-heading_max3.701950562644331
deviation-heading_mean2.5610081758251244
deviation-heading_median2.616060519098789
deviation-heading_min1.3099611024585878
driven_any_max11.256374279387895
driven_any_mean4.994730319866759
driven_any_median3.1339199772439974
driven_any_min2.4547070455911473
driven_lanedir_consec_max3.759570680886319
driven_lanedir_consec_mean2.3772275158023177
driven_lanedir_consec_min1.0008167410644913
driven_lanedir_max3.759570680886319
driven_lanedir_mean2.3772275158023177
driven_lanedir_median2.374261320629231
driven_lanedir_min1.0008167410644913
get_duckie_state_max1.5099843343098958e-06
get_duckie_state_mean1.4579520791487354e-06
get_duckie_state_median1.4859047510830728e-06
get_duckie_state_min1.350014480118899e-06
get_robot_state_max0.003971168185320228
get_robot_state_mean0.003802587618251817
get_robot_state_median0.003804375929831924
get_robot_state_min0.0036304304280231903
get_state_dump_max0.004838182176013602
get_state_dump_mean0.004717479599604293
get_state_dump_median0.004714200035030699
get_state_dump_min0.004603336152342177
get_ui_image_max0.035807940148815665
get_ui_image_mean0.03165966854129467
get_ui_image_median0.03234653984282721
get_ui_image_min0.026137654330708603
in-drivable-lane_max39.39999999999897
in-drivable-lane_mean13.912499999999785
in-drivable-lane_min1.9500000000000275
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4547070455911473, "get_ui_image": 0.029685810102638623, "step_physics": 0.10247216917944292, "survival_time": 14.050000000000065, "driven_lanedir": 2.199673271268948, "get_state_dump": 0.004808419139672678, "get_robot_state": 0.003864831958256715, "sim_render-ego0": 0.004114889929480586, "get_duckie_state": 1.5099843343098958e-06, "in-drivable-lane": 1.9500000000000275, "deviation-heading": 1.3099611024585878, "agent_compute-ego0": 0.012358871757561434, "complete-iteration": 0.17187444199907018, "set_robot_commands": 0.0023166279420785024, "deviation-center-line": 0.5432303563425482, "driven_lanedir_consec": 2.199673271268948, "sim_compute_sim_state": 0.010055083755060291, "sim_compute_performance-ego0": 0.002108042967234943}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.454654480999688, "get_ui_image": 0.035807940148815665, "step_physics": 0.11971705537481406, "survival_time": 19.35000000000014, "driven_lanedir": 2.548849369989514, "get_state_dump": 0.004603336152342177, "get_robot_state": 0.0036304304280231903, "sim_render-ego0": 0.003932222877581095, "get_duckie_state": 1.350014480118899e-06, "in-drivable-lane": 4.700000000000067, "deviation-heading": 3.701950562644331, "agent_compute-ego0": 0.012082106673840395, "complete-iteration": 0.195354465971288, "set_robot_commands": 0.002208444875540193, "deviation-center-line": 1.178320086454992, "driven_lanedir_consec": 2.548849369989514, "sim_compute_sim_state": 0.011246560160646731, "sim_compute_performance-ego0": 0.002040867952956366}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.813185473488307, "get_ui_image": 0.035007269583015796, "step_physics": 0.12014648401848624, "survival_time": 16.000000000000092, "driven_lanedir": 1.0008167410644913, "get_state_dump": 0.004838182176013602, "get_robot_state": 0.003971168185320228, "sim_render-ego0": 0.004319310559661961, "get_duckie_state": 1.4676483249367211e-06, "in-drivable-lane": 9.600000000000076, "deviation-heading": 2.274153560005971, "agent_compute-ego0": 0.014725439273679738, "complete-iteration": 0.19932565733651136, "set_robot_commands": 0.0023893210746788905, "deviation-center-line": 0.3149185552478978, "driven_lanedir_consec": 1.0008167410644913, "sim_compute_sim_state": 0.011612343268231068, "sim_compute_performance-ego0": 0.002224181671380254}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.256374279387895, "get_ui_image": 0.026137654330708603, "step_physics": 0.09826306220792316, "survival_time": 59.99999999999873, "driven_lanedir": 3.759570680886319, "get_state_dump": 0.004619980930388718, "get_robot_state": 0.003743919901407132, "sim_render-ego0": 0.00392990862697884, "get_duckie_state": 1.5041611772294246e-06, "in-drivable-lane": 39.39999999999897, "deviation-heading": 2.957967478191607, "agent_compute-ego0": 0.011868681141379275, "complete-iteration": 0.15932335603445594, "set_robot_commands": 0.0022496595470037784, "deviation-center-line": 2.3884279186588646, "driven_lanedir_consec": 3.759570680886319, "sim_compute_sim_state": 0.006357744472608479, "sim_compute_performance-ego0": 0.002064997111629387}}
set_robot_commands_max0.0023893210746788905
set_robot_commands_mean0.002291013359825341
set_robot_commands_median0.00228314374454114
set_robot_commands_min0.002208444875540193
sim_compute_performance-ego0_max0.002224181671380254
sim_compute_performance-ego0_mean0.0021095224258002375
sim_compute_performance-ego0_median0.002086520039432165
sim_compute_performance-ego0_min0.002040867952956366
sim_compute_sim_state_max0.011612343268231068
sim_compute_sim_state_mean0.009817932914136645
sim_compute_sim_state_median0.010650821957853511
sim_compute_sim_state_min0.006357744472608479
sim_render-ego0_max0.004319310559661961
sim_render-ego0_mean0.0040740829984256205
sim_render-ego0_median0.00402355640353084
sim_render-ego0_min0.00392990862697884
simulation-passed1
step_physics_max0.12014648401848624
step_physics_mean0.11014969269516658
step_physics_median0.1110946122771285
step_physics_min0.09826306220792316
survival_time_max59.99999999999873
survival_time_mean27.349999999999756
survival_time_min14.050000000000065
No reset possible
5774210852Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:13:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5638766224282804
survival_time_median19.325000000000134
deviation-center-line_median0.504024735645444
in-drivable-lane_median10.650000000000103


other stats
agent_compute-ego0_max0.01417162490356879
agent_compute-ego0_mean0.013499026604915844
agent_compute-ego0_median0.013547709574400397
agent_compute-ego0_min0.012729062367293794
complete-iteration_max0.24654733959366293
complete-iteration_mean0.20914599987900465
complete-iteration_median0.21473526398747567
complete-iteration_min0.16056613194740424
deviation-center-line_max1.2496081008919622
deviation-center-line_mean0.6480307920783603
deviation-center-line_min0.33446559613059124
deviation-heading_max2.9766692190668325
deviation-heading_mean1.813095218132075
deviation-heading_median1.5400784602145092
deviation-heading_min1.1955547330324487
driven_any_max3.774956603958053
driven_any_mean2.4210196442928105
driven_any_median2.5555435398890887
driven_any_min0.7980348934350114
driven_lanedir_consec_max1.4547606282114538
driven_lanedir_consec_mean0.734337002408433
driven_lanedir_consec_min0.3548341365657174
driven_lanedir_max1.4547606282114538
driven_lanedir_mean0.734337002408433
driven_lanedir_median0.5638766224282804
driven_lanedir_min0.3548341365657174
get_duckie_state_max2.4807389633693663e-06
get_duckie_state_mean2.380184106426576e-06
get_duckie_state_median2.443579256453576e-06
get_duckie_state_min2.1528389494297867e-06
get_robot_state_max0.0045174480966734
get_robot_state_mean0.004263628614397402
get_robot_state_median0.004309453777469864
get_robot_state_min0.00391815880597648
get_state_dump_max0.005675504703332882
get_state_dump_mean0.0053867919517851335
get_state_dump_median0.005555915827537427
get_state_dump_min0.0047598314487327965
get_ui_image_max0.03938406705856323
get_ui_image_mean0.03382447154766502
get_ui_image_median0.034571255312573684
get_ui_image_min0.026771308506949473
in-drivable-lane_max24.750000000000263
in-drivable-lane_mean12.200000000000117
in-drivable-lane_min2.7499999999999902
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.965056330097135, "get_ui_image": 0.03225037052293028, "step_physics": 0.13428861788003751, "survival_time": 15.10000000000008, "driven_lanedir": 0.7437935981762278, "get_state_dump": 0.005675504703332882, "get_robot_state": 0.004351372766022635, "sim_render-ego0": 0.004569938867399008, "get_duckie_state": 2.480182710653878e-06, "in-drivable-lane": 9.150000000000093, "deviation-heading": 1.7785672553630585, "agent_compute-ego0": 0.013599914292691173, "complete-iteration": 0.2107352281954422, "set_robot_commands": 0.002637982761899237, "deviation-center-line": 0.555409644741715, "driven_lanedir_consec": 0.7437935981762278, "sim_compute_sim_state": 0.010807496092893895, "sim_compute_performance-ego0": 0.002443259305293017}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7980348934350114, "get_ui_image": 0.03938406705856323, "step_physics": 0.16265451206880455, "survival_time": 6.749999999999984, "driven_lanedir": 0.383959646680333, "get_state_dump": 0.005463501986335306, "get_robot_state": 0.004267534788917093, "sim_render-ego0": 0.0044459823299856744, "get_duckie_state": 2.4069758022532744e-06, "in-drivable-lane": 2.7499999999999902, "deviation-heading": 1.30158966506596, "agent_compute-ego0": 0.01349550485610962, "complete-iteration": 0.24654733959366293, "set_robot_commands": 0.002633741673301248, "deviation-center-line": 0.4526398265491731, "driven_lanedir_consec": 0.383959646680333, "sim_compute_sim_state": 0.011712074279785156, "sim_compute_performance-ego0": 0.0023753274889553293}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.774956603958053, "get_ui_image": 0.036892140102217086, "step_physics": 0.13340079974958782, "survival_time": 28.100000000000264, "driven_lanedir": 0.3548341365657174, "get_state_dump": 0.0056483296687395495, "get_robot_state": 0.0045174480966734, "sim_render-ego0": 0.004868332911977548, "get_duckie_state": 2.4807389633693663e-06, "in-drivable-lane": 24.750000000000263, "deviation-heading": 1.1955547330324487, "agent_compute-ego0": 0.01417162490356879, "complete-iteration": 0.21873529977950917, "set_robot_commands": 0.002689398838402323, "deviation-center-line": 0.33446559613059124, "driven_lanedir_consec": 0.3548341365657174, "sim_compute_sim_state": 0.013881563928580412, "sim_compute_performance-ego0": 0.002547144254613304}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.1460307496810422, "get_ui_image": 0.026771308506949473, "step_physics": 0.0970494979518955, "survival_time": 23.5500000000002, "driven_lanedir": 1.4547606282114538, "get_state_dump": 0.0047598314487327965, "get_robot_state": 0.00391815880597648, "sim_render-ego0": 0.004040541790299497, "get_duckie_state": 2.1528389494297867e-06, "in-drivable-lane": 12.15000000000012, "deviation-heading": 2.9766692190668325, "agent_compute-ego0": 0.012729062367293794, "complete-iteration": 0.16056613194740424, "set_robot_commands": 0.002403515880390749, "deviation-center-line": 1.2496081008919622, "driven_lanedir_consec": 1.4547606282114538, "sim_compute_sim_state": 0.006707902682029595, "sim_compute_performance-ego0": 0.002088145179263616}}
set_robot_commands_max0.002689398838402323
set_robot_commands_mean0.002591159788498389
set_robot_commands_median0.0026358622176002426
set_robot_commands_min0.002403515880390749
sim_compute_performance-ego0_max0.002547144254613304
sim_compute_performance-ego0_mean0.0023634690570313167
sim_compute_performance-ego0_median0.0024092933971241732
sim_compute_performance-ego0_min0.002088145179263616
sim_compute_sim_state_max0.013881563928580412
sim_compute_sim_state_mean0.010777259245822264
sim_compute_sim_state_median0.011259785186339523
sim_compute_sim_state_min0.006707902682029595
sim_render-ego0_max0.004868332911977548
sim_render-ego0_mean0.004481198974915432
sim_render-ego0_median0.004507960598692341
sim_render-ego0_min0.004040541790299497
simulation-passed1
step_physics_max0.16265451206880455
step_physics_mean0.13184835691258137
step_physics_median0.13384470881481267
step_physics_min0.0970494979518955
survival_time_max28.100000000000264
survival_time_mean18.37500000000013
survival_time_min6.749999999999984
No reset possible
5772510859Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:17:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1029634412556657
survival_time_median26.22500000000013
deviation-center-line_median0.7330088381650948
in-drivable-lane_median9.124999999999863


other stats
agent_compute-ego0_max0.01431120854836923
agent_compute-ego0_mean0.01399450029051956
agent_compute-ego0_median0.014069297071808208
agent_compute-ego0_min0.0135281984700926
complete-iteration_max0.237702210744222
complete-iteration_mean0.1975066599050996
complete-iteration_median0.1925765580536024
complete-iteration_min0.16717131276897143
deviation-center-line_max2.021340393132602
deviation-center-line_mean0.978247869910099
deviation-center-line_min0.4256334101776048
deviation-heading_max5.759534189537193
deviation-heading_mean2.957450940777034
deviation-heading_median2.1450071210132307
deviation-heading_min1.7802553315444825
driven_any_max7.859764571345261
driven_any_mean4.814279763193601
driven_any_median4.571312950629427
driven_any_min2.2547285801702865
driven_lanedir_consec_max6.128940343424623
driven_lanedir_consec_mean3.4290543754244727
driven_lanedir_consec_min1.381350275761935
driven_lanedir_max6.128940343424623
driven_lanedir_mean3.4290543754244727
driven_lanedir_median3.1029634412556657
driven_lanedir_min1.381350275761935
get_duckie_state_max2.765601759161191e-06
get_duckie_state_mean2.508039171201073e-06
get_duckie_state_median2.520035662109063e-06
get_duckie_state_min2.2264836014249754e-06
get_robot_state_max0.0044037798480492975
get_robot_state_mean0.0041508231954518835
get_robot_state_median0.004138104356872929
get_robot_state_min0.003923304220012377
get_state_dump_max0.005278114267239576
get_state_dump_mean0.0050758655848600915
get_state_dump_median0.005100580383839126
get_state_dump_min0.00482418730452254
get_ui_image_max0.03836220458701805
get_ui_image_mean0.03246800434728783
get_ui_image_median0.03133432652063304
get_ui_image_min0.02884115976086721
in-drivable-lane_max10.749999999999932
in-drivable-lane_mean7.899999999999925
in-drivable-lane_min2.600000000000037
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.188359502632827, "get_ui_image": 0.02884115976086721, "step_physics": 0.0966083097932688, "survival_time": 35.10000000000014, "driven_lanedir": 4.337560553170489, "get_state_dump": 0.00482418730452254, "get_robot_state": 0.003923304220012377, "sim_render-ego0": 0.004190485643628312, "get_duckie_state": 2.2264836014249754e-06, "in-drivable-lane": 10.749999999999932, "deviation-heading": 1.939676538065298, "agent_compute-ego0": 0.0135281984700926, "complete-iteration": 0.16717131276897143, "set_robot_commands": 0.0023436176658185415, "deviation-center-line": 0.8804772479174547, "driven_lanedir_consec": 4.337560553170489, "sim_compute_sim_state": 0.010646546039608433, "sim_compute_performance-ego0": 0.0021737886865651115}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.2547285801702865, "get_ui_image": 0.03836220458701805, "step_physics": 0.15326653763099954, "survival_time": 13.450000000000056, "driven_lanedir": 1.868366329340842, "get_state_dump": 0.005271406526918765, "get_robot_state": 0.004330016065526892, "sim_render-ego0": 0.004608701776575159, "get_duckie_state": 2.6641068635163484e-06, "in-drivable-lane": 2.600000000000037, "deviation-heading": 1.7802553315444825, "agent_compute-ego0": 0.01431120854836923, "complete-iteration": 0.237702210744222, "set_robot_commands": 0.0025621696754738136, "deviation-center-line": 0.4256334101776048, "driven_lanedir_consec": 1.868366329340842, "sim_compute_sim_state": 0.012375159616823547, "sim_compute_performance-ego0": 0.0025011574780499494}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.9542663986260274, "get_ui_image": 0.0338116315589554, "step_physics": 0.1195558727472678, "survival_time": 17.35000000000011, "driven_lanedir": 1.381350275761935, "get_state_dump": 0.004929754240759488, "get_robot_state": 0.003946192648218966, "sim_render-ego0": 0.0042547124555741235, "get_duckie_state": 2.375964460701778e-06, "in-drivable-lane": 8.800000000000068, "deviation-heading": 2.3503377039611633, "agent_compute-ego0": 0.01396564231521782, "complete-iteration": 0.19642789404967737, "set_robot_commands": 0.0024290002625564047, "deviation-center-line": 0.5855404284127347, "driven_lanedir_consec": 1.381350275761935, "sim_compute_sim_state": 0.011271053347094306, "sim_compute_performance-ego0": 0.002168142932584916}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.859764571345261, "get_ui_image": 0.02885702148231068, "step_physics": 0.11882160078175576, "survival_time": 44.29999999999962, "driven_lanedir": 6.128940343424623, "get_state_dump": 0.005278114267239576, "get_robot_state": 0.0044037798480492975, "sim_render-ego0": 0.004655162538186539, "get_duckie_state": 2.765601759161191e-06, "in-drivable-lane": 9.449999999999662, "deviation-heading": 5.759534189537193, "agent_compute-ego0": 0.014172951828398592, "complete-iteration": 0.18872522205752745, "set_robot_commands": 0.0026502133490939822, "deviation-center-line": 2.021340393132602, "driven_lanedir_consec": 6.128940343424623, "sim_compute_sim_state": 0.007223474939081822, "sim_compute_performance-ego0": 0.0025502866661131986}}
set_robot_commands_max0.0026502133490939822
set_robot_commands_mean0.0024962502382356857
set_robot_commands_median0.002495584969015109
set_robot_commands_min0.0023436176658185415
sim_compute_performance-ego0_max0.0025502866661131986
sim_compute_performance-ego0_mean0.002348343940828294
sim_compute_performance-ego0_median0.0023374730823075302
sim_compute_performance-ego0_min0.002168142932584916
sim_compute_sim_state_max0.012375159616823547
sim_compute_sim_state_mean0.010379058485652026
sim_compute_sim_state_median0.010958799693351368
sim_compute_sim_state_min0.007223474939081822
sim_render-ego0_max0.004655162538186539
sim_render-ego0_mean0.004427265603491033
sim_render-ego0_median0.004431707116074641
sim_render-ego0_min0.004190485643628312
simulation-passed1
step_physics_max0.15326653763099954
step_physics_mean0.12206308023832296
step_physics_median0.11918873676451178
step_physics_min0.0966083097932688
survival_time_max44.29999999999962
survival_time_mean27.549999999999983
survival_time_min13.450000000000056
No reset possible
5769410875Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:08:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.014686087857375
survival_time_median12.30000000000004
deviation-center-line_median0.3554824359369245
in-drivable-lane_median7.450000000000022


other stats
agent_compute-ego0_max0.04741663402981229
agent_compute-ego0_mean0.03410684868907997
agent_compute-ego0_median0.03742325551993688
agent_compute-ego0_min0.01416424968663384
complete-iteration_max0.21645935526433985
complete-iteration_mean0.19840170834019685
complete-iteration_median0.19516990832665215
complete-iteration_min0.18680766144314329
deviation-center-line_max0.6026956082740155
deviation-center-line_mean0.3529439200709312
deviation-center-line_min0.09811520013586043
deviation-heading_max3.8682746994658648
deviation-heading_mean1.5348613428785192
deviation-heading_median0.8668482325772109
deviation-heading_min0.5374742068937902
driven_any_max4.270383716060153
driven_any_mean2.87017592307513
driven_any_median2.747895482513489
driven_any_min1.7145290112133873
driven_lanedir_consec_max1.9924391036825555
driven_lanedir_consec_mean1.177502061129147
driven_lanedir_consec_min0.6881969651192819
driven_lanedir_max1.9924391036825555
driven_lanedir_mean1.177502061129147
driven_lanedir_median1.014686087857375
driven_lanedir_min0.6881969651192819
get_duckie_state_max1.7302877762738395e-06
get_duckie_state_mean1.49803106921337e-06
get_duckie_state_median1.5361570778949522e-06
get_duckie_state_min1.1895223447897364e-06
get_robot_state_max0.004092454033739427
get_robot_state_mean0.0037804888196846546
get_robot_state_median0.003732229217832232
get_robot_state_min0.003565042809334727
get_state_dump_max0.0051726208013646744
get_state_dump_mean0.004872508157157387
get_state_dump_median0.004851980405731397
get_state_dump_min0.004613451015802078
get_ui_image_max0.03438528207434477
get_ui_image_mean0.031286891454526275
get_ui_image_median0.03160903025586326
get_ui_image_min0.027544223232033812
in-drivable-lane_max11.450000000000127
in-drivable-lane_mean7.200000000000053
in-drivable-lane_min2.450000000000035
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.448280494092495, "get_ui_image": 0.02886619009413161, "step_physics": 0.10196491726883895, "survival_time": 11.050000000000022, "driven_lanedir": 1.9924391036825555, "get_state_dump": 0.004971147657514692, "get_robot_state": 0.0038703057143065303, "sim_render-ego0": 0.004075238296577522, "get_duckie_state": 1.6785956717826224e-06, "in-drivable-lane": 2.450000000000035, "deviation-heading": 1.162490987446388, "agent_compute-ego0": 0.02854561590933585, "complete-iteration": 0.18680766144314329, "set_robot_commands": 0.0022671029374406143, "deviation-center-line": 0.6026956082740155, "driven_lanedir_consec": 1.9924391036825555, "sim_compute_sim_state": 0.00999389038429604, "sim_compute_performance-ego0": 0.002152768341270653}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.270383716060153, "get_ui_image": 0.03438528207434477, "step_physics": 0.10775502929790322, "survival_time": 18.500000000000128, "driven_lanedir": 1.3089350462050584, "get_state_dump": 0.004732813153948102, "get_robot_state": 0.003565042809334727, "sim_render-ego0": 0.003686246846242735, "get_duckie_state": 1.1895223447897364e-06, "in-drivable-lane": 11.450000000000127, "deviation-heading": 3.8682746994658648, "agent_compute-ego0": 0.046300895130537915, "complete-iteration": 0.21645935526433985, "set_robot_commands": 0.0020483034961628465, "deviation-center-line": 0.5510512078588701, "driven_lanedir_consec": 1.3089350462050584, "sim_compute_sim_state": 0.0120880892977239, "sim_compute_performance-ego0": 0.0018128596868797777}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.047510470934483, "get_ui_image": 0.03435187041759491, "step_physics": 0.1243171569179086, "survival_time": 13.550000000000058, "driven_lanedir": 0.7204371295096913, "get_state_dump": 0.0051726208013646744, "get_robot_state": 0.004092454033739427, "sim_render-ego0": 0.004387695123167599, "get_duckie_state": 1.7302877762738395e-06, "in-drivable-lane": 10.100000000000062, "deviation-heading": 0.5712054777080336, "agent_compute-ego0": 0.01416424968663384, "complete-iteration": 0.2022566786583732, "set_robot_commands": 0.002418852027724771, "deviation-center-line": 0.09811520013586043, "driven_lanedir_consec": 0.7204371295096913, "sim_compute_sim_state": 0.010955047958037431, "sim_compute_performance-ego0": 0.002288061029770795}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7145290112133873, "get_ui_image": 0.027544223232033812, "step_physics": 0.09163098717913216, "survival_time": 8.04999999999998, "driven_lanedir": 0.6881969651192819, "get_state_dump": 0.004613451015802078, "get_robot_state": 0.003594152721357934, "sim_render-ego0": 0.003796656926472982, "get_duckie_state": 1.393718484007282e-06, "in-drivable-lane": 4.799999999999983, "deviation-heading": 0.5374742068937902, "agent_compute-ego0": 0.04741663402981229, "complete-iteration": 0.1880831379949311, "set_robot_commands": 0.002278221978081597, "deviation-center-line": 0.159913664014979, "driven_lanedir_consec": 0.6881969651192819, "sim_compute_sim_state": 0.0051575325153492115, "sim_compute_performance-ego0": 0.00196050567391478}}
set_robot_commands_max0.002418852027724771
set_robot_commands_mean0.002253120109852457
set_robot_commands_median0.002272662457761106
set_robot_commands_min0.0020483034961628465
sim_compute_performance-ego0_max0.002288061029770795
sim_compute_performance-ego0_mean0.002053548682959001
sim_compute_performance-ego0_median0.0020566370075927164
sim_compute_performance-ego0_min0.0018128596868797777
sim_compute_sim_state_max0.0120880892977239
sim_compute_sim_state_mean0.009548640038851646
sim_compute_sim_state_median0.010474469171166735
sim_compute_sim_state_min0.0051575325153492115
sim_render-ego0_max0.004387695123167599
sim_render-ego0_mean0.003986459298115209
sim_render-ego0_median0.003935947611525252
sim_render-ego0_min0.003686246846242735
simulation-passed1
step_physics_max0.1243171569179086
step_physics_mean0.10641702266594572
step_physics_median0.1048599732833711
step_physics_min0.09163098717913216
survival_time_max18.500000000000128
survival_time_mean12.787500000000048
survival_time_min8.04999999999998
No reset possible
5762410903Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:44:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013137060835597717
agent_compute-ego0_mean0.012510063001059377
agent_compute-ego0_median0.012591294603085735
agent_compute-ego0_min0.011720601962468309
complete-iteration_max0.35144434483422526
complete-iteration_mean0.3072048453466779
complete-iteration_median0.31362426271049504
complete-iteration_min0.25012651113149625
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.5208365815962283e-06
get_duckie_state_mean1.4004858209131955e-06
get_duckie_state_median1.4242581979718235e-06
get_duckie_state_min1.2325903061129072e-06
get_robot_state_max0.003993848479856162
get_robot_state_mean0.00384584974984543
get_robot_state_median0.0038397305216221487
get_robot_state_min0.0037100894762812607
get_state_dump_max0.004854999116616483
get_state_dump_mean0.004764343826697331
get_state_dump_median0.0047607935040717714
get_state_dump_min0.004680789182029298
get_ui_image_max0.035810407452738155
get_ui_image_mean0.03162446427007797
get_ui_image_median0.031760684854283516
get_ui_image_min0.027166079919006703
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02936627148192292, "step_physics": 0.22459162244391775, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004832420023553675, "get_robot_state": 0.003922857710165743, "sim_render-ego0": 0.0040676498492492625, "get_duckie_state": 1.5208365815962283e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012090061427552336, "complete-iteration": 0.2923123562564262, "set_robot_commands": 0.002351384873592685, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008879151372091656, "sim_compute_performance-ego0": 0.0021172776805868155}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.035810407452738155, "step_physics": 0.2741218982985574, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004689166984589868, "get_robot_state": 0.0037100894762812607, "sim_render-ego0": 0.004054775245977778, "get_duckie_state": 1.2325903061129072e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013092527778619136, "complete-iteration": 0.35144434483422526, "set_robot_commands": 0.0022645935627145634, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.01154174772924825, "sim_compute_performance-ego0": 0.0020698313907620116}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.034155098226644115, "step_physics": 0.2606294039981153, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004854999116616483, "get_robot_state": 0.003993848479856162, "sim_render-ego0": 0.004156624844032561, "get_duckie_state": 1.4005354500928588e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.013137060835597717, "complete-iteration": 0.33493616916456387, "set_robot_commands": 0.0024154045301909054, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009332472438319934, "sim_compute_performance-ego0": 0.0021685833339389416}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.027166079919006703, "step_physics": 0.18829074608694008, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004680789182029298, "get_robot_state": 0.003756603333078554, "sim_render-ego0": 0.003953775299478828, "get_duckie_state": 1.4479809458507884e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.011720601962468309, "complete-iteration": 0.25012651113149625, "set_robot_commands": 0.0022727111098569796, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.0061593069621267964, "sim_compute_performance-ego0": 0.002033622536829965}}
set_robot_commands_max0.0024154045301909054
set_robot_commands_mean0.0023260235190887832
set_robot_commands_median0.0023120479917248323
set_robot_commands_min0.0022645935627145634
sim_compute_performance-ego0_max0.0021685833339389416
sim_compute_performance-ego0_mean0.0020973287355294337
sim_compute_performance-ego0_median0.0020935545356744138
sim_compute_performance-ego0_min0.002033622536829965
sim_compute_sim_state_max0.01154174772924825
sim_compute_sim_state_mean0.008978169625446659
sim_compute_sim_state_median0.009105811905205794
sim_compute_sim_state_min0.0061593069621267964
sim_render-ego0_max0.004156624844032561
sim_render-ego0_mean0.004058206309684608
sim_render-ego0_median0.00406121254761352
sim_render-ego0_min0.003953775299478828
simulation-passed1
step_physics_max0.2741218982985574
step_physics_mean0.23690841770688265
step_physics_median0.24261051322101657
step_physics_min0.18829074608694008
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5752310902Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:43:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013291069311861392
agent_compute-ego0_mean0.012892114530495066
agent_compute-ego0_median0.012903943843984484
agent_compute-ego0_min0.012469501122149895
complete-iteration_max0.3545571082239842
complete-iteration_mean0.2987918906862988
complete-iteration_median0.2918547468320416
complete-iteration_min0.2569009608571277
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.4970145753579371e-06
get_duckie_state_mean1.3528418084366138e-06
get_duckie_state_median1.3645046656574438e-06
get_duckie_state_min1.18534332707363e-06
get_robot_state_max0.003844723713388054
get_robot_state_mean0.003718026968759859
get_robot_state_median0.003709268411132914
get_robot_state_min0.0036088473393855545
get_state_dump_max0.004795824657570413
get_state_dump_mean0.004661240595564259
get_state_dump_median0.004687001663481167
get_state_dump_min0.004475134397724288
get_ui_image_max0.03656510985165611
get_ui_image_mean0.03077482154823958
get_ui_image_median0.02959215779983432
get_ui_image_min0.02734986074163356
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.028092149096067304, "step_physics": 0.21476354825308083, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0046846231354166325, "get_robot_state": 0.003633627387308062, "sim_render-ego0": 0.003848171750274328, "get_duckie_state": 1.3243050301303277e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.013060588820788584, "complete-iteration": 0.2808072279136842, "set_robot_commands": 0.0021472842766780045, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008532209459887655, "sim_compute_performance-ego0": 0.001961111327591387}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03656510985165611, "step_physics": 0.27591708498533124, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004689380191545701, "get_robot_state": 0.0037849094349577663, "sim_render-ego0": 0.00400471925536957, "get_duckie_state": 1.4970145753579371e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013291069311861392, "complete-iteration": 0.3545571082239842, "set_robot_commands": 0.0022347080618217528, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011924277336571636, "sim_compute_performance-ego0": 0.0020553972401487937}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.031092166503601328, "step_physics": 0.23467425561566635, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004475134397724288, "get_robot_state": 0.0036088473393855545, "sim_render-ego0": 0.003793176068155891, "get_duckie_state": 1.18534332707363e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012469501122149895, "complete-iteration": 0.302902265750399, "set_robot_commands": 0.0021405309364261674, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00866283048301017, "sim_compute_performance-ego0": 0.0019049443968329003}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02734986074163356, "step_physics": 0.19326527350947423, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004795824657570413, "get_robot_state": 0.003844723713388054, "sim_render-ego0": 0.004013969141875179, "get_duckie_state": 1.4047043011845597e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012747298867180384, "complete-iteration": 0.2569009608571277, "set_robot_commands": 0.002345943530334422, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006366630080935362, "sim_compute_performance-ego0": 0.0020803257785768532}}
set_robot_commands_max0.002345943530334422
set_robot_commands_mean0.0022171167013150866
set_robot_commands_median0.0021909961692498786
set_robot_commands_min0.0021405309364261674
sim_compute_performance-ego0_max0.0020803257785768532
sim_compute_performance-ego0_mean0.002000444685787484
sim_compute_performance-ego0_median0.0020082542838700903
sim_compute_performance-ego0_min0.0019049443968329003
sim_compute_sim_state_max0.011924277336571636
sim_compute_sim_state_mean0.008871486840101205
sim_compute_sim_state_median0.008597519971448912
sim_compute_sim_state_min0.006366630080935362
sim_render-ego0_max0.004013969141875179
sim_render-ego0_mean0.0039150090539187415
sim_render-ego0_median0.003926445502821949
sim_render-ego0_min0.003793176068155891
simulation-passed1
step_physics_max0.27591708498533124
step_physics_mean0.22965504059088815
step_physics_median0.2247189019343736
step_physics_min0.19326527350947423
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5747010917Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:15:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.774679819902348
survival_time_median21.97500000000018
deviation-center-line_median0.704071269700693
in-drivable-lane_median6.45000000000006


other stats
agent_compute-ego0_max0.024908719908486397
agent_compute-ego0_mean0.015941234823292967
agent_compute-ego0_median0.013147679901867965
agent_compute-ego0_min0.012560859580949551
complete-iteration_max0.23028908310265375
complete-iteration_mean0.18639241689818864
complete-iteration_median0.1780637964614375
complete-iteration_min0.1591529915672258
deviation-center-line_max3.354063796425286
deviation-center-line_mean1.289353363721596
deviation-center-line_min0.3952071190597115
deviation-heading_max7.204736635903443
deviation-heading_mean3.1430080815743295
deviation-heading_median2.1712396511475434
deviation-heading_min1.0248163880987888
driven_any_max10.682338398947596
driven_any_mean4.813709787863498
driven_any_median3.885192722024303
driven_any_min0.8021153084577939
driven_lanedir_consec_max7.484973745178201
driven_lanedir_consec_mean3.39538464157246
driven_lanedir_consec_min0.5472051813069425
driven_lanedir_max7.484973745178201
driven_lanedir_mean3.39538464157246
driven_lanedir_median2.774679819902348
driven_lanedir_min0.5472051813069425
get_duckie_state_max1.3132780296367835e-06
get_duckie_state_mean1.2719067177794257e-06
get_duckie_state_median1.2845769212710232e-06
get_duckie_state_min1.2051949989388725e-06
get_robot_state_max0.0038410425186157222
get_robot_state_mean0.0037026876614013847
get_robot_state_median0.00373315722834309
get_robot_state_min0.003503393670303637
get_state_dump_max0.004848030390660407
get_state_dump_mean0.004727473616798211
get_state_dump_median0.004785641248689824
get_state_dump_min0.0044905815791527895
get_ui_image_max0.03638621034293339
get_ui_image_mean0.030748122865285304
get_ui_image_median0.030707820831030776
get_ui_image_min0.025190639456146267
in-drivable-lane_max17.14999999999915
in-drivable-lane_mean8.037499999999815
in-drivable-lane_min2.0999999999999925
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.722794465325763, "get_ui_image": 0.028245178031553884, "step_physics": 0.09335275697800006, "survival_time": 25.900000000000233, "driven_lanedir": 3.947043009543265, "get_state_dump": 0.004774557602428517, "get_robot_state": 0.003653724758611249, "sim_render-ego0": 0.00388717054172288, "get_duckie_state": 1.3092349719449963e-06, "in-drivable-lane": 4.7500000000000675, "deviation-heading": 1.95615463879028, "agent_compute-ego0": 0.012560859580949551, "complete-iteration": 0.16127419885183344, "set_robot_commands": 0.0021985427033235114, "deviation-center-line": 0.6882598335728599, "driven_lanedir_consec": 3.947043009543265, "sim_compute_sim_state": 0.01053354413982531, "sim_compute_performance-ego0": 0.0019744650706620117}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.8021153084577939, "get_ui_image": 0.03638621034293339, "step_physics": 0.15332043993061986, "survival_time": 5.749999999999988, "driven_lanedir": 0.5472051813069425, "get_state_dump": 0.00479672489495113, "get_robot_state": 0.0038410425186157222, "sim_render-ego0": 0.004118045856212747, "get_duckie_state": 1.25991887059705e-06, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 1.0248163880987888, "agent_compute-ego0": 0.012848960942235489, "complete-iteration": 0.23028908310265375, "set_robot_commands": 0.0022679341250452503, "deviation-center-line": 0.3952071190597115, "driven_lanedir_consec": 0.5472051813069425, "sim_compute_sim_state": 0.010512138235157934, "sim_compute_performance-ego0": 0.0021015076801694675}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.0475909787228437, "get_ui_image": 0.033170463630507664, "step_physics": 0.1199891139130566, "survival_time": 18.05000000000012, "driven_lanedir": 1.6023166302614311, "get_state_dump": 0.004848030390660407, "get_robot_state": 0.003812589698074931, "sim_render-ego0": 0.004082200276917515, "get_duckie_state": 1.3132780296367835e-06, "in-drivable-lane": 8.150000000000052, "deviation-heading": 2.3863246635048068, "agent_compute-ego0": 0.01344639886150044, "complete-iteration": 0.19485339407104155, "set_robot_commands": 0.002346400397917184, "deviation-center-line": 0.7198827058285261, "driven_lanedir_consec": 1.6023166302614311, "sim_compute_sim_state": 0.01091554744467551, "sim_compute_performance-ego0": 0.002144818147901672}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.682338398947596, "get_ui_image": 0.025190639456146267, "step_physics": 0.08711403335361656, "survival_time": 59.99999999999873, "driven_lanedir": 7.484973745178201, "get_state_dump": 0.0044905815791527895, "get_robot_state": 0.003503393670303637, "sim_render-ego0": 0.003761613498023904, "get_duckie_state": 1.2051949989388725e-06, "in-drivable-lane": 17.14999999999915, "deviation-heading": 7.204736635903443, "agent_compute-ego0": 0.024908719908486397, "complete-iteration": 0.1591529915672258, "set_robot_commands": 0.0021528941606304033, "deviation-center-line": 3.354063796425286, "driven_lanedir_consec": 7.484973745178201, "sim_compute_sim_state": 0.006077303675985852, "sim_compute_performance-ego0": 0.001866710870887318}}
set_robot_commands_max0.002346400397917184
set_robot_commands_mean0.002241442846729087
set_robot_commands_median0.0022332384141843806
set_robot_commands_min0.0021528941606304033
sim_compute_performance-ego0_max0.002144818147901672
sim_compute_performance-ego0_mean0.0020218754424051175
sim_compute_performance-ego0_median0.0020379863754157396
sim_compute_performance-ego0_min0.001866710870887318
sim_compute_sim_state_max0.01091554744467551
sim_compute_sim_state_mean0.00950963337391115
sim_compute_sim_state_median0.01052284118749162
sim_compute_sim_state_min0.006077303675985852
sim_render-ego0_max0.004118045856212747
sim_render-ego0_mean0.0039622575432192615
sim_render-ego0_median0.0039846854093201975
sim_render-ego0_min0.003761613498023904
simulation-passed1
step_physics_max0.15332043993061986
step_physics_mean0.11344408604382328
step_physics_median0.10667093544552832
step_physics_min0.08711403335361656
survival_time_max59.99999999999873
survival_time_mean27.42499999999977
survival_time_min5.749999999999988
No reset possible
5745210922Moustafa Elarabichallenge-aido_LF-template-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:01:31
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5734010959Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:20:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0174577534135705
survival_time_median26.57500000000006
deviation-center-line_median0.5200560396921238
in-drivable-lane_median9.174999999999695


other stats
agent_compute-ego0_max0.01334627398422786
agent_compute-ego0_mean0.0129723811601416
agent_compute-ego0_median0.012910338211989144
agent_compute-ego0_min0.01272257423236026
complete-iteration_max0.22991684824228287
complete-iteration_mean0.19016242454909416
complete-iteration_median0.1783049096527848
complete-iteration_min0.1741230306485241
deviation-center-line_max1.6399335445602363
deviation-center-line_mean0.7304826653959571
deviation-center-line_min0.24188503763934435
deviation-heading_max7.615490310984674
deviation-heading_mean3.792023885458826
deviation-heading_median3.2903908885424027
deviation-heading_min0.9718234537658248
driven_any_max7.74906123639702
driven_any_mean3.903325283623741
driven_any_median3.2480954986350112
driven_any_min1.3680489008279215
driven_lanedir_consec_max6.046105161499615
driven_lanedir_consec_mean2.1839384760332985
driven_lanedir_consec_min0.6547332358064386
driven_lanedir_max6.046105161499615
driven_lanedir_mean2.192281583849395
driven_lanedir_median1.034143969045763
driven_lanedir_min0.6547332358064386
get_duckie_state_max2.1702476910182407e-06
get_duckie_state_mean2.0922963415580092e-06
get_duckie_state_median2.1376119185531514e-06
get_duckie_state_min1.923713838107493e-06
get_robot_state_max0.00404525025290732
get_robot_state_mean0.003936039338725996
get_robot_state_median0.003983340101347159
get_robot_state_min0.0037322268993023426
get_state_dump_max0.005326945589195868
get_state_dump_mean0.005066348277209453
get_state_dump_median0.005066483837080555
get_state_dump_min0.004805479845480835
get_ui_image_max0.0381621207509722
get_ui_image_mean0.03133201241523561
get_ui_image_median0.029581566842312702
get_ui_image_min0.02800279522534483
in-drivable-lane_max31.550000000000043
in-drivable-lane_mean13.424999999999866
in-drivable-lane_min3.8000000000000345
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.74906123639702, "get_ui_image": 0.028283567807750657, "step_physics": 0.10558691927350176, "survival_time": 57.79999999999885, "driven_lanedir": 6.046105161499615, "get_state_dump": 0.0049806964119241065, "get_robot_state": 0.003950414929600141, "sim_render-ego0": 0.004089085109911814, "get_duckie_state": 2.1346396377814052e-06, "in-drivable-lane": 12.549999999999358, "deviation-heading": 7.615490310984674, "agent_compute-ego0": 0.01272257423236026, "complete-iteration": 0.1741230306485241, "set_robot_commands": 0.002320205742878036, "deviation-center-line": 1.6399335445602363, "driven_lanedir_consec": 6.046105161499615, "sim_compute_sim_state": 0.009898029531810236, "sim_compute_performance-ego0": 0.0021982277480300997}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3680489008279215, "get_ui_image": 0.0381621207509722, "step_physics": 0.14961943988289153, "survival_time": 11.150000000000023, "driven_lanedir": 0.6547332358064386, "get_state_dump": 0.005152271262237004, "get_robot_state": 0.004016265273094177, "sim_render-ego0": 0.004205690962927682, "get_duckie_state": 2.1702476910182407e-06, "in-drivable-lane": 5.8000000000000345, "deviation-heading": 1.595075294460947, "agent_compute-ego0": 0.01334627398422786, "complete-iteration": 0.22991684824228287, "set_robot_commands": 0.002423000122819628, "deviation-center-line": 0.2724327780913775, "driven_lanedir_consec": 0.6547332358064386, "sim_compute_sim_state": 0.010653307395321982, "sim_compute_performance-ego0": 0.0022373337830816}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.456665385285638, "get_ui_image": 0.03087956587687476, "step_physics": 0.10935122552822928, "survival_time": 37.10000000000003, "driven_lanedir": 0.6852905978227202, "get_state_dump": 0.004805479845480835, "get_robot_state": 0.0037322268993023426, "sim_render-ego0": 0.0039518720208395215, "get_duckie_state": 1.923713838107493e-06, "in-drivable-lane": 31.550000000000043, "deviation-heading": 0.9718234537658248, "agent_compute-ego0": 0.012883305389178392, "complete-iteration": 0.18030891379950667, "set_robot_commands": 0.002221242255189056, "deviation-center-line": 0.24188503763934435, "driven_lanedir_consec": 0.6852905978227202, "sim_compute_sim_state": 0.010380893183588822, "sim_compute_performance-ego0": 0.002011579908881823}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.0395256119843843, "get_ui_image": 0.02800279522534483, "step_physics": 0.1112857212931473, "survival_time": 16.050000000000093, "driven_lanedir": 1.3829973402688056, "get_state_dump": 0.005326945589195868, "get_robot_state": 0.00404525025290732, "sim_render-ego0": 0.00417086278429683, "get_duckie_state": 2.140584199324898e-06, "in-drivable-lane": 3.8000000000000345, "deviation-heading": 4.985706482623859, "agent_compute-ego0": 0.012937371034799895, "complete-iteration": 0.17630090550606295, "set_robot_commands": 0.002368389449504592, "deviation-center-line": 0.76767930129287, "driven_lanedir_consec": 1.3496249090044203, "sim_compute_sim_state": 0.005943415327842191, "sim_compute_performance-ego0": 0.0021137628496063422}}
set_robot_commands_max0.002423000122819628
set_robot_commands_mean0.002333209392597828
set_robot_commands_median0.0023442975961913137
set_robot_commands_min0.002221242255189056
sim_compute_performance-ego0_max0.0022373337830816
sim_compute_performance-ego0_mean0.002140226072399966
sim_compute_performance-ego0_median0.002155995298818221
sim_compute_performance-ego0_min0.002011579908881823
sim_compute_sim_state_max0.010653307395321982
sim_compute_sim_state_mean0.009218911359640808
sim_compute_sim_state_median0.010139461357699529
sim_compute_sim_state_min0.005943415327842191
sim_render-ego0_max0.004205690962927682
sim_render-ego0_mean0.004104377719493962
sim_render-ego0_median0.004129973947104322
sim_render-ego0_min0.0039518720208395215
simulation-passed1
step_physics_max0.14961943988289153
step_physics_mean0.11896082649444246
step_physics_median0.11031847341068828
step_physics_min0.10558691927350176
survival_time_max57.79999999999885
survival_time_mean30.52499999999975
survival_time_min11.150000000000023
No reset possible
5731710964Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:07:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3125833401820054
survival_time_median9.32500000000001
deviation-center-line_median0.09047587670182115
in-drivable-lane_median7.300000000000012


other stats
agent_compute-ego0_max0.013106919769057654
agent_compute-ego0_mean0.01262524090239724
agent_compute-ego0_median0.012735769083034722
agent_compute-ego0_min0.01192250567446187
complete-iteration_max0.2363609611124232
complete-iteration_mean0.19178801722817584
complete-iteration_median0.18617188661247963
complete-iteration_min0.1584473345753208
deviation-center-line_max0.37359835298296373
deviation-center-line_mean0.15631434883664816
deviation-center-line_min0.07070728895998658
deviation-heading_max1.987457034944908
deviation-heading_mean0.895467955287025
deviation-heading_median0.576431062158383
deviation-heading_min0.441552661886426
driven_any_max3.2043840758313458
driven_any_mean2.068076883688308
driven_any_median2.214608917056292
driven_any_min0.6387056248093019
driven_lanedir_consec_max0.640494382737567
driven_lanedir_consec_mean0.3659889084565902
driven_lanedir_consec_min0.1982945707247832
driven_lanedir_max0.640494382737567
driven_lanedir_mean0.3659889084565902
driven_lanedir_median0.3125833401820054
driven_lanedir_min0.1982945707247832
get_duckie_state_max2.052472985309103e-06
get_duckie_state_mean1.924893562427672e-06
get_duckie_state_median1.9559221187785653e-06
get_duckie_state_min1.735257026844455e-06
get_robot_state_max0.003896791087694405
get_robot_state_mean0.003756568611081224
get_robot_state_median0.0037697446856790216
get_robot_state_min0.0035899939852724505
get_state_dump_max0.004871002713540443
get_state_dump_mean0.004733818269526792
get_state_dump_median0.00475705496664318
get_state_dump_min0.004550160431280368
get_ui_image_max0.036371497140414474
get_ui_image_mean0.031100408551947213
get_ui_image_median0.03052043853583477
get_ui_image_min0.02698925999570484
in-drivable-lane_max10.500000000000036
in-drivable-lane_mean6.812500000000014
in-drivable-lane_min2.1499999999999955
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.2043840758313458, "get_ui_image": 0.028028390133422423, "step_physics": 0.09279977569181327, "survival_time": 14.300000000000068, "driven_lanedir": 0.640494382737567, "get_state_dump": 0.004550160431280368, "get_robot_state": 0.0035899939852724505, "sim_render-ego0": 0.00372052026542637, "get_duckie_state": 1.888241917414117e-06, "in-drivable-lane": 9.65000000000004, "deviation-heading": 1.987457034944908, "agent_compute-ego0": 0.01192250567446187, "complete-iteration": 0.1584473345753208, "set_robot_commands": 0.002099808084840143, "deviation-center-line": 0.37359835298296373, "driven_lanedir_consec": 0.640494382737567, "sim_compute_sim_state": 0.009747702900956315, "sim_compute_performance-ego0": 0.0019055459557510005}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6387056248093019, "get_ui_image": 0.036371497140414474, "step_physics": 0.1603731141574141, "survival_time": 3.399999999999996, "driven_lanedir": 0.1982945707247832, "get_state_dump": 0.004751340202663256, "get_robot_state": 0.003757663395093835, "sim_render-ego0": 0.003983774046966995, "get_duckie_state": 2.052472985309103e-06, "in-drivable-lane": 2.1499999999999955, "deviation-heading": 0.646021374653201, "agent_compute-ego0": 0.012939981792284094, "complete-iteration": 0.2363609611124232, "set_robot_commands": 0.0021774492402007613, "deviation-center-line": 0.07070728895998658, "driven_lanedir_consec": 0.1982945707247832, "sim_compute_sim_state": 0.009879903516907623, "sim_compute_performance-ego0": 0.002038402833800385}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.540167506254256, "get_ui_image": 0.033012486938247106, "step_physics": 0.13379844149252526, "survival_time": 6.5999999999999845, "driven_lanedir": 0.32054955276623387, "get_state_dump": 0.004871002713540443, "get_robot_state": 0.003781825976264208, "sim_render-ego0": 0.004014549398780765, "get_duckie_state": 1.735257026844455e-06, "in-drivable-lane": 4.949999999999983, "deviation-heading": 0.5068407496635652, "agent_compute-ego0": 0.013106919769057654, "complete-iteration": 0.20541106130843773, "set_robot_commands": 0.002287932804652622, "deviation-center-line": 0.08914637651422161, "driven_lanedir_consec": 0.32054955276623387, "sim_compute_sim_state": 0.008428994874308881, "sim_compute_performance-ego0": 0.002021280446446928}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.889050327858328, "get_ui_image": 0.02698925999570484, "step_physics": 0.10430242404464848, "survival_time": 12.050000000000036, "driven_lanedir": 0.3046171275977769, "get_state_dump": 0.004762769730623104, "get_robot_state": 0.003896791087694405, "sim_render-ego0": 0.004026952853872757, "get_duckie_state": 2.023602320143014e-06, "in-drivable-lane": 10.500000000000036, "deviation-heading": 0.441552661886426, "agent_compute-ego0": 0.01253155637378535, "complete-iteration": 0.16693271191652156, "set_robot_commands": 0.0022752245595632505, "deviation-center-line": 0.09180537688942073, "driven_lanedir_consec": 0.3046171275977769, "sim_compute_sim_state": 0.005897753494830171, "sim_compute_performance-ego0": 0.0021569255954963116}}
set_robot_commands_max0.002287932804652622
set_robot_commands_mean0.0022101036723141945
set_robot_commands_median0.002226336899882006
set_robot_commands_min0.002099808084840143
sim_compute_performance-ego0_max0.0021569255954963116
sim_compute_performance-ego0_mean0.0020305387078736565
sim_compute_performance-ego0_median0.0020298416401236564
sim_compute_performance-ego0_min0.0019055459557510005
sim_compute_sim_state_max0.009879903516907623
sim_compute_sim_state_mean0.008488588696750747
sim_compute_sim_state_median0.0090883488876326
sim_compute_sim_state_min0.005897753494830171
sim_render-ego0_max0.004026952853872757
sim_render-ego0_mean0.003936449141261722
sim_render-ego0_median0.00399916172287388
sim_render-ego0_min0.00372052026542637
simulation-passed1
step_physics_max0.1603731141574141
step_physics_mean0.12281843884660028
step_physics_median0.11905043276858689
step_physics_min0.09279977569181327
survival_time_max14.300000000000068
survival_time_mean9.08750000000002
survival_time_min3.399999999999996
No reset possible
5731311313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-010:01:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5729711281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:35
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5729011281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5711311020Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:43:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.014513641074734069
agent_compute-ego0_mean0.013083468071129997
agent_compute-ego0_median0.012857449144050542
agent_compute-ego0_min0.01210533292168483
complete-iteration_max0.37478147319314087
complete-iteration_mean0.2970436206963735
complete-iteration_median0.29664905740259884
complete-iteration_min0.22009489478715552
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max2.534065913598206e-06
get_duckie_state_mean2.140407260510447e-06
get_duckie_state_median2.101895017091877e-06
get_duckie_state_min1.823773094259829e-06
get_robot_state_max0.0040380627189845865
get_robot_state_mean0.003764199823463688
get_robot_state_median0.003744240505907756
get_robot_state_min0.0035302555630546523
get_state_dump_max0.0049750532933218496
get_state_dump_mean0.0047176036608407735
get_state_dump_median0.004709423035011005
get_state_dump_min0.004476515280019235
get_ui_image_max0.036801897615913945
get_ui_image_mean0.030272887707947692
get_ui_image_median0.029889268839389065
get_ui_image_min0.024511115537098702
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02821853198576331, "step_physics": 0.2193105159254495, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004689582678598726, "get_robot_state": 0.003794406871811535, "sim_render-ego0": 0.004006581739223966, "get_duckie_state": 2.3438868971291826e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.013068648401049154, "complete-iteration": 0.28632078123132354, "set_robot_commands": 0.002288324251262274, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008752110796506757, "sim_compute_performance-ego0": 0.0020906887483239473}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.036801897615913945, "step_physics": 0.2927899704090662, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.0049750532933218496, "get_robot_state": 0.0040380627189845865, "sim_render-ego0": 0.0042965320822202, "get_duckie_state": 2.534065913598206e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.014513641074734069, "complete-iteration": 0.37478147319314087, "set_robot_commands": 0.0024298555547252088, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012485890463925122, "sim_compute_performance-ego0": 0.0023425903844396636}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.031560005693014814, "step_physics": 0.2376088383394316, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004476515280019235, "get_robot_state": 0.003694074140003976, "sim_render-ego0": 0.003880399152897082, "get_duckie_state": 1.8599031370545703e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012646249887051928, "complete-iteration": 0.3069773335738742, "set_robot_commands": 0.002254824753506396, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008737762206599277, "sim_compute_performance-ego0": 0.002032345081745437}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.024511115537098702, "step_physics": 0.1614603043396606, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004729263391423285, "get_robot_state": 0.0035302555630546523, "sim_render-ego0": 0.0036762507134532056, "get_duckie_state": 1.823773094259829e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.01210533292168483, "complete-iteration": 0.22009489478715552, "set_robot_commands": 0.0022239538156221947, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.005845164776245422, "sim_compute_performance-ego0": 0.0019319710584603975}}
set_robot_commands_max0.0024298555547252088
set_robot_commands_mean0.002299239593779018
set_robot_commands_median0.002271574502384335
set_robot_commands_min0.0022239538156221947
sim_compute_performance-ego0_max0.0023425903844396636
sim_compute_performance-ego0_mean0.0020993988182423616
sim_compute_performance-ego0_median0.0020615169150346923
sim_compute_performance-ego0_min0.0019319710584603975
sim_compute_sim_state_max0.012485890463925122
sim_compute_sim_state_mean0.008955232060819144
sim_compute_sim_state_median0.008744936501553016
sim_compute_sim_state_min0.005845164776245422
sim_render-ego0_max0.0042965320822202
sim_render-ego0_mean0.003964940921948613
sim_render-ego0_median0.003943490446060524
sim_render-ego0_min0.0036762507134532056
simulation-passed1
step_physics_max0.2927899704090662
step_physics_mean0.22779240725340197
step_physics_median0.22845967713244056
step_physics_min0.1614603043396606
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5710211312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-010:00:52
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5707211026Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:03:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 68, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 63, in compute_action
              ||     observation = self.preprocessor.toTensor(observation).to(self._device)
              ||   File "/workspace/wrappers.py", line 23, in toTensor
              ||     return self.compose_obs(obs)
              ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/transforms.py", line 67, in __call__
              ||     img = t(img)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/transforms.py", line 226, in forward
              ||     return F.normalize(tensor, self.mean, self.std, self.inplace)
              ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/functional.py", line 284, in normalize
              ||     tensor.sub_(mean).div_(std)
              || RuntimeError: The size of tensor a (120) must match the size of tensor b (3) at non-singleton dimension 0
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5692311055Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:30:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.146266739046131
survival_time_median56.57499999999892
deviation-center-line_median3.2466475804826107
in-drivable-lane_median12.225000000000014


other stats
agent_compute-ego0_max0.012339246610593156
agent_compute-ego0_mean0.012136307315810488
agent_compute-ego0_median0.01213145983949554
agent_compute-ego0_min0.011943062973657714
complete-iteration_max0.1952555650158932
complete-iteration_mean0.17572026421934653
complete-iteration_median0.17553461906723028
complete-iteration_min0.15655625372703227
deviation-center-line_max3.386639956808826
deviation-center-line_mean2.676063944906693
deviation-center-line_min0.8243206618527248
deviation-heading_max11.161145158074374
deviation-heading_mean7.870008002291921
deviation-heading_median8.606644665180752
deviation-heading_min3.1055975207317994
driven_any_max8.850952087791036
driven_any_mean7.1506448463064265
driven_any_median7.844222780026207
driven_any_min4.063181737382255
driven_lanedir_consec_max8.720762252640888
driven_lanedir_consec_mean5.758951533771594
driven_lanedir_consec_min2.0225104043532234
driven_lanedir_max8.720762252640888
driven_lanedir_mean5.758951533771594
driven_lanedir_median6.146266739046131
driven_lanedir_min2.0225104043532234
get_duckie_state_max1.296911793920571e-06
get_duckie_state_mean1.2545267346892064e-06
get_duckie_state_median1.2523423464670969e-06
get_duckie_state_min1.2165104519020609e-06
get_robot_state_max0.003705079708369348
get_robot_state_mean0.003614514830824845
get_robot_state_median0.003607712002301569
get_robot_state_min0.003537555610326896
get_state_dump_max0.004626762822158355
get_state_dump_mean0.004578729981315334
get_state_dump_median0.004579760331525698
get_state_dump_min0.0045286364400515845
get_ui_image_max0.03535066242504837
get_ui_image_mean0.03034453345253828
get_ui_image_median0.0300496927979047
get_ui_image_min0.02592808578929536
in-drivable-lane_max20.300000000000185
in-drivable-lane_mean11.187500000000052
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.063181737382255, "get_ui_image": 0.028099839271625, "step_physics": 0.1033608796166592, "survival_time": 33.500000000000234, "driven_lanedir": 2.0225104043532234, "get_state_dump": 0.00454078701320597, "get_robot_state": 0.0035725201295491657, "sim_render-ego0": 0.0038285486389023713, "get_duckie_state": 1.296911793920571e-06, "in-drivable-lane": 20.300000000000185, "deviation-heading": 3.1055975207317994, "agent_compute-ego0": 0.012339246610593156, "complete-iteration": 0.17034397928263498, "set_robot_commands": 0.00213651898720936, "deviation-center-line": 0.8243206618527248, "driven_lanedir_consec": 2.0225104043532234, "sim_compute_sim_state": 0.010397019578163386, "sim_compute_performance-ego0": 0.0019876882322854327}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.896082676480561, "get_ui_image": 0.03535066242504837, "step_physics": 0.12037366606239087, "survival_time": 53.14999999999912, "driven_lanedir": 5.731896575800452, "get_state_dump": 0.004626762822158355, "get_robot_state": 0.003537555610326896, "sim_render-ego0": 0.0038017151050997854, "get_duckie_state": 1.2216711402835703e-06, "in-drivable-lane": 9.449999999999855, "deviation-heading": 11.161145158074374, "agent_compute-ego0": 0.0122110745064298, "complete-iteration": 0.1952555650158932, "set_robot_commands": 0.002080339686314862, "deviation-center-line": 3.254170177050809, "driven_lanedir_consec": 5.731896575800452, "sim_compute_sim_state": 0.011285016635306795, "sim_compute_performance-ego0": 0.0019097807712124704}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.792362883571855, "get_ui_image": 0.0319995463241844, "step_physics": 0.10904559862802268, "survival_time": 59.99999999999873, "driven_lanedir": 6.56063690229181, "get_state_dump": 0.0045286364400515845, "get_robot_state": 0.003642903875053971, "sim_render-ego0": 0.003883217891785227, "get_duckie_state": 1.2165104519020609e-06, "in-drivable-lane": 15.00000000000017, "deviation-heading": 8.640905008014185, "agent_compute-ego0": 0.012051845172561276, "complete-iteration": 0.18072525885182555, "set_robot_commands": 0.0021708194262578424, "deviation-center-line": 3.239124983914412, "driven_lanedir_consec": 6.56063690229181, "sim_compute_sim_state": 0.011367717055258008, "sim_compute_performance-ego0": 0.0019545860830492818}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.850952087791036, "get_ui_image": 0.02592808578929536, "step_physics": 0.09610138864541036, "survival_time": 59.99999999999873, "driven_lanedir": 8.720762252640888, "get_state_dump": 0.004618733649845425, "get_robot_state": 0.003705079708369348, "sim_render-ego0": 0.0039158996991769755, "get_duckie_state": 1.2830135526506232e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.572384322347322, "agent_compute-ego0": 0.011943062973657714, "complete-iteration": 0.15655625372703227, "set_robot_commands": 0.002201798952787147, "deviation-center-line": 3.386639956808826, "driven_lanedir_consec": 8.720762252640888, "sim_compute_sim_state": 0.006088067252471187, "sim_compute_performance-ego0": 0.0019753926203312424}}
set_robot_commands_max0.002201798952787147
set_robot_commands_mean0.002147369263142303
set_robot_commands_median0.002153669206733601
set_robot_commands_min0.002080339686314862
sim_compute_performance-ego0_max0.0019876882322854327
sim_compute_performance-ego0_mean0.0019568619267196067
sim_compute_performance-ego0_median0.0019649893516902623
sim_compute_performance-ego0_min0.0019097807712124704
sim_compute_sim_state_max0.011367717055258008
sim_compute_sim_state_mean0.009784455130299845
sim_compute_sim_state_median0.01084101810673509
sim_compute_sim_state_min0.006088067252471187
sim_render-ego0_max0.0039158996991769755
sim_render-ego0_mean0.0038573453337410898
sim_render-ego0_median0.003855883265343799
sim_render-ego0_min0.0038017151050997854
simulation-passed1
step_physics_max0.12037366606239087
step_physics_mean0.1072203832381208
step_physics_median0.10620323912234096
step_physics_min0.09610138864541036
survival_time_max59.99999999999873
survival_time_mean51.6624999999992
survival_time_min33.500000000000234
No reset possible
5683211076Francois Hebertreal-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:13:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.9012423640016962
survival_time_median23.4750000000002
deviation-center-line_median0.2826115801251918
in-drivable-lane_median12.925000000000132


other stats
agent_compute-ego0_max0.012963127272672697
agent_compute-ego0_mean0.012496216551424685
agent_compute-ego0_median0.012527974046490812
agent_compute-ego0_min0.011965790840044411
complete-iteration_max0.22621488115853733
complete-iteration_mean0.19895277541603285
complete-iteration_median0.20542241145773965
complete-iteration_min0.15875139759011464
deviation-center-line_max1.2338702522174407
deviation-center-line_mean0.49939940584275
deviation-center-line_min0.19850421090317555
deviation-heading_max6.585492551234013
deviation-heading_mean2.9469251611546414
deviation-heading_median1.9419935260130727
deviation-heading_min1.3182210413584086
driven_any_max6.6867277138538315
driven_any_mean4.19669664853209
driven_any_median4.58632098993143
driven_any_min0.9274169004116668
driven_lanedir_consec_max3.304732782236757
driven_lanedir_consec_mean1.3805413405355953
driven_lanedir_consec_min0.4149478519022321
driven_lanedir_max3.304732782236757
driven_lanedir_mean1.3805413405355953
driven_lanedir_median0.9012423640016962
driven_lanedir_min0.4149478519022321
get_duckie_state_max1.3708180002590584e-06
get_duckie_state_mean1.290501608735052e-06
get_duckie_state_median1.2708068997771651e-06
get_duckie_state_min1.2495746351268191e-06
get_robot_state_max0.0036272245148817697
get_robot_state_mean0.003567084515714884
get_robot_state_median0.0036126181747289975
get_robot_state_min0.003415877198519772
get_state_dump_max0.004759177013679787
get_state_dump_mean0.004578676828631333
get_state_dump_median0.004579766306641836
get_state_dump_min0.004395997687561872
get_ui_image_max0.03474611995948686
get_ui_image_mean0.029722778081817707
get_ui_image_median0.02951383410900603
get_ui_image_min0.025117324149771914
in-drivable-lane_max27.7000000000002
in-drivable-lane_mean14.037500000000117
in-drivable-lane_min2.5999999999999908
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.9274169004116668, "get_ui_image": 0.027619920395038747, "step_physics": 0.14300940213380037, "survival_time": 5.349999999999989, "driven_lanedir": 0.4149478519022321, "get_state_dump": 0.004759177013679787, "get_robot_state": 0.003603988223605686, "sim_render-ego0": 0.003774338298373752, "get_duckie_state": 1.2803960729528356e-06, "in-drivable-lane": 2.5999999999999908, "deviation-heading": 1.3182210413584086, "agent_compute-ego0": 0.01222802312285812, "complete-iteration": 0.20699771024562696, "set_robot_commands": 0.0021413189393502696, "deviation-center-line": 0.21160396717789248, "driven_lanedir_consec": 0.4149478519022321, "sim_compute_sim_state": 0.007839138861055727, "sim_compute_performance-ego0": 0.0019323362244500057}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.365117195449994, "get_ui_image": 0.03474611995948686, "step_physics": 0.15086947919593918, "survival_time": 28.750000000000274, "driven_lanedir": 3.304732782236757, "get_state_dump": 0.004629787471559312, "get_robot_state": 0.0036272245148817697, "sim_render-ego0": 0.00386208337214258, "get_duckie_state": 1.2612177266014946e-06, "in-drivable-lane": 11.35000000000014, "deviation-heading": 6.585492551234013, "agent_compute-ego0": 0.012827924970123503, "complete-iteration": 0.22621488115853733, "set_robot_commands": 0.002151628335316976, "deviation-center-line": 1.2338702522174407, "driven_lanedir_consec": 3.304732782236757, "sim_compute_sim_state": 0.011428652124272453, "sim_compute_performance-ego0": 0.0019779068728288016}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.6867277138538315, "get_ui_image": 0.03140774782297331, "step_physics": 0.13192228624255753, "survival_time": 33.500000000000234, "driven_lanedir": 1.083418291132578, "get_state_dump": 0.0045297451417243605, "get_robot_state": 0.003621248125852309, "sim_render-ego0": 0.003906611358710799, "get_duckie_state": 1.3708180002590584e-06, "in-drivable-lane": 27.7000000000002, "deviation-heading": 2.392478667744989, "agent_compute-ego0": 0.012963127272672697, "complete-iteration": 0.2038471126698524, "set_robot_commands": 0.0021719378259604807, "deviation-center-line": 0.35361919307249107, "driven_lanedir_consec": 1.083418291132578, "sim_compute_sim_state": 0.011229078744811556, "sim_compute_performance-ego0": 0.0019969712781835063}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.807524784412866, "get_ui_image": 0.025117324149771914, "step_physics": 0.10035037079902544, "survival_time": 18.200000000000124, "driven_lanedir": 0.7190664368708144, "get_state_dump": 0.004395997687561872, "get_robot_state": 0.003415877198519772, "sim_render-ego0": 0.003670776706852325, "get_duckie_state": 1.2495746351268191e-06, "in-drivable-lane": 14.500000000000124, "deviation-heading": 1.4915083842811565, "agent_compute-ego0": 0.011965790840044411, "complete-iteration": 0.15875139759011464, "set_robot_commands": 0.002104106014722014, "deviation-center-line": 0.19850421090317555, "driven_lanedir_consec": 0.7190664368708144, "sim_compute_sim_state": 0.005793972537942129, "sim_compute_performance-ego0": 0.001849179725124411}}
set_robot_commands_max0.0021719378259604807
set_robot_commands_mean0.002142247778837435
set_robot_commands_median0.002146473637333623
set_robot_commands_min0.002104106014722014
sim_compute_performance-ego0_max0.0019969712781835063
sim_compute_performance-ego0_mean0.0019390985251466811
sim_compute_performance-ego0_median0.0019551215486394036
sim_compute_performance-ego0_min0.001849179725124411
sim_compute_sim_state_max0.011428652124272453
sim_compute_sim_state_mean0.009072710567020466
sim_compute_sim_state_median0.009534108802933644
sim_compute_sim_state_min0.005793972537942129
sim_render-ego0_max0.003906611358710799
sim_render-ego0_mean0.003803452434019864
sim_render-ego0_median0.0038182108352581663
sim_render-ego0_min0.003670776706852325
simulation-passed1
step_physics_max0.15086947919593918
step_physics_mean0.13153788459283064
step_physics_median0.13746584418817895
step_physics_min0.10035037079902544
survival_time_max33.500000000000234
survival_time_mean21.450000000000152
survival_time_min5.349999999999989
No reset possible
5675811421Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-010:11:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.98527289715129
survival_time_median10.07500000000002
deviation-center-line_median0.4152929240955376
in-drivable-lane_median0.574999999999998


other stats
agent_compute-ego0_max0.04823235873758358
agent_compute-ego0_mean0.04760640412520344
agent_compute-ego0_median0.04760640412520344
agent_compute-ego0_min0.046980449512823305
agent_compute-npc0_max0.044962867333071074
agent_compute-npc0_mean0.04371547716507297
agent_compute-npc0_median0.04371547716507297
agent_compute-npc0_min0.04246808699707487
agent_compute-npc1_max0.04334323085955719
agent_compute-npc1_mean0.038317093065795664
agent_compute-npc1_median0.038317093065795664
agent_compute-npc1_min0.033290955272034135
agent_compute-npc2_max0.03901942630312336
agent_compute-npc2_mean0.036061159022065574
agent_compute-npc2_median0.036061159022065574
agent_compute-npc2_min0.033102891741007785
complete-iteration_max1.10190903705402
complete-iteration_mean1.0953243851259078
complete-iteration_median1.0953243851259078
complete-iteration_min1.0887397331977955
deviation-center-line_max0.4428453840397468
deviation-center-line_mean0.4152929240955376
deviation-center-line_min0.3877404641513284
deviation-heading_max2.337012532611664
deviation-heading_mean2.176119920874941
deviation-heading_median2.176119920874941
deviation-heading_min2.015227309138218
driven_any_max3.010509437430402
driven_any_mean2.2095657782111875
driven_any_median2.2095657782111875
driven_any_min1.4086221189919723
driven_lanedir_consec_max2.967449007773209
driven_lanedir_consec_mean1.98527289715129
driven_lanedir_consec_min1.0030967865293712
driven_lanedir_max2.967449007773209
driven_lanedir_mean1.9889402704343049
driven_lanedir_median1.9889402704343049
driven_lanedir_min1.0104315330954003
get_duckie_state_max2.6782933812941947e-06
get_duckie_state_mean2.506330182368179e-06
get_duckie_state_median2.506330182368179e-06
get_duckie_state_min2.334366983442164e-06
get_robot_state_max0.015624698931283324
get_robot_state_mean0.014802262665906209
get_robot_state_median0.014802262665906209
get_robot_state_min0.013979826400529092
get_state_dump_max0.009953457073573648
get_state_dump_mean0.009504308029384262
get_state_dump_median0.009504308029384262
get_state_dump_min0.009055158985194876
get_ui_image_max0.05433978651561877
get_ui_image_mean0.051461489563713485
get_ui_image_median0.051461489563713485
get_ui_image_min0.048583192611808206
in-drivable-lane_max1.149999999999996
in-drivable-lane_mean0.574999999999998
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 1.4086221189919723, "get_ui_image": 0.05433978651561877, "step_physics": 0.7850460814733575, "survival_time": 6.799999999999984, "driven_lanedir": 1.0104315330954003, "get_state_dump": 0.009953457073573648, "get_robot_state": 0.015624698931283324, "sim_render-ego0": 0.003979750793345653, "sim_render-npc0": 0.004062515105644282, "sim_render-npc1": 0.004131193578678326, "sim_render-npc2": 0.004241776292341469, "get_duckie_state": 2.6782933812941947e-06, "in-drivable-lane": 1.149999999999996, "deviation-heading": 2.337012532611664, "agent_compute-ego0": 0.04823235873758358, "agent_compute-npc0": 0.044962867333071074, "agent_compute-npc1": 0.033290955272034135, "agent_compute-npc2": 0.033102891741007785, "complete-iteration": 1.10190903705402, "set_robot_commands": 0.002633357570119148, "deviation-center-line": 0.3877404641513284, "driven_lanedir_consec": 1.0030967865293712, "sim_compute_sim_state": 0.04233153545073349, "sim_compute_performance-ego0": 0.0022079718373987796, "sim_compute_performance-npc0": 0.002106158402714416, "sim_compute_performance-npc1": 0.002093341228735708, "sim_compute_performance-npc2": 0.0022389157845156037}, "LFVI-norm-udem1-000-ego0": {"driven_any": 3.010509437430402, "get_ui_image": 0.048583192611808206, "step_physics": 0.7722835398432034, "survival_time": 13.350000000000056, "driven_lanedir": 2.967449007773209, "get_state_dump": 0.009055158985194876, "get_robot_state": 0.013979826400529092, "sim_render-ego0": 0.00374239416264776, "sim_render-npc0": 0.003744837953083551, "sim_render-npc1": 0.003726868487116116, "sim_render-npc2": 0.0038002222331602184, "get_duckie_state": 2.334366983442164e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.015227309138218, "agent_compute-ego0": 0.046980449512823305, "agent_compute-npc0": 0.04246808699707487, "agent_compute-npc1": 0.04334323085955719, "agent_compute-npc2": 0.03901942630312336, "complete-iteration": 1.0887397331977955, "set_robot_commands": 0.00215877792728481, "deviation-center-line": 0.4428453840397468, "driven_lanedir_consec": 2.967449007773209, "sim_compute_sim_state": 0.04119360535892088, "sim_compute_performance-ego0": 0.002022455877332545, "sim_compute_performance-npc0": 0.0019144736119170688, "sim_compute_performance-npc1": 0.0020273354516100526, "sim_compute_performance-npc2": 0.0019158276159371903}}
set_robot_commands_max0.002633357570119148
set_robot_commands_mean0.002396067748701979
set_robot_commands_median0.002396067748701979
set_robot_commands_min0.00215877792728481
sim_compute_performance-ego0_max0.0022079718373987796
sim_compute_performance-ego0_mean0.0021152138573656623
sim_compute_performance-ego0_median0.0021152138573656623
sim_compute_performance-ego0_min0.002022455877332545
sim_compute_performance-npc0_max0.002106158402714416
sim_compute_performance-npc0_mean0.0020103160073157425
sim_compute_performance-npc0_median0.0020103160073157425
sim_compute_performance-npc0_min0.0019144736119170688
sim_compute_performance-npc1_max0.002093341228735708
sim_compute_performance-npc1_mean0.0020603383401728804
sim_compute_performance-npc1_median0.0020603383401728804
sim_compute_performance-npc1_min0.0020273354516100526
sim_compute_performance-npc2_max0.0022389157845156037
sim_compute_performance-npc2_mean0.002077371700226397
sim_compute_performance-npc2_median0.002077371700226397
sim_compute_performance-npc2_min0.0019158276159371903
sim_compute_sim_state_max0.04233153545073349
sim_compute_sim_state_mean0.041762570404827185
sim_compute_sim_state_median0.041762570404827185
sim_compute_sim_state_min0.04119360535892088
sim_render-ego0_max0.003979750793345653
sim_render-ego0_mean0.0038610724779967066
sim_render-ego0_median0.0038610724779967066
sim_render-ego0_min0.00374239416264776
sim_render-npc0_max0.004062515105644282
sim_render-npc0_mean0.003903676529363917
sim_render-npc0_median0.003903676529363917
sim_render-npc0_min0.003744837953083551
sim_render-npc1_max0.004131193578678326
sim_render-npc1_mean0.003929031032897221
sim_render-npc1_median0.003929031032897221
sim_render-npc1_min0.003726868487116116
sim_render-npc2_max0.004241776292341469
sim_render-npc2_mean0.004020999262750844
sim_render-npc2_median0.004020999262750844
sim_render-npc2_min0.0038002222331602184
simulation-passed1
step_physics_max0.7850460814733575
step_physics_mean0.7786648106582805
step_physics_median0.7786648106582805
step_physics_min0.7722835398432034
survival_time_max13.350000000000056
survival_time_mean10.07500000000002
survival_time_min6.799999999999984
No reset possible
5673711090Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:04:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6797475442338904
survival_time_median6.024999999999986
deviation-center-line_median0.11629049163922428
in-drivable-lane_median3.5749999999999877


other stats
agent_compute-ego0_max0.013479428213150776
agent_compute-ego0_mean0.01321745331369732
agent_compute-ego0_median0.013293080285111563
agent_compute-ego0_min0.01280422447141537
complete-iteration_max0.21052164718753005
complete-iteration_mean0.1827051306274015
complete-iteration_median0.18396133837525025
complete-iteration_min0.15237619857157558
deviation-center-line_max0.30386370794395706
deviation-center-line_mean0.150819411044717
deviation-center-line_min0.06683295295646235
deviation-heading_max1.1875099909278402
deviation-heading_mean0.7646151074648614
deviation-heading_median0.7135251838861169
deviation-heading_min0.4439000711593719
driven_any_max1.8727976444999377
driven_any_mean1.6937365005944625
driven_any_median1.7417816186762245
driven_any_min1.4185851205254636
driven_lanedir_consec_max0.8202960172606562
driven_lanedir_consec_mean0.6775966380080325
driven_lanedir_consec_min0.5305954463036928
driven_lanedir_max0.8202960172606562
driven_lanedir_mean0.6775966380080325
driven_lanedir_median0.6797475442338904
driven_lanedir_min0.5305954463036928
get_duckie_state_max1.855598863705184e-06
get_duckie_state_mean1.6600583503962622e-06
get_duckie_state_median1.6759152884664872e-06
get_duckie_state_min1.43280396094689e-06
get_robot_state_max0.003954582436140193
get_robot_state_mean0.003779905825995664
get_robot_state_median0.003809638894521273
get_robot_state_min0.0035457630787999175
get_state_dump_max0.005140736454822978
get_state_dump_mean0.005050363335942894
get_state_dump_median0.005078166216771803
get_state_dump_min0.004904384455404991
get_ui_image_max0.03691045573500336
get_ui_image_mean0.030869235810513488
get_ui_image_median0.029968346389689187
get_ui_image_min0.02662979472767223
in-drivable-lane_max3.8999999999999897
in-drivable-lane_mean3.437499999999989
in-drivable-lane_min2.6999999999999904
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.8727976444999377, "get_ui_image": 0.02793504840643831, "step_physics": 0.11020859637001688, "survival_time": 6.399999999999985, "driven_lanedir": 0.8202960172606562, "get_state_dump": 0.005094932955364848, "get_robot_state": 0.003954582436140193, "sim_render-ego0": 0.004134069117464761, "get_duckie_state": 1.855598863705184e-06, "in-drivable-lane": 3.5499999999999887, "deviation-heading": 0.9793443487370244, "agent_compute-ego0": 0.013123667517373728, "complete-iteration": 0.1780684881432112, "set_robot_commands": 0.0023390248764392943, "deviation-center-line": 0.30386370794395706, "driven_lanedir_consec": 0.8202960172606562, "sim_compute_sim_state": 0.00900435632513475, "sim_compute_performance-ego0": 0.0021752128305361253}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.7505145859000428, "get_ui_image": 0.03691045573500336, "step_physics": 0.13283096571437647, "survival_time": 6.0499999999999865, "driven_lanedir": 0.5305954463036928, "get_state_dump": 0.005140736454822978, "get_robot_state": 0.003728508949279785, "sim_render-ego0": 0.004027151670612273, "get_duckie_state": 1.6474332965788297e-06, "in-drivable-lane": 3.8999999999999897, "deviation-heading": 1.1875099909278402, "agent_compute-ego0": 0.013479428213150776, "complete-iteration": 0.21052164718753005, "set_robot_commands": 0.0021930620318553486, "deviation-center-line": 0.16504050848925808, "driven_lanedir_consec": 0.5305954463036928, "sim_compute_sim_state": 0.01003797523310927, "sim_compute_performance-ego0": 0.002079506389430312}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4185851205254636, "get_ui_image": 0.032001644372940063, "step_physics": 0.11836981773376463, "survival_time": 5.14999999999999, "driven_lanedir": 0.6777624890922094, "get_state_dump": 0.005061399478178758, "get_robot_state": 0.0038907688397627617, "sim_render-ego0": 0.0042490271421579216, "get_duckie_state": 1.43280396094689e-06, "in-drivable-lane": 2.6999999999999904, "deviation-heading": 0.4439000711593719, "agent_compute-ego0": 0.013462493052849404, "complete-iteration": 0.18985418860728925, "set_robot_commands": 0.002334505319595337, "deviation-center-line": 0.06683295295646235, "driven_lanedir_consec": 0.6777624890922094, "sim_compute_sim_state": 0.008284830130063571, "sim_compute_performance-ego0": 0.0021091126478635347}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.733048651452406, "get_ui_image": 0.02662979472767223, "step_physics": 0.0913037426215558, "survival_time": 5.999999999999987, "driven_lanedir": 0.6817325993755714, "get_state_dump": 0.004904384455404991, "get_robot_state": 0.0035457630787999175, "sim_render-ego0": 0.003864520837452786, "get_duckie_state": 1.7043972803541451e-06, "in-drivable-lane": 3.599999999999987, "deviation-heading": 0.4477060190352093, "agent_compute-ego0": 0.01280422447141537, "complete-iteration": 0.15237619857157558, "set_robot_commands": 0.002233568301870803, "deviation-center-line": 0.06754047478919047, "driven_lanedir_consec": 0.6817325993755714, "sim_compute_sim_state": 0.005032210310628591, "sim_compute_performance-ego0": 0.0019660764489292113}}
set_robot_commands_max0.0023390248764392943
set_robot_commands_mean0.002275040132440196
set_robot_commands_median0.00228403681073307
set_robot_commands_min0.0021930620318553486
sim_compute_performance-ego0_max0.0021752128305361253
sim_compute_performance-ego0_mean0.002082477079189796
sim_compute_performance-ego0_median0.002094309518646923
sim_compute_performance-ego0_min0.0019660764489292113
sim_compute_sim_state_max0.01003797523310927
sim_compute_sim_state_mean0.008089842999734045
sim_compute_sim_state_median0.00864459322759916
sim_compute_sim_state_min0.005032210310628591
sim_render-ego0_max0.0042490271421579216
sim_render-ego0_mean0.004068692191921935
sim_render-ego0_median0.004080610394038517
sim_render-ego0_min0.003864520837452786
simulation-passed1
step_physics_max0.13283096571437647
step_physics_mean0.11317828060992846
step_physics_median0.11428920705189076
step_physics_min0.0913037426215558
survival_time_max6.399999999999985
survival_time_mean5.899999999999987
survival_time_min5.14999999999999
No reset possible
5670911280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:00:51
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5669511283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5667511282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5666211284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5664311284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5662411290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:55
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5660111289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5659611285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5654811425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-010:03:55
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5653511427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-010:00:52
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5649411296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:53
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5647311301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:31
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5644611301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5639011303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:01:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5636611450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-010:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5500311415Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessyesnogpu-prod-011:37:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median13.244289278462052
survival_time_median59.99999999999873
deviation-center-line_median2.8232756558080307
in-drivable-lane_median2.5749999999999824


other stats
agent_compute-ego0_max0.042476465660368376
agent_compute-ego0_mean0.04201942652572937
agent_compute-ego0_median0.04202865958710098
agent_compute-ego0_min0.04149212507681485
agent_compute-ego1_max0.04365318204639953
agent_compute-ego1_mean0.04215592396607371
agent_compute-ego1_median0.0416123354861778
agent_compute-ego1_min0.04151146080372832
complete-iteration_max0.7640384488260616
complete-iteration_mean0.6533257465981767
complete-iteration_median0.736505141166922
complete-iteration_min0.32069305228699824
deviation-center-line_max3.3377121093021103
deviation-center-line_mean2.7951811656811145
deviation-center-line_min1.6753504117871665
deviation-heading_max14.278283768896904
deviation-heading_mean10.925830593870966
deviation-heading_median11.29808991831325
deviation-heading_min5.458199613473701
driven_any_max14.590320002142294
driven_any_mean13.835536669195326
driven_any_median14.590151130839264
driven_any_min9.307535393842445
driven_lanedir_consec_max14.240157955669602
driven_lanedir_consec_mean12.399810283348298
driven_lanedir_consec_min6.987901081338952
driven_lanedir_max14.240157955669602
driven_lanedir_mean12.497155344277534
driven_lanedir_median13.244289278462052
driven_lanedir_min6.987901081338952
get_duckie_state_max1.6167201567053495e-06
get_duckie_state_mean1.5303904114684084e-06
get_duckie_state_median1.5522022231433117e-06
get_duckie_state_min1.427732240548241e-06
get_robot_state_max0.014595755927270894
get_robot_state_mean0.013173287128359674
get_robot_state_median0.014101157478249936
get_robot_state_min0.0072589633108555585
get_state_dump_max0.009640808407214162
get_state_dump_mean0.00900002297621071
get_state_dump_median0.00962150622962615
get_state_dump_min0.006170229893534576
get_ui_image_max0.04630615411451913
get_ui_image_mean0.04124888420658553
get_ui_image_median0.043823813518616285
get_ui_image_min0.027484207469993777
in-drivable-lane_max9.499999999999968
in-drivable-lane_mean3.424999999999943
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 14.5902730432591, "get_ui_image": 0.04049902335491704, "step_physics": 0.33596354082760266, "survival_time": 59.99999999999873, "driven_lanedir": 14.141441985241428, "get_state_dump": 0.00962150622962615, "get_robot_state": 0.013780109888310238, "sim_render-ego0": 0.0035822979119496975, "sim_render-ego1": 0.003666443789035057, "sim_render-ego2": 0.003631472289810371, "sim_render-ego3": 0.0035563605115574463, "get_duckie_state": 1.6167201567053495e-06, "in-drivable-lane": 0.5500000000000078, "deviation-heading": 8.910538068363719, "agent_compute-ego0": 0.04202865958710098, "agent_compute-ego1": 0.0416123354861778, "agent_compute-ego2": 0.04093222177395912, "agent_compute-ego3": 0.041557632814736095, "complete-iteration": 0.6257499969571357, "set_robot_commands": 0.0021311460585518743, "deviation-center-line": 2.733821751657914, "driven_lanedir_consec": 14.141441985241428, "sim_compute_sim_state": 0.028845719354138783, "sim_compute_performance-ego0": 0.0020002826465158837, "sim_compute_performance-ego1": 0.0019195697190461803, "sim_compute_performance-ego2": 0.0019407746793824769, "sim_compute_performance-ego3": 0.0019011009146430709}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 14.590315637034868, "get_ui_image": 0.04049902335491704, "step_physics": 0.33596354082760266, "survival_time": 59.99999999999873, "driven_lanedir": 14.22893005474485, "get_state_dump": 0.00962150622962615, "get_robot_state": 0.013780109888310238, "sim_render-ego0": 0.0035822979119496975, "sim_render-ego1": 0.003666443789035057, "sim_render-ego2": 0.003631472289810371, "sim_render-ego3": 0.0035563605115574463, "get_duckie_state": 1.6167201567053495e-06, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 8.144409722198054, "agent_compute-ego0": 0.04202865958710098, "agent_compute-ego1": 0.0416123354861778, "agent_compute-ego2": 0.04093222177395912, "agent_compute-ego3": 0.041557632814736095, "complete-iteration": 0.6257499969571357, "set_robot_commands": 0.0021311460585518743, "deviation-center-line": 2.55476947818271, "driven_lanedir_consec": 14.22893005474485, "sim_compute_sim_state": 0.028845719354138783, "sim_compute_performance-ego0": 0.0020002826465158837, "sim_compute_performance-ego1": 0.0019195697190461803, "sim_compute_performance-ego2": 0.0019407746793824769, "sim_compute_performance-ego3": 0.0019011009146430709}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 14.590127640767218, "get_ui_image": 0.04049902335491704, "step_physics": 0.33596354082760266, "survival_time": 59.99999999999873, "driven_lanedir": 12.625761572714728, "get_state_dump": 0.00962150622962615, "get_robot_state": 0.013780109888310238, "sim_render-ego0": 0.0035822979119496975, "sim_render-ego1": 0.003666443789035057, "sim_render-ego2": 0.003631472289810371, "sim_render-ego3": 0.0035563605115574463, "get_duckie_state": 1.6167201567053495e-06, "in-drivable-lane": 5.849999999999839, "deviation-heading": 11.342340466666103, "agent_compute-ego0": 0.04202865958710098, "agent_compute-ego1": 0.0416123354861778, "agent_compute-ego2": 0.04093222177395912, "agent_compute-ego3": 0.041557632814736095, "complete-iteration": 0.6257499969571357, "set_robot_commands": 0.0021311460585518743, "deviation-center-line": 2.5598726661459428, "driven_lanedir_consec": 12.625761572714728, "sim_compute_sim_state": 0.028845719354138783, "sim_compute_performance-ego0": 0.0020002826465158837, "sim_compute_performance-ego1": 0.0019195697190461803, "sim_compute_performance-ego2": 0.0019407746793824769, "sim_compute_performance-ego3": 0.0019011009146430709}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 14.590320002142294, "get_ui_image": 0.04049902335491704, "step_physics": 0.33596354082760266, "survival_time": 59.99999999999873, "driven_lanedir": 14.240157955669602, "get_state_dump": 0.00962150622962615, "get_robot_state": 0.013780109888310238, "sim_render-ego0": 0.0035822979119496975, "sim_render-ego1": 0.003666443789035057, "sim_render-ego2": 0.003631472289810371, "sim_render-ego3": 0.0035563605115574463, "get_duckie_state": 1.6167201567053495e-06, "in-drivable-lane": 0.4499999999999744, "deviation-heading": 7.700365314146502, "agent_compute-ego0": 0.04202865958710098, "agent_compute-ego1": 0.0416123354861778, "agent_compute-ego2": 0.04093222177395912, "agent_compute-ego3": 0.041557632814736095, "complete-iteration": 0.6257499969571357, "set_robot_commands": 0.0021311460585518743, "deviation-center-line": 2.5378176698404205, "driven_lanedir_consec": 14.240157955669602, "sim_compute_sim_state": 0.028845719354138783, "sim_compute_performance-ego0": 0.0020002826465158837, "sim_compute_performance-ego1": 0.0019195697190461803, "sim_compute_performance-ego2": 0.0019407746793824769, "sim_compute_performance-ego3": 0.0019011009146430709}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 14.590144647585197, "get_ui_image": 0.04630615411451913, "step_physics": 0.45253008767825975, "survival_time": 59.99999999999873, "driven_lanedir": 13.258694451344738, "get_state_dump": 0.009152650833129885, "get_robot_state": 0.014101157478249936, "sim_render-ego0": 0.003704089109943272, "sim_render-ego1": 0.003660407689687711, "sim_render-ego2": 0.00363542197844468, "sim_render-ego3": 0.00366249826925184, "get_duckie_state": 1.5522022231433117e-06, "in-drivable-lane": 2.7999999999999776, "deviation-heading": 13.120754353129335, "agent_compute-ego0": 0.04149212507681485, "agent_compute-ego1": 0.04151146080372832, "agent_compute-ego2": 0.04158846206410938, "agent_compute-ego3": 0.04089328688844654, "complete-iteration": 0.7640384488260616, "set_robot_commands": 0.002145325909248498, "deviation-center-line": 3.2048200089630243, "driven_lanedir_consec": 13.258694451344738, "sim_compute_sim_state": 0.04499410967544949, "sim_compute_performance-ego0": 0.002163376438925407, "sim_compute_performance-ego1": 0.0019408848561613288, "sim_compute_performance-ego2": 0.001894783318588676, "sim_compute_performance-ego3": 0.0019184530625037607}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 14.590111097542447, "get_ui_image": 0.04630615411451913, "step_physics": 0.45253008767825975, "survival_time": 59.99999999999873, "driven_lanedir": 13.229884105579366, "get_state_dump": 0.009152650833129885, "get_robot_state": 0.014101157478249936, "sim_render-ego0": 0.003704089109943272, "sim_render-ego1": 0.003660407689687711, "sim_render-ego2": 0.00363542197844468, "sim_render-ego3": 0.00366249826925184, "get_duckie_state": 1.5522022231433117e-06, "in-drivable-lane": 2.8999999999999195, "deviation-heading": 13.335821685212204, "agent_compute-ego0": 0.04149212507681485, "agent_compute-ego1": 0.04151146080372832, "agent_compute-ego2": 0.04158846206410938, "agent_compute-ego3": 0.04089328688844654, "complete-iteration": 0.7640384488260616, "set_robot_commands": 0.002145325909248498, "deviation-center-line": 3.282022719765582, "driven_lanedir_consec": 13.229884105579366, "sim_compute_sim_state": 0.04499410967544949, "sim_compute_performance-ego0": 0.002163376438925407, "sim_compute_performance-ego1": 0.0019408848561613288, "sim_compute_performance-ego2": 0.001894783318588676, "sim_compute_performance-ego3": 0.0019184530625037607}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 14.590157614093332, "get_ui_image": 0.04630615411451913, "step_physics": 0.45253008767825975, "survival_time": 59.99999999999873, "driven_lanedir": 13.226162819960347, "get_state_dump": 0.009152650833129885, "get_robot_state": 0.014101157478249936, "sim_render-ego0": 0.003704089109943272, "sim_render-ego1": 0.003660407689687711, "sim_render-ego2": 0.00363542197844468, "sim_render-ego3": 0.00366249826925184, "get_duckie_state": 1.5522022231433117e-06, "in-drivable-lane": 3.0999999999998913, "deviation-heading": 12.503919157748056, "agent_compute-ego0": 0.04149212507681485, "agent_compute-ego1": 0.04151146080372832, "agent_compute-ego2": 0.04158846206410938, "agent_compute-ego3": 0.04089328688844654, "complete-iteration": 0.7640384488260616, "set_robot_commands": 0.002145325909248498, "deviation-center-line": 3.1046431577056612, "driven_lanedir_consec": 13.226162819960347, "sim_compute_sim_state": 0.04499410967544949, "sim_compute_performance-ego0": 0.002163376438925407, "sim_compute_performance-ego1": 0.0019408848561613288, "sim_compute_performance-ego2": 0.001894783318588676, "sim_compute_performance-ego3": 0.0019184530625037607}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 14.590136745179713, "get_ui_image": 0.04630615411451913, "step_physics": 0.45253008767825975, "survival_time": 59.99999999999873, "driven_lanedir": 11.589663841250047, "get_state_dump": 0.009152650833129885, "get_robot_state": 0.014101157478249936, "sim_render-ego0": 0.003704089109943272, "sim_render-ego1": 0.003660407689687711, "sim_render-ego2": 0.00363542197844468, "sim_render-ego3": 0.00366249826925184, "get_duckie_state": 1.5522022231433117e-06, "in-drivable-lane": 9.499999999999968, "deviation-heading": 12.44061494097976, "agent_compute-ego0": 0.04149212507681485, "agent_compute-ego1": 0.04151146080372832, "agent_compute-ego2": 0.04158846206410938, "agent_compute-ego3": 0.04089328688844654, "complete-iteration": 0.7640384488260616, "set_robot_commands": 0.002145325909248498, "deviation-center-line": 2.917440862836468, "driven_lanedir_consec": 10.226832988240714, "sim_compute_sim_state": 0.04499410967544949, "sim_compute_performance-ego0": 0.002163376438925407, "sim_compute_performance-ego1": 0.0019408848561613288, "sim_compute_performance-ego2": 0.001894783318588676, "sim_compute_performance-ego3": 0.0019184530625037607}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 14.590179984837036, "get_ui_image": 0.043823813518616285, "step_physics": 0.4247732908898448, "survival_time": 59.99999999999873, "driven_lanedir": 13.477396919313936, "get_state_dump": 0.009640808407214162, "get_robot_state": 0.014595755927270894, "sim_render-ego0": 0.0037372906341044537, "sim_render-ego1": 0.003715035123293048, "sim_render-ego2": 0.003633532694833265, "sim_render-ego3": 0.0035832934732937397, "get_duckie_state": 1.427732240548241e-06, "in-drivable-lane": 2.349999999999987, "deviation-heading": 11.230386108341875, "agent_compute-ego0": 0.042476465660368376, "agent_compute-ego1": 0.04365318204639953, "agent_compute-ego2": 0.04352678903235087, "agent_compute-ego3": 0.04184373669779172, "complete-iteration": 0.736505141166922, "set_robot_commands": 0.0022057621405583237, "deviation-center-line": 2.7330500862689115, "driven_lanedir_consec": 13.477396919313936, "sim_compute_sim_state": 0.04060926782797021, "sim_compute_performance-ego0": 0.002090642096895064, "sim_compute_performance-ego1": 0.0019315206240257752, "sim_compute_performance-ego2": 0.0019203076056894116, "sim_compute_performance-ego3": 0.0018601600176885067}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 14.590161770609011, "get_ui_image": 0.043823813518616285, "step_physics": 0.4247732908898448, "survival_time": 59.99999999999873, "driven_lanedir": 13.532014385004304, "get_state_dump": 0.009640808407214162, "get_robot_state": 0.014595755927270894, "sim_render-ego0": 0.0037372906341044537, "sim_render-ego1": 0.003715035123293048, "sim_render-ego2": 0.003633532694833265, "sim_render-ego3": 0.0035832934732937397, "get_duckie_state": 1.427732240548241e-06, "in-drivable-lane": 1.4999999999999218, "deviation-heading": 13.19800909632936, "agent_compute-ego0": 0.042476465660368376, "agent_compute-ego1": 0.04365318204639953, "agent_compute-ego2": 0.04352678903235087, "agent_compute-ego3": 0.04184373669779172, "complete-iteration": 0.736505141166922, "set_robot_commands": 0.0022057621405583237, "deviation-center-line": 3.3377121093021103, "driven_lanedir_consec": 13.532014385004304, "sim_compute_sim_state": 0.04060926782797021, "sim_compute_performance-ego0": 0.002090642096895064, "sim_compute_performance-ego1": 0.0019315206240257752, "sim_compute_performance-ego2": 0.0019203076056894116, "sim_compute_performance-ego3": 0.0018601600176885067}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 14.59008591546166, "get_ui_image": 0.043823813518616285, "step_physics": 0.4247732908898448, "survival_time": 59.99999999999873, "driven_lanedir": 11.742222175627491, "get_state_dump": 0.009640808407214162, "get_robot_state": 0.014595755927270894, "sim_render-ego0": 0.0037372906341044537, "sim_render-ego1": 0.003715035123293048, "sim_render-ego2": 0.003633532694833265, "sim_render-ego3": 0.0035832934732937397, "get_duckie_state": 1.427732240548241e-06, "in-drivable-lane": 8.14999999999981, "deviation-heading": 14.278283768896904, "agent_compute-ego0": 0.042476465660368376, "agent_compute-ego1": 0.04365318204639953, "agent_compute-ego2": 0.04352678903235087, "agent_compute-ego3": 0.04184373669779172, "complete-iteration": 0.736505141166922, "set_robot_commands": 0.0022057621405583237, "deviation-center-line": 3.0299202863350287, "driven_lanedir_consec": 11.742222175627491, "sim_compute_sim_state": 0.04060926782797021, "sim_compute_performance-ego0": 0.002090642096895064, "sim_compute_performance-ego1": 0.0019315206240257752, "sim_compute_performance-ego2": 0.0019203076056894116, "sim_compute_performance-ego3": 0.0018601600176885067}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 14.590163721317085, "get_ui_image": 0.043823813518616285, "step_physics": 0.4247732908898448, "survival_time": 59.99999999999873, "driven_lanedir": 13.50178349867005, "get_state_dump": 0.009640808407214162, "get_robot_state": 0.014595755927270894, "sim_render-ego0": 0.0037372906341044537, "sim_render-ego1": 0.003715035123293048, "sim_render-ego2": 0.003633532694833265, "sim_render-ego3": 0.0035832934732937397, "get_duckie_state": 1.427732240548241e-06, "in-drivable-lane": 2.249999999999975, "deviation-heading": 11.253839369960398, "agent_compute-ego0": 0.042476465660368376, "agent_compute-ego1": 0.04365318204639953, "agent_compute-ego2": 0.04352678903235087, "agent_compute-ego3": 0.04184373669779172, "complete-iteration": 0.736505141166922, "set_robot_commands": 0.0022057621405583237, "deviation-center-line": 2.912729559958148, "driven_lanedir_consec": 13.50178349867005, "sim_compute_sim_state": 0.04060926782797021, "sim_compute_performance-ego0": 0.002090642096895064, "sim_compute_performance-ego1": 0.0019315206240257752, "sim_compute_performance-ego2": 0.0019203076056894116, "sim_compute_performance-ego3": 0.0018601600176885067}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 9.307800155063164, "get_ui_image": 0.027484207469993777, "step_physics": 0.1704720415527032, "survival_time": 39.09999999999992, "driven_lanedir": 9.178159973425672, "get_state_dump": 0.006170229893534576, "get_robot_state": 0.0072589633108555585, "sim_render-ego0": 0.003687015742938942, "sim_render-ego1": 0.003763295072553106, "get_duckie_state": 1.5194236394850535e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.458199613473701, "agent_compute-ego0": 0.04214148503153717, "agent_compute-ego1": 0.04153751108990471, "complete-iteration": 0.32069305228699824, "set_robot_commands": 0.002227135544992498, "deviation-center-line": 1.6753504117871665, "driven_lanedir_consec": 9.178159973425672, "sim_compute_sim_state": 0.009526036860537865, "sim_compute_performance-ego0": 0.002050848908503546, "sim_compute_performance-ego1": 0.0020252915330012337}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 9.307535393842445, "get_ui_image": 0.027484207469993777, "step_physics": 0.1704720415527032, "survival_time": 39.09999999999992, "driven_lanedir": 6.987901081338952, "get_state_dump": 0.006170229893534576, "get_robot_state": 0.0072589633108555585, "sim_render-ego0": 0.003687015742938942, "sim_render-ego1": 0.003763295072553106, "get_duckie_state": 1.5194236394850535e-06, "in-drivable-lane": 8.099999999999937, "deviation-heading": 10.044146648747548, "agent_compute-ego0": 0.04214148503153717, "agent_compute-ego1": 0.04153751108990471, "complete-iteration": 0.32069305228699824, "set_robot_commands": 0.002227135544992498, "deviation-center-line": 2.548565550786516, "driven_lanedir_consec": 6.987901081338952, "sim_compute_sim_state": 0.009526036860537865, "sim_compute_performance-ego0": 0.002050848908503546, "sim_compute_performance-ego1": 0.0020252915330012337}}
set_robot_commands_max0.002227135544992498
set_robot_commands_mean0.0021702291088156987
set_robot_commands_median0.002145325909248498
set_robot_commands_min0.0021311460585518743
sim_compute_performance-ego0_max0.002163376438925407
sim_compute_performance-ego0_mean0.002079921610453751
sim_compute_performance-ego0_median0.002090642096895064
sim_compute_performance-ego0_min0.0020002826465158837
sim_compute_performance-ego1_max0.0020252915330012337
sim_compute_performance-ego1_mean0.0019441774187811144
sim_compute_performance-ego1_median0.0019315206240257752
sim_compute_performance-ego1_min0.0019195697190461803
sim_compute_sim_state_max0.04499410967544949
sim_compute_sim_state_mean0.034060604367950685
sim_compute_sim_state_median0.04060926782797021
sim_compute_sim_state_min0.009526036860537865
sim_render-ego0_max0.0037372906341044537
sim_render-ego0_mean0.0036763387221333977
sim_render-ego0_median0.003704089109943272
sim_render-ego0_min0.0035822979119496975
sim_render-ego1_max0.003763295072553106
sim_render-ego1_mean0.003692438325226392
sim_render-ego1_median0.003666443789035057
sim_render-ego1_min0.003660407689687711
simulation-passed1
step_physics_max0.45253008767825975
step_physics_mean0.3710008400491596
step_physics_median0.4247732908898448
step_physics_min0.1704720415527032
survival_time_max59.99999999999873
survival_time_mean57.01428571428461
survival_time_min39.09999999999992
No reset possible
5496011310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:01:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5479611364Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:23:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.571986646754615
survival_time_median46.149999999999515
deviation-center-line_median1.3205397512507124
in-drivable-lane_median21.57499999999952


other stats
agent_compute-ego0_max0.01246491474532696
agent_compute-ego0_mean0.01208605689773606
agent_compute-ego0_median0.01207000186799109
agent_compute-ego0_min0.011739309109635087
complete-iteration_max0.19970941904454853
complete-iteration_mean0.18197642000313216
complete-iteration_median0.18668604756266957
complete-iteration_min0.15482416584264094
deviation-center-line_max1.5510174064510092
deviation-center-line_mean1.09697325718876
deviation-center-line_min0.1957961198026068
deviation-heading_max8.29833563423779
deviation-heading_mean5.4509679645952005
deviation-heading_median6.330581590430018
deviation-heading_min0.8443730432829774
driven_any_max8.775401514599674
driven_any_mean6.611485856059145
driven_any_median8.007397050274738
driven_any_min1.655747809087429
driven_lanedir_consec_max4.049026317675331
driven_lanedir_consec_mean2.4708814700579804
driven_lanedir_consec_min0.6905262690473606
driven_lanedir_max5.649389782785773
driven_lanedir_mean2.911369230322565
driven_lanedir_median2.6527804347285633
driven_lanedir_min0.6905262690473606
get_duckie_state_max2.3972612556804716e-06
get_duckie_state_mean2.147961491819672e-06
get_duckie_state_median2.0970229928835117e-06
get_duckie_state_min2.000538725831193e-06
get_robot_state_max0.003876959640010214
get_robot_state_mean0.003742959548897019
get_robot_state_median0.0037509553931255896
get_robot_state_min0.0035929677693266847
get_state_dump_max0.004871420374311183
get_state_dump_mean0.004712300147136386
get_state_dump_median0.004717847322517773
get_state_dump_min0.004542085569198818
get_ui_image_max0.03498219050228868
get_ui_image_mean0.030613743019719343
get_ui_image_median0.03135107036445887
get_ui_image_min0.02477064084767097
in-drivable-lane_max38.149999999999054
in-drivable-lane_mean21.849999999999525
in-drivable-lane_min6.100000000000011
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.889677394090437, "get_ui_image": 0.029435995996624335, "step_physics": 0.10859999884802374, "survival_time": 42.799999999999706, "driven_lanedir": 5.649389782785773, "get_state_dump": 0.004832303927409329, "get_robot_state": 0.003828922814777601, "sim_render-ego0": 0.004047920990435357, "get_duckie_state": 2.3972612556804716e-06, "in-drivable-lane": 14.049999999999953, "deviation-heading": 5.618777752740711, "agent_compute-ego0": 0.012096054495563308, "complete-iteration": 0.17871652823484904, "set_robot_commands": 0.0022877731568059397, "deviation-center-line": 1.463952276147149, "driven_lanedir_consec": 4.049026317675331, "sim_compute_sim_state": 0.011372487213953793, "sim_compute_performance-ego0": 0.0021252974328805573}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.775401514599674, "get_ui_image": 0.03498219050228868, "step_physics": 0.11899897039753116, "survival_time": 54.69999999999903, "driven_lanedir": 2.508089889929645, "get_state_dump": 0.004542085569198818, "get_robot_state": 0.0035929677693266847, "sim_render-ego0": 0.003950169750544579, "get_duckie_state": 2.000538725831193e-06, "in-drivable-lane": 38.149999999999054, "deviation-heading": 7.042385428119325, "agent_compute-ego0": 0.012043949240418874, "complete-iteration": 0.1946555668904901, "set_robot_commands": 0.0021974911972812324, "deviation-center-line": 1.1771272263542756, "driven_lanedir_consec": 2.478584598846174, "sim_compute_sim_state": 0.01228532660497378, "sim_compute_performance-ego0": 0.0019784825033248832}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.125116706459039, "get_ui_image": 0.0332661447322934, "step_physics": 0.122809256602729, "survival_time": 49.499999999999325, "driven_lanedir": 2.7974709795274815, "get_state_dump": 0.004871420374311183, "get_robot_state": 0.003876959640010214, "sim_render-ego0": 0.0041257988672805, "get_duckie_state": 2.095004023023619e-06, "in-drivable-lane": 29.099999999999092, "deviation-heading": 8.29833563423779, "agent_compute-ego0": 0.01246491474532696, "complete-iteration": 0.19970941904454853, "set_robot_commands": 0.002372190762239797, "deviation-center-line": 1.5510174064510092, "driven_lanedir_consec": 2.6653886946630556, "sim_compute_sim_state": 0.013642716961118696, "sim_compute_performance-ego0": 0.0021911420446832776}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.655747809087429, "get_ui_image": 0.02477064084767097, "step_physics": 0.09719041004851836, "survival_time": 9.900000000000006, "driven_lanedir": 0.6905262690473606, "get_state_dump": 0.004603390717626217, "get_robot_state": 0.003672987971473578, "sim_render-ego0": 0.00376772161704212, "get_duckie_state": 2.0990419627434045e-06, "in-drivable-lane": 6.100000000000011, "deviation-heading": 0.8443730432829774, "agent_compute-ego0": 0.011739309109635087, "complete-iteration": 0.15482416584264094, "set_robot_commands": 0.002120093484619754, "deviation-center-line": 0.1957961198026068, "driven_lanedir_consec": 0.6905262690473606, "sim_compute_sim_state": 0.004990272186509329, "sim_compute_performance-ego0": 0.0018886812967271664}}
set_robot_commands_max0.002372190762239797
set_robot_commands_mean0.0022443871502366808
set_robot_commands_median0.002242632177043586
set_robot_commands_min0.002120093484619754
sim_compute_performance-ego0_max0.0021911420446832776
sim_compute_performance-ego0_mean0.002045900819403971
sim_compute_performance-ego0_median0.0020518899681027203
sim_compute_performance-ego0_min0.0018886812967271664
sim_compute_sim_state_max0.013642716961118696
sim_compute_sim_state_mean0.0105727007416389
sim_compute_sim_state_median0.011828906909463786
sim_compute_sim_state_min0.004990272186509329
sim_render-ego0_max0.0041257988672805
sim_render-ego0_mean0.003972902806325639
sim_render-ego0_median0.003999045370489968
sim_render-ego0_min0.00376772161704212
simulation-passed1
step_physics_max0.122809256602729
step_physics_mean0.11189965897420057
step_physics_median0.11379948462277743
step_physics_min0.09719041004851836
survival_time_max54.69999999999903
survival_time_mean39.22499999999952
survival_time_min9.900000000000006
No reset possible
5479111439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5474611378Martin Cote 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:05:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3735098497077224
survival_time_median8.449999999999994
deviation-center-line_median0.1877038000014591
in-drivable-lane_median5.724999999999997


other stats
agent_compute-ego0_max0.013081988707411714
agent_compute-ego0_mean0.012575534444533937
agent_compute-ego0_median0.01257315855617671
agent_compute-ego0_min0.012073831958370609
complete-iteration_max0.2519035450247831
complete-iteration_mean0.19560209393841255
complete-iteration_median0.18503558160291156
complete-iteration_min0.16043366752304397
deviation-center-line_max0.2197532882518168
deviation-center-line_mean0.1634535081138885
deviation-center-line_min0.05865314420081917
deviation-heading_max1.1849342268916745
deviation-heading_mean0.775236670392483
deviation-heading_median0.7415953969118713
deviation-heading_min0.4328216608545152
driven_any_max3.4276373952285133
driven_any_mean2.033708301871556
driven_any_median2.2032746886569514
driven_any_min0.30064643494380905
driven_lanedir_consec_max0.8294769900123494
driven_lanedir_consec_mean0.42865651606426386
driven_lanedir_consec_min0.13812937482926113
driven_lanedir_max0.8294769900123494
driven_lanedir_mean0.4287394862988954
driven_lanedir_median0.3736757901769856
driven_lanedir_min0.13812937482926113
get_duckie_state_max1.450841741044392e-06
get_duckie_state_mean1.354330135305968e-06
get_duckie_state_median1.3430189516393514e-06
get_duckie_state_min1.2804408969007774e-06
get_robot_state_max0.003733162952558643
get_robot_state_mean0.0036177604499027607
get_robot_state_median0.0036435956527671497
get_robot_state_min0.0034506875415181004
get_state_dump_max0.004593360242504759
get_state_dump_mean0.00450710214567946
get_state_dump_median0.004574995015173764
get_state_dump_min0.004285058309865552
get_ui_image_max0.034054240515065747
get_ui_image_mean0.030242821568353263
get_ui_image_median0.030229732969437394
get_ui_image_min0.02645757981947252
in-drivable-lane_max11.500000000000044
in-drivable-lane_mean6.01250000000001
in-drivable-lane_min1.1000000000000003
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.4276373952285133, "get_ui_image": 0.028394602065862612, "step_physics": 0.10916310779808104, "survival_time": 12.850000000000048, "driven_lanedir": 0.20689749393587387, "get_state_dump": 0.004583215528680373, "get_robot_state": 0.003672974054203477, "sim_render-ego0": 0.003952204719070316, "get_duckie_state": 1.450841741044392e-06, "in-drivable-lane": 11.500000000000044, "deviation-heading": 0.8256279095265344, "agent_compute-ego0": 0.01254390468893125, "complete-iteration": 0.17626169023587723, "set_robot_commands": 0.002214592556620753, "deviation-center-line": 0.16189174191471556, "driven_lanedir_consec": 0.20656561299734744, "sim_compute_sim_state": 0.009644711664480755, "sim_compute_performance-ego0": 0.002005217611327652}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.30064643494380905, "get_ui_image": 0.034054240515065747, "step_physics": 0.1816753065863321, "survival_time": 2.1000000000000005, "driven_lanedir": 0.13812937482926113, "get_state_dump": 0.004285058309865552, "get_robot_state": 0.0034506875415181004, "sim_render-ego0": 0.003609535305999046, "get_duckie_state": 1.397243765897529e-06, "in-drivable-lane": 1.1000000000000003, "deviation-heading": 0.6575628842972081, "agent_compute-ego0": 0.012602412423422173, "complete-iteration": 0.2519035450247831, "set_robot_commands": 0.002151910648789517, "deviation-center-line": 0.05865314420081917, "driven_lanedir_consec": 0.13812937482926113, "sim_compute_sim_state": 0.008180457492207372, "sim_compute_performance-ego0": 0.0018101459325746048}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.601338900661425, "get_ui_image": 0.032064863873012175, "step_physics": 0.12148840294271555, "survival_time": 9.800000000000004, "driven_lanedir": 0.8294769900123494, "get_state_dump": 0.004593360242504759, "get_robot_state": 0.003733162952558643, "sim_render-ego0": 0.0040209886386309785, "get_duckie_state": 1.2804408969007774e-06, "in-drivable-lane": 6.550000000000011, "deviation-heading": 1.1849342268916745, "agent_compute-ego0": 0.013081988707411714, "complete-iteration": 0.1938094729699459, "set_robot_commands": 0.0022279441659220586, "deviation-center-line": 0.21351585808820264, "driven_lanedir_consec": 0.8294769900123494, "sim_compute_sim_state": 0.01051069637240492, "sim_compute_performance-ego0": 0.0020027172746997193}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8052104766524772, "get_ui_image": 0.02645757981947252, "step_physics": 0.10111361283522384, "survival_time": 7.099999999999983, "driven_lanedir": 0.5404540864180973, "get_state_dump": 0.004566774501667156, "get_robot_state": 0.0036142172513308223, "sim_render-ego0": 0.0037230728389499902, "get_duckie_state": 1.2887941373811736e-06, "in-drivable-lane": 4.899999999999983, "deviation-heading": 0.4328216608545152, "agent_compute-ego0": 0.012073831958370609, "complete-iteration": 0.16043366752304397, "set_robot_commands": 0.002039380840488247, "deviation-center-line": 0.2197532882518168, "driven_lanedir_consec": 0.5404540864180973, "sim_compute_sim_state": 0.004879547999455378, "sim_compute_performance-ego0": 0.0018845171361536416}}
set_robot_commands_max0.0022279441659220586
set_robot_commands_mean0.0021584570529551437
set_robot_commands_median0.0021832516027051347
set_robot_commands_min0.002039380840488247
sim_compute_performance-ego0_max0.002005217611327652
sim_compute_performance-ego0_mean0.001925649488688904
sim_compute_performance-ego0_median0.0019436172054266804
sim_compute_performance-ego0_min0.0018101459325746048
sim_compute_sim_state_max0.01051069637240492
sim_compute_sim_state_mean0.008303853382137107
sim_compute_sim_state_median0.008912584578344065
sim_compute_sim_state_min0.004879547999455378
sim_render-ego0_max0.0040209886386309785
sim_render-ego0_mean0.003826450375662583
sim_render-ego0_median0.0038376387790101537
sim_render-ego0_min0.003609535305999046
simulation-passed1
step_physics_max0.1816753065863321
step_physics_mean0.12836010754058813
step_physics_median0.1153257553703983
step_physics_min0.10111361283522384
survival_time_max12.850000000000048
survival_time_mean7.962500000000009
survival_time_min2.1000000000000005
No reset possible
5473011424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:02:08
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5467311398Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:06:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5463411435Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:02:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5460211437Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:04:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5458111441Riccardo Tresa 🇮🇹template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.01277542445394728
agent_compute-ego0_mean0.01129575640189588
agent_compute-ego0_median0.011132206507416694
agent_compute-ego0_min0.010143188138802849
complete-iteration_max0.21908852587575495
complete-iteration_mean0.1919689137406138
complete-iteration_median0.19597734990837537
complete-iteration_min0.1568324292699496
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.4007091522216797e-06
get_duckie_state_mean1.310985422619897e-06
get_duckie_state_median1.3292951116735094e-06
get_duckie_state_min1.1846423149108889e-06
get_robot_state_max0.004108955462773641
get_robot_state_mean0.0038176661398630143
get_robot_state_median0.00377200631630834
get_robot_state_min0.003617696464061737
get_state_dump_max0.00519210762447781
get_state_dump_mean0.004874872505488959
get_state_dump_median0.004900480405800147
get_state_dump_min0.004506421585877736
get_ui_image_max0.03678705381310504
get_ui_image_mean0.03174583541681218
get_ui_image_median0.03172966401955917
get_ui_image_min0.02673695981502533
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.03009736990626854, "step_physics": 0.10994501204430304, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004817618599420861, "get_robot_state": 0.003753527810301962, "sim_render-ego0": 0.004013248636752744, "get_duckie_state": 1.3550625571721717e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.011394609378862984, "complete-iteration": 0.1786645515055596, "set_robot_commands": 0.0022947063928917995, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.010179471366013153, "sim_compute_performance-ego0": 0.002077377295192284}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03678705381310504, "step_physics": 0.14475294558898263, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.004983342212179433, "get_robot_state": 0.0037904848223147183, "sim_render-ego0": 0.003984453885451607, "get_duckie_state": 1.3035276661748472e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.010869803635970406, "complete-iteration": 0.21908852587575495, "set_robot_commands": 0.0022876936456431513, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.009410319120987602, "sim_compute_performance-ego0": 0.0021285622016243315}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.0333619581328498, "step_physics": 0.1413861314455668, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.00519210762447781, "get_robot_state": 0.004108955462773641, "sim_render-ego0": 0.004063636064529419, "get_duckie_state": 1.4007091522216797e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.01277542445394728, "complete-iteration": 0.2132901483111911, "set_robot_commands": 0.0022888249821133083, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007960041364034018, "sim_compute_performance-ego0": 0.002060145139694214}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.02673695981502533, "step_physics": 0.0992841050028801, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004506421585877736, "get_robot_state": 0.003617696464061737, "sim_render-ego0": 0.003679310282071432, "get_duckie_state": 1.1846423149108889e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.010143188138802849, "complete-iteration": 0.1568324292699496, "set_robot_commands": 0.0020785058538118997, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.004844933748245239, "sim_compute_performance-ego0": 0.0018586938579877217}}
set_robot_commands_max0.0022947063928917995
set_robot_commands_mean0.0022374327186150396
set_robot_commands_median0.00228825931387823
set_robot_commands_min0.0020785058538118997
sim_compute_performance-ego0_max0.0021285622016243315
sim_compute_performance-ego0_mean0.0020311946236246377
sim_compute_performance-ego0_median0.002068761217443249
sim_compute_performance-ego0_min0.0018586938579877217
sim_compute_sim_state_max0.010179471366013153
sim_compute_sim_state_mean0.008098691399820003
sim_compute_sim_state_median0.00868518024251081
sim_compute_sim_state_min0.004844933748245239
sim_render-ego0_max0.004063636064529419
sim_render-ego0_mean0.0039351622172013
sim_render-ego0_median0.003998851261102176
sim_render-ego0_min0.003679310282071432
simulation-passed1
step_physics_max0.14475294558898263
step_physics_mean0.12384204852043317
step_physics_median0.12566557174493492
step_physics_min0.0992841050028801
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5457611449Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:00:57
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5455011451Aleksandar Petrov 🇨🇭exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:05:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.48892942179856824
survival_time_median5.249999999999989
deviation-center-line_median0.13191648840869452
in-drivable-lane_median3.2499999999999902


other stats
agent_compute-ego0_max0.04777259296841092
agent_compute-ego0_mean0.030075958202050848
agent_compute-ego0_median0.029706710617230167
agent_compute-ego0_min0.013117818605332149
complete-iteration_max0.2274235549725984
complete-iteration_mean0.19693824855563927
complete-iteration_median0.19729751723298805
complete-iteration_min0.1657344047839825
deviation-center-line_max0.1643959468172477
deviation-center-line_mean0.12557847619610993
deviation-center-line_min0.07408498114980296
deviation-heading_max1.3085060007319516
deviation-heading_mean0.8127054713150081
deviation-heading_median0.7946842392500675
deviation-heading_min0.35294740602794605
driven_any_max3.0258559942245338
driven_any_mean1.7592592311392878
driven_any_median1.470999276751933
driven_any_min1.0691823768287514
driven_lanedir_consec_max0.6494315759471684
driven_lanedir_consec_mean0.4751876951392385
driven_lanedir_consec_min0.27346036101264914
driven_lanedir_max0.6494315759471684
driven_lanedir_mean0.4751876951392385
driven_lanedir_median0.48892942179856824
driven_lanedir_min0.27346036101264914
get_duckie_state_max2.451432056916066e-06
get_duckie_state_mean2.1316846043214294e-06
get_duckie_state_median2.1228787372109365e-06
get_duckie_state_min1.8295488859477797e-06
get_robot_state_max0.004004254227592831
get_robot_state_mean0.003677327894634364
get_robot_state_median0.0036002784605450957
get_robot_state_min0.003504500429854434
get_state_dump_max0.0051885758127485
get_state_dump_mean0.00474305758074986
get_state_dump_median0.004678324713558965
get_state_dump_min0.004427005083133013
get_ui_image_max0.03402750868546335
get_ui_image_mean0.030589455419377017
get_ui_image_median0.03113597749353765
get_ui_image_min0.02605835800496941
in-drivable-lane_max8.100000000000005
in-drivable-lane_mean4.099999999999995
in-drivable-lane_min1.7999999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0258559942245338, "get_ui_image": 0.02919624768770658, "step_physics": 0.0958752644367707, "survival_time": 9.700000000000005, "driven_lanedir": 0.27346036101264914, "get_state_dump": 0.004905314323229668, "get_robot_state": 0.003688969978919396, "sim_render-ego0": 0.003862629181299454, "get_duckie_state": 2.451432056916066e-06, "in-drivable-lane": 8.100000000000005, "deviation-heading": 1.175100072434885, "agent_compute-ego0": 0.01417686633574657, "complete-iteration": 0.1657344047839825, "set_robot_commands": 0.0022238853650215344, "deviation-center-line": 0.1643959468172477, "driven_lanedir_consec": 0.27346036101264914, "sim_compute_sim_state": 0.009698194112533176, "sim_compute_performance-ego0": 0.0020156249021872495}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.278825974691371, "get_ui_image": 0.03402750868546335, "step_physics": 0.12363645653975636, "survival_time": 4.699999999999991, "driven_lanedir": 0.3629620387619259, "get_state_dump": 0.004451335103888261, "get_robot_state": 0.0035115869421707955, "sim_render-ego0": 0.003570897955643503, "get_duckie_state": 1.8295488859477797e-06, "in-drivable-lane": 2.8499999999999934, "deviation-heading": 1.3085060007319516, "agent_compute-ego0": 0.04523655489871376, "complete-iteration": 0.2274235549725984, "set_robot_commands": 0.002058495973285876, "deviation-center-line": 0.1429278448490799, "driven_lanedir_consec": 0.3629620387619259, "sim_compute_sim_state": 0.009031782652202404, "sim_compute_performance-ego0": 0.001816197445518092}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0691823768287514, "get_ui_image": 0.03307570729936872, "step_physics": 0.13602177869705928, "survival_time": 4.149999999999993, "driven_lanedir": 0.6494315759471684, "get_state_dump": 0.0051885758127485, "get_robot_state": 0.004004254227592831, "sim_render-ego0": 0.004192111038026356, "get_duckie_state": 2.330257779075986e-06, "in-drivable-lane": 1.7999999999999936, "deviation-heading": 0.41426840606525006, "agent_compute-ego0": 0.013117818605332149, "complete-iteration": 0.20829757906141735, "set_robot_commands": 0.002323579220544724, "deviation-center-line": 0.07408498114980296, "driven_lanedir_consec": 0.6494315759471684, "sim_compute_sim_state": 0.008063157399495443, "sim_compute_performance-ego0": 0.0022113436744326635}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6631725788124958, "get_ui_image": 0.02605835800496941, "step_physics": 0.09201313899113582, "survival_time": 5.799999999999987, "driven_lanedir": 0.6148968048352106, "get_state_dump": 0.004427005083133013, "get_robot_state": 0.003504500429854434, "sim_render-ego0": 0.0035718465462709083, "get_duckie_state": 1.9154996953458867e-06, "in-drivable-lane": 3.649999999999987, "deviation-heading": 0.35294740602794605, "agent_compute-ego0": 0.04777259296841092, "complete-iteration": 0.18629745540455875, "set_robot_commands": 0.0021860823672041935, "deviation-center-line": 0.12090513196830915, "driven_lanedir_consec": 0.6148968048352106, "sim_compute_sim_state": 0.00483600094787076, "sim_compute_performance-ego0": 0.0018445365449302215}}
set_robot_commands_max0.002323579220544724
set_robot_commands_mean0.0021980107315140818
set_robot_commands_median0.002204983866112864
set_robot_commands_min0.002058495973285876
sim_compute_performance-ego0_max0.0022113436744326635
sim_compute_performance-ego0_mean0.001971925641767057
sim_compute_performance-ego0_median0.0019300807235587355
sim_compute_performance-ego0_min0.001816197445518092
sim_compute_sim_state_max0.009698194112533176
sim_compute_sim_state_mean0.007907283778025447
sim_compute_sim_state_median0.008547470025848925
sim_compute_sim_state_min0.00483600094787076
sim_render-ego0_max0.004192111038026356
sim_render-ego0_mean0.0037993711803100553
sim_render-ego0_median0.003717237863785182
sim_render-ego0_min0.003570897955643503
simulation-passed1
step_physics_max0.13602177869705928
step_physics_mean0.11188665966618054
step_physics_median0.10975586048826354
step_physics_min0.09201313899113582
survival_time_max9.700000000000005
survival_time_mean6.087499999999993
survival_time_min4.149999999999993
No reset possible
5448411501Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:24:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.200443100271357
survival_time_median38.749999999999936
deviation-center-line_median1.9805486107751524
in-drivable-lane_median9.624999999999748


other stats
agent_compute-ego0_max0.0135766338175676
agent_compute-ego0_mean0.012948868692097756
agent_compute-ego0_median0.01297846755695168
agent_compute-ego0_min0.01226190583692006
complete-iteration_max0.21320751481031247
complete-iteration_mean0.18395571529910804
complete-iteration_median0.181643166607595
complete-iteration_min0.1593290131709297
deviation-center-line_max3.394949458838365
deviation-center-line_mean1.884558294463144
deviation-center-line_min0.1821864974639064
deviation-heading_max9.548483504109871
deviation-heading_mean6.785968947079059
deviation-heading_median8.449145772204162
deviation-heading_min0.697100739798043
driven_any_max11.134780384663612
driven_any_mean6.504692904683246
driven_any_median5.663836966670533
driven_any_min3.556317300728308
driven_lanedir_consec_max9.671139649073313
driven_lanedir_consec_mean4.681776108823559
driven_lanedir_consec_min0.6550785856782096
driven_lanedir_max9.671139649073313
driven_lanedir_mean4.681776108823559
driven_lanedir_median4.200443100271357
driven_lanedir_min0.6550785856782096
get_duckie_state_max2.203859048446423e-06
get_duckie_state_mean2.1435808285831005e-06
get_duckie_state_median2.158305147353995e-06
get_duckie_state_min2.0538539711779895e-06
get_robot_state_max0.003965556152223602
get_robot_state_mean0.003847586027135829
get_robot_state_median0.003827218273203801
get_robot_state_min0.00377035140991211
get_state_dump_max0.004820436004578598
get_state_dump_mean0.004745424371332241
get_state_dump_median0.004756176216184889
get_state_dump_min0.004648909048380586
get_ui_image_max0.03787632668829713
get_ui_image_mean0.03176871437782601
get_ui_image_median0.031491582563768813
get_ui_image_min0.02621536569546927
in-drivable-lane_max22.700000000000227
in-drivable-lane_mean12.362499999999825
in-drivable-lane_min7.499999999999574
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.134780384663612, "get_ui_image": 0.028426077443296765, "step_physics": 0.09720609408433392, "survival_time": 59.99999999999873, "driven_lanedir": 9.671139649073313, "get_state_dump": 0.0046986114174797575, "get_robot_state": 0.0037855895532358697, "sim_render-ego0": 0.003866723336149116, "get_duckie_state": 2.0538539711779895e-06, "in-drivable-lane": 7.499999999999574, "deviation-heading": 9.548483504109871, "agent_compute-ego0": 0.01226190583692006, "complete-iteration": 0.16411178733387358, "set_robot_commands": 0.0022872572238995174, "deviation-center-line": 3.394949458838365, "driven_lanedir_consec": 9.671139649073313, "sim_compute_sim_state": 0.00939525533576095, "sim_compute_performance-ego0": 0.0021012508303398496}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.417410479591464, "get_ui_image": 0.03787632668829713, "step_physics": 0.13315846876324158, "survival_time": 38.14999999999997, "driven_lanedir": 3.97786632423637, "get_state_dump": 0.004813741014890021, "get_robot_state": 0.003868846993171732, "sim_render-ego0": 0.003971356684000705, "get_duckie_state": 2.188208215523765e-06, "in-drivable-lane": 9.499999999999822, "deviation-heading": 7.503228543679034, "agent_compute-ego0": 0.013192783787612516, "complete-iteration": 0.21320751481031247, "set_robot_commands": 0.0023140426705645016, "deviation-center-line": 1.8703189463926888, "driven_lanedir_consec": 3.97786632423637, "sim_compute_sim_state": 0.011773348790812866, "sim_compute_performance-ego0": 0.002148323034116735}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.556317300728308, "get_ui_image": 0.034557087684240866, "step_physics": 0.12227480007907536, "survival_time": 25.350000000000225, "driven_lanedir": 0.6550785856782096, "get_state_dump": 0.004820436004578598, "get_robot_state": 0.003965556152223602, "sim_render-ego0": 0.00414717525947751, "get_duckie_state": 2.1284020791842244e-06, "in-drivable-lane": 22.700000000000227, "deviation-heading": 0.697100739798043, "agent_compute-ego0": 0.0135766338175676, "complete-iteration": 0.1991745458813164, "set_robot_commands": 0.002472938984397828, "deviation-center-line": 0.1821864974639064, "driven_lanedir_consec": 0.6550785856782096, "sim_compute_sim_state": 0.011124776104303796, "sim_compute_performance-ego0": 0.002143758019124429}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.910263453749602, "get_ui_image": 0.02621536569546927, "step_physics": 0.09765137149597788, "survival_time": 39.3499999999999, "driven_lanedir": 4.423019876306346, "get_state_dump": 0.004648909048380586, "get_robot_state": 0.00377035140991211, "sim_render-ego0": 0.00383055512675174, "get_duckie_state": 2.203859048446423e-06, "in-drivable-lane": 9.749999999999671, "deviation-heading": 9.395063000729287, "agent_compute-ego0": 0.012764151326290846, "complete-iteration": 0.1593290131709297, "set_robot_commands": 0.002204968239450213, "deviation-center-line": 2.090778275157616, "driven_lanedir_consec": 4.423019876306346, "sim_compute_sim_state": 0.00610399518521304, "sim_compute_performance-ego0": 0.002050178910269955}}
set_robot_commands_max0.002472938984397828
set_robot_commands_mean0.0023198017795780152
set_robot_commands_median0.0023006499472320095
set_robot_commands_min0.002204968239450213
sim_compute_performance-ego0_max0.002148323034116735
sim_compute_performance-ego0_mean0.0021108776984627422
sim_compute_performance-ego0_median0.002122504424732139
sim_compute_performance-ego0_min0.002050178910269955
sim_compute_sim_state_max0.011773348790812866
sim_compute_sim_state_mean0.009599343854022665
sim_compute_sim_state_median0.010260015720032371
sim_compute_sim_state_min0.00610399518521304
sim_render-ego0_max0.00414717525947751
sim_render-ego0_mean0.003953952601594768
sim_render-ego0_median0.00391904001007491
sim_render-ego0_min0.00383055512675174
simulation-passed1
step_physics_max0.13315846876324158
step_physics_mean0.11257268360565718
step_physics_median0.10996308578752662
step_physics_min0.09720609408433392
survival_time_max59.99999999999873
survival_time_mean40.71249999999971
survival_time_min25.350000000000225
No reset possible
5440911554Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:36:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.18075384362875
survival_time_median59.99999999999873
deviation-center-line_median4.011598292875796
in-drivable-lane_median1.624999999999936


other stats
agent_compute-ego0_max0.01284810679833995
agent_compute-ego0_mean0.012235998003100776
agent_compute-ego0_median0.01228679427497095
agent_compute-ego0_min0.011522296664121247
complete-iteration_max0.22344956290811227
complete-iteration_mean0.19621044103715535
complete-iteration_median0.19716840509307065
complete-iteration_min0.16705539105436784
deviation-center-line_max4.311711063825556
deviation-center-line_mean3.877329432770365
deviation-center-line_min3.174410081504312
deviation-heading_max12.838486008630031
deviation-heading_mean12.073341830744646
deviation-heading_median12.202520002066864
deviation-heading_min11.049841310214823
driven_any_max11.87267372292744
driven_any_mean10.83438815251441
driven_any_median10.745196706636465
driven_any_min9.974485473857277
driven_lanedir_consec_max11.28578253848749
driven_lanedir_consec_mean10.002601646746731
driven_lanedir_consec_min8.363116361241948
driven_lanedir_max11.28578253848749
driven_lanedir_mean10.002601646746731
driven_lanedir_median10.18075384362875
driven_lanedir_min8.363116361241948
get_duckie_state_max1.4317025749212896e-06
get_duckie_state_mean1.367923757006161e-06
get_duckie_state_median1.3920878454540567e-06
get_duckie_state_min1.255816762195241e-06
get_robot_state_max0.003858797357640199
get_robot_state_mean0.00381242957903283
get_robot_state_median0.0038271834107064338
get_robot_state_min0.003736554137078253
get_state_dump_max0.0049024511651568755
get_state_dump_mean0.004803582740997216
get_state_dump_median0.0047821683947192346
get_state_dump_min0.004747543009393519
get_ui_image_max0.03635542954533027
get_ui_image_mean0.030996264532811537
get_ui_image_median0.03065666462930433
get_ui_image_min0.0263162993273072
in-drivable-lane_max7.599999999999568
in-drivable-lane_mean2.71249999999986
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.87267372292744, "get_ui_image": 0.02872345509080466, "step_physics": 0.11501853035252656, "survival_time": 59.99999999999873, "driven_lanedir": 11.28578253848749, "get_state_dump": 0.004793676706674593, "get_robot_state": 0.003858797357640199, "sim_render-ego0": 0.003938799992290564, "get_duckie_state": 1.367383158077904e-06, "in-drivable-lane": 0.8000000000000114, "deviation-heading": 12.838486008630031, "agent_compute-ego0": 0.012505900750648568, "complete-iteration": 0.18298483788222697, "set_robot_commands": 0.0023501965525148313, "deviation-center-line": 3.174410081504312, "driven_lanedir_consec": 11.28578253848749, "sim_compute_sim_state": 0.009563719997993617, "sim_compute_performance-ego0": 0.0021350074072463824}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.80384010932002, "get_ui_image": 0.03635542954533027, "step_physics": 0.14416566280203, "survival_time": 59.99999999999873, "driven_lanedir": 9.947915649531897, "get_state_dump": 0.004747543009393519, "get_robot_state": 0.003796703908763063, "sim_render-ego0": 0.003944672712378458, "get_duckie_state": 1.4317025749212896e-06, "in-drivable-lane": 2.4499999999998607, "deviation-heading": 12.837097902098062, "agent_compute-ego0": 0.012067687799293332, "complete-iteration": 0.22344956290811227, "set_robot_commands": 0.0023113099065648823, "deviation-center-line": 4.284939251128854, "driven_lanedir_consec": 9.947915649531897, "sim_compute_sim_state": 0.013859623973316, "sim_compute_performance-ego0": 0.0021030160410021067}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.974485473857277, "get_ui_image": 0.032589874167804005, "step_physics": 0.13476589418226673, "survival_time": 57.29999999999888, "driven_lanedir": 8.363116361241948, "get_state_dump": 0.0049024511651568755, "get_robot_state": 0.0038576629126498047, "sim_render-ego0": 0.003996123203320824, "get_duckie_state": 1.4167925328302091e-06, "in-drivable-lane": 7.599999999999568, "deviation-heading": 11.567942102035666, "agent_compute-ego0": 0.01284810679833995, "complete-iteration": 0.2113519723039143, "set_robot_commands": 0.002336010479781559, "deviation-center-line": 3.738257334622737, "driven_lanedir_consec": 8.363116361241948, "sim_compute_sim_state": 0.013766235544459136, "sim_compute_performance-ego0": 0.0021807758727069512}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.686553303952907, "get_ui_image": 0.0263162993273072, "step_physics": 0.10631946024549296, "survival_time": 59.99999999999873, "driven_lanedir": 10.413592037725603, "get_state_dump": 0.004770660082763875, "get_robot_state": 0.003736554137078253, "sim_render-ego0": 0.0038183396503788346, "get_duckie_state": 1.255816762195241e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.049841310214823, "agent_compute-ego0": 0.011522296664121247, "complete-iteration": 0.16705539105436784, "set_robot_commands": 0.002230191210922254, "deviation-center-line": 4.311711063825556, "driven_lanedir_consec": 10.413592037725603, "sim_compute_sim_state": 0.006250668326385015, "sim_compute_performance-ego0": 0.00199847713695974}}
set_robot_commands_max0.0023501965525148313
set_robot_commands_mean0.0023069270374458817
set_robot_commands_median0.0023236601931732204
set_robot_commands_min0.002230191210922254
sim_compute_performance-ego0_max0.0021807758727069512
sim_compute_performance-ego0_mean0.002104319114478795
sim_compute_performance-ego0_median0.002119011724124245
sim_compute_performance-ego0_min0.00199847713695974
sim_compute_sim_state_max0.013859623973316
sim_compute_sim_state_mean0.01086006196053844
sim_compute_sim_state_median0.011664977771226374
sim_compute_sim_state_min0.006250668326385015
sim_render-ego0_max0.003996123203320824
sim_render-ego0_mean0.00392448388959217
sim_render-ego0_median0.003941736352334511
sim_render-ego0_min0.0038183396503788346
simulation-passed1
step_physics_max0.14416566280203
step_physics_mean0.12506738689557906
step_physics_median0.12489221226739664
step_physics_min0.10631946024549296
survival_time_max59.99999999999873
survival_time_mean59.32499999999877
survival_time_min57.29999999999888
No reset possible
5438511624Anthony Courchesne 🇨🇦TNetR1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:02:21
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5427711607Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:31:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.25996355614934
survival_time_median59.99999999999873
deviation-center-line_median3.6649571594661943
in-drivable-lane_median0.30000000000000426


other stats
agent_compute-ego0_max0.012978677249371658
agent_compute-ego0_mean0.012506193542320826
agent_compute-ego0_median0.012453861379504305
agent_compute-ego0_min0.012138374160903045
complete-iteration_max0.2100120801711261
complete-iteration_mean0.18457290358813988
complete-iteration_median0.18400696770790745
complete-iteration_min0.1602655987656186
deviation-center-line_max4.275095065974609
deviation-center-line_mean3.273869036375696
deviation-center-line_min1.4904667605957858
deviation-heading_max13.859888039430038
deviation-heading_mean10.863265322951836
deviation-heading_median12.20222284420635
deviation-heading_min5.1887275639646075
driven_any_max13.31605678364395
driven_any_mean10.79822329975086
driven_any_median11.69689900699927
driven_any_min6.483038401360945
driven_lanedir_consec_max12.93653939600602
driven_lanedir_consec_mean9.819317492030825
driven_lanedir_consec_min3.8208034598186
driven_lanedir_max12.93653939600602
driven_lanedir_mean9.819317492030825
driven_lanedir_median11.25996355614934
driven_lanedir_min3.8208034598186
get_duckie_state_max1.2935349387392015e-06
get_duckie_state_mean1.2101224886234263e-06
get_duckie_state_median1.23854580767248e-06
get_duckie_state_min1.069863400409545e-06
get_robot_state_max0.003810342007334485
get_robot_state_mean0.0035924959708113313
get_robot_state_median0.00362541931654194
get_robot_state_min0.0033088032428269594
get_state_dump_max0.0046980384982297264
get_state_dump_mean0.004550627033334431
get_state_dump_median0.0046355031511368695
get_state_dump_min0.004233463332834258
get_ui_image_max0.03333971601640255
get_ui_image_mean0.029836113544084095
get_ui_image_median0.03030425124095729
get_ui_image_min0.025396235678019272
in-drivable-lane_max12.40000000000007
in-drivable-lane_mean3.2500000000000195
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 13.31605678364395, "get_ui_image": 0.028427364228667068, "step_physics": 0.11285701004492056, "survival_time": 59.99999999999873, "driven_lanedir": 12.93653939600602, "get_state_dump": 0.0046980384982297264, "get_robot_state": 0.003704511355003846, "sim_render-ego0": 0.00379934418112114, "get_duckie_state": 1.2935349387392015e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.956361836978044, "agent_compute-ego0": 0.012706191811732308, "complete-iteration": 0.18023825922576117, "set_robot_commands": 0.002260305403074952, "deviation-center-line": 3.170899677582569, "driven_lanedir_consec": 12.93653939600602, "sim_compute_sim_state": 0.009686206798569349, "sim_compute_performance-ego0": 0.0020057394740782015}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.483038401360945, "get_ui_image": 0.032181138253247504, "step_physics": 0.11844877514505173, "survival_time": 33.500000000000234, "driven_lanedir": 3.8208034598186, "get_state_dump": 0.004233463332834258, "get_robot_state": 0.0033088032428269594, "sim_render-ego0": 0.0034447046754612475, "get_duckie_state": 1.069863400409545e-06, "in-drivable-lane": 12.40000000000007, "deviation-heading": 5.1887275639646075, "agent_compute-ego0": 0.012138374160903045, "complete-iteration": 0.18777567619005364, "set_robot_commands": 0.001959711535321618, "deviation-center-line": 1.4904667605957858, "driven_lanedir_consec": 3.8208034598186, "sim_compute_sim_state": 0.01020505282633706, "sim_compute_performance-ego0": 0.0017746948094375088}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.897893119637692, "get_ui_image": 0.03333971601640255, "step_physics": 0.13367351425577462, "survival_time": 59.99999999999873, "driven_lanedir": 11.38280627180812, "get_state_dump": 0.004684620951732728, "get_robot_state": 0.003810342007334485, "sim_render-ego0": 0.0038879562873427418, "get_duckie_state": 1.2802343185894892e-06, "in-drivable-lane": 0.6000000000000085, "deviation-heading": 13.859888039430038, "agent_compute-ego0": 0.012978677249371658, "complete-iteration": 0.2100120801711261, "set_robot_commands": 0.0023159236336230834, "deviation-center-line": 4.15901464134982, "driven_lanedir_consec": 11.38280627180812, "sim_compute_sim_state": 0.013145067808927845, "sim_compute_performance-ego0": 0.0020820647850322486}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.495904894360846, "get_ui_image": 0.025396235678019272, "step_physics": 0.10067438702102904, "survival_time": 59.99999999999873, "driven_lanedir": 11.13712084049056, "get_state_dump": 0.004586385350541012, "get_robot_state": 0.0035463272780800344, "sim_render-ego0": 0.003643887525394894, "get_duckie_state": 1.1968572967554706e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.448083851434657, "agent_compute-ego0": 0.012201530947276298, "complete-iteration": 0.1602655987656186, "set_robot_commands": 0.0021351622502869313, "deviation-center-line": 4.275095065974609, "driven_lanedir_consec": 11.13712084049056, "sim_compute_sim_state": 0.006099509557617594, "sim_compute_performance-ego0": 0.0018957941657200543}}
set_robot_commands_max0.0023159236336230834
set_robot_commands_mean0.002167775705576646
set_robot_commands_median0.002197733826680942
set_robot_commands_min0.001959711535321618
sim_compute_performance-ego0_max0.0020820647850322486
sim_compute_performance-ego0_mean0.001939573308567003
sim_compute_performance-ego0_median0.001950766819899128
sim_compute_performance-ego0_min0.0017746948094375088
sim_compute_sim_state_max0.013145067808927845
sim_compute_sim_state_mean0.00978395924786296
sim_compute_sim_state_median0.009945629812453205
sim_compute_sim_state_min0.006099509557617594
sim_render-ego0_max0.0038879562873427418
sim_render-ego0_mean0.003693973167330006
sim_render-ego0_median0.003721615853258018
sim_render-ego0_min0.0034447046754612475
simulation-passed1
step_physics_max0.13367351425577462
step_physics_mean0.116413421616694
step_physics_median0.11565289259498614
step_physics_min0.10067438702102904
survival_time_max59.99999999999873
survival_time_mean53.374999999999105
survival_time_min33.500000000000234
No reset possible
5421911634Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:15:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.779191738958391
survival_time_median17.825000000000117
deviation-center-line_median0.6213399650139809
in-drivable-lane_median9.275000000000112


other stats
agent_compute-ego0_max0.012919818843729608
agent_compute-ego0_mean0.01189153658415329
agent_compute-ego0_median0.01163196456648388
agent_compute-ego0_min0.01138239835991579
complete-iteration_max0.22636989169411412
complete-iteration_mean0.1925649370817748
complete-iteration_median0.19161052569570017
complete-iteration_min0.16066880524158478
deviation-center-line_max3.3073931222282527
deviation-center-line_mean1.1809143011310124
deviation-center-line_min0.17358415226783486
deviation-heading_max10.980486716316744
deviation-heading_mean4.249090285015543
deviation-heading_median2.4896630018456345
deviation-heading_min1.0365484200541597
driven_any_max13.966472109461211
driven_any_mean5.599604829999033
driven_any_median3.5157630570530953
driven_any_min1.400421096428732
driven_lanedir_consec_max11.24566706855322
driven_lanedir_consec_mean3.858570352667992
driven_lanedir_consec_min0.6302308642019705
driven_lanedir_max11.24566706855322
driven_lanedir_mean3.85894717968041
driven_lanedir_median1.7799453929832254
driven_lanedir_min0.6302308642019705
get_duckie_state_max1.461188357247725e-06
get_duckie_state_mean1.2859607442428532e-06
get_duckie_state_median1.2487870176829604e-06
get_duckie_state_min1.1850805843577666e-06
get_robot_state_max0.0040229626218567585
get_robot_state_mean0.003698250136632057
get_robot_state_median0.0036287128820785422
get_robot_state_min0.003512612160514382
get_state_dump_max0.0050211307964798555
get_state_dump_mean0.004748699624319232
get_state_dump_median0.0047234811372343765
get_state_dump_min0.004526705426328322
get_ui_image_max0.0348872276062661
get_ui_image_mean0.030723729641352553
get_ui_image_median0.03137023079922573
get_ui_image_min0.02526722936069264
in-drivable-lane_max12.599999999999664
in-drivable-lane_mean8.749999999999968
in-drivable-lane_min3.8499999999999863
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 13.966472109461211, "get_ui_image": 0.0281301890682122, "step_physics": 0.11046187784352172, "survival_time": 59.99999999999873, "driven_lanedir": 11.24566706855322, "get_state_dump": 0.004716840810720172, "get_robot_state": 0.003678930292121576, "sim_render-ego0": 0.0037572413658123033, "get_duckie_state": 1.288572020772891e-06, "in-drivable-lane": 12.599999999999664, "deviation-heading": 10.980486716316744, "agent_compute-ego0": 0.011717773893294384, "complete-iteration": 0.17586864480170283, "set_robot_commands": 0.00220908908224622, "deviation-center-line": 3.3073931222282527, "driven_lanedir_consec": 11.24566706855322, "sim_compute_sim_state": 0.009134806363806936, "sim_compute_performance-ego0": 0.001977661070875284}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.400421096428732, "get_ui_image": 0.0348872276062661, "step_physics": 0.13527195504371156, "survival_time": 6.999999999999983, "driven_lanedir": 0.6302308642019705, "get_state_dump": 0.00473012146374858, "get_robot_state": 0.0035784954720355093, "sim_render-ego0": 0.003723481022719796, "get_duckie_state": 1.2090020145930297e-06, "in-drivable-lane": 3.8499999999999863, "deviation-heading": 1.0365484200541597, "agent_compute-ego0": 0.01154615523967337, "complete-iteration": 0.20735240658969745, "set_robot_commands": 0.002279743235161964, "deviation-center-line": 0.17358415226783486, "driven_lanedir_consec": 0.6302308642019705, "sim_compute_sim_state": 0.009338201360499603, "sim_compute_performance-ego0": 0.0019168464850026663}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.305586874550505, "get_ui_image": 0.03461027253023927, "step_physics": 0.14932156201140875, "survival_time": 22.10000000000018, "driven_lanedir": 2.2602589322625786, "get_state_dump": 0.0050211307964798555, "get_robot_state": 0.0040229626218567585, "sim_render-ego0": 0.004073561717909561, "get_duckie_state": 1.461188357247725e-06, "in-drivable-lane": 11.050000000000155, "deviation-heading": 2.5368128957616993, "agent_compute-ego0": 0.012919818843729608, "complete-iteration": 0.22636989169411412, "set_robot_commands": 0.0024230609359913433, "deviation-center-line": 0.8461421798225324, "driven_lanedir_consec": 2.2602589322625786, "sim_compute_sim_state": 0.011700657635725378, "sim_compute_performance-ego0": 0.0021837828659849834}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.725939239555686, "get_ui_image": 0.02526722936069264, "step_physics": 0.10266614836805008, "survival_time": 13.550000000000058, "driven_lanedir": 1.2996318537038722, "get_state_dump": 0.004526705426328322, "get_robot_state": 0.003512612160514382, "sim_render-ego0": 0.003662478397874271, "get_duckie_state": 1.1850805843577666e-06, "in-drivable-lane": 7.5000000000000675, "deviation-heading": 2.4425131079295697, "agent_compute-ego0": 0.01138239835991579, "complete-iteration": 0.16066880524158478, "set_robot_commands": 0.0021775619072072648, "deviation-center-line": 0.3965377502054294, "driven_lanedir_consec": 1.298124545654203, "sim_compute_sim_state": 0.005489075008560629, "sim_compute_performance-ego0": 0.0019043894375071807}}
set_robot_commands_max0.0024230609359913433
set_robot_commands_mean0.002272363790151698
set_robot_commands_median0.002244416158704092
set_robot_commands_min0.0021775619072072648
sim_compute_performance-ego0_max0.0021837828659849834
sim_compute_performance-ego0_mean0.0019956699648425286
sim_compute_performance-ego0_median0.001947253777938975
sim_compute_performance-ego0_min0.0019043894375071807
sim_compute_sim_state_max0.011700657635725378
sim_compute_sim_state_mean0.008915685092148136
sim_compute_sim_state_median0.009236503862153267
sim_compute_sim_state_min0.005489075008560629
sim_render-ego0_max0.004073561717909561
sim_render-ego0_mean0.0038041906260789823
sim_render-ego0_median0.0037403611942660496
sim_render-ego0_min0.003662478397874271
simulation-passed1
step_physics_max0.14932156201140875
step_physics_mean0.12443038581667304
step_physics_median0.12286691644361664
step_physics_min0.10266614836805008
survival_time_max59.99999999999873
survival_time_mean25.66249999999974
survival_time_min6.999999999999983
No reset possible
5413311674Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:36:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.422971098043155
survival_time_median59.99999999999873
deviation-center-line_median3.1059731121398917
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013466444738103786
agent_compute-ego0_mean0.012851713896790311
agent_compute-ego0_median0.012674661202792026
agent_compute-ego0_min0.012591088443473416
complete-iteration_max0.21148772481875455
complete-iteration_mean0.19157210565625776
complete-iteration_median0.19509605871052865
complete-iteration_min0.16460858038521925
deviation-center-line_max3.490052090239994
deviation-center-line_mean3.1549722853700795
deviation-center-line_min2.9178908269605386
deviation-heading_max16.510312701095863
deviation-heading_mean15.1770748655521
deviation-heading_median16.068404156131848
deviation-heading_min12.061178448848835
driven_any_max9.86781528442897
driven_any_mean8.134695140332198
driven_any_median7.760792875647922
driven_any_min7.1493795256039805
driven_lanedir_consec_max9.614950484698465
driven_lanedir_consec_mean7.825720984071061
driven_lanedir_consec_min6.841991255499471
driven_lanedir_max9.614950484698465
driven_lanedir_mean7.825720984071061
driven_lanedir_median7.422971098043155
driven_lanedir_min6.841991255499471
get_duckie_state_max1.4521497969424894e-06
get_duckie_state_mean1.372048300966236e-06
get_duckie_state_median1.3608321063623738e-06
get_duckie_state_min1.3143791941977064e-06
get_robot_state_max0.004171846510468672
get_robot_state_mean0.0039728747914970965
get_robot_state_median0.003936207066169884
get_robot_state_min0.0038472385231799423
get_state_dump_max0.005217082891535699
get_state_dump_mean0.0049781711969050044
get_state_dump_median0.004947101742302151
get_state_dump_min0.004801398411480017
get_ui_image_max0.037301386325782185
get_ui_image_mean0.03231339788158966
get_ui_image_median0.03202570725440185
get_ui_image_min0.02790079069177277
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.86781528442897, "get_ui_image": 0.0293771440440868, "step_physics": 0.11308986241374784, "survival_time": 59.99999999999873, "driven_lanedir": 9.614950484698465, "get_state_dump": 0.004976687681466515, "get_robot_state": 0.0039060159487887087, "sim_render-ego0": 0.003858620082210442, "get_duckie_state": 1.368375741671166e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.061178448848835, "agent_compute-ego0": 0.012591088443473416, "complete-iteration": 0.18196035761519536, "set_robot_commands": 0.002324941851118026, "deviation-center-line": 3.490052090239994, "driven_lanedir_consec": 9.614950484698465, "sim_compute_sim_state": 0.009640062976935622, "sim_compute_performance-ego0": 0.002095197460037981}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.432445434715294, "get_ui_image": 0.037301386325782185, "step_physics": 0.12847332751919685, "survival_time": 59.99999999999873, "driven_lanedir": 7.106473844121279, "get_state_dump": 0.004801398411480017, "get_robot_state": 0.0038472385231799423, "sim_render-ego0": 0.0038601409187920383, "get_duckie_state": 1.3143791941977064e-06, "in-drivable-lane": 0.0, "deviation-heading": 16.510312701095863, "agent_compute-ego0": 0.012699793220856704, "complete-iteration": 0.20823175980586195, "set_robot_commands": 0.002279825750536764, "deviation-center-line": 2.9271094834900047, "driven_lanedir_consec": 7.106473844121279, "sim_compute_sim_state": 0.012806225577361578, "sim_compute_performance-ego0": 0.002065887260595825}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.089140316580549, "get_ui_image": 0.034674270464716904, "step_physics": 0.13040241889413648, "survival_time": 59.99999999999873, "driven_lanedir": 7.739468351965032, "get_state_dump": 0.005217082891535699, "get_robot_state": 0.004171846510468672, "sim_render-ego0": 0.004236966148204947, "get_duckie_state": 1.4521497969424894e-06, "in-drivable-lane": 0.0, "deviation-heading": 15.899785747054306, "agent_compute-ego0": 0.013466444738103786, "complete-iteration": 0.21148772481875455, "set_robot_commands": 0.002565497065662445, "deviation-center-line": 2.9178908269605386, "driven_lanedir_consec": 7.739468351965032, "sim_compute_sim_state": 0.014288782577133495, "sim_compute_performance-ego0": 0.002351553215770102}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.1493795256039805, "get_ui_image": 0.02790079069177277, "step_physics": 0.1000939749559693, "survival_time": 59.99999999999873, "driven_lanedir": 6.841991255499471, "get_state_dump": 0.004917515803137786, "get_robot_state": 0.003966398183551061, "sim_render-ego0": 0.0039717140642431354, "get_duckie_state": 1.3532884710535816e-06, "in-drivable-lane": 0.0, "deviation-heading": 16.237022565209394, "agent_compute-ego0": 0.012649529184727348, "complete-iteration": 0.16460858038521925, "set_robot_commands": 0.0024014380849668327, "deviation-center-line": 3.284836740789779, "driven_lanedir_consec": 6.841991255499471, "sim_compute_sim_state": 0.0064776229620178375, "sim_compute_performance-ego0": 0.0021341976575509993}}
set_robot_commands_max0.002565497065662445
set_robot_commands_mean0.002392925688071017
set_robot_commands_median0.002363189968042429
set_robot_commands_min0.002279825750536764
sim_compute_performance-ego0_max0.002351553215770102
sim_compute_performance-ego0_mean0.0021617088984887266
sim_compute_performance-ego0_median0.0021146975587944903
sim_compute_performance-ego0_min0.002065887260595825
sim_compute_sim_state_max0.014288782577133495
sim_compute_sim_state_mean0.010803173523362134
sim_compute_sim_state_median0.0112231442771486
sim_compute_sim_state_min0.0064776229620178375
sim_render-ego0_max0.004236966148204947
sim_render-ego0_mean0.003981860303362641
sim_render-ego0_median0.003915927491517587
sim_render-ego0_min0.003858620082210442
simulation-passed1
step_physics_max0.13040241889413648
step_physics_mean0.11801489594576262
step_physics_median0.12078159496647234
step_physics_min0.1000939749559693
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5407211675Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:18:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.269756884370164
survival_time_median24.475000000000215
deviation-center-line_median1.1039935972360992
in-drivable-lane_median11.624999999999982


other stats
agent_compute-ego0_max0.013677723161519623
agent_compute-ego0_mean0.01310182425759266
agent_compute-ego0_median0.0132064110721083
agent_compute-ego0_min0.012316751724634416
complete-iteration_max0.30385475582546656
complete-iteration_mean0.25816895171515847
complete-iteration_median0.254065890238833
complete-iteration_min0.22068927055750137
deviation-center-line_max3.1103203328393674
deviation-center-line_mean1.4782153356864964
deviation-center-line_min0.5945538154344197
deviation-heading_max12.864700291117664
deviation-heading_mean5.94100657633068
deviation-heading_median4.202560237742563
deviation-heading_min2.4942055387199313
driven_any_max18.92338167886757
driven_any_mean10.36140720693052
driven_any_median9.25486300698032
driven_any_min4.012521134893869
driven_lanedir_consec_max13.249195901415716
driven_lanedir_consec_mean5.795192271513033
driven_lanedir_consec_min1.3920594158960895
driven_lanedir_max13.249195901415716
driven_lanedir_mean5.963192412795429
driven_lanedir_median4.271450961211802
driven_lanedir_min2.0606718273423947
get_duckie_state_max1.927761182393113e-06
get_duckie_state_mean1.7845731994374835e-06
get_duckie_state_median1.756495666076848e-06
get_duckie_state_min1.697540283203125e-06
get_robot_state_max0.003989041668095001
get_robot_state_mean0.003856078328179008
get_robot_state_median0.003869611845275384
get_robot_state_min0.0036960479540702625
get_state_dump_max0.00496637127170824
get_state_dump_mean0.0048569379864601275
get_state_dump_median0.004890118151060713
get_state_dump_min0.004681144372010842
get_ui_image_max0.03867942174275716
get_ui_image_mean0.03249229149349839
get_ui_image_median0.03174515820813185
get_ui_image_min0.027799427814972705
in-drivable-lane_max13.050000000000091
in-drivable-lane_mean10.325000000000022
in-drivable-lane_min5.000000000000031
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 18.92338167886757, "get_ui_image": 0.027799427814972705, "step_physics": 0.15512892234019743, "survival_time": 48.69999999999937, "driven_lanedir": 13.249195901415716, "get_state_dump": 0.004681144372010842, "get_robot_state": 0.0036960479540702625, "sim_render-ego0": 0.0036769262949625657, "get_duckie_state": 1.697540283203125e-06, "in-drivable-lane": 11.799999999999882, "deviation-heading": 12.864700291117664, "agent_compute-ego0": 0.012316751724634416, "complete-iteration": 0.22068927055750137, "set_robot_commands": 0.002207922079624274, "deviation-center-line": 3.1103203328393674, "driven_lanedir_consec": 13.249195901415716, "sim_compute_sim_state": 0.009130479127932816, "sim_compute_performance-ego0": 0.0019629752330290965}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.012521134893869, "get_ui_image": 0.03867942174275716, "step_physics": 0.22296652687920465, "survival_time": 11.200000000000024, "driven_lanedir": 2.0606718273423947, "get_state_dump": 0.004858170615302192, "get_robot_state": 0.0038346534305148654, "sim_render-ego0": 0.003893103069729275, "get_duckie_state": 1.7876095241970483e-06, "in-drivable-lane": 5.000000000000031, "deviation-heading": 2.4942055387199313, "agent_compute-ego0": 0.013363348642985023, "complete-iteration": 0.30385475582546656, "set_robot_commands": 0.0023308499654134114, "deviation-center-line": 0.6476971716732902, "driven_lanedir_consec": 1.3920594158960895, "sim_compute_sim_state": 0.011770984861585829, "sim_compute_performance-ego0": 0.0020630762312147354}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.125976792069164, "get_ui_image": 0.03509947045208656, "step_physics": 0.19432783086005956, "survival_time": 29.15000000000028, "driven_lanedir": 6.368966438783994, "get_state_dump": 0.00496637127170824, "get_robot_state": 0.003989041668095001, "sim_render-ego0": 0.004151023005786007, "get_duckie_state": 1.927761182393113e-06, "in-drivable-lane": 11.45000000000008, "deviation-heading": 5.272547996983932, "agent_compute-ego0": 0.013049473501231573, "complete-iteration": 0.2745761957070599, "set_robot_commands": 0.0024699429943136975, "deviation-center-line": 1.560290022798908, "driven_lanedir_consec": 6.368966438783994, "sim_compute_sim_state": 0.014212863494272102, "sim_compute_performance-ego0": 0.002209687886172778}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.383749221891476, "get_ui_image": 0.02839084596417713, "step_physics": 0.16748942776350892, "survival_time": 19.800000000000143, "driven_lanedir": 2.1739354836396103, "get_state_dump": 0.004922065686819235, "get_robot_state": 0.0039045702600359017, "sim_render-ego0": 0.003939524105273807, "get_duckie_state": 1.7253818079566477e-06, "in-drivable-lane": 13.050000000000091, "deviation-heading": 3.1325724785011926, "agent_compute-ego0": 0.013677723161519623, "complete-iteration": 0.2335555847706062, "set_robot_commands": 0.002399834937953228, "deviation-center-line": 0.5945538154344197, "driven_lanedir_consec": 2.170547329956334, "sim_compute_sim_state": 0.006625390473180814, "sim_compute_performance-ego0": 0.0021115598510434708}}
set_robot_commands_max0.0024699429943136975
set_robot_commands_mean0.0023521374943261527
set_robot_commands_median0.0023653424516833195
set_robot_commands_min0.002207922079624274
sim_compute_performance-ego0_max0.002209687886172778
sim_compute_performance-ego0_mean0.00208682480036502
sim_compute_performance-ego0_median0.002087318041129103
sim_compute_performance-ego0_min0.0019629752330290965
sim_compute_sim_state_max0.014212863494272102
sim_compute_sim_state_mean0.01043492948924289
sim_compute_sim_state_median0.010450731994759325
sim_compute_sim_state_min0.006625390473180814
sim_render-ego0_max0.004151023005786007
sim_render-ego0_mean0.003915144118937914
sim_render-ego0_median0.003916313587501541
sim_render-ego0_min0.0036769262949625657
simulation-passed1
step_physics_max0.22296652687920465
step_physics_mean0.18497817696074265
step_physics_median0.18090862931178425
step_physics_min0.15512892234019743
survival_time_max48.69999999999937
survival_time_mean27.212499999999956
survival_time_min11.200000000000024
No reset possible
5403911685Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:11:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6706546993259925
survival_time_median16.150000000000095
deviation-center-line_median0.64989606872603
in-drivable-lane_median5.950000000000058


other stats
agent_compute-ego0_max0.012398028574070009
agent_compute-ego0_mean0.012123029776681426
agent_compute-ego0_median0.012211906323688113
agent_compute-ego0_min0.011670277885279473
complete-iteration_max0.2885586490137292
complete-iteration_mean0.24015075299796684
complete-iteration_median0.23937417236325548
complete-iteration_min0.19329601825162723
deviation-center-line_max1.057022309900119
deviation-center-line_mean0.6948440906480796
deviation-center-line_min0.4225619152401393
deviation-heading_max4.184950343243092
deviation-heading_mean2.6792940747659917
deviation-heading_median2.44138345201677
deviation-heading_min1.6494590517873338
driven_any_max6.864469364596763
driven_any_mean5.767077118094661
driven_any_median5.969217161112958
driven_any_min4.265404785555964
driven_lanedir_consec_max4.945830084725377
driven_lanedir_consec_mean2.8547798160795153
driven_lanedir_consec_min1.1319797809406982
driven_lanedir_max4.945830084725377
driven_lanedir_mean2.917526674917978
driven_lanedir_median2.6706546993259925
driven_lanedir_min1.38296721629455
get_duckie_state_max1.3850365412657527e-06
get_duckie_state_mean1.325619933428026e-06
get_duckie_state_median1.3215321193322738e-06
get_duckie_state_min1.2743789537818032e-06
get_robot_state_max0.003898511040943726
get_robot_state_mean0.003763413541867885
get_robot_state_median0.0037551875054171622
get_robot_state_min0.003644768115693489
get_state_dump_max0.004845351732077719
get_state_dump_mean0.004762423105251459
get_state_dump_median0.004809701859939982
get_state_dump_min0.004584936969048154
get_ui_image_max0.03737547251013105
get_ui_image_mean0.0312916242550067
get_ui_image_median0.030764847429508423
get_ui_image_min0.026261329650878903
in-drivable-lane_max12.5000000000001
in-drivable-lane_mean7.275000000000068
in-drivable-lane_min4.700000000000051
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.864469364596763, "get_ui_image": 0.028709076405870816, "step_physics": 0.1508928793977327, "survival_time": 18.300000000000125, "driven_lanedir": 4.945830084725377, "get_state_dump": 0.00478762436952513, "get_robot_state": 0.0037803493988286577, "sim_render-ego0": 0.003801954539660212, "get_duckie_state": 1.3850365412657527e-06, "in-drivable-lane": 4.700000000000051, "deviation-heading": 4.184950343243092, "agent_compute-ego0": 0.01222037619401064, "complete-iteration": 0.2187800829676906, "set_robot_commands": 0.002236301307782165, "deviation-center-line": 1.057022309900119, "driven_lanedir_consec": 4.945830084725377, "sim_compute_sim_state": 0.010222686408975794, "sim_compute_performance-ego0": 0.002034352975580283}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.665608858406539, "get_ui_image": 0.03737547251013105, "step_physics": 0.21003064600009363, "survival_time": 15.400000000000084, "driven_lanedir": 3.2132961565056526, "get_state_dump": 0.004831779350354833, "get_robot_state": 0.003898511040943726, "sim_render-ego0": 0.004029334170147053, "get_duckie_state": 1.3417796409631625e-06, "in-drivable-lane": 6.2000000000000695, "deviation-heading": 3.0620501685481165, "agent_compute-ego0": 0.012203436453365584, "complete-iteration": 0.2885586490137292, "set_robot_commands": 0.002445046569922981, "deviation-center-line": 0.6480419739562775, "driven_lanedir_consec": 3.2132961565056526, "sim_compute_sim_state": 0.011449233613739508, "sim_compute_performance-ego0": 0.0022026088245478263}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.265404785555964, "get_ui_image": 0.03282061845314603, "step_physics": 0.1872674787745756, "survival_time": 11.850000000000032, "driven_lanedir": 2.128013242146333, "get_state_dump": 0.004845351732077719, "get_robot_state": 0.0037300256120056663, "sim_render-ego0": 0.003788869921900645, "get_duckie_state": 1.3012845977013853e-06, "in-drivable-lane": 5.700000000000047, "deviation-heading": 1.8207167354854237, "agent_compute-ego0": 0.012398028574070009, "complete-iteration": 0.2599682617588204, "set_robot_commands": 0.0022268305305673296, "deviation-center-line": 0.6517501634957826, "driven_lanedir_consec": 2.128013242146333, "sim_compute_sim_state": 0.010745074568676348, "sim_compute_performance-ego0": 0.0020530303987134403}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.272825463819376, "get_ui_image": 0.026261329650878903, "step_physics": 0.1330059664790961, "survival_time": 16.900000000000105, "driven_lanedir": 1.38296721629455, "get_state_dump": 0.004584936969048154, "get_robot_state": 0.003644768115693489, "sim_render-ego0": 0.003675686574615208, "get_duckie_state": 1.2743789537818032e-06, "in-drivable-lane": 12.5000000000001, "deviation-heading": 1.6494590517873338, "agent_compute-ego0": 0.011670277885279473, "complete-iteration": 0.19329601825162723, "set_robot_commands": 0.002101412213305808, "deviation-center-line": 0.4225619152401393, "driven_lanedir_consec": 1.1319797809406982, "sim_compute_sim_state": 0.006323936062928147, "sim_compute_performance-ego0": 0.0019426113736313}}
set_robot_commands_max0.002445046569922981
set_robot_commands_mean0.002252397655394571
set_robot_commands_median0.002231565919174747
set_robot_commands_min0.002101412213305808
sim_compute_performance-ego0_max0.0022026088245478263
sim_compute_performance-ego0_mean0.002058150893118212
sim_compute_performance-ego0_median0.002043691687146862
sim_compute_performance-ego0_min0.0019426113736313
sim_compute_sim_state_max0.011449233613739508
sim_compute_sim_state_mean0.009685232663579948
sim_compute_sim_state_median0.010483880488826073
sim_compute_sim_state_min0.006323936062928147
sim_render-ego0_max0.004029334170147053
sim_render-ego0_mean0.00382396130158078
sim_render-ego0_median0.003795412230780429
sim_render-ego0_min0.003675686574615208
simulation-passed1
step_physics_max0.21003064600009363
step_physics_mean0.1702992426628745
step_physics_median0.16908017908615414
step_physics_min0.1330059664790961
survival_time_max18.300000000000125
survival_time_mean15.612500000000086
survival_time_min11.850000000000032
No reset possible
5389311574Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:54:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.7305314830361693
survival_time_median59.99999999999873
deviation-center-line_median0.790729159948695
in-drivable-lane_median50.74999999999864


other stats
agent_compute-ego0_max0.16085407835160762
agent_compute-ego0_mean0.13405081006906908
agent_compute-ego0_median0.14509282858544445
agent_compute-ego0_min0.0851635047537798
complete-iteration_max0.5480290177859037
complete-iteration_mean0.4433879196693458
complete-iteration_median0.4768033404830691
complete-iteration_min0.27191597992534144
deviation-center-line_max5.324036018525398
deviation-center-line_mean1.7904586213066565
deviation-center-line_min0.2563401468038376
deviation-heading_max10.118380600676508
deviation-heading_mean3.879472843566762
deviation-heading_median2.3296513945599435
deviation-heading_min0.740207984470653
driven_any_max18.972144348016453
driven_any_mean7.176980288837521
driven_any_median4.1728446875935425
driven_any_min1.390087432146546
driven_lanedir_consec_max16.139940167063106
driven_lanedir_consec_mean5.639407638296345
driven_lanedir_consec_min0.9566274200499356
driven_lanedir_max16.139940167063106
driven_lanedir_mean5.639407638296345
driven_lanedir_median2.7305314830361693
driven_lanedir_min0.9566274200499356
get_duckie_state_max1.980402785276592e-06
get_duckie_state_mean1.8128050455542825e-06
get_duckie_state_median1.7819853249834935e-06
get_duckie_state_min1.7068467469735507e-06
get_robot_state_max0.004313108228227678
get_robot_state_mean0.00408011585548458
get_robot_state_median0.004123636030535416
get_robot_state_min0.0037600831326398128
get_state_dump_max0.0051643788864173855
get_state_dump_mean0.004981147309921861
get_state_dump_median0.005024981836196683
get_state_dump_min0.004710246680876695
get_ui_image_max0.04456451334226737
get_ui_image_mean0.03593963196037413
get_ui_image_median0.0359352523341564
get_ui_image_min0.027323509830916356
in-drivable-lane_max56.999999999998735
in-drivable-lane_mean41.899999999998975
in-drivable-lane_min9.099999999999882
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.66389112273792, "get_ui_image": 0.03458532088007359, "step_physics": 0.24829434514740523, "survival_time": 59.99999999999873, "driven_lanedir": 2.8375579013318464, "get_state_dump": 0.005064952383430474, "get_robot_state": 0.004167037244442599, "sim_render-ego0": 0.004288746455031371, "get_duckie_state": 1.980402785276592e-06, "in-drivable-lane": 50.69999999999861, "deviation-heading": 1.9510158512427875, "agent_compute-ego0": 0.15641430712659393, "complete-iteration": 0.4700254568152384, "set_robot_commands": 0.0027136516809264984, "deviation-center-line": 0.7791430578116844, "driven_lanedir_consec": 2.8375579013318464, "sim_compute_sim_state": 0.012029250793711132, "sim_compute_performance-ego0": 0.0023672328602761454}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.6817982524491657, "get_ui_image": 0.04456451334226737, "step_physics": 0.30987897760961375, "survival_time": 59.99999999999873, "driven_lanedir": 2.6235050647404923, "get_state_dump": 0.0051643788864173855, "get_robot_state": 0.004313108228227678, "sim_render-ego0": 0.004506253878540242, "get_duckie_state": 1.816229458951037e-06, "in-drivable-lane": 50.799999999998676, "deviation-heading": 2.7082869378770997, "agent_compute-ego0": 0.16085407835160762, "complete-iteration": 0.5480290177859037, "set_robot_commands": 0.0026151629709185013, "deviation-center-line": 0.8023152620857057, "driven_lanedir_consec": 2.6235050647404923, "sim_compute_sim_state": 0.013580763171257127, "sim_compute_performance-ego0": 0.002447465972836865}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.390087432146546, "get_ui_image": 0.03728518378823921, "step_physics": 0.2830922639340187, "survival_time": 59.99999999999873, "driven_lanedir": 0.9566274200499356, "get_state_dump": 0.004985011288962892, "get_robot_state": 0.004080234816628233, "sim_render-ego0": 0.004183320776806783, "get_duckie_state": 1.7068467469735507e-06, "in-drivable-lane": 56.999999999998735, "deviation-heading": 0.740207984470653, "agent_compute-ego0": 0.13377135004429497, "complete-iteration": 0.4835812241508998, "set_robot_commands": 0.0025149245345523017, "deviation-center-line": 0.2563401468038376, "driven_lanedir_consec": 0.9566274200499356, "sim_compute_sim_state": 0.011266546185864298, "sim_compute_performance-ego0": 0.002304073575136564}, "LF-norm-small_loop-000-ego0": {"driven_any": 18.972144348016453, "get_ui_image": 0.027323509830916356, "step_physics": 0.13641672725979237, "survival_time": 59.99999999999873, "driven_lanedir": 16.139940167063106, "get_state_dump": 0.004710246680876695, "get_robot_state": 0.0037600831326398128, "sim_render-ego0": 0.0038032283592382937, "get_duckie_state": 1.7477411910159503e-06, "in-drivable-lane": 9.099999999999882, "deviation-heading": 10.118380600676508, "agent_compute-ego0": 0.0851635047537798, "complete-iteration": 0.27191597992534144, "set_robot_commands": 0.002304310802615354, "deviation-center-line": 5.324036018525398, "driven_lanedir_consec": 16.139940167063106, "sim_compute_sim_state": 0.006319684053241561, "sim_compute_performance-ego0": 0.002020906151383247}}
set_robot_commands_max0.0027136516809264984
set_robot_commands_mean0.002537012497253164
set_robot_commands_median0.0025650437527354013
set_robot_commands_min0.002304310802615354
sim_compute_performance-ego0_max0.002447465972836865
sim_compute_performance-ego0_mean0.0022849196399082053
sim_compute_performance-ego0_median0.0023356532177063547
sim_compute_performance-ego0_min0.002020906151383247
sim_compute_sim_state_max0.013580763171257127
sim_compute_sim_state_mean0.01079906105101853
sim_compute_sim_state_median0.011647898489787716
sim_compute_sim_state_min0.006319684053241561
sim_render-ego0_max0.004506253878540242
sim_render-ego0_mean0.004195387367404172
sim_render-ego0_median0.004236033615919076
sim_render-ego0_min0.0038032283592382937
simulation-passed1
step_physics_max0.30987897760961375
step_physics_mean0.2444205784877075
step_physics_median0.26569330454071194
step_physics_min0.13641672725979237
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5386311742Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-010:29:42
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1176, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 758, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5385811744Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:04:30
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 285 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5382711754Étienne Boucher 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:27:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.803494439639106
survival_time_median48.099999999999405
deviation-center-line_median1.5505681184232032
in-drivable-lane_median8.424999999999946


other stats
agent_compute-ego0_max0.012772587085592335
agent_compute-ego0_mean0.012345467934237605
agent_compute-ego0_median0.012256599683547198
agent_compute-ego0_min0.012096085284263678
complete-iteration_max0.21980721885020488
complete-iteration_mean0.20314839849768315
complete-iteration_median0.20398646877677856
complete-iteration_min0.18481343758697064
deviation-center-line_max4.1447088732748725
deviation-center-line_mean1.916601096834078
deviation-center-line_min0.4205592772150334
deviation-heading_max18.513536005565044
deviation-heading_mean8.044630242413533
deviation-heading_median5.80812362166403
deviation-heading_min2.048737720761025
driven_any_max9.71981331026416
driven_any_mean6.881501021968223
driven_any_median7.5551296496593645
driven_any_min2.695931478290004
driven_lanedir_consec_max5.1093421502268885
driven_lanedir_consec_mean2.852079884790808
driven_lanedir_consec_min0.6919885096581304
driven_lanedir_max7.887791063068412
driven_lanedir_mean3.546692113001189
driven_lanedir_median2.803494439639106
driven_lanedir_min0.6919885096581304
get_duckie_state_max1.846180017766035e-06
get_duckie_state_mean1.65881548978794e-06
get_duckie_state_median1.634718230050706e-06
get_duckie_state_min1.5196454812843138e-06
get_robot_state_max0.003923369883299867
get_robot_state_mean0.0038200103775012
get_robot_state_median0.0038168825585002983
get_robot_state_min0.003722906509704336
get_state_dump_max0.005087070492891806
get_state_dump_mean0.004908882465992208
get_state_dump_median0.004892912461107415
get_state_dump_min0.004762634448862195
get_ui_image_max0.03630866138861638
get_ui_image_mean0.031882371295916916
get_ui_image_median0.03164261368275695
get_ui_image_min0.027935596429537374
in-drivable-lane_max55.04999999999873
in-drivable-lane_mean19.57499999999964
in-drivable-lane_min6.399999999999935
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.695931478290004, "get_ui_image": 0.029932912515134222, "step_physics": 0.11521498385393238, "survival_time": 17.100000000000108, "driven_lanedir": 1.109704468535814, "get_state_dump": 0.005087070492891806, "get_robot_state": 0.003844722019340137, "sim_render-ego0": 0.003935961264563024, "get_duckie_state": 1.846180017766035e-06, "in-drivable-lane": 9.75000000000007, "deviation-heading": 2.2472701439882243, "agent_compute-ego0": 0.012096085284263678, "complete-iteration": 0.18481343758697064, "set_robot_commands": 0.0023030518790375736, "deviation-center-line": 0.4953661536876619, "driven_lanedir_consec": 1.109704468535814, "sim_compute_sim_state": 0.010165459908132304, "sim_compute_performance-ego0": 0.002133349287961732}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.71981331026416, "get_ui_image": 0.03630866138861638, "step_physics": 0.14283759746821498, "survival_time": 59.99999999999873, "driven_lanedir": 7.887791063068412, "get_state_dump": 0.004762634448862195, "get_robot_state": 0.003722906509704336, "sim_render-ego0": 0.0038189496922552534, "get_duckie_state": 1.5196454812843138e-06, "in-drivable-lane": 7.099999999999821, "deviation-heading": 18.513536005565044, "agent_compute-ego0": 0.012109100967521573, "complete-iteration": 0.21980721885020488, "set_robot_commands": 0.0022318573617419036, "deviation-center-line": 4.1447088732748725, "driven_lanedir_consec": 5.1093421502268885, "sim_compute_sim_state": 0.011885702163353253, "sim_compute_performance-ego0": 0.0020347878299684548}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.713675066588156, "get_ui_image": 0.03335231485037968, "step_physics": 0.13979063560222757, "survival_time": 36.20000000000008, "driven_lanedir": 4.497284410742398, "get_state_dump": 0.004900707047561119, "get_robot_state": 0.0037890430976604593, "sim_render-ego0": 0.003872426460529196, "get_duckie_state": 1.6149981268521014e-06, "in-drivable-lane": 6.399999999999935, "deviation-heading": 9.368977099339835, "agent_compute-ego0": 0.012772587085592335, "complete-iteration": 0.21532417955069708, "set_robot_commands": 0.0022718475604879447, "deviation-center-line": 2.6057700831587445, "driven_lanedir_consec": 4.497284410742398, "sim_compute_sim_state": 0.012335951574917497, "sim_compute_performance-ego0": 0.0021417617797851564}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.396584232730572, "get_ui_image": 0.027935596429537374, "step_physics": 0.12832942572759648, "survival_time": 59.99999999999873, "driven_lanedir": 0.6919885096581304, "get_state_dump": 0.004885117874653711, "get_robot_state": 0.003923369883299867, "sim_render-ego0": 0.0039409141953442115, "get_duckie_state": 1.6544383332493104e-06, "in-drivable-lane": 55.04999999999873, "deviation-heading": 2.048737720761025, "agent_compute-ego0": 0.012404098399572823, "complete-iteration": 0.19264875800286008, "set_robot_commands": 0.0023339346584729808, "deviation-center-line": 0.4205592772150334, "driven_lanedir_consec": 0.6919885096581304, "sim_compute_sim_state": 0.006664652907778877, "sim_compute_performance-ego0": 0.002131148242235779}}
set_robot_commands_max0.0023339346584729808
set_robot_commands_mean0.0022851728649351008
set_robot_commands_median0.0022874497197627594
set_robot_commands_min0.0022318573617419036
sim_compute_performance-ego0_max0.0021417617797851564
sim_compute_performance-ego0_mean0.0021102617849877805
sim_compute_performance-ego0_median0.002132248765098756
sim_compute_performance-ego0_min0.0020347878299684548
sim_compute_sim_state_max0.012335951574917497
sim_compute_sim_state_mean0.010262941638545483
sim_compute_sim_state_median0.011025581035742778
sim_compute_sim_state_min0.006664652907778877
sim_render-ego0_max0.0039409141953442115
sim_render-ego0_mean0.0038920629031729214
sim_render-ego0_median0.0039041938625461103
sim_render-ego0_min0.0038189496922552534
simulation-passed1
step_physics_max0.14283759746821498
step_physics_mean0.13154316066299288
step_physics_median0.134060030664912
step_physics_min0.11521498385393238
survival_time_max59.99999999999873
survival_time_mean43.32499999999941
survival_time_min17.100000000000108
No reset possible
5382111757Ayman Shams 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:03:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 113 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5380911761Ayman Shams 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:08:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 636 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5379511765Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:07:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 636 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5374712095Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-010:36:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.925988100155144
survival_time_median59.99999999999873
deviation-center-line_median3.666394589001729
in-drivable-lane_median9.874999999999906


other stats
agent_compute-ego0_max0.03623522509146888
agent_compute-ego0_mean0.029698996023770477
agent_compute-ego0_median0.03483473907203896
agent_compute-ego0_min0.012891280859535083
complete-iteration_max0.23028050552895424
complete-iteration_mean0.20334531961134533
complete-iteration_median0.1981644140095834
complete-iteration_min0.1867719448972602
deviation-center-line_max4.301870147077171
deviation-center-line_mean3.628413268843288
deviation-center-line_min2.8789937502925245
deviation-heading_max12.525512186598815
deviation-heading_mean9.971569721108215
deviation-heading_median10.40944587880457
deviation-heading_min6.541874940224915
driven_any_max7.921172685521955
driven_any_mean7.919298308984159
driven_any_median7.920837673439747
driven_any_min7.914345203535182
driven_lanedir_consec_max6.564541637126992
driven_lanedir_consec_mean5.021283722504156
driven_lanedir_consec_min3.6686170525793456
driven_lanedir_max7.207146715561639
driven_lanedir_mean5.958235168241275
driven_lanedir_median6.221760709571713
driven_lanedir_min4.182272538260033
get_duckie_state_max1.3602365562064166e-06
get_duckie_state_mean1.3121458811128667e-06
get_duckie_state_median1.3056444585769996e-06
get_duckie_state_min1.2770580510910503e-06
get_robot_state_max0.003955366212462109
get_robot_state_mean0.0037845234191983463
get_robot_state_median0.003772787309308334
get_robot_state_min0.0036371528457146106
get_state_dump_max0.004822759008923736
get_state_dump_mean0.0047277944173344365
get_state_dump_median0.0047362584257800815
get_state_dump_min0.004615901808853848
get_ui_image_max0.03537368258270594
get_ui_image_mean0.03071520414876501
get_ui_image_median0.030677697739930673
get_ui_image_min0.02613173853249276
in-drivable-lane_max24.849999999999714
in-drivable-lane_mean12.124999999999895
in-drivable-lane_min3.900000000000055
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.921172685521955, "get_ui_image": 0.02788428323254994, "step_physics": 0.09780800828925774, "survival_time": 59.99999999999873, "driven_lanedir": 7.207146715561639, "get_state_dump": 0.004767484212298874, "get_robot_state": 0.00380553730719294, "sim_render-ego0": 0.003835094064399662, "get_duckie_state": 1.2770580510910503e-06, "in-drivable-lane": 3.900000000000055, "deviation-heading": 6.541874940224915, "agent_compute-ego0": 0.03405327860461385, "complete-iteration": 0.1867719448972602, "set_robot_commands": 0.0023323606194107856, "deviation-center-line": 2.8789937502925245, "driven_lanedir_consec": 3.972996418293853, "sim_compute_sim_state": 0.010051364604876895, "sim_compute_performance-ego0": 0.0021449429704982178}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.920964733212752, "get_ui_image": 0.03537368258270594, "step_physics": 0.1297691247544618, "survival_time": 59.99999999999873, "driven_lanedir": 6.564541637126992, "get_state_dump": 0.004615901808853848, "get_robot_state": 0.0036371528457146106, "sim_render-ego0": 0.003797189877690324, "get_duckie_state": 1.3078281424821765e-06, "in-drivable-lane": 8.09999999999993, "deviation-heading": 10.63194020699844, "agent_compute-ego0": 0.03623522509146888, "complete-iteration": 0.23028050552895424, "set_robot_commands": 0.0022585266932758264, "deviation-center-line": 4.301870147077171, "driven_lanedir_consec": 6.564541637126992, "sim_compute_sim_state": 0.012497701216101349, "sim_compute_performance-ego0": 0.0020052717686890563}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.914345203535182, "get_ui_image": 0.033471112247311405, "step_physics": 0.12950741718651154, "survival_time": 59.99999999999873, "driven_lanedir": 5.878979782016435, "get_state_dump": 0.004822759008923736, "get_robot_state": 0.003955366212462109, "sim_render-ego0": 0.003940471900095054, "get_duckie_state": 1.303460774671823e-06, "in-drivable-lane": 11.64999999999988, "deviation-heading": 12.525512186598815, "agent_compute-ego0": 0.012891280859535083, "complete-iteration": 0.2070162594070244, "set_robot_commands": 0.002367952681897979, "deviation-center-line": 4.079525217925133, "driven_lanedir_consec": 5.878979782016435, "sim_compute_sim_state": 0.01381370765184185, "sim_compute_performance-ego0": 0.0021547050301379505}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920710613666744, "get_ui_image": 0.02613173853249276, "step_physics": 0.10477427161801964, "survival_time": 59.99999999999873, "driven_lanedir": 4.182272538260033, "get_state_dump": 0.0047050326392612885, "get_robot_state": 0.003740037311423728, "sim_render-ego0": 0.0038140121844289303, "get_duckie_state": 1.3602365562064166e-06, "in-drivable-lane": 24.849999999999714, "deviation-heading": 10.1869515506107, "agent_compute-ego0": 0.03561619953946408, "complete-iteration": 0.1893125686121424, "set_robot_commands": 0.0023021036937373764, "deviation-center-line": 3.253263960078325, "driven_lanedir_consec": 3.6686170525793456, "sim_compute_sim_state": 0.006121912566350958, "sim_compute_performance-ego0": 0.0020157470988989073}}
set_robot_commands_max0.002367952681897979
set_robot_commands_mean0.002315235922080492
set_robot_commands_median0.0023172321565740808
set_robot_commands_min0.0022585266932758264
sim_compute_performance-ego0_max0.0021547050301379505
sim_compute_performance-ego0_mean0.002080166717056033
sim_compute_performance-ego0_median0.0020803450346985625
sim_compute_performance-ego0_min0.0020052717686890563
sim_compute_sim_state_max0.01381370765184185
sim_compute_sim_state_mean0.010621171509792762
sim_compute_sim_state_median0.011274532910489122
sim_compute_sim_state_min0.006121912566350958
sim_render-ego0_max0.003940471900095054
sim_render-ego0_mean0.003846692006653493
sim_render-ego0_median0.003824553124414296
sim_render-ego0_min0.003797189877690324
simulation-passed1
step_physics_max0.1297691247544618
step_physics_mean0.1154647054620627
step_physics_median0.1171408444022656
step_physics_min0.09780800828925774
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5373612322Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-010:02:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5369912714Bea Baselines 🐤template-randomaido5-LFV-sim-validationLFVv-simsuccessyesnogpu-prod-010:12:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7324341757991104
survival_time_median6.1749999999999865
deviation-center-line_median0.1416289228220337
in-drivable-lane_median4.024999999999986


other stats
agent_compute-ego0_max0.013422287427462064
agent_compute-ego0_mean0.012448706586408656
agent_compute-ego0_median0.012379702932593844
agent_compute-ego0_min0.011613133052984871
agent_compute-npc0_max0.02499643216530482
agent_compute-npc0_mean0.02356928559617843
agent_compute-npc0_median0.023296708291112748
agent_compute-npc0_min0.022687293637183404
agent_compute-npc1_max0.03966849033649151
agent_compute-npc1_mean0.03329392772680686
agent_compute-npc1_median0.030601922203512752
agent_compute-npc1_min0.029611370640416294
agent_compute-npc2_max0.03957475882310134
agent_compute-npc2_mean0.032196970041952135
agent_compute-npc2_median0.028624782375260897
agent_compute-npc2_min0.028391368927494172
agent_compute-npc3_max0.04338915831123302
agent_compute-npc3_mean0.038408423731806106
agent_compute-npc3_median0.038408423731806106
agent_compute-npc3_min0.03342768915237919
complete-iteration_max1.2352191856484007
complete-iteration_mean0.8665456630360484
complete-iteration_median0.9614632864448036
complete-iteration_min0.3080368936061859
deviation-center-line_max0.1728925413407413
deviation-center-line_mean0.1314871218615119
deviation-center-line_min0.06979810046123884
deviation-heading_max1.394684528928578
deviation-heading_mean0.6266950388971282
deviation-heading_median0.4258079888276152
deviation-heading_min0.26047964900470477
driven_any_max3.0432991877567512
driven_any_mean2.157906677127926
driven_any_median2.312372712230844
driven_any_min0.9635820962932632
driven_lanedir_consec_max0.8125862604449666
driven_lanedir_consec_mean0.715646099889072
driven_lanedir_consec_min0.5851297875131007
driven_lanedir_max0.8125862604449666
driven_lanedir_mean0.715646099889072
driven_lanedir_median0.7324341757991104
driven_lanedir_min0.5851297875131007
get_duckie_state_max2.765655517578125e-06
get_duckie_state_mean2.4877609569212563e-06
get_duckie_state_median2.574448140140528e-06
get_duckie_state_min2.0364920298258462e-06
get_robot_state_max0.01928038135651619
get_robot_state_mean0.015516327081888924
get_robot_state_median0.017525885343671506
get_robot_state_min0.007733156283696492
get_state_dump_max0.012595962708996189
get_state_dump_mean0.010629108058654734
get_state_dump_median0.011530495337231666
get_state_dump_min0.006859478851159413
get_ui_image_max0.05930281454516995
get_ui_image_mean0.04871412043972553
get_ui_image_median0.05145613191833803
get_ui_image_min0.03264140337705612
in-drivable-lane_max5.59999999999998
in-drivable-lane_mean3.712499999999987
in-drivable-lane_min1.1999999999999955
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 0.9635820962932632, "get_ui_image": 0.047274340116060694, "step_physics": 0.4963701394888071, "survival_time": 3.1999999999999966, "driven_lanedir": 0.7205039289860935, "get_state_dump": 0.010779600877028244, "get_robot_state": 0.015805717614980844, "sim_render-ego0": 0.004199097706721379, "sim_render-npc0": 0.003982342206514799, "sim_render-npc1": 0.004297395852895883, "sim_render-npc2": 0.004028008534358098, "get_duckie_state": 2.765655517578125e-06, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 0.26047964900470477, "agent_compute-ego0": 0.013422287427462064, "agent_compute-npc0": 0.02379612189072829, "agent_compute-npc1": 0.03966849033649151, "agent_compute-npc2": 0.03957475882310134, "complete-iteration": 0.7507146028371957, "set_robot_commands": 0.0024977207183837892, "deviation-center-line": 0.06979810046123884, "driven_lanedir_consec": 0.7205039289860935, "sim_compute_sim_state": 0.028108519774216873, "sim_compute_performance-ego0": 0.00241396243755634, "sim_compute_performance-npc0": 0.002213709171001728, "sim_compute_performance-npc1": 0.002212230975811298, "sim_compute_performance-npc2": 0.002192273506751427}, "LFV-norm-zigzag-000-ego0": {"driven_any": 3.0432991877567512, "get_ui_image": 0.05930281454516995, "step_physics": 0.8471783884109989, "survival_time": 7.699999999999981, "driven_lanedir": 0.8125862604449666, "get_state_dump": 0.012595962708996189, "get_robot_state": 0.01928038135651619, "sim_render-ego0": 0.004223388241183373, "sim_render-npc0": 0.00397199353864116, "sim_render-npc1": 0.0040993336708314955, "sim_render-npc2": 0.0040956481810539, "sim_render-npc3": 0.004047464555309665, "get_duckie_state": 2.5995316043976813e-06, "in-drivable-lane": 5.59999999999998, "deviation-heading": 0.5728223245352578, "agent_compute-ego0": 0.012531437412385018, "agent_compute-npc0": 0.022687293637183404, "agent_compute-npc1": 0.029611370640416294, "agent_compute-npc2": 0.028391368927494172, "agent_compute-npc3": 0.03342768915237919, "complete-iteration": 1.1722119700524114, "set_robot_commands": 0.0024355811457480152, "deviation-center-line": 0.1159684528189553, "driven_lanedir_consec": 0.8125862604449666, "sim_compute_sim_state": 0.06347724699204968, "sim_compute_performance-ego0": 0.002373393889396421, "sim_compute_performance-npc0": 0.0020946610358453565, "sim_compute_performance-npc1": 0.002119153545748803, "sim_compute_performance-npc2": 0.0021523798665692728, "sim_compute_performance-npc3": 0.0021256477602066533}, "LFV-norm-techtrack-000-ego0": {"driven_any": 2.9493172253703293, "get_ui_image": 0.055637923720615365, "step_physics": 0.9028218945646598, "survival_time": 7.599999999999981, "driven_lanedir": 0.7443644226121274, "get_state_dump": 0.012281389797435089, "get_robot_state": 0.019246053072362164, "sim_render-ego0": 0.004198401582007315, "sim_render-npc0": 0.004471230351067836, "sim_render-npc1": 0.004166294546688304, "sim_render-npc2": 0.004053977579852335, "sim_render-npc3": 0.004134840435451931, "get_duckie_state": 2.549364675883374e-06, "in-drivable-lane": 4.999999999999982, "deviation-heading": 1.394684528928578, "agent_compute-ego0": 0.012227968452802673, "agent_compute-npc0": 0.02279729469149721, "agent_compute-npc1": 0.030601922203512752, "agent_compute-npc2": 0.028624782375260897, "agent_compute-npc3": 0.04338915831123302, "complete-iteration": 1.2352191856484007, "set_robot_commands": 0.002526230282253689, "deviation-center-line": 0.1728925413407413, "driven_lanedir_consec": 0.7443644226121274, "sim_compute_sim_state": 0.06220366284738179, "sim_compute_performance-ego0": 0.002372659109776316, "sim_compute_performance-npc0": 0.0022561098235884523, "sim_compute_performance-npc1": 0.0022198811076045814, "sim_compute_performance-npc2": 0.0021608374477211944, "sim_compute_performance-npc3": 0.002215754752065621}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.6754281990913586, "get_ui_image": 0.03264140337705612, "step_physics": 0.19680518905321756, "survival_time": 4.749999999999991, "driven_lanedir": 0.5851297875131007, "get_state_dump": 0.006859478851159413, "get_robot_state": 0.007733156283696492, "sim_render-ego0": 0.003938650091489156, "sim_render-npc0": 0.0038531944155693054, "get_duckie_state": 2.0364920298258462e-06, "in-drivable-lane": 3.04999999999999, "deviation-heading": 0.2787936531199725, "agent_compute-ego0": 0.011613133052984871, "agent_compute-npc0": 0.02499643216530482, "complete-iteration": 0.3080368936061859, "set_robot_commands": 0.0024032692114512124, "deviation-center-line": 0.16728939282511213, "driven_lanedir_consec": 0.5851297875131007, "sim_compute_sim_state": 0.010460587839285532, "sim_compute_performance-ego0": 0.002159764369328817, "sim_compute_performance-npc0": 0.0020920087893803916}}
set_robot_commands_max0.002526230282253689
set_robot_commands_mean0.0024657003394591764
set_robot_commands_median0.0024666509320659022
set_robot_commands_min0.0024032692114512124
sim_compute_performance-ego0_max0.00241396243755634
sim_compute_performance-ego0_mean0.0023299449515144736
sim_compute_performance-ego0_median0.0023730264995863687
sim_compute_performance-ego0_min0.002159764369328817
sim_compute_performance-npc0_max0.0022561098235884523
sim_compute_performance-npc0_mean0.002164122204953982
sim_compute_performance-npc0_median0.002154185103423542
sim_compute_performance-npc0_min0.0020920087893803916
sim_compute_performance-npc1_max0.0022198811076045814
sim_compute_performance-npc1_mean0.0021837552097215608
sim_compute_performance-npc1_median0.002212230975811298
sim_compute_performance-npc1_min0.002119153545748803
sim_compute_performance-npc2_max0.002192273506751427
sim_compute_performance-npc2_mean0.0021684969403472977
sim_compute_performance-npc2_median0.0021608374477211944
sim_compute_performance-npc2_min0.0021523798665692728
sim_compute_performance-npc3_max0.002215754752065621
sim_compute_performance-npc3_mean0.002170701256136137
sim_compute_performance-npc3_median0.002170701256136137
sim_compute_performance-npc3_min0.0021256477602066533
sim_compute_sim_state_max0.06347724699204968
sim_compute_sim_state_mean0.04106250436323347
sim_compute_sim_state_median0.04515609131079933
sim_compute_sim_state_min0.010460587839285532
sim_render-ego0_max0.004223388241183373
sim_render-ego0_mean0.004139884405350305
sim_render-ego0_median0.0041987496443643465
sim_render-ego0_min0.003938650091489156
sim_render-npc0_max0.004471230351067836
sim_render-npc0_mean0.004069690127948275
sim_render-npc0_median0.00397716787257798
sim_render-npc0_min0.0038531944155693054
sim_render-npc1_max0.004297395852895883
sim_render-npc1_mean0.004187674690138561
sim_render-npc1_median0.004166294546688304
sim_render-npc1_min0.0040993336708314955
sim_render-npc2_max0.0040956481810539
sim_render-npc2_mean0.004059211431754777
sim_render-npc2_median0.004053977579852335
sim_render-npc2_min0.004028008534358098
sim_render-npc3_max0.004134840435451931
sim_render-npc3_mean0.004091152495380798
sim_render-npc3_median0.004091152495380798
sim_render-npc3_min0.004047464555309665
simulation-passed1
step_physics_max0.9028218945646598
step_physics_mean0.6107939028794208
step_physics_median0.671774263949903
step_physics_min0.19680518905321756
survival_time_max7.699999999999981
survival_time_mean5.812499999999988
survival_time_min3.1999999999999966
No reset possible
5368612717Bea Baselines 🐤template-randomaido5-LFP-sim-testingLFP-simsuccessyesnogpu-prod-010:04:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4012977349482021
survival_time_median4.499999999999992
deviation-center-line_median0.1385293223550657
in-drivable-lane_median2.7749999999999937


other stats
agent_compute-ego0_max0.01142830533139846
agent_compute-ego0_mean0.011051588875806135
agent_compute-ego0_median0.011059902175780264
agent_compute-ego0_min0.01065824582026555
complete-iteration_max0.25683247126065767
complete-iteration_mean0.22372032234161787
complete-iteration_median0.22590721860895577
complete-iteration_min0.1862343808879023
deviation-center-line_max0.18027339903737324
deviation-center-line_mean0.1285451587987956
deviation-center-line_min0.056848591447677815
deviation-heading_max1.7649200470050517
deviation-heading_mean0.7368137764399135
deviation-heading_median0.48008699517634235
deviation-heading_min0.22216106840191804
driven_any_max3.0249186308586435
driven_any_mean1.6335412217500125
driven_any_median1.5621944647828574
driven_any_min0.38485732657569066
driven_lanedir_consec_max0.7467792340807347
driven_lanedir_consec_mean0.4327941126790024
driven_lanedir_consec_min0.18180174673887084
driven_lanedir_max0.7467792340807347
driven_lanedir_mean0.4327941126790024
driven_lanedir_median0.4012977349482021
driven_lanedir_min0.18180174673887084
get_duckie_state_max0.024326079931014623
get_duckie_state_mean0.017882573521872537
get_duckie_state_median0.021369731725958765
get_duckie_state_min0.004464750704558
get_robot_state_max0.003970333837693738
get_robot_state_mean0.003775261857264728
get_robot_state_median0.00376124253108217
get_robot_state_min0.0036082285292008344
get_state_dump_max0.008568262442564353
get_state_dump_mean0.007646406001238179
get_state_dump_median0.008252217336442937
get_state_dump_min0.005512926889502484
get_ui_image_max0.037173038913357645
get_ui_image_mean0.032815858443322375
get_ui_image_median0.03385352854635201
get_ui_image_min0.026383337767227837
in-drivable-lane_max6.349999999999983
in-drivable-lane_mean2.9749999999999925
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.38485732657569066, "get_ui_image": 0.03244312604268392, "step_physics": 0.1638973370576516, "survival_time": 1.900000000000001, "driven_lanedir": 0.3799549493870889, "get_state_dump": 0.008568262442564353, "get_robot_state": 0.003720014523237179, "sim_render-ego0": 0.0036524625924917366, "get_duckie_state": 0.024326079931014623, "in-drivable-lane": 0.0, "deviation-heading": 0.22216106840191804, "agent_compute-ego0": 0.01065824582026555, "complete-iteration": 0.25683247126065767, "set_robot_commands": 0.0020872079409085787, "deviation-center-line": 0.13386765529050942, "driven_lanedir_consec": 0.3799549493870889, "sim_compute_sim_state": 0.005492803377982898, "sim_compute_performance-ego0": 0.0018989000564966448}, "LFP-norm-zigzag-000-ego0": {"driven_any": 2.5553912208152347, "get_ui_image": 0.035263931050020104, "step_physics": 0.11840712848831624, "survival_time": 6.749999999999984, "driven_lanedir": 0.7467792340807347, "get_state_dump": 0.007986564846599804, "get_robot_state": 0.0036082285292008344, "sim_render-ego0": 0.003776541527579812, "get_duckie_state": 0.02058512147735147, "in-drivable-lane": 4.049999999999987, "deviation-heading": 1.7649200470050517, "agent_compute-ego0": 0.01142830533139846, "complete-iteration": 0.21825838965528152, "set_robot_commands": 0.0020974611534791835, "deviation-center-line": 0.18027339903737324, "driven_lanedir_consec": 0.7467792340807347, "sim_compute_sim_state": 0.013032043681425206, "sim_compute_performance-ego0": 0.00198287473005407}, "LFP-norm-techtrack-000-ego0": {"driven_any": 3.0249186308586435, "get_ui_image": 0.037173038913357645, "step_physics": 0.12991913980053318, "survival_time": 7.699999999999981, "driven_lanedir": 0.4226405205093153, "get_state_dump": 0.00851786982628607, "get_robot_state": 0.003970333837693738, "sim_render-ego0": 0.004130188111336, "get_duckie_state": 0.02215434197456606, "in-drivable-lane": 6.349999999999983, "deviation-heading": 0.5966178261082585, "agent_compute-ego0": 0.01106636139654344, "complete-iteration": 0.23355604756262996, "set_robot_commands": 0.0022661009142475744, "deviation-center-line": 0.14319098941962197, "driven_lanedir_consec": 0.4226405205093153, "sim_compute_sim_state": 0.012051845365954984, "sim_compute_performance-ego0": 0.0022026492703345513}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.5689977087504798, "get_ui_image": 0.026383337767227837, "step_physics": 0.121084275452987, "survival_time": 2.25, "driven_lanedir": 0.18180174673887084, "get_state_dump": 0.005512926889502484, "get_robot_state": 0.003802470538927161, "sim_render-ego0": 0.003860084906868313, "get_duckie_state": 0.004464750704558, "in-drivable-lane": 1.5, "deviation-heading": 0.3635561642444261, "agent_compute-ego0": 0.01105344295501709, "complete-iteration": 0.1862343808879023, "set_robot_commands": 0.0023066168246061907, "deviation-center-line": 0.056848591447677815, "driven_lanedir_consec": 0.18180174673887084, "sim_compute_sim_state": 0.005651888640030571, "sim_compute_performance-ego0": 0.0020210535629935885}}
set_robot_commands_max0.0023066168246061907
set_robot_commands_mean0.0021893467083103817
set_robot_commands_median0.002181781033863379
set_robot_commands_min0.0020872079409085787
sim_compute_performance-ego0_max0.0022026492703345513
sim_compute_performance-ego0_mean0.0020263694049697132
sim_compute_performance-ego0_median0.0020019641465238293
sim_compute_performance-ego0_min0.0018989000564966448
sim_compute_sim_state_max0.013032043681425206
sim_compute_sim_state_mean0.009057145266348416
sim_compute_sim_state_median0.008851867002992777
sim_compute_sim_state_min0.005492803377982898
sim_render-ego0_max0.004130188111336
sim_render-ego0_mean0.0038548192845689654
sim_render-ego0_median0.003818313217224063
sim_render-ego0_min0.0036524625924917366
simulation-passed1
step_physics_max0.1638973370576516
step_physics_mean0.13332697019987202
step_physics_median0.1255017076267601
step_physics_min0.11840712848831624
survival_time_max7.699999999999981
survival_time_mean4.6499999999999915
survival_time_min1.900000000000001
No reset possible
5367812720Bea Baselines 🐤template-randomaido5-LFI-sim-validationLFVIv-simsuccessyesnogpu-prod-010:02:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19295142106760688
survival_time_median2.6749999999999985
deviation-center-line_median0.1430668550637951
in-drivable-lane_median1.1250000000000004


other stats
agent_compute-ego0_max0.012081902367728097
agent_compute-ego0_mean0.01192195197164794
agent_compute-ego0_median0.01192195197164794
agent_compute-ego0_min0.011762001575567784
complete-iteration_max0.26281332358335835
complete-iteration_mean0.24516266108432533
complete-iteration_median0.24516266108432533
complete-iteration_min0.22751199858529228
deviation-center-line_max0.22596774648423773
deviation-center-line_mean0.1430668550637951
deviation-center-line_min0.06016596364335245
deviation-heading_max1.9892082549741996
deviation-heading_mean1.1948036666590705
deviation-heading_median1.1948036666590705
deviation-heading_min0.4003990783439415
driven_any_max1.0672360153840748
driven_any_mean0.7318093849558207
driven_any_median0.7318093849558207
driven_any_min0.39638275452756666
driven_lanedir_consec_max0.26738221859900735
driven_lanedir_consec_mean0.19295142106760688
driven_lanedir_consec_min0.1185206235362064
driven_lanedir_max0.40392741637882246
driven_lanedir_mean0.26122401995751443
driven_lanedir_median0.26122401995751443
driven_lanedir_min0.1185206235362064
get_duckie_state_max1.6077970847105369e-06
get_duckie_state_mean1.5566200563759155e-06
get_duckie_state_median1.5566200563759155e-06
get_duckie_state_min1.5054430280412946e-06
get_robot_state_max0.0038912602833339146
get_robot_state_mean0.003798744661030752
get_robot_state_median0.003798744661030752
get_robot_state_min0.003706229038727589
get_state_dump_max0.00490266237503443
get_state_dump_mean0.004888752441266518
get_state_dump_median0.004888752441266518
get_state_dump_min0.004874842507498605
get_ui_image_max0.03688273674402481
get_ui_image_mean0.0366251446825244
get_ui_image_median0.0366251446825244
get_ui_image_min0.036367552621023994
in-drivable-lane_max1.250000000000001
in-drivable-lane_mean1.1250000000000004
in-drivable-lane_min0.9999999999999996
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.39638275452756666, "get_ui_image": 0.03688273674402481, "step_physics": 0.18868061823722643, "survival_time": 1.900000000000001, "driven_lanedir": 0.1185206235362064, "get_state_dump": 0.00490266237503443, "get_robot_state": 0.003706229038727589, "sim_render-ego0": 0.003910627120580428, "get_duckie_state": 1.6077970847105369e-06, "in-drivable-lane": 1.250000000000001, "deviation-heading": 0.4003990783439415, "agent_compute-ego0": 0.011762001575567784, "complete-iteration": 0.26281332358335835, "set_robot_commands": 0.0023187918540758965, "deviation-center-line": 0.06016596364335245, "driven_lanedir_consec": 0.1185206235362064, "sim_compute_sim_state": 0.008478366411649264, "sim_compute_performance-ego0": 0.002071191103030474}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.0672360153840748, "get_ui_image": 0.036367552621023994, "step_physics": 0.15220047065189907, "survival_time": 3.4499999999999957, "driven_lanedir": 0.40392741637882246, "get_state_dump": 0.004874842507498605, "get_robot_state": 0.0038912602833339146, "sim_render-ego0": 0.0038966928209577287, "get_duckie_state": 1.5054430280412946e-06, "in-drivable-lane": 0.9999999999999996, "deviation-heading": 1.9892082549741996, "agent_compute-ego0": 0.012081902367728097, "complete-iteration": 0.22751199858529228, "set_robot_commands": 0.002306066240583147, "deviation-center-line": 0.22596774648423773, "driven_lanedir_consec": 0.26738221859900735, "sim_compute_sim_state": 0.00975374834878104, "sim_compute_performance-ego0": 0.002046629360743931}}
set_robot_commands_max0.0023187918540758965
set_robot_commands_mean0.0023124290473295218
set_robot_commands_median0.0023124290473295218
set_robot_commands_min0.002306066240583147
sim_compute_performance-ego0_max0.002071191103030474
sim_compute_performance-ego0_mean0.0020589102318872027
sim_compute_performance-ego0_median0.0020589102318872027
sim_compute_performance-ego0_min0.002046629360743931
sim_compute_sim_state_max0.00975374834878104
sim_compute_sim_state_mean0.009116057380215151
sim_compute_sim_state_median0.009116057380215151
sim_compute_sim_state_min0.008478366411649264
sim_render-ego0_max0.003910627120580428
sim_render-ego0_mean0.0039036599707690783
sim_render-ego0_median0.0039036599707690783
sim_render-ego0_min0.0038966928209577287
simulation-passed1
step_physics_max0.18868061823722643
step_physics_mean0.17044054444456275
step_physics_median0.17044054444456275
step_physics_min0.15220047065189907
survival_time_max3.4499999999999957
survival_time_mean2.6749999999999985
survival_time_min1.900000000000001
No reset possible
5366812723Bea Baselines 🐤template-randomaido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-010:03:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.34594080188194565
survival_time_median3.649999999999995
deviation-center-line_median0.09488940232508568
in-drivable-lane_median2.449999999999993


other stats
agent_compute-ego0_max0.01173022867159079
agent_compute-ego0_mean0.011432213097451764
agent_compute-ego0_median0.0114776944214443
agent_compute-ego0_min0.011043234875327662
complete-iteration_max0.22509127259254455
complete-iteration_mean0.19035545616182584
complete-iteration_median0.18966549707904737
complete-iteration_min0.15699955789666423
deviation-center-line_max0.25831223976637174
deviation-center-line_mean0.13066585301948935
deviation-center-line_min0.07457236766141423
deviation-heading_max1.4169556658180873
deviation-heading_mean0.6148969366642039
deviation-heading_median0.388641682360125
deviation-heading_min0.26534871611847816
driven_any_max2.4199481648528267
driven_any_mean1.3020780256656512
driven_any_median1.2008709458648514
driven_any_min0.3866220460800752
driven_lanedir_consec_max0.918768019317286
driven_lanedir_consec_mean0.4760575018003668
driven_lanedir_consec_min0.29358038412028975
driven_lanedir_max0.918768019317286
driven_lanedir_mean0.4760575018003668
driven_lanedir_median0.34594080188194565
driven_lanedir_min0.29358038412028975
get_duckie_state_max2.420173501068691e-06
get_duckie_state_mean2.222140257624067e-06
get_duckie_state_median2.191426189801165e-06
get_duckie_state_min2.0855351498252465e-06
get_robot_state_max0.003715180258714516
get_robot_state_mean0.003631680899768876
get_robot_state_median0.003627787608849375
get_robot_state_min0.0035559681226622385
get_state_dump_max0.004765164852142334
get_state_dump_mean0.00462409394945996
get_state_dump_median0.004600376902886157
get_state_dump_min0.004530457139925192
get_ui_image_max0.03507397375034012
get_ui_image_mean0.029501143459277283
get_ui_image_median0.0286948894554714
get_ui_image_min0.025540821175826223
in-drivable-lane_max3.6999999999999913
in-drivable-lane_mean2.3624999999999945
in-drivable-lane_min0.8500000000000008
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.7195926723959571, "get_ui_image": 0.0274447630036552, "step_physics": 0.1256680668524976, "survival_time": 2.5999999999999988, "driven_lanedir": 0.3934042908794564, "get_state_dump": 0.0046299358583846185, "get_robot_state": 0.0035559681226622385, "sim_render-ego0": 0.003766347777168706, "get_duckie_state": 2.420173501068691e-06, "in-drivable-lane": 1.3499999999999983, "deviation-heading": 0.396385773337009, "agent_compute-ego0": 0.011382503329582934, "complete-iteration": 0.18695238401305, "set_robot_commands": 0.0020567651064890735, "deviation-center-line": 0.08121507017171659, "driven_lanedir_consec": 0.3934042908794564, "sim_compute_sim_state": 0.006393698026549141, "sim_compute_performance-ego0": 0.0019638808268421103}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.4199481648528267, "get_ui_image": 0.03507397375034012, "step_physics": 0.11841358847290503, "survival_time": 6.499999999999985, "driven_lanedir": 0.918768019317286, "get_state_dump": 0.004530457139925192, "get_robot_state": 0.003715180258714516, "sim_render-ego0": 0.0038703197741326487, "get_duckie_state": 2.254966561120885e-06, "in-drivable-lane": 3.5499999999999874, "deviation-heading": 1.4169556658180873, "agent_compute-ego0": 0.01173022867159079, "complete-iteration": 0.1923786101450447, "set_robot_commands": 0.0022650729608899764, "deviation-center-line": 0.25831223976637174, "driven_lanedir_consec": 0.918768019317286, "sim_compute_sim_state": 0.010650421826894046, "sim_compute_performance-ego0": 0.0020422334889419204}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.3866220460800752, "get_ui_image": 0.0299450159072876, "step_physics": 0.15834463834762574, "survival_time": 1.950000000000001, "driven_lanedir": 0.2984773128844349, "get_state_dump": 0.004765164852142334, "get_robot_state": 0.003580528497695923, "sim_render-ego0": 0.0038483023643493654, "get_duckie_state": 2.1278858184814455e-06, "in-drivable-lane": 0.8500000000000008, "deviation-heading": 0.3808975913832409, "agent_compute-ego0": 0.011572885513305663, "complete-iteration": 0.22509127259254455, "set_robot_commands": 0.002172112464904785, "deviation-center-line": 0.07457236766141423, "driven_lanedir_consec": 0.2984773128844349, "sim_compute_sim_state": 0.00881609320640564, "sim_compute_performance-ego0": 0.001954686641693115}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6821492193337455, "get_ui_image": 0.025540821175826223, "step_physics": 0.0981765345523232, "survival_time": 4.699999999999991, "driven_lanedir": 0.29358038412028975, "get_state_dump": 0.004570817947387696, "get_robot_state": 0.003675046720002827, "sim_render-ego0": 0.003763607928627416, "get_duckie_state": 2.0855351498252465e-06, "in-drivable-lane": 3.6999999999999913, "deviation-heading": 0.26534871611847816, "agent_compute-ego0": 0.011043234875327662, "complete-iteration": 0.15699955789666423, "set_robot_commands": 0.0021823130155864514, "deviation-center-line": 0.1085637344784548, "driven_lanedir_consec": 0.29358038412028975, "sim_compute_sim_state": 0.006005467866596423, "sim_compute_performance-ego0": 0.001954199138440584}}
set_robot_commands_max0.0022650729608899764
set_robot_commands_mean0.002169065886967572
set_robot_commands_median0.0021772127402456183
set_robot_commands_min0.0020567651064890735
sim_compute_performance-ego0_max0.0020422334889419204
sim_compute_performance-ego0_mean0.0019787500239794326
sim_compute_performance-ego0_median0.001959283734267613
sim_compute_performance-ego0_min0.001954199138440584
sim_compute_sim_state_max0.010650421826894046
sim_compute_sim_state_mean0.007966420231611312
sim_compute_sim_state_median0.00760489561647739
sim_compute_sim_state_min0.006005467866596423
sim_render-ego0_max0.0038703197741326487
sim_render-ego0_mean0.003812144461069534
sim_render-ego0_median0.003807325070759035
sim_render-ego0_min0.003763607928627416
simulation-passed1
step_physics_max0.15834463834762574
step_physics_mean0.1251507070563379
step_physics_median0.12204082766270131
step_physics_min0.0981765345523232
survival_time_max6.499999999999985
survival_time_mean3.937499999999994
survival_time_min1.950000000000001
No reset possible
5364712727Bea Baselines 🐤template-randomaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-010:08:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5758601445640131
survival_time_median6.099999999999986
deviation-center-line_median0.17553830655708547
in-drivable-lane_median3.29999999999999


other stats
agent_compute-ego0_max0.012585885901200144
agent_compute-ego0_mean0.011812075691050292
agent_compute-ego0_median0.011812075691050292
agent_compute-ego0_min0.011038265480900445
agent_compute-ego1_max0.012158632278442385
agent_compute-ego1_mean0.011775415464742294
agent_compute-ego1_median0.011775415464742294
agent_compute-ego1_min0.011392198651042204
agent_compute-ego2_max0.012678246749074836
agent_compute-ego2_mean0.011625921156980634
agent_compute-ego2_median0.011625921156980634
agent_compute-ego2_min0.010573595564886434
agent_compute-ego3_max0.013043207871286492
agent_compute-ego3_mean0.01216173410498751
agent_compute-ego3_median0.01216173410498751
agent_compute-ego3_min0.011280260338688527
complete-iteration_max1.029521272056981
complete-iteration_mean0.938607601622498
complete-iteration_median0.938607601622498
complete-iteration_min0.847693931188015
deviation-center-line_max0.47013425987002005
deviation-center-line_mean0.2174177284809568
deviation-center-line_min0.0720091252708566
deviation-heading_max3.0542186889712815
deviation-heading_mean1.2634654122591242
deviation-heading_median1.0697442157871273
deviation-heading_min0.3081468886732283
driven_any_max2.8773005288041658
driven_any_mean1.716787495843618
driven_any_median1.6399654313822998
driven_any_min0.38662204608009304
driven_lanedir_consec_max1.8220023141314807
driven_lanedir_consec_mean0.7121644428869928
driven_lanedir_consec_min0.30949264303267476
driven_lanedir_max1.8220034571617316
driven_lanedir_mean0.7349677350690881
driven_lanedir_median0.5758601445640131
driven_lanedir_min0.30949264303267476
get_duckie_state_max2.105612503854852e-06
get_duckie_state_mean1.8446401421223503e-06
get_duckie_state_median1.8446401421223503e-06
get_duckie_state_min1.583667780389849e-06
get_robot_state_max0.01520905243723016
get_robot_state_mean0.015123727156252513
get_robot_state_median0.015123727156252513
get_robot_state_min0.01503840187527486
get_state_dump_max0.010197466298153528
get_state_dump_mean0.010056983024328585
get_state_dump_median0.010056983024328585
get_state_dump_min0.00991649975050364
get_ui_image_max0.05681052428997115
get_ui_image_mean0.05485486592844248
get_ui_image_median0.05485486592844248
get_ui_image_min0.05289920756691381
in-drivable-lane_max6.049999999999983
in-drivable-lane_mean3.4749999999999894
in-drivable-lane_min0.9999999999999998
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 2.831813082003494, "get_ui_image": 0.05681052428997115, "step_physics": 0.6526446152996543, "survival_time": 7.499999999999981, "driven_lanedir": 1.8220034571617316, "get_state_dump": 0.00991649975050364, "get_robot_state": 0.01503840187527486, "sim_render-ego0": 0.0039482558799895226, "sim_render-ego1": 0.0040215782771836845, "sim_render-ego2": 0.003944922756675064, "sim_render-ego3": 0.003861327834476698, "get_duckie_state": 1.583667780389849e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 0.3442852314393885, "agent_compute-ego0": 0.011038265480900445, "agent_compute-ego1": 0.011392198651042204, "agent_compute-ego2": 0.010573595564886434, "agent_compute-ego3": 0.011280260338688527, "complete-iteration": 0.847693931188015, "set_robot_commands": 0.002309254463145275, "deviation-center-line": 0.22968417496144336, "driven_lanedir_consec": 1.8220023141314807, "sim_compute_sim_state": 0.03521407834741454, "sim_compute_performance-ego0": 0.0021824663048548416, "sim_compute_performance-ego1": 0.0020743032164921033, "sim_compute_performance-ego2": 0.0020529355434392464, "sim_compute_performance-ego3": 0.00206490226139296}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.3028841294963844, "get_ui_image": 0.05681052428997115, "step_physics": 0.6526446152996543, "survival_time": 7.499999999999981, "driven_lanedir": 0.4284094322301284, "get_state_dump": 0.00991649975050364, "get_robot_state": 0.01503840187527486, "sim_render-ego0": 0.0039482558799895226, "sim_render-ego1": 0.0040215782771836845, "sim_render-ego2": 0.003944922756675064, "sim_render-ego3": 0.003861327834476698, "get_duckie_state": 1.583667780389849e-06, "in-drivable-lane": 5.799999999999981, "deviation-heading": 1.002056979235454, "agent_compute-ego0": 0.011038265480900445, "agent_compute-ego1": 0.011392198651042204, "agent_compute-ego2": 0.010573595564886434, "agent_compute-ego3": 0.011280260338688527, "complete-iteration": 0.847693931188015, "set_robot_commands": 0.002309254463145275, "deviation-center-line": 0.1213924381527276, "driven_lanedir_consec": 0.4284094322301284, "sim_compute_sim_state": 0.03521407834741454, "sim_compute_performance-ego0": 0.0021824663048548416, "sim_compute_performance-ego1": 0.0020743032164921033, "sim_compute_performance-ego2": 0.0020529355434392464, "sim_compute_performance-ego3": 0.00206490226139296}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 1.9654839397698145, "get_ui_image": 0.05681052428997115, "step_physics": 0.6526446152996543, "survival_time": 7.499999999999981, "driven_lanedir": 0.3166075872147196, "get_state_dump": 0.00991649975050364, "get_robot_state": 0.01503840187527486, "sim_render-ego0": 0.0039482558799895226, "sim_render-ego1": 0.0040215782771836845, "sim_render-ego2": 0.003944922756675064, "sim_render-ego3": 0.003861327834476698, "get_duckie_state": 1.583667780389849e-06, "in-drivable-lane": 6.049999999999983, "deviation-heading": 1.1374314523388007, "agent_compute-ego0": 0.011038265480900445, "agent_compute-ego1": 0.011392198651042204, "agent_compute-ego2": 0.010573595564886434, "agent_compute-ego3": 0.011280260338688527, "complete-iteration": 0.847693931188015, "set_robot_commands": 0.002309254463145275, "deviation-center-line": 0.10797637530751922, "driven_lanedir_consec": 0.3166075872147196, "sim_compute_sim_state": 0.03521407834741454, "sim_compute_performance-ego0": 0.0021824663048548416, "sim_compute_performance-ego1": 0.0020743032164921033, "sim_compute_performance-ego2": 0.0020529355434392464, "sim_compute_performance-ego3": 0.00206490226139296}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 2.8773005288041658, "get_ui_image": 0.05681052428997115, "step_physics": 0.6526446152996543, "survival_time": 7.499999999999981, "driven_lanedir": 1.093112188430767, "get_state_dump": 0.00991649975050364, "get_robot_state": 0.01503840187527486, "sim_render-ego0": 0.0039482558799895226, "sim_render-ego1": 0.0040215782771836845, "sim_render-ego2": 0.003944922756675064, "sim_render-ego3": 0.003861327834476698, "get_duckie_state": 1.583667780389849e-06, "in-drivable-lane": 4.199999999999985, "deviation-heading": 1.4050102318329205, "agent_compute-ego0": 0.011038265480900445, "agent_compute-ego1": 0.011392198651042204, "agent_compute-ego2": 0.010573595564886434, "agent_compute-ego3": 0.011280260338688527, "complete-iteration": 0.847693931188015, "set_robot_commands": 0.002309254463145275, "deviation-center-line": 0.2963999319120335, "driven_lanedir_consec": 1.019001024923512, "sim_compute_sim_state": 0.03521407834741454, "sim_compute_performance-ego0": 0.0021824663048548416, "sim_compute_performance-ego1": 0.0020743032164921033, "sim_compute_performance-ego2": 0.0020529355434392464, "sim_compute_performance-ego3": 0.00206490226139296}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 1.6280751458799152, "get_ui_image": 0.05289920756691381, "step_physics": 0.8364373658832751, "survival_time": 4.699999999999991, "driven_lanedir": 0.7583962833546565, "get_state_dump": 0.010197466298153528, "get_robot_state": 0.01520905243723016, "sim_render-ego0": 0.004105914266485917, "sim_render-ego1": 0.0039172197643079255, "sim_render-ego2": 0.004071386236893504, "sim_render-ego3": 0.003996889214766653, "get_duckie_state": 2.105612503854852e-06, "in-drivable-lane": 1.2999999999999958, "deviation-heading": 2.3745112943922093, "agent_compute-ego0": 0.012585885901200144, "agent_compute-ego1": 0.012158632278442385, "agent_compute-ego2": 0.012678246749074836, "agent_compute-ego3": 0.013043207871286492, "complete-iteration": 1.029521272056981, "set_robot_commands": 0.002431781668412058, "deviation-center-line": 0.35315000024132365, "driven_lanedir_consec": 0.6500822524354004, "sim_compute_sim_state": 0.029702675969977128, "sim_compute_performance-ego0": 0.0023413959302400287, "sim_compute_performance-ego1": 0.0020593894155401934, "sim_compute_performance-ego2": 0.002085397118016293, "sim_compute_performance-ego3": 0.002073599162854646}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.651855716884684, "get_ui_image": 0.05289920756691381, "step_physics": 0.8364373658832751, "survival_time": 4.699999999999991, "driven_lanedir": 0.6448691596131364, "get_state_dump": 0.010197466298153528, "get_robot_state": 0.01520905243723016, "sim_render-ego0": 0.004105914266485917, "sim_render-ego1": 0.0039172197643079255, "sim_render-ego2": 0.004071386236893504, "sim_render-ego3": 0.003996889214766653, "get_duckie_state": 2.105612503854852e-06, "in-drivable-lane": 2.8499999999999903, "deviation-heading": 0.3081468886732283, "agent_compute-ego0": 0.012585885901200144, "agent_compute-ego1": 0.012158632278442385, "agent_compute-ego2": 0.012678246749074836, "agent_compute-ego3": 0.013043207871286492, "complete-iteration": 1.029521272056981, "set_robot_commands": 0.002431781668412058, "deviation-center-line": 0.08859552213173046, "driven_lanedir_consec": 0.6448691596131364, "sim_compute_sim_state": 0.029702675969977128, "sim_compute_performance-ego0": 0.0023413959302400287, "sim_compute_performance-ego1": 0.0020593894155401934, "sim_compute_performance-ego2": 0.002085397118016293, "sim_compute_performance-ego3": 0.002073599162854646}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 1.0902653778303937, "get_ui_image": 0.05289920756691381, "step_physics": 0.8364373658832751, "survival_time": 4.699999999999991, "driven_lanedir": 0.5068511295148899, "get_state_dump": 0.010197466298153528, "get_robot_state": 0.01520905243723016, "sim_render-ego0": 0.004105914266485917, "sim_render-ego1": 0.0039172197643079255, "sim_render-ego2": 0.004071386236893504, "sim_render-ego3": 0.003996889214766653, "get_duckie_state": 2.105612503854852e-06, "in-drivable-lane": 0.9999999999999998, "deviation-heading": 3.0542186889712815, "agent_compute-ego0": 0.012585885901200144, "agent_compute-ego1": 0.012158632278442385, "agent_compute-ego2": 0.012678246749074836, "agent_compute-ego3": 0.013043207871286492, "complete-iteration": 1.029521272056981, "set_robot_commands": 0.002431781668412058, "deviation-center-line": 0.47013425987002005, "driven_lanedir_consec": 0.5068511295148899, "sim_compute_sim_state": 0.029702675969977128, "sim_compute_performance-ego0": 0.0023413959302400287, "sim_compute_performance-ego1": 0.0020593894155401934, "sim_compute_performance-ego2": 0.002085397118016293, "sim_compute_performance-ego3": 0.002073599162854646}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.38662204608009304, "get_ui_image": 0.05289920756691381, "step_physics": 0.8364373658832751, "survival_time": 4.699999999999991, "driven_lanedir": 0.30949264303267476, "get_state_dump": 0.010197466298153528, "get_robot_state": 0.01520905243723016, "sim_render-ego0": 0.004105914266485917, "sim_render-ego1": 0.0039172197643079255, "sim_render-ego2": 0.004071386236893504, "sim_render-ego3": 0.003996889214766653, "get_duckie_state": 2.105612503854852e-06, "in-drivable-lane": 3.549999999999991, "deviation-heading": 0.4820625311897111, "agent_compute-ego0": 0.012585885901200144, "agent_compute-ego1": 0.012158632278442385, "agent_compute-ego2": 0.012678246749074836, "agent_compute-ego3": 0.013043207871286492, "complete-iteration": 1.029521272056981, "set_robot_commands": 0.002431781668412058, "deviation-center-line": 0.0720091252708566, "driven_lanedir_consec": 0.30949264303267476, "sim_compute_sim_state": 0.029702675969977128, "sim_compute_performance-ego0": 0.0023413959302400287, "sim_compute_performance-ego1": 0.0020593894155401934, "sim_compute_performance-ego2": 0.002085397118016293, "sim_compute_performance-ego3": 0.002073599162854646}}
set_robot_commands_max0.002431781668412058
set_robot_commands_mean0.002370518065778666
set_robot_commands_median0.002370518065778666
set_robot_commands_min0.002309254463145275
sim_compute_performance-ego0_max0.0023413959302400287
sim_compute_performance-ego0_mean0.0022619311175474353
sim_compute_performance-ego0_median0.0022619311175474353
sim_compute_performance-ego0_min0.0021824663048548416
sim_compute_performance-ego1_max0.0020743032164921033
sim_compute_performance-ego1_mean0.0020668463160161484
sim_compute_performance-ego1_median0.0020668463160161484
sim_compute_performance-ego1_min0.0020593894155401934
sim_compute_performance-ego2_max0.002085397118016293
sim_compute_performance-ego2_mean0.0020691663307277697
sim_compute_performance-ego2_median0.0020691663307277697
sim_compute_performance-ego2_min0.0020529355434392464
sim_compute_performance-ego3_max0.002073599162854646
sim_compute_performance-ego3_mean0.002069250712123803
sim_compute_performance-ego3_median0.002069250712123803
sim_compute_performance-ego3_min0.00206490226139296
sim_compute_sim_state_max0.03521407834741454
sim_compute_sim_state_mean0.03245837715869583
sim_compute_sim_state_median0.03245837715869583
sim_compute_sim_state_min0.029702675969977128
sim_render-ego0_max0.004105914266485917
sim_render-ego0_mean0.004027085073237719
sim_render-ego0_median0.004027085073237719
sim_render-ego0_min0.0039482558799895226
sim_render-ego1_max0.0040215782771836845
sim_render-ego1_mean0.003969399020745805
sim_render-ego1_median0.003969399020745805
sim_render-ego1_min0.0039172197643079255
sim_render-ego2_max0.004071386236893504
sim_render-ego2_mean0.004008154496784284
sim_render-ego2_median0.004008154496784284
sim_render-ego2_min0.003944922756675064
sim_render-ego3_max0.003996889214766653
sim_render-ego3_mean0.003929108524621676
sim_render-ego3_median0.003929108524621676
sim_render-ego3_min0.003861327834476698
simulation-passed1
step_physics_max0.8364373658832751
step_physics_mean0.7445409905914647
step_physics_median0.7445409905914647
step_physics_min0.6526446152996543
survival_time_max7.499999999999981
survival_time_mean6.099999999999986
survival_time_min4.699999999999991
No reset possible
5364312580Bea Baselines 🐤template-rosaido5-LFI-full-sim-testingLFVIv-simsuccessyesnogpu-prod-010:03:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.49432122607494344
survival_time_median7.024999999999983
deviation-center-line_median0.2291869969458572
in-drivable-lane_median4.549999999999986


other stats
agent_compute-ego0_max0.01412567320991965
agent_compute-ego0_mean0.013862185773490764
agent_compute-ego0_median0.013862185773490764
agent_compute-ego0_min0.013598698337061876
complete-iteration_max0.2461339393082787
complete-iteration_mean0.24560536594450977
complete-iteration_median0.24560536594450977
complete-iteration_min0.2450767925807408
deviation-center-line_max0.23473922415174917
deviation-center-line_mean0.2291869969458572
deviation-center-line_min0.22363476973996524
deviation-heading_max1.428064757187096
deviation-heading_mean1.3002326319996789
deviation-heading_median1.3002326319996789
deviation-heading_min1.1724005068122616
driven_any_max1.7802969423088617
driven_any_mean1.7582197523949576
driven_any_median1.7582197523949576
driven_any_min1.7361425624810536
driven_lanedir_consec_max0.5624403895452856
driven_lanedir_consec_mean0.49432122607494344
driven_lanedir_consec_min0.4262020626046012
driven_lanedir_max0.5624403895452856
driven_lanedir_mean0.49432122607494344
driven_lanedir_median0.49432122607494344
driven_lanedir_min0.4262020626046012
get_duckie_state_max1.756512388891103e-06
get_duckie_state_mean1.717980454663555e-06
get_duckie_state_median1.717980454663555e-06
get_duckie_state_min1.6794485204360064e-06
get_robot_state_max0.004179347963894115
get_robot_state_mean0.00415423452830305
get_robot_state_median0.00415423452830305
get_robot_state_min0.004129121092711987
get_state_dump_max0.005561099332921645
get_state_dump_mean0.005502889231711971
get_state_dump_median0.005502889231711971
get_state_dump_min0.005444679130502298
get_ui_image_max0.041114782585817224
get_ui_image_mean0.04061418396084249
get_ui_image_median0.04061418396084249
get_ui_image_min0.040113585335867744
in-drivable-lane_max4.949999999999985
in-drivable-lane_mean4.549999999999986
in-drivable-lane_min4.149999999999986
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 1.7361425624810536, "get_ui_image": 0.041114782585817224, "step_physics": 0.1593687586924609, "survival_time": 6.749999999999984, "driven_lanedir": 0.5624403895452856, "get_state_dump": 0.005561099332921645, "get_robot_state": 0.004179347963894115, "sim_render-ego0": 0.004239355816560633, "get_duckie_state": 1.6794485204360064e-06, "in-drivable-lane": 4.149999999999986, "deviation-heading": 1.1724005068122616, "agent_compute-ego0": 0.01412567320991965, "complete-iteration": 0.2461339393082787, "set_robot_commands": 0.0025010792648091037, "deviation-center-line": 0.23473922415174917, "driven_lanedir_consec": 0.5624403895452856, "sim_compute_sim_state": 0.012564608279396506, "sim_compute_performance-ego0": 0.0023694844806895535}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7802969423088617, "get_ui_image": 0.040113585335867744, "step_physics": 0.16174142863474736, "survival_time": 7.299999999999982, "driven_lanedir": 0.4262020626046012, "get_state_dump": 0.005444679130502298, "get_robot_state": 0.004129121092711987, "sim_render-ego0": 0.004169475464593796, "get_duckie_state": 1.756512388891103e-06, "in-drivable-lane": 4.949999999999985, "deviation-heading": 1.428064757187096, "agent_compute-ego0": 0.013598698337061876, "complete-iteration": 0.2450767925807408, "set_robot_commands": 0.002498584539711881, "deviation-center-line": 0.22363476973996524, "driven_lanedir_consec": 0.4262020626046012, "sim_compute_sim_state": 0.010962108365532491, "sim_compute_performance-ego0": 0.00231202119061736}}
set_robot_commands_max0.0025010792648091037
set_robot_commands_mean0.002499831902260492
set_robot_commands_median0.002499831902260492
set_robot_commands_min0.002498584539711881
sim_compute_performance-ego0_max0.0023694844806895535
sim_compute_performance-ego0_mean0.002340752835653457
sim_compute_performance-ego0_median0.002340752835653457
sim_compute_performance-ego0_min0.00231202119061736
sim_compute_sim_state_max0.012564608279396506
sim_compute_sim_state_mean0.0117633583224645
sim_compute_sim_state_median0.0117633583224645
sim_compute_sim_state_min0.010962108365532491
sim_render-ego0_max0.004239355816560633
sim_render-ego0_mean0.004204415640577214
sim_render-ego0_median0.004204415640577214
sim_render-ego0_min0.004169475464593796
simulation-passed1
step_physics_max0.16174142863474736
step_physics_mean0.16055509366360413
step_physics_median0.16055509366360413
step_physics_min0.1593687586924609
survival_time_max7.299999999999982
survival_time_mean7.024999999999983
survival_time_min6.749999999999984
No reset possible
5363112692Bea Baselines 🐤template-randomaido5-LFI-full-sim-validationLFVIv-simabortedyesnogpu-prod-010:00:35
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5358212592Bea Baselines 🐤template-rosaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-010:13:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.712478279424638
survival_time_median8.825000000000003
deviation-center-line_median0.24592115138325532
in-drivable-lane_median5.500000000000009


other stats
agent_compute-ego0_max0.0133065406541179
agent_compute-ego0_mean0.013206126037784476
agent_compute-ego0_median0.013206126037784476
agent_compute-ego0_min0.013105711421451054
agent_compute-ego1_max0.01353625068090912
agent_compute-ego1_mean0.012937106733632865
agent_compute-ego1_median0.012937106733632865
agent_compute-ego1_min0.012337962786356607
agent_compute-ego2_max0.013335875102451869
agent_compute-ego2_mean0.013076039891752343
agent_compute-ego2_median0.013076039891752343
agent_compute-ego2_min0.012816204681052818
agent_compute-ego3_max0.013231228063772391
agent_compute-ego3_mean0.013074942496881846
agent_compute-ego3_median0.013074942496881846
agent_compute-ego3_min0.0129186569299913
complete-iteration_max1.1599930224117931
complete-iteration_mean1.0880172232265986
complete-iteration_median1.0880172232265986
complete-iteration_min1.016041424041404
deviation-center-line_max0.6371730436102692
deviation-center-line_mean0.2900049312449935
deviation-center-line_min0.12664974518966002
deviation-heading_max2.679262832987346
deviation-heading_mean1.5511810587530837
deviation-heading_median1.4813973093964603
deviation-heading_min0.5309472021524279
driven_any_max2.9175561473340266
driven_any_mean1.595063062205631
driven_any_median1.5286980932623253
driven_any_min1.094166779010447
driven_lanedir_consec_max0.935772562122486
driven_lanedir_consec_mean0.6452683881516471
driven_lanedir_consec_min0.25521524706790166
driven_lanedir_max1.1517250785209527
driven_lanedir_mean0.715962711574986
driven_lanedir_median0.7446170796418663
driven_lanedir_min0.2552153275564695
get_duckie_state_max2.904045850710761e-06
get_duckie_state_mean2.826688606661687e-06
get_duckie_state_median2.826688606661687e-06
get_duckie_state_min2.7493313626126125e-06
get_robot_state_max0.01559766611658541
get_robot_state_mean0.015502765077260068
get_robot_state_median0.015502765077260068
get_robot_state_min0.015407864037934723
get_state_dump_max0.01014194832191811
get_state_dump_mean0.009989621152660107
get_state_dump_median0.009989621152660107
get_state_dump_min0.009837293983402108
get_ui_image_max0.05923632033785483
get_ui_image_mean0.05698120381655606
get_ui_image_median0.05698120381655606
get_ui_image_min0.05472608729525729
in-drivable-lane_max8.500000000000023
in-drivable-lane_mean5.23750000000001
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 1.1085004754516852, "get_ui_image": 0.05923632033785483, "step_physics": 0.8081298878318385, "survival_time": 6.5999999999999845, "driven_lanedir": 1.0845914686810607, "get_state_dump": 0.009837293983402108, "get_robot_state": 0.01559766611658541, "sim_render-ego0": 0.004078628425311325, "sim_render-ego1": 0.003951857860823323, "sim_render-ego2": 0.00397867546942001, "sim_render-ego3": 0.004025670818816451, "get_duckie_state": 2.904045850710761e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.994054373977731, "agent_compute-ego0": 0.0133065406541179, "agent_compute-ego1": 0.01353625068090912, "agent_compute-ego2": 0.013335875102451869, "agent_compute-ego3": 0.0129186569299913, "complete-iteration": 1.016041424041404, "set_robot_commands": 0.002520969935825893, "deviation-center-line": 0.6371730436102692, "driven_lanedir_consec": 0.7789441012049213, "sim_compute_sim_state": 0.03518483334017875, "sim_compute_performance-ego0": 0.00233658274313561, "sim_compute_performance-ego1": 0.00209625860802213, "sim_compute_performance-ego2": 0.002197154482504479, "sim_compute_performance-ego3": 0.0021963442178597127}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.1870665469280377, "get_ui_image": 0.05923632033785483, "step_physics": 0.8081298878318385, "survival_time": 6.5999999999999845, "driven_lanedir": 0.37160033894430944, "get_state_dump": 0.009837293983402108, "get_robot_state": 0.01559766611658541, "sim_render-ego0": 0.004078628425311325, "sim_render-ego1": 0.003951857860823323, "sim_render-ego2": 0.00397867546942001, "sim_render-ego3": 0.004025670818816451, "get_duckie_state": 2.904045850710761e-06, "in-drivable-lane": 4.399999999999987, "deviation-heading": 1.4552512066331689, "agent_compute-ego0": 0.0133065406541179, "agent_compute-ego1": 0.01353625068090912, "agent_compute-ego2": 0.013335875102451869, "agent_compute-ego3": 0.0129186569299913, "complete-iteration": 1.016041424041404, "set_robot_commands": 0.002520969935825893, "deviation-center-line": 0.1607186069807639, "driven_lanedir_consec": 0.37160033894430944, "sim_compute_sim_state": 0.03518483334017875, "sim_compute_performance-ego0": 0.00233658274313561, "sim_compute_performance-ego1": 0.00209625860802213, "sim_compute_performance-ego2": 0.002197154482504479, "sim_compute_performance-ego3": 0.0021963442178597127}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 1.443740998153609, "get_ui_image": 0.05923632033785483, "step_physics": 0.8081298878318385, "survival_time": 6.5999999999999845, "driven_lanedir": 0.2552153275564695, "get_state_dump": 0.009837293983402108, "get_robot_state": 0.01559766611658541, "sim_render-ego0": 0.004078628425311325, "sim_render-ego1": 0.003951857860823323, "sim_render-ego2": 0.00397867546942001, "sim_render-ego3": 0.004025670818816451, "get_duckie_state": 2.904045850710761e-06, "in-drivable-lane": 3.499999999999992, "deviation-heading": 2.679262832987346, "agent_compute-ego0": 0.0133065406541179, "agent_compute-ego1": 0.01353625068090912, "agent_compute-ego2": 0.013335875102451869, "agent_compute-ego3": 0.0129186569299913, "complete-iteration": 1.016041424041404, "set_robot_commands": 0.002520969935825893, "deviation-center-line": 0.2714457292220315, "driven_lanedir_consec": 0.25521524706790166, "sim_compute_sim_state": 0.03518483334017875, "sim_compute_performance-ego0": 0.00233658274313561, "sim_compute_performance-ego1": 0.00209625860802213, "sim_compute_performance-ego2": 0.002197154482504479, "sim_compute_performance-ego3": 0.0021963442178597127}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 1.6457540766455503, "get_ui_image": 0.05923632033785483, "step_physics": 0.8081298878318385, "survival_time": 6.5999999999999845, "driven_lanedir": 0.47365427193347953, "get_state_dump": 0.009837293983402108, "get_robot_state": 0.01559766611658541, "sim_render-ego0": 0.004078628425311325, "sim_render-ego1": 0.003951857860823323, "sim_render-ego2": 0.00397867546942001, "sim_render-ego3": 0.004025670818816451, "get_duckie_state": 2.904045850710761e-06, "in-drivable-lane": 3.799999999999988, "deviation-heading": 1.9834100134299504, "agent_compute-ego0": 0.0133065406541179, "agent_compute-ego1": 0.01353625068090912, "agent_compute-ego2": 0.013335875102451869, "agent_compute-ego3": 0.0129186569299913, "complete-iteration": 1.016041424041404, "set_robot_commands": 0.002520969935825893, "deviation-center-line": 0.2203965735444791, "driven_lanedir_consec": 0.4296996489099425, "sim_compute_sim_state": 0.03518483334017875, "sim_compute_performance-ego0": 0.00233658274313561, "sim_compute_performance-ego1": 0.00209625860802213, "sim_compute_performance-ego2": 0.002197154482504479, "sim_compute_performance-ego3": 0.0021963442178597127}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 1.094166779010447, "get_ui_image": 0.05472608729525729, "step_physics": 0.9627561579953444, "survival_time": 11.050000000000022, "driven_lanedir": 0.6460124576443547, "get_state_dump": 0.01014194832191811, "get_robot_state": 0.015407864037934723, "sim_render-ego0": 0.004063751246478106, "sim_render-ego1": 0.0038639693646817593, "sim_render-ego2": 0.003967365703067264, "sim_render-ego3": 0.003993502608290664, "get_duckie_state": 2.7493313626126125e-06, "in-drivable-lane": 8.500000000000023, "deviation-heading": 0.5309472021524279, "agent_compute-ego0": 0.013105711421451054, "agent_compute-ego1": 0.012337962786356607, "agent_compute-ego2": 0.012816204681052818, "agent_compute-ego3": 0.013231228063772391, "complete-iteration": 1.1599930224117931, "set_robot_commands": 0.002436478932698568, "deviation-center-line": 0.17730873854751092, "driven_lanedir_consec": 0.6460124576443547, "sim_compute_sim_state": 0.031201198294356063, "sim_compute_performance-ego0": 0.0022494621105022257, "sim_compute_performance-ego1": 0.0020799250216097446, "sim_compute_performance-ego2": 0.002088093542837882, "sim_compute_performance-ego3": 0.002097396163253097}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.75006428575065, "get_ui_image": 0.05472608729525729, "step_physics": 0.9627561579953444, "survival_time": 11.050000000000022, "driven_lanedir": 0.8432217016393779, "get_state_dump": 0.01014194832191811, "get_robot_state": 0.015407864037934723, "sim_render-ego0": 0.004063751246478106, "sim_render-ego1": 0.0038639693646817593, "sim_render-ego2": 0.003967365703067264, "sim_render-ego3": 0.003993502608290664, "get_duckie_state": 2.7493313626126125e-06, "in-drivable-lane": 7.800000000000026, "deviation-heading": 0.9167182736677764, "agent_compute-ego0": 0.013105711421451054, "agent_compute-ego1": 0.012337962786356607, "agent_compute-ego2": 0.012816204681052818, "agent_compute-ego3": 0.013231228063772391, "complete-iteration": 1.1599930224117931, "set_robot_commands": 0.002436478932698568, "deviation-center-line": 0.12664974518966002, "driven_lanedir_consec": 0.8432217016393779, "sim_compute_sim_state": 0.031201198294356063, "sim_compute_performance-ego0": 0.0022494621105022257, "sim_compute_performance-ego1": 0.0020799250216097446, "sim_compute_performance-ego2": 0.002088093542837882, "sim_compute_performance-ego3": 0.002097396163253097}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 2.9175561473340266, "get_ui_image": 0.05472608729525729, "step_physics": 0.9627561579953444, "survival_time": 11.050000000000022, "driven_lanedir": 0.9016810476798838, "get_state_dump": 0.01014194832191811, "get_robot_state": 0.015407864037934723, "sim_render-ego0": 0.004063751246478106, "sim_render-ego1": 0.0038639693646817593, "sim_render-ego2": 0.003967365703067264, "sim_render-ego3": 0.003993502608290664, "get_duckie_state": 2.7493313626126125e-06, "in-drivable-lane": 7.300000000000028, "deviation-heading": 1.5075434121597515, "agent_compute-ego0": 0.013105711421451054, "agent_compute-ego1": 0.012337962786356607, "agent_compute-ego2": 0.012816204681052818, "agent_compute-ego3": 0.013231228063772391, "complete-iteration": 1.1599930224117931, "set_robot_commands": 0.002436478932698568, "deviation-center-line": 0.3140751991741098, "driven_lanedir_consec": 0.9016810476798838, "sim_compute_sim_state": 0.031201198294356063, "sim_compute_performance-ego0": 0.0022494621105022257, "sim_compute_performance-ego1": 0.0020799250216097446, "sim_compute_performance-ego2": 0.002088093542837882, "sim_compute_performance-ego3": 0.002097396163253097}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.6136551883710422, "get_ui_image": 0.05472608729525729, "step_physics": 0.9627561579953444, "survival_time": 11.050000000000022, "driven_lanedir": 1.1517250785209527, "get_state_dump": 0.01014194832191811, "get_robot_state": 0.015407864037934723, "sim_render-ego0": 0.004063751246478106, "sim_render-ego1": 0.0038639693646817593, "sim_render-ego2": 0.003967365703067264, "sim_render-ego3": 0.003993502608290664, "get_duckie_state": 2.7493313626126125e-06, "in-drivable-lane": 6.60000000000003, "deviation-heading": 1.3422611550165189, "agent_compute-ego0": 0.013105711421451054, "agent_compute-ego1": 0.012337962786356607, "agent_compute-ego2": 0.012816204681052818, "agent_compute-ego3": 0.013231228063772391, "complete-iteration": 1.1599930224117931, "set_robot_commands": 0.002436478932698568, "deviation-center-line": 0.4122718136911234, "driven_lanedir_consec": 0.935772562122486, "sim_compute_sim_state": 0.031201198294356063, "sim_compute_performance-ego0": 0.0022494621105022257, "sim_compute_performance-ego1": 0.0020799250216097446, "sim_compute_performance-ego2": 0.002088093542837882, "sim_compute_performance-ego3": 0.002097396163253097}}
set_robot_commands_max0.002520969935825893
set_robot_commands_mean0.00247872443426223
set_robot_commands_median0.00247872443426223
set_robot_commands_min0.002436478932698568
sim_compute_performance-ego0_max0.00233658274313561
sim_compute_performance-ego0_mean0.002293022426818918
sim_compute_performance-ego0_median0.002293022426818918
sim_compute_performance-ego0_min0.0022494621105022257
sim_compute_performance-ego1_max0.00209625860802213
sim_compute_performance-ego1_mean0.0020880918148159376
sim_compute_performance-ego1_median0.0020880918148159376
sim_compute_performance-ego1_min0.0020799250216097446
sim_compute_performance-ego2_max0.002197154482504479
sim_compute_performance-ego2_mean0.00214262401267118
sim_compute_performance-ego2_median0.00214262401267118
sim_compute_performance-ego2_min0.002088093542837882
sim_compute_performance-ego3_max0.0021963442178597127
sim_compute_performance-ego3_mean0.002146870190556405
sim_compute_performance-ego3_median0.002146870190556405
sim_compute_performance-ego3_min0.002097396163253097
sim_compute_sim_state_max0.03518483334017875
sim_compute_sim_state_mean0.033193015817267406
sim_compute_sim_state_median0.033193015817267406
sim_compute_sim_state_min0.031201198294356063
sim_render-ego0_max0.004078628425311325
sim_render-ego0_mean0.004071189835894716
sim_render-ego0_median0.004071189835894716
sim_render-ego0_min0.004063751246478106
sim_render-ego1_max0.003951857860823323
sim_render-ego1_mean0.003907913612752541
sim_render-ego1_median0.003907913612752541
sim_render-ego1_min0.0038639693646817593
sim_render-ego2_max0.00397867546942001
sim_render-ego2_mean0.003973020586243637
sim_render-ego2_median0.003973020586243637
sim_render-ego2_min0.003967365703067264
sim_render-ego3_max0.004025670818816451
sim_render-ego3_mean0.004009586713553557
sim_render-ego3_median0.004009586713553557
sim_render-ego3_min0.003993502608290664
simulation-passed1
step_physics_max0.9627561579953444
step_physics_mean0.8854430229135914
step_physics_median0.8854430229135914
step_physics_min0.8081298878318385
survival_time_max11.050000000000022
survival_time_mean8.825000000000003
survival_time_min6.5999999999999845
No reset possible
5355012598Bea Baselines 🐤template-randomaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessyesnogpu-prod-010:12:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6824877811914045
survival_time_median5.899999999999987
deviation-center-line_median0.12472377253302876
in-drivable-lane_median3.4999999999999876


other stats
agent_compute-ego0_max0.012646446228027344
agent_compute-ego0_mean0.010986840411060664
agent_compute-ego0_median0.011042470023745582
agent_compute-ego0_min0.009522558260364692
agent_compute-ego1_max0.012616284234183177
agent_compute-ego1_mean0.011243301126755636
agent_compute-ego1_median0.011202446619669596
agent_compute-ego1_min0.010074300765991213
complete-iteration_max0.8535693781716484
complete-iteration_mean0.6987259914780578
complete-iteration_median0.8095992292676654
complete-iteration_min0.2524415349960327
deviation-center-line_max0.3720891524232108
deviation-center-line_mean0.14685622741377286
deviation-center-line_min0.05518112651933551
deviation-heading_max0.867080540349331
deviation-heading_mean0.5357711264887624
deviation-heading_median0.5079772825538268
deviation-heading_min0.26252044590060647
driven_any_max3.446854510378138
driven_any_mean1.820198672632691
driven_any_median1.6714945309441915
driven_any_min0.8190735567943087
driven_lanedir_consec_max1.3675792451083173
driven_lanedir_consec_mean0.7011373480211068
driven_lanedir_consec_min0.11975322687645118
driven_lanedir_max1.3675792451083173
driven_lanedir_mean0.7011373480211068
driven_lanedir_median0.6824877811914045
driven_lanedir_min0.11975322687645118
get_duckie_state_max1.6416822160993305e-06
get_duckie_state_mean1.551432340514331e-06
get_duckie_state_median1.5599387032645089e-06
get_duckie_state_min1.41143798828125e-06
get_robot_state_max0.015783555167061942
get_robot_state_mean0.014085473544886705
get_robot_state_median0.015007986741907457
get_robot_state_min0.007137813568115234
get_state_dump_max0.010245291392008464
get_state_dump_mean0.00951717914987345
get_state_dump_median0.01008882442442309
get_state_dump_min0.006226677894592286
get_ui_image_max0.04962793304806664
get_ui_image_mean0.04510803653889535
get_ui_image_median0.04850890023367745
get_ui_image_min0.030417842864990233
in-drivable-lane_max7.7499999999999885
in-drivable-lane_mean4.346428571428561
in-drivable-lane_min2.499999999999991
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.6675608627969534, "get_ui_image": 0.04453237317189449, "step_physics": 0.4881505365131282, "survival_time": 5.899999999999987, "driven_lanedir": 0.7346281785949911, "get_state_dump": 0.01008882442442309, "get_robot_state": 0.015007986741907457, "sim_render-ego0": 0.0038082860097163863, "sim_render-ego1": 0.003769582059203076, "sim_render-ego2": 0.003906544517068302, "sim_render-ego3": 0.0037972306003089713, "get_duckie_state": 1.5226732782956934e-06, "in-drivable-lane": 3.8499999999999863, "deviation-heading": 0.469738838674098, "agent_compute-ego0": 0.009522558260364692, "agent_compute-ego1": 0.01049567270679634, "agent_compute-ego2": 0.01037184731299136, "agent_compute-ego3": 0.0097658073200899, "complete-iteration": 0.6561515952358726, "set_robot_commands": 0.0022686128856755105, "deviation-center-line": 0.09483029131067588, "driven_lanedir_consec": 0.7346281785949911, "sim_compute_sim_state": 0.025755315267739175, "sim_compute_performance-ego0": 0.002142713851287585, "sim_compute_performance-ego1": 0.0019793951210855436, "sim_compute_performance-ego2": 0.001951229672472016, "sim_compute_performance-ego3": 0.0019914562962636225}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.2509378169054304, "get_ui_image": 0.04453237317189449, "step_physics": 0.4881505365131282, "survival_time": 5.899999999999987, "driven_lanedir": 1.3675792451083173, "get_state_dump": 0.01008882442442309, "get_robot_state": 0.015007986741907457, "sim_render-ego0": 0.0038082860097163863, "sim_render-ego1": 0.003769582059203076, "sim_render-ego2": 0.003906544517068302, "sim_render-ego3": 0.0037972306003089713, "get_duckie_state": 1.5226732782956934e-06, "in-drivable-lane": 2.499999999999991, "deviation-heading": 0.6629283611959488, "agent_compute-ego0": 0.009522558260364692, "agent_compute-ego1": 0.01049567270679634, "agent_compute-ego2": 0.01037184731299136, "agent_compute-ego3": 0.0097658073200899, "complete-iteration": 0.6561515952358726, "set_robot_commands": 0.0022686128856755105, "deviation-center-line": 0.3720891524232108, "driven_lanedir_consec": 1.3675792451083173, "sim_compute_sim_state": 0.025755315267739175, "sim_compute_performance-ego0": 0.002142713851287585, "sim_compute_performance-ego1": 0.0019793951210855436, "sim_compute_performance-ego2": 0.001951229672472016, "sim_compute_performance-ego3": 0.0019914562962636225}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.6203586225454043, "get_ui_image": 0.04453237317189449, "step_physics": 0.4881505365131282, "survival_time": 5.899999999999987, "driven_lanedir": 1.2561576430034282, "get_state_dump": 0.01008882442442309, "get_robot_state": 0.015007986741907457, "sim_render-ego0": 0.0038082860097163863, "sim_render-ego1": 0.003769582059203076, "sim_render-ego2": 0.003906544517068302, "sim_render-ego3": 0.0037972306003089713, "get_duckie_state": 1.5226732782956934e-06, "in-drivable-lane": 2.7499999999999902, "deviation-heading": 0.5462157264335555, "agent_compute-ego0": 0.009522558260364692, "agent_compute-ego1": 0.01049567270679634, "agent_compute-ego2": 0.01037184731299136, "agent_compute-ego3": 0.0097658073200899, "complete-iteration": 0.6561515952358726, "set_robot_commands": 0.0022686128856755105, "deviation-center-line": 0.14039104003872624, "driven_lanedir_consec": 1.2561576430034282, "sim_compute_sim_state": 0.025755315267739175, "sim_compute_performance-ego0": 0.002142713851287585, "sim_compute_performance-ego1": 0.0019793951210855436, "sim_compute_performance-ego2": 0.001951229672472016, "sim_compute_performance-ego3": 0.0019914562962636225}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.667560862796993, "get_ui_image": 0.04453237317189449, "step_physics": 0.4881505365131282, "survival_time": 5.899999999999987, "driven_lanedir": 0.719009961023402, "get_state_dump": 0.01008882442442309, "get_robot_state": 0.015007986741907457, "sim_render-ego0": 0.0038082860097163863, "sim_render-ego1": 0.003769582059203076, "sim_render-ego2": 0.003906544517068302, "sim_render-ego3": 0.0037972306003089713, "get_duckie_state": 1.5226732782956934e-06, "in-drivable-lane": 3.899999999999986, "deviation-heading": 0.4254966176967258, "agent_compute-ego0": 0.009522558260364692, "agent_compute-ego1": 0.01049567270679634, "agent_compute-ego2": 0.01037184731299136, "agent_compute-ego3": 0.0097658073200899, "complete-iteration": 0.6561515952358726, "set_robot_commands": 0.0022686128856755105, "deviation-center-line": 0.07109220477049745, "driven_lanedir_consec": 0.719009961023402, "sim_compute_sim_state": 0.025755315267739175, "sim_compute_performance-ego0": 0.002142713851287585, "sim_compute_performance-ego1": 0.0019793951210855436, "sim_compute_performance-ego2": 0.001951229672472016, "sim_compute_performance-ego3": 0.0019914562962636225}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.3478761906085373, "get_ui_image": 0.04962793304806664, "step_physics": 0.6626082170577277, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7173980024822183, "get_state_dump": 0.010245291392008464, "get_robot_state": 0.015783555167061942, "sim_render-ego0": 0.004165336063929967, "sim_render-ego1": 0.004201235089983259, "sim_render-ego2": 0.004052754810878209, "sim_render-ego3": 0.003937864303588867, "get_duckie_state": 1.5599387032645089e-06, "in-drivable-lane": 3.0499999999999914, "deviation-heading": 0.867080540349331, "agent_compute-ego0": 0.011042470023745582, "agent_compute-ego1": 0.011202446619669596, "agent_compute-ego2": 0.010687971115112304, "agent_compute-ego3": 0.01100208872840518, "complete-iteration": 0.8535693781716484, "set_robot_commands": 0.00228652727036249, "deviation-center-line": 0.18524260463403516, "driven_lanedir_consec": 0.7173980024822183, "sim_compute_sim_state": 0.03620189485095796, "sim_compute_performance-ego0": 0.00247911498660133, "sim_compute_performance-ego1": 0.0021935372125534785, "sim_compute_performance-ego2": 0.002226477577572777, "sim_compute_performance-ego3": 0.0021312804449172247}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.413599166315601, "get_ui_image": 0.04962793304806664, "step_physics": 0.6626082170577277, "survival_time": 5.1999999999999895, "driven_lanedir": 0.11975322687645118, "get_state_dump": 0.010245291392008464, "get_robot_state": 0.015783555167061942, "sim_render-ego0": 0.004165336063929967, "sim_render-ego1": 0.004201235089983259, "sim_render-ego2": 0.004052754810878209, "sim_render-ego3": 0.003937864303588867, "get_duckie_state": 1.5599387032645089e-06, "in-drivable-lane": 4.54999999999999, "deviation-heading": 0.41633267011024633, "agent_compute-ego0": 0.011042470023745582, "agent_compute-ego1": 0.011202446619669596, "agent_compute-ego2": 0.010687971115112304, "agent_compute-ego3": 0.01100208872840518, "complete-iteration": 0.8535693781716484, "set_robot_commands": 0.00228652727036249, "deviation-center-line": 0.05518112651933551, "driven_lanedir_consec": 0.11975322687645118, "sim_compute_sim_state": 0.03620189485095796, "sim_compute_performance-ego0": 0.00247911498660133, "sim_compute_performance-ego1": 0.0021935372125534785, "sim_compute_performance-ego2": 0.002226477577572777, "sim_compute_performance-ego3": 0.0021312804449172247}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.8859035020838468, "get_ui_image": 0.04962793304806664, "step_physics": 0.6626082170577277, "survival_time": 5.1999999999999895, "driven_lanedir": 0.9084889312577556, "get_state_dump": 0.010245291392008464, "get_robot_state": 0.015783555167061942, "sim_render-ego0": 0.004165336063929967, "sim_render-ego1": 0.004201235089983259, "sim_render-ego2": 0.004052754810878209, "sim_render-ego3": 0.003937864303588867, "get_duckie_state": 1.5599387032645089e-06, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 0.7560294458114469, "agent_compute-ego0": 0.011042470023745582, "agent_compute-ego1": 0.011202446619669596, "agent_compute-ego2": 0.010687971115112304, "agent_compute-ego3": 0.01100208872840518, "complete-iteration": 0.8535693781716484, "set_robot_commands": 0.00228652727036249, "deviation-center-line": 0.2274030062822905, "driven_lanedir_consec": 0.9084889312577556, "sim_compute_sim_state": 0.03620189485095796, "sim_compute_performance-ego0": 0.00247911498660133, "sim_compute_performance-ego1": 0.0021935372125534785, "sim_compute_performance-ego2": 0.002226477577572777, "sim_compute_performance-ego3": 0.0021312804449172247}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.3478761906085472, "get_ui_image": 0.04962793304806664, "step_physics": 0.6626082170577277, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6255720679354082, "get_state_dump": 0.010245291392008464, "get_robot_state": 0.015783555167061942, "sim_render-ego0": 0.004165336063929967, "sim_render-ego1": 0.004201235089983259, "sim_render-ego2": 0.004052754810878209, "sim_render-ego3": 0.003937864303588867, "get_duckie_state": 1.5599387032645089e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 0.7506184812162171, "agent_compute-ego0": 0.011042470023745582, "agent_compute-ego1": 0.011202446619669596, "agent_compute-ego2": 0.010687971115112304, "agent_compute-ego3": 0.01100208872840518, "complete-iteration": 0.8535693781716484, "set_robot_commands": 0.00228652727036249, "deviation-center-line": 0.1970464118524351, "driven_lanedir_consec": 0.6255720679354082, "sim_compute_sim_state": 0.03620189485095796, "sim_compute_performance-ego0": 0.00247911498660133, "sim_compute_performance-ego1": 0.0021935372125534785, "sim_compute_performance-ego2": 0.002226477577572777, "sim_compute_performance-ego3": 0.0021312804449172247}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8190735567943087, "get_ui_image": 0.04850890023367745, "step_physics": 0.6284230177743094, "survival_time": 8.699999999999989, "driven_lanedir": 0.204271039946744, "get_state_dump": 0.00986267226082938, "get_robot_state": 0.014938708714076453, "sim_render-ego0": 0.004059688023158482, "sim_render-ego1": 0.00396669660295759, "sim_render-ego2": 0.003905939374651228, "sim_render-ego3": 0.003771073477608817, "get_duckie_state": 1.6416822160993305e-06, "in-drivable-lane": 7.7499999999999885, "deviation-heading": 0.5956547684236475, "agent_compute-ego0": 0.012646446228027344, "agent_compute-ego1": 0.012616284234183177, "agent_compute-ego2": 0.012134817668369838, "agent_compute-ego3": 0.01165114266531808, "complete-iteration": 0.8095992292676654, "set_robot_commands": 0.0023610387529645646, "deviation-center-line": 0.06316401342706499, "driven_lanedir_consec": 0.204271039946744, "sim_compute_sim_state": 0.02502328872680664, "sim_compute_performance-ego0": 0.0021810899462018692, "sim_compute_performance-ego1": 0.002091866901942662, "sim_compute_performance-ego2": 0.0020293876102992466, "sim_compute_performance-ego3": 0.0020536654336111887}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.9291785515511695, "get_ui_image": 0.04850890023367745, "step_physics": 0.6284230177743094, "survival_time": 8.699999999999989, "driven_lanedir": 0.6475775599005906, "get_state_dump": 0.00986267226082938, "get_robot_state": 0.014938708714076453, "sim_render-ego0": 0.004059688023158482, "sim_render-ego1": 0.00396669660295759, "sim_render-ego2": 0.003905939374651228, "sim_render-ego3": 0.003771073477608817, "get_duckie_state": 1.6416822160993305e-06, "in-drivable-lane": 6.849999999999988, "deviation-heading": 0.26252044590060647, "agent_compute-ego0": 0.012646446228027344, "agent_compute-ego1": 0.012616284234183177, "agent_compute-ego2": 0.012134817668369838, "agent_compute-ego3": 0.01165114266531808, "complete-iteration": 0.8095992292676654, "set_robot_commands": 0.0023610387529645646, "deviation-center-line": 0.0775485848193056, "driven_lanedir_consec": 0.6475775599005906, "sim_compute_sim_state": 0.02502328872680664, "sim_compute_performance-ego0": 0.0021810899462018692, "sim_compute_performance-ego1": 0.002091866901942662, "sim_compute_performance-ego2": 0.0020293876102992466, "sim_compute_performance-ego3": 0.0020536654336111887}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.446854510378138, "get_ui_image": 0.04850890023367745, "step_physics": 0.6284230177743094, "survival_time": 8.699999999999989, "driven_lanedir": 0.5656387472941029, "get_state_dump": 0.00986267226082938, "get_robot_state": 0.014938708714076453, "sim_render-ego0": 0.004059688023158482, "sim_render-ego1": 0.00396669660295759, "sim_render-ego2": 0.003905939374651228, "sim_render-ego3": 0.003771073477608817, "get_duckie_state": 1.6416822160993305e-06, "in-drivable-lane": 7.049999999999987, "deviation-heading": 0.2665393864559088, "agent_compute-ego0": 0.012646446228027344, "agent_compute-ego1": 0.012616284234183177, "agent_compute-ego2": 0.012134817668369838, "agent_compute-ego3": 0.01165114266531808, "complete-iteration": 0.8095992292676654, "set_robot_commands": 0.0023610387529645646, "deviation-center-line": 0.1858875809975676, "driven_lanedir_consec": 0.5656387472941029, "sim_compute_sim_state": 0.02502328872680664, "sim_compute_performance-ego0": 0.0021810899462018692, "sim_compute_performance-ego1": 0.002091866901942662, "sim_compute_performance-ego2": 0.0020293876102992466, "sim_compute_performance-ego3": 0.0020536654336111887}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.6754281990913904, "get_ui_image": 0.04850890023367745, "step_physics": 0.6284230177743094, "survival_time": 8.699999999999989, "driven_lanedir": 0.531623736296337, "get_state_dump": 0.00986267226082938, "get_robot_state": 0.014938708714076453, "sim_render-ego0": 0.004059688023158482, "sim_render-ego1": 0.00396669660295759, "sim_render-ego2": 0.003905939374651228, "sim_render-ego3": 0.003771073477608817, "get_duckie_state": 1.6416822160993305e-06, "in-drivable-lane": 7.099999999999988, "deviation-heading": 0.3765924624405937, "agent_compute-ego0": 0.012646446228027344, "agent_compute-ego1": 0.012616284234183177, "agent_compute-ego2": 0.012134817668369838, "agent_compute-ego3": 0.01165114266531808, "complete-iteration": 0.8095992292676654, "set_robot_commands": 0.0023610387529645646, "deviation-center-line": 0.09654869044461176, "driven_lanedir_consec": 0.531623736296337, "sim_compute_sim_state": 0.02502328872680664, "sim_compute_performance-ego0": 0.0021810899462018692, "sim_compute_performance-ego1": 0.002091866901942662, "sim_compute_performance-ego2": 0.0020293876102992466, "sim_compute_performance-ego3": 0.0020536654336111887}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.7160571722130875, "get_ui_image": 0.030417842864990233, "step_physics": 0.1641351556777954, "survival_time": 4.94999999999999, "driven_lanedir": 0.7912652802573135, "get_state_dump": 0.006226677894592286, "get_robot_state": 0.007137813568115234, "sim_render-ego0": 0.0036005258560180666, "sim_render-ego1": 0.003571274280548096, "get_duckie_state": 1.41143798828125e-06, "in-drivable-lane": 2.79999999999999, "deviation-heading": 0.27730149789233977, "agent_compute-ego0": 0.010484933853149414, "agent_compute-ego1": 0.010074300765991213, "complete-iteration": 0.2524415349960327, "set_robot_commands": 0.002107772827148438, "deviation-center-line": 0.1090565050273313, "driven_lanedir_consec": 0.7912652802573135, "sim_compute_sim_state": 0.00877418279647827, "sim_compute_performance-ego0": 0.001889491081237793, "sim_compute_performance-ego1": 0.0018314218521118164}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.694516212168272, "get_ui_image": 0.030417842864990233, "step_physics": 0.1641351556777954, "survival_time": 4.94999999999999, "driven_lanedir": 0.6269592523184353, "get_state_dump": 0.006226677894592286, "get_robot_state": 0.007137813568115234, "sim_render-ego0": 0.0036005258560180666, "sim_render-ego1": 0.003571274280548096, "get_duckie_state": 1.41143798828125e-06, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 0.8277465282420078, "agent_compute-ego0": 0.010484933853149414, "agent_compute-ego1": 0.010074300765991213, "complete-iteration": 0.2524415349960327, "set_robot_commands": 0.002107772827148438, "deviation-center-line": 0.18050597124573223, "driven_lanedir_consec": 0.6269592523184353, "sim_compute_sim_state": 0.00877418279647827, "sim_compute_performance-ego0": 0.001889491081237793, "sim_compute_performance-ego1": 0.0018314218521118164}}
set_robot_commands_max0.0023610387529645646
set_robot_commands_mean0.0022771615207362247
set_robot_commands_median0.00228652727036249
set_robot_commands_min0.002107772827148438
sim_compute_performance-ego0_max0.00247911498660133
sim_compute_performance-ego0_mean0.0022136183784884807
sim_compute_performance-ego0_median0.0021810899462018692
sim_compute_performance-ego0_min0.001889491081237793
sim_compute_performance-ego1_max0.0021935372125534785
sim_compute_performance-ego1_mean0.0020515743318964543
sim_compute_performance-ego1_median0.002091866901942662
sim_compute_performance-ego1_min0.0018314218521118164
sim_compute_sim_state_max0.03620189485095796
sim_compute_sim_state_mean0.026105025783926546
sim_compute_sim_state_median0.025755315267739175
sim_compute_sim_state_min0.00877418279647827
sim_render-ego0_max0.004165336063929967
sim_render-ego0_mean0.003952449435661106
sim_render-ego0_median0.004059688023158482
sim_render-ego0_min0.0036005258560180666
sim_render-ego1_max0.004201235089983259
sim_render-ego1_mean0.003920900254976563
sim_render-ego1_median0.00396669660295759
sim_render-ego1_min0.003571274280548096
simulation-passed1
step_physics_max0.6626082170577277
step_physics_mean0.5317855283383037
step_physics_median0.6284230177743094
step_physics_min0.1641351556777954
survival_time_max8.699999999999989
survival_time_mean6.364285714285702
survival_time_min4.94999999999999
No reset possible
5353912601Bea Baselines 🐤template-randomaido5-LFI-sim-testingLFVIv-simsuccessyesnogpu-prod-010:02:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19295142106760688
survival_time_median2.6749999999999985
deviation-center-line_median0.1430668550637951
in-drivable-lane_median1.1250000000000004


other stats
agent_compute-ego0_max0.01280015536717006
agent_compute-ego0_mean0.01231740979484586
agent_compute-ego0_median0.01231740979484586
agent_compute-ego0_min0.01183466422252166
complete-iteration_max0.2889725734026004
complete-iteration_mean0.2729474347589653
complete-iteration_median0.2729474347589653
complete-iteration_min0.2569222961153303
deviation-center-line_max0.22596774648423773
deviation-center-line_mean0.1430668550637951
deviation-center-line_min0.06016596364335245
deviation-heading_max1.9892082549741996
deviation-heading_mean1.1948036666590705
deviation-heading_median1.1948036666590705
deviation-heading_min0.4003990783439415
driven_any_max1.0672360153840748
driven_any_mean0.7318093849558207
driven_any_median0.7318093849558207
driven_any_min0.39638275452756666
driven_lanedir_consec_max0.26738221859900735
driven_lanedir_consec_mean0.19295142106760688
driven_lanedir_consec_min0.1185206235362064
driven_lanedir_max0.40392741637882246
driven_lanedir_mean0.26122401995751443
driven_lanedir_median0.26122401995751443
driven_lanedir_min0.1185206235362064
get_duckie_state_max1.6995838710239956e-06
get_duckie_state_mean1.6475771809672262e-06
get_duckie_state_median1.6475771809672262e-06
get_duckie_state_min1.5955704909104568e-06
get_robot_state_max0.004060026577540806
get_robot_state_mean0.00402543924667023
get_robot_state_median0.00402543924667023
get_robot_state_min0.003990851915799654
get_state_dump_max0.005218720436096192
get_state_dump_mean0.005201462293282534
get_state_dump_median0.005201462293282534
get_state_dump_min0.005184204150468876
get_ui_image_max0.03973442826952253
get_ui_image_mean0.03958371842737163
get_ui_image_median0.03958371842737163
get_ui_image_min0.03943300858522073
in-drivable-lane_max1.250000000000001
in-drivable-lane_mean1.1250000000000004
in-drivable-lane_min0.9999999999999996
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.39638275452756666, "get_ui_image": 0.03943300858522073, "step_physics": 0.2117293614607591, "survival_time": 1.900000000000001, "driven_lanedir": 0.1185206235362064, "get_state_dump": 0.005184204150468876, "get_robot_state": 0.003990851915799654, "sim_render-ego0": 0.0039196014404296875, "get_duckie_state": 1.5955704909104568e-06, "in-drivable-lane": 1.250000000000001, "deviation-heading": 0.4003990783439415, "agent_compute-ego0": 0.01183466422252166, "complete-iteration": 0.2889725734026004, "set_robot_commands": 0.0023005375495323767, "deviation-center-line": 0.06016596364335245, "driven_lanedir_consec": 0.1185206235362064, "sim_compute_sim_state": 0.008453112382155199, "sim_compute_performance-ego0": 0.0020241431700877654}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.0672360153840748, "get_ui_image": 0.03973442826952253, "step_physics": 0.1751218387058803, "survival_time": 3.4499999999999957, "driven_lanedir": 0.40392741637882246, "get_state_dump": 0.005218720436096192, "get_robot_state": 0.004060026577540806, "sim_render-ego0": 0.004268663270132882, "get_duckie_state": 1.6995838710239956e-06, "in-drivable-lane": 0.9999999999999996, "deviation-heading": 1.9892082549741996, "agent_compute-ego0": 0.01280015536717006, "complete-iteration": 0.2569222961153303, "set_robot_commands": 0.002362619127546038, "deviation-center-line": 0.22596774648423773, "driven_lanedir_consec": 0.26738221859900735, "sim_compute_sim_state": 0.010959090505327498, "sim_compute_performance-ego0": 0.0022839137486049105}}
set_robot_commands_max0.002362619127546038
set_robot_commands_mean0.002331578338539207
set_robot_commands_median0.002331578338539207
set_robot_commands_min0.0023005375495323767
sim_compute_performance-ego0_max0.0022839137486049105
sim_compute_performance-ego0_mean0.002154028459346338
sim_compute_performance-ego0_median0.002154028459346338
sim_compute_performance-ego0_min0.0020241431700877654
sim_compute_sim_state_max0.010959090505327498
sim_compute_sim_state_mean0.009706101443741347
sim_compute_sim_state_median0.009706101443741347
sim_compute_sim_state_min0.008453112382155199
sim_render-ego0_max0.004268663270132882
sim_render-ego0_mean0.004094132355281285
sim_render-ego0_median0.004094132355281285
sim_render-ego0_min0.0039196014404296875
simulation-passed1
step_physics_max0.2117293614607591
step_physics_mean0.19342560008331972
step_physics_median0.19342560008331972
step_physics_min0.1751218387058803
survival_time_max3.4499999999999957
survival_time_mean2.6749999999999985
survival_time_min1.900000000000001
No reset possible
5352512605Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-010:02:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2999735197577017
survival_time_median1.7750000000000008
deviation-center-line_median0.16116976962533835
in-drivable-lane_median0.37500000000000033


other stats
agent_compute-ego0_max0.013058286905288695
agent_compute-ego0_mean0.012578660881880558
agent_compute-ego0_median0.012578660881880558
agent_compute-ego0_min0.01209903485847242
agent_compute-npc0_max0.054088670015335086
agent_compute-npc0_mean0.0440239715756792
agent_compute-npc0_median0.0440239715756792
agent_compute-npc0_min0.033959273136023316
agent_compute-npc1_max0.05201065540313721
agent_compute-npc1_mean0.04185065536788016
agent_compute-npc1_median0.04185065536788016
agent_compute-npc1_min0.03169065533262311
agent_compute-npc2_max0.05777067542076111
agent_compute-npc2_mean0.0446740698633772
agent_compute-npc2_median0.0446740698633772
agent_compute-npc2_min0.031577464305993286
complete-iteration_max0.9807998180389405
complete-iteration_mean0.881529366608822
complete-iteration_median0.881529366608822
complete-iteration_min0.7822589151787035
deviation-center-line_max0.2029614423431128
deviation-center-line_mean0.16116976962533835
deviation-center-line_min0.1193780969075639
deviation-heading_max0.42290029630167686
deviation-heading_mean0.33090990458760183
deviation-heading_median0.33090990458760183
deviation-heading_min0.2389195128735269
driven_any_max0.3866220460800679
driven_any_mean0.31982841800446105
driven_any_median0.31982841800446105
driven_any_min0.2530347899288541
driven_lanedir_consec_max0.3549885974886773
driven_lanedir_consec_mean0.2999735197577017
driven_lanedir_consec_min0.24495844202672612
driven_lanedir_max0.3549885974886773
driven_lanedir_mean0.2999735197577017
driven_lanedir_median0.2999735197577017
driven_lanedir_min0.24495844202672612
get_duckie_state_max2.366304397583008e-06
get_duckie_state_mean2.281322623744156e-06
get_duckie_state_median2.281322623744156e-06
get_duckie_state_min2.196340849905303e-06
get_robot_state_max0.014636784791946411
get_robot_state_mean0.014283289060448156
get_robot_state_median0.014283289060448156
get_robot_state_min0.0139297933289499
get_state_dump_max0.0097667396068573
get_state_dump_mean0.00952664026708314
get_state_dump_median0.00952664026708314
get_state_dump_min0.00928654092730898
get_ui_image_max0.0512559175491333
get_ui_image_mean0.05039062174883756
get_ui_image_median0.05039062174883756
get_ui_image_min0.049525325948541817
in-drivable-lane_max0.7500000000000007
in-drivable-lane_mean0.37500000000000033
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 0.2530347899288541, "get_ui_image": 0.049525325948541817, "step_physics": 0.52868145162409, "survival_time": 1.6000000000000008, "driven_lanedir": 0.24495844202672612, "get_state_dump": 0.00928654092730898, "get_robot_state": 0.0139297933289499, "sim_render-ego0": 0.0038019382592403526, "sim_render-npc0": 0.0035911690105091443, "sim_render-npc1": 0.003595677289095792, "sim_render-npc2": 0.0037975094535134058, "get_duckie_state": 2.196340849905303e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.42290029630167686, "agent_compute-ego0": 0.01209903485847242, "agent_compute-npc0": 0.033959273136023316, "agent_compute-npc1": 0.03169065533262311, "agent_compute-npc2": 0.031577464305993286, "complete-iteration": 0.7822589151787035, "set_robot_commands": 0.0021840008822354403, "deviation-center-line": 0.2029614423431128, "driven_lanedir_consec": 0.24495844202672612, "sim_compute_sim_state": 0.03958671020739006, "sim_compute_performance-ego0": 0.0021271850123549953, "sim_compute_performance-npc0": 0.001981207818695993, "sim_compute_performance-npc1": 0.0019144433917421284, "sim_compute_performance-npc2": 0.0019436605048902104}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.3866220460800679, "get_ui_image": 0.0512559175491333, "step_physics": 0.652647203207016, "survival_time": 1.950000000000001, "driven_lanedir": 0.3549885974886773, "get_state_dump": 0.0097667396068573, "get_robot_state": 0.014636784791946411, "sim_render-ego0": 0.004079663753509521, "sim_render-npc0": 0.003897511959075928, "sim_render-npc1": 0.004111027717590332, "sim_render-npc2": 0.0038474023342132567, "get_duckie_state": 2.366304397583008e-06, "in-drivable-lane": 0.7500000000000007, "deviation-heading": 0.2389195128735269, "agent_compute-ego0": 0.013058286905288695, "agent_compute-npc0": 0.054088670015335086, "agent_compute-npc1": 0.05201065540313721, "agent_compute-npc2": 0.05777067542076111, "complete-iteration": 0.9807998180389405, "set_robot_commands": 0.0023002207279205324, "deviation-center-line": 0.1193780969075639, "driven_lanedir_consec": 0.3549885974886773, "sim_compute_sim_state": 0.04116371273994446, "sim_compute_performance-ego0": 0.0022228121757507323, "sim_compute_performance-npc0": 0.0021324872970581053, "sim_compute_performance-npc1": 0.0021749138832092285, "sim_compute_performance-npc2": 0.002096211910247802}}
set_robot_commands_max0.0023002207279205324
set_robot_commands_mean0.0022421108050779863
set_robot_commands_median0.0022421108050779863
set_robot_commands_min0.0021840008822354403
sim_compute_performance-ego0_max0.0022228121757507323
sim_compute_performance-ego0_mean0.002174998594052864
sim_compute_performance-ego0_median0.002174998594052864
sim_compute_performance-ego0_min0.0021271850123549953
sim_compute_performance-npc0_max0.0021324872970581053
sim_compute_performance-npc0_mean0.002056847557877049
sim_compute_performance-npc0_median0.002056847557877049
sim_compute_performance-npc0_min0.001981207818695993
sim_compute_performance-npc1_max0.0021749138832092285
sim_compute_performance-npc1_mean0.0020446786374756784
sim_compute_performance-npc1_median0.0020446786374756784
sim_compute_performance-npc1_min0.0019144433917421284
sim_compute_performance-npc2_max0.002096211910247802
sim_compute_performance-npc2_mean0.002019936207569006
sim_compute_performance-npc2_median0.002019936207569006
sim_compute_performance-npc2_min0.0019436605048902104
sim_compute_sim_state_max0.04116371273994446
sim_compute_sim_state_mean0.04037521147366726
sim_compute_sim_state_median0.04037521147366726
sim_compute_sim_state_min0.03958671020739006
sim_render-ego0_max0.004079663753509521
sim_render-ego0_mean0.003940801006374937
sim_render-ego0_median0.003940801006374937
sim_render-ego0_min0.0038019382592403526
sim_render-npc0_max0.003897511959075928
sim_render-npc0_mean0.003744340484792536
sim_render-npc0_median0.003744340484792536
sim_render-npc0_min0.0035911690105091443
sim_render-npc1_max0.004111027717590332
sim_render-npc1_mean0.003853352503343062
sim_render-npc1_median0.003853352503343062
sim_render-npc1_min0.003595677289095792
sim_render-npc2_max0.0038474023342132567
sim_render-npc2_mean0.0038224558938633312
sim_render-npc2_median0.0038224558938633312
sim_render-npc2_min0.0037975094535134058
simulation-passed1
step_physics_max0.652647203207016
step_physics_mean0.590664327415553
step_physics_median0.590664327415553
step_physics_min0.52868145162409
survival_time_max1.950000000000001
survival_time_mean1.7750000000000008
survival_time_min1.6000000000000008
No reset possible
5351312607Bea Baselines 🐤template-randomaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-010:08:28
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5758601445640131
survival_time_median6.099999999999986
deviation-center-line_median0.17553830655708547
in-drivable-lane_median3.29999999999999


other stats
agent_compute-ego0_max0.012938682656539116
agent_compute-ego0_mean0.011745351854206668
agent_compute-ego0_median0.011745351854206668
agent_compute-ego0_min0.010552021051874224
agent_compute-ego1_max0.012984235663163037
agent_compute-ego1_mean0.012021532570621867
agent_compute-ego1_median0.012021532570621867
agent_compute-ego1_min0.0110588294780807
agent_compute-ego2_max0.01309224429883455
agent_compute-ego2_mean0.011752366820209408
agent_compute-ego2_median0.011752366820209408
agent_compute-ego2_min0.010412489341584265
agent_compute-ego3_max0.012824505253842005
agent_compute-ego3_mean0.011686788431315856
agent_compute-ego3_median0.011686788431315856
agent_compute-ego3_min0.01054907160878971
complete-iteration_max1.0520355525769685
complete-iteration_mean0.9440377736515432
complete-iteration_median0.9440377736515432
complete-iteration_min0.8360399947261179
deviation-center-line_max0.47013425987002005
deviation-center-line_mean0.2174177284809568
deviation-center-line_min0.0720091252708566
deviation-heading_max3.0542186889712815
deviation-heading_mean1.2634654122591242
deviation-heading_median1.0697442157871273
deviation-heading_min0.3081468886732283
driven_any_max2.8773005288041658
driven_any_mean1.716787495843618
driven_any_median1.6399654313822998
driven_any_min0.38662204608009304
driven_lanedir_consec_max1.8220023141314807
driven_lanedir_consec_mean0.7121644428869928
driven_lanedir_consec_min0.30949264303267476
driven_lanedir_max1.8220034571617316
driven_lanedir_mean0.7349677350690881
driven_lanedir_median0.5758601445640131
driven_lanedir_min0.30949264303267476
get_duckie_state_max1.7417104620682565e-06
get_duckie_state_mean1.635847294442784e-06
get_duckie_state_median1.635847294442784e-06
get_duckie_state_min1.5299841268173116e-06
get_robot_state_max0.01617938342847322
get_robot_state_mean0.015295459061559796
get_robot_state_median0.015295459061559796
get_robot_state_min0.014411534694646368
get_state_dump_max0.010626381321957238
get_state_dump_mean0.010125194421916443
get_state_dump_median0.010125194421916443
get_state_dump_min0.009624007521875647
get_ui_image_max0.05616976883237725
get_ui_image_mean0.05571351450218395
get_ui_image_median0.05571351450218395
get_ui_image_min0.055257260171990646
in-drivable-lane_max6.049999999999983
in-drivable-lane_mean3.4749999999999894
in-drivable-lane_min0.9999999999999998
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 2.831813082003494, "get_ui_image": 0.05616976883237725, "step_physics": 0.6479044655300924, "survival_time": 7.499999999999981, "driven_lanedir": 1.8220034571617316, "get_state_dump": 0.009624007521875647, "get_robot_state": 0.014411534694646368, "sim_render-ego0": 0.00386418096277098, "sim_render-ego1": 0.0038008326726243985, "sim_render-ego2": 0.003676442910503867, "sim_render-ego3": 0.003828907644511848, "get_duckie_state": 1.5299841268173116e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 0.3442852314393885, "agent_compute-ego0": 0.010552021051874224, "agent_compute-ego1": 0.0110588294780807, "agent_compute-ego2": 0.010412489341584265, "agent_compute-ego3": 0.01054907160878971, "complete-iteration": 0.8360399947261179, "set_robot_commands": 0.0022902567655045465, "deviation-center-line": 0.22968417496144336, "driven_lanedir_consec": 1.8220023141314807, "sim_compute_sim_state": 0.03290880279035758, "sim_compute_performance-ego0": 0.0021446635391538507, "sim_compute_performance-ego1": 0.0019461777036553188, "sim_compute_performance-ego2": 0.002007639171271924, "sim_compute_performance-ego3": 0.001973437947153256}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.3028841294963844, "get_ui_image": 0.05616976883237725, "step_physics": 0.6479044655300924, "survival_time": 7.499999999999981, "driven_lanedir": 0.4284094322301284, "get_state_dump": 0.009624007521875647, "get_robot_state": 0.014411534694646368, "sim_render-ego0": 0.00386418096277098, "sim_render-ego1": 0.0038008326726243985, "sim_render-ego2": 0.003676442910503867, "sim_render-ego3": 0.003828907644511848, "get_duckie_state": 1.5299841268173116e-06, "in-drivable-lane": 5.799999999999981, "deviation-heading": 1.002056979235454, "agent_compute-ego0": 0.010552021051874224, "agent_compute-ego1": 0.0110588294780807, "agent_compute-ego2": 0.010412489341584265, "agent_compute-ego3": 0.01054907160878971, "complete-iteration": 0.8360399947261179, "set_robot_commands": 0.0022902567655045465, "deviation-center-line": 0.1213924381527276, "driven_lanedir_consec": 0.4284094322301284, "sim_compute_sim_state": 0.03290880279035758, "sim_compute_performance-ego0": 0.0021446635391538507, "sim_compute_performance-ego1": 0.0019461777036553188, "sim_compute_performance-ego2": 0.002007639171271924, "sim_compute_performance-ego3": 0.001973437947153256}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 1.9654839397698145, "get_ui_image": 0.05616976883237725, "step_physics": 0.6479044655300924, "survival_time": 7.499999999999981, "driven_lanedir": 0.3166075872147196, "get_state_dump": 0.009624007521875647, "get_robot_state": 0.014411534694646368, "sim_render-ego0": 0.00386418096277098, "sim_render-ego1": 0.0038008326726243985, "sim_render-ego2": 0.003676442910503867, "sim_render-ego3": 0.003828907644511848, "get_duckie_state": 1.5299841268173116e-06, "in-drivable-lane": 6.049999999999983, "deviation-heading": 1.1374314523388007, "agent_compute-ego0": 0.010552021051874224, "agent_compute-ego1": 0.0110588294780807, "agent_compute-ego2": 0.010412489341584265, "agent_compute-ego3": 0.01054907160878971, "complete-iteration": 0.8360399947261179, "set_robot_commands": 0.0022902567655045465, "deviation-center-line": 0.10797637530751922, "driven_lanedir_consec": 0.3166075872147196, "sim_compute_sim_state": 0.03290880279035758, "sim_compute_performance-ego0": 0.0021446635391538507, "sim_compute_performance-ego1": 0.0019461777036553188, "sim_compute_performance-ego2": 0.002007639171271924, "sim_compute_performance-ego3": 0.001973437947153256}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 2.8773005288041658, "get_ui_image": 0.05616976883237725, "step_physics": 0.6479044655300924, "survival_time": 7.499999999999981, "driven_lanedir": 1.093112188430767, "get_state_dump": 0.009624007521875647, "get_robot_state": 0.014411534694646368, "sim_render-ego0": 0.00386418096277098, "sim_render-ego1": 0.0038008326726243985, "sim_render-ego2": 0.003676442910503867, "sim_render-ego3": 0.003828907644511848, "get_duckie_state": 1.5299841268173116e-06, "in-drivable-lane": 4.199999999999985, "deviation-heading": 1.4050102318329205, "agent_compute-ego0": 0.010552021051874224, "agent_compute-ego1": 0.0110588294780807, "agent_compute-ego2": 0.010412489341584265, "agent_compute-ego3": 0.01054907160878971, "complete-iteration": 0.8360399947261179, "set_robot_commands": 0.0022902567655045465, "deviation-center-line": 0.2963999319120335, "driven_lanedir_consec": 1.019001024923512, "sim_compute_sim_state": 0.03290880279035758, "sim_compute_performance-ego0": 0.0021446635391538507, "sim_compute_performance-ego1": 0.0019461777036553188, "sim_compute_performance-ego2": 0.002007639171271924, "sim_compute_performance-ego3": 0.001973437947153256}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 1.6280751458799152, "get_ui_image": 0.055257260171990646, "step_physics": 0.8541640683224326, "survival_time": 4.699999999999991, "driven_lanedir": 0.7583962833546565, "get_state_dump": 0.010626381321957238, "get_robot_state": 0.01617938342847322, "sim_render-ego0": 0.003946382121035927, "sim_render-ego1": 0.004109518151534231, "sim_render-ego2": 0.003971752367521587, "sim_render-ego3": 0.003976849505775853, "get_duckie_state": 1.7417104620682565e-06, "in-drivable-lane": 1.2999999999999958, "deviation-heading": 2.3745112943922093, "agent_compute-ego0": 0.012938682656539116, "agent_compute-ego1": 0.012984235663163037, "agent_compute-ego2": 0.01309224429883455, "agent_compute-ego3": 0.012824505253842005, "complete-iteration": 1.0520355525769685, "set_robot_commands": 0.0023753015618575247, "deviation-center-line": 0.35315000024132365, "driven_lanedir_consec": 0.6500822524354004, "sim_compute_sim_state": 0.029605953316939503, "sim_compute_performance-ego0": 0.00218277981406764, "sim_compute_performance-ego1": 0.002098613036306281, "sim_compute_performance-ego2": 0.0021226180227179275, "sim_compute_performance-ego3": 0.0020798306716115853}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.651855716884684, "get_ui_image": 0.055257260171990646, "step_physics": 0.8541640683224326, "survival_time": 4.699999999999991, "driven_lanedir": 0.6448691596131364, "get_state_dump": 0.010626381321957238, "get_robot_state": 0.01617938342847322, "sim_render-ego0": 0.003946382121035927, "sim_render-ego1": 0.004109518151534231, "sim_render-ego2": 0.003971752367521587, "sim_render-ego3": 0.003976849505775853, "get_duckie_state": 1.7417104620682565e-06, "in-drivable-lane": 2.8499999999999903, "deviation-heading": 0.3081468886732283, "agent_compute-ego0": 0.012938682656539116, "agent_compute-ego1": 0.012984235663163037, "agent_compute-ego2": 0.01309224429883455, "agent_compute-ego3": 0.012824505253842005, "complete-iteration": 1.0520355525769685, "set_robot_commands": 0.0023753015618575247, "deviation-center-line": 0.08859552213173046, "driven_lanedir_consec": 0.6448691596131364, "sim_compute_sim_state": 0.029605953316939503, "sim_compute_performance-ego0": 0.00218277981406764, "sim_compute_performance-ego1": 0.002098613036306281, "sim_compute_performance-ego2": 0.0021226180227179275, "sim_compute_performance-ego3": 0.0020798306716115853}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 1.0902653778303937, "get_ui_image": 0.055257260171990646, "step_physics": 0.8541640683224326, "survival_time": 4.699999999999991, "driven_lanedir": 0.5068511295148899, "get_state_dump": 0.010626381321957238, "get_robot_state": 0.01617938342847322, "sim_render-ego0": 0.003946382121035927, "sim_render-ego1": 0.004109518151534231, "sim_render-ego2": 0.003971752367521587, "sim_render-ego3": 0.003976849505775853, "get_duckie_state": 1.7417104620682565e-06, "in-drivable-lane": 0.9999999999999998, "deviation-heading": 3.0542186889712815, "agent_compute-ego0": 0.012938682656539116, "agent_compute-ego1": 0.012984235663163037, "agent_compute-ego2": 0.01309224429883455, "agent_compute-ego3": 0.012824505253842005, "complete-iteration": 1.0520355525769685, "set_robot_commands": 0.0023753015618575247, "deviation-center-line": 0.47013425987002005, "driven_lanedir_consec": 0.5068511295148899, "sim_compute_sim_state": 0.029605953316939503, "sim_compute_performance-ego0": 0.00218277981406764, "sim_compute_performance-ego1": 0.002098613036306281, "sim_compute_performance-ego2": 0.0021226180227179275, "sim_compute_performance-ego3": 0.0020798306716115853}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.38662204608009304, "get_ui_image": 0.055257260171990646, "step_physics": 0.8541640683224326, "survival_time": 4.699999999999991, "driven_lanedir": 0.30949264303267476, "get_state_dump": 0.010626381321957238, "get_robot_state": 0.01617938342847322, "sim_render-ego0": 0.003946382121035927, "sim_render-ego1": 0.004109518151534231, "sim_render-ego2": 0.003971752367521587, "sim_render-ego3": 0.003976849505775853, "get_duckie_state": 1.7417104620682565e-06, "in-drivable-lane": 3.549999999999991, "deviation-heading": 0.4820625311897111, "agent_compute-ego0": 0.012938682656539116, "agent_compute-ego1": 0.012984235663163037, "agent_compute-ego2": 0.01309224429883455, "agent_compute-ego3": 0.012824505253842005, "complete-iteration": 1.0520355525769685, "set_robot_commands": 0.0023753015618575247, "deviation-center-line": 0.0720091252708566, "driven_lanedir_consec": 0.30949264303267476, "sim_compute_sim_state": 0.029605953316939503, "sim_compute_performance-ego0": 0.00218277981406764, "sim_compute_performance-ego1": 0.002098613036306281, "sim_compute_performance-ego2": 0.0021226180227179275, "sim_compute_performance-ego3": 0.0020798306716115853}}
set_robot_commands_max0.0023753015618575247
set_robot_commands_mean0.002332779163681036
set_robot_commands_median0.002332779163681036
set_robot_commands_min0.0022902567655045465
sim_compute_performance-ego0_max0.00218277981406764
sim_compute_performance-ego0_mean0.0021637216766107453
sim_compute_performance-ego0_median0.0021637216766107453
sim_compute_performance-ego0_min0.0021446635391538507
sim_compute_performance-ego1_max0.002098613036306281
sim_compute_performance-ego1_mean0.0020223953699808
sim_compute_performance-ego1_median0.0020223953699808
sim_compute_performance-ego1_min0.0019461777036553188
sim_compute_performance-ego2_max0.0021226180227179275
sim_compute_performance-ego2_mean0.002065128596994926
sim_compute_performance-ego2_median0.002065128596994926
sim_compute_performance-ego2_min0.002007639171271924
sim_compute_performance-ego3_max0.0020798306716115853
sim_compute_performance-ego3_mean0.0020266343093824205
sim_compute_performance-ego3_median0.0020266343093824205
sim_compute_performance-ego3_min0.001973437947153256
sim_compute_sim_state_max0.03290880279035758
sim_compute_sim_state_mean0.03125737805364854
sim_compute_sim_state_median0.03125737805364854
sim_compute_sim_state_min0.029605953316939503
sim_render-ego0_max0.003946382121035927
sim_render-ego0_mean0.0039052815419034536
sim_render-ego0_median0.0039052815419034536
sim_render-ego0_min0.00386418096277098
sim_render-ego1_max0.004109518151534231
sim_render-ego1_mean0.003955175412079315
sim_render-ego1_median0.003955175412079315
sim_render-ego1_min0.0038008326726243985
sim_render-ego2_max0.003971752367521587
sim_render-ego2_mean0.003824097639012727
sim_render-ego2_median0.003824097639012727
sim_render-ego2_min0.003676442910503867
sim_render-ego3_max0.003976849505775853
sim_render-ego3_mean0.0039028785751438503
sim_render-ego3_median0.0039028785751438503
sim_render-ego3_min0.003828907644511848
simulation-passed1
step_physics_max0.8541640683224326
step_physics_mean0.7510342669262625
step_physics_median0.7510342669262625
step_physics_min0.6479044655300924
survival_time_max7.499999999999981
survival_time_mean6.099999999999986
survival_time_min4.699999999999991
No reset possible
5349412677Bea Baselines 🐤baseline-duckietownaido5-LFI-full-sim-validationLFVIv-simsuccessyesnogpu-prod-010:16:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.896903710151475
survival_time_median45.82499999999952
deviation-center-line_median2.80793549679957
in-drivable-lane_median2.6750000000000314


other stats
agent_compute-ego0_max0.01354304021841344
agent_compute-ego0_mean0.013407588594666836
agent_compute-ego0_median0.013407588594666836
agent_compute-ego0_min0.01327213697092023
complete-iteration_max0.24270744842685735
complete-iteration_mean0.22531717047322505
complete-iteration_median0.22531717047322505
complete-iteration_min0.20792689251959273
deviation-center-line_max3.858815622858591
deviation-center-line_mean2.80793549679957
deviation-center-line_min1.7570553707405494
deviation-heading_max7.8449083207206
deviation-heading_mean6.5168479568585
deviation-heading_median6.5168479568585
deviation-heading_min5.188787592996399
driven_any_max7.921257070461843
driven_any_mean5.98923729120976
driven_any_median5.98923729120976
driven_any_min4.057217511957676
driven_lanedir_consec_max6.666035655388082
driven_lanedir_consec_mean4.896903710151475
driven_lanedir_consec_min3.1277717649148675
driven_lanedir_max7.420939143157886
driven_lanedir_mean5.456426697400823
driven_lanedir_median5.456426697400823
driven_lanedir_min3.491914251643759
get_duckie_state_max1.5307624175288496e-06
get_duckie_state_mean1.4751841552221525e-06
get_duckie_state_median1.4751841552221525e-06
get_duckie_state_min1.419605892915455e-06
get_robot_state_max0.004045164059044221
get_robot_state_mean0.003948640503921424
get_robot_state_median0.003948640503921424
get_robot_state_min0.003852116948798628
get_state_dump_max0.0050791939728266
get_state_dump_mean0.004943022103809706
get_state_dump_median0.004943022103809706
get_state_dump_min0.004806850234792812
get_ui_image_max0.03996430436143364
get_ui_image_mean0.0398154045729608
get_ui_image_median0.0398154045729608
get_ui_image_min0.039666504784487966
in-drivable-lane_max3.200000000000032
in-drivable-lane_mean2.6750000000000314
in-drivable-lane_min2.1500000000000306
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 4.057217511957676, "get_ui_image": 0.03996430436143364, "step_physics": 0.1606578251540849, "survival_time": 31.650000000000315, "driven_lanedir": 3.491914251643759, "get_state_dump": 0.004806850234792812, "get_robot_state": 0.003852116948798628, "sim_render-ego0": 0.004025978620872136, "get_duckie_state": 1.419605892915455e-06, "in-drivable-lane": 2.1500000000000306, "deviation-heading": 7.8449083207206, "agent_compute-ego0": 0.01354304021841344, "complete-iteration": 0.24270744842685735, "set_robot_commands": 0.0023338151654986555, "deviation-center-line": 1.7570553707405494, "driven_lanedir_consec": 3.1277717649148675, "sim_compute_sim_state": 0.01134190687245751, "sim_compute_performance-ego0": 0.0020934805885098333}, "LFI-full-udem1-000-ego0": {"driven_any": 7.921257070461843, "get_ui_image": 0.039666504784487966, "step_physics": 0.12415135135063024, "survival_time": 59.99999999999873, "driven_lanedir": 7.420939143157886, "get_state_dump": 0.0050791939728266, "get_robot_state": 0.004045164059044221, "sim_render-ego0": 0.004022566106893141, "get_duckie_state": 1.5307624175288496e-06, "in-drivable-lane": 3.200000000000032, "deviation-heading": 5.188787592996399, "agent_compute-ego0": 0.01327213697092023, "complete-iteration": 0.20792689251959273, "set_robot_commands": 0.0023679316391258015, "deviation-center-line": 3.858815622858591, "driven_lanedir_consec": 6.666035655388082, "sim_compute_sim_state": 0.013061902207399188, "sim_compute_performance-ego0": 0.002168002672536883}}
set_robot_commands_max0.0023679316391258015
set_robot_commands_mean0.0023508734023122285
set_robot_commands_median0.0023508734023122285
set_robot_commands_min0.0023338151654986555
sim_compute_performance-ego0_max0.002168002672536883
sim_compute_performance-ego0_mean0.0021307416305233586
sim_compute_performance-ego0_median0.0021307416305233586
sim_compute_performance-ego0_min0.0020934805885098333
sim_compute_sim_state_max0.013061902207399188
sim_compute_sim_state_mean0.012201904539928348
sim_compute_sim_state_median0.012201904539928348
sim_compute_sim_state_min0.01134190687245751
sim_render-ego0_max0.004025978620872136
sim_render-ego0_mean0.004024272363882638
sim_render-ego0_median0.004024272363882638
sim_render-ego0_min0.004022566106893141
simulation-passed1
step_physics_max0.1606578251540849
step_physics_mean0.14240458825235758
step_physics_median0.14240458825235758
step_physics_min0.12415135135063024
survival_time_max59.99999999999873
survival_time_mean45.82499999999952
survival_time_min31.650000000000315
No reset possible
5346712564Bea Baselines 🐤straightaido5-LFV-sim-validationLFVv-simsuccessyesnogpu-prod-010:18:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6111249934350206
survival_time_median10.375000000000012
deviation-center-line_median0.3289032233668977
in-drivable-lane_median6.075000000000026


other stats
agent_compute-ego0_max0.011768332048624503
agent_compute-ego0_mean0.010753646302727245
agent_compute-ego0_median0.010540107735256895
agent_compute-ego0_min0.010166037691770678
agent_compute-npc0_max0.02623865008354187
agent_compute-npc0_mean0.02312838283266889
agent_compute-npc0_median0.02312551182853894
agent_compute-npc0_min0.020023857590055812
agent_compute-npc1_max0.031145332240256944
agent_compute-npc1_mean0.03018363785980477
agent_compute-npc1_median0.030087871273068615
agent_compute-npc1_min0.029317710066088742
agent_compute-npc2_max0.03071724411344876
agent_compute-npc2_mean0.02897828673320929
agent_compute-npc2_median0.028985023498535156
agent_compute-npc2_min0.02723259258764395
agent_compute-npc3_max0.04077450846143337
agent_compute-npc3_mean0.03806664050987893
agent_compute-npc3_median0.03806664050987893
agent_compute-npc3_min0.03535877255832448
complete-iteration_max1.2305211900662976
complete-iteration_mean0.878632645507708
complete-iteration_median0.9846443939639996
complete-iteration_min0.3147206040365355
deviation-center-line_max0.4020719844429631
deviation-center-line_mean0.3039323060899035
deviation-center-line_min0.1558507931828555
deviation-heading_max2.6014820831000502
deviation-heading_mean1.3142043552437723
deviation-heading_median1.0339592049419246
deviation-heading_min0.5874169279911909
driven_any_max1.7856212315220987
driven_any_mean1.4540063834269006
driven_any_median1.5364362609816873
driven_any_min0.9575317802221288
driven_lanedir_consec_max0.7766595174703629
driven_lanedir_consec_mean0.6222730404710497
driven_lanedir_consec_min0.4901826575437944
driven_lanedir_max0.7766595174703629
driven_lanedir_mean0.6222730404710497
driven_lanedir_median0.6111249934350206
driven_lanedir_min0.4901826575437944
get_duckie_state_max1.940406671091288e-06
get_duckie_state_mean1.6187029749532668e-06
get_duckie_state_median1.555139983026313e-06
get_duckie_state_min1.4241252626691543e-06
get_robot_state_max0.01995913521582339
get_robot_state_mean0.015065391507374477
get_robot_state_median0.01637631701402371
get_robot_state_min0.007549796785627093
get_state_dump_max0.01233678905903792
get_state_dump_mean0.0102932981224382
get_state_dump_median0.010992525871914249
get_state_dump_min0.006851351686886379
get_ui_image_max0.05992355466890736
get_ui_image_mean0.04577947336981354
get_ui_image_median0.04561341117700765
get_ui_image_min0.03196751645633152
in-drivable-lane_max7.800000000000027
in-drivable-lane_mean5.387500000000019
in-drivable-lane_min1.5999999999999943
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 0.9575317802221288, "get_ui_image": 0.03910994529724121, "step_physics": 0.5389490667050773, "survival_time": 6.799999999999984, "driven_lanedir": 0.7766595174703629, "get_state_dump": 0.010670296467133682, "get_robot_state": 0.014551491632948828, "sim_render-ego0": 0.003840305509358427, "sim_render-npc0": 0.0036092935687434065, "sim_render-npc1": 0.003631692733207758, "sim_render-npc2": 0.0036881683516676407, "get_duckie_state": 1.4252906298115303e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 0.8011106083148233, "agent_compute-ego0": 0.010166037691770678, "agent_compute-npc0": 0.020023857590055812, "agent_compute-npc1": 0.030087871273068615, "agent_compute-npc2": 0.03071724411344876, "complete-iteration": 0.749214369015102, "set_robot_commands": 0.0020605160372100606, "deviation-center-line": 0.1558507931828555, "driven_lanedir_consec": 0.7766595174703629, "sim_compute_sim_state": 0.02394559783657102, "sim_compute_performance-ego0": 0.0020246070666904868, "sim_compute_performance-npc0": 0.001861041479737219, "sim_compute_performance-npc1": 0.00191580118054021, "sim_compute_performance-npc2": 0.00182788215414451}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.7856212315220987, "get_ui_image": 0.05992355466890736, "step_physics": 0.8935059539410246, "survival_time": 11.850000000000032, "driven_lanedir": 0.6844270440640212, "get_state_dump": 0.01233678905903792, "get_robot_state": 0.01995913521582339, "sim_render-ego0": 0.004315061729495265, "sim_render-npc0": 0.004047820548049542, "sim_render-npc1": 0.004260288567102256, "sim_render-npc2": 0.004158742287579705, "sim_render-npc3": 0.004150441714695522, "get_duckie_state": 1.940406671091288e-06, "in-drivable-lane": 7.200000000000042, "deviation-heading": 1.266807801569026, "agent_compute-ego0": 0.011768332048624503, "agent_compute-npc0": 0.024245035748521822, "agent_compute-npc1": 0.031145332240256944, "agent_compute-npc2": 0.028985023498535156, "agent_compute-npc3": 0.03535877255832448, "complete-iteration": 1.2305211900662976, "set_robot_commands": 0.002531935186947093, "deviation-center-line": 0.301513281556401, "driven_lanedir_consec": 0.6844270440640212, "sim_compute_sim_state": 0.06807243423301633, "sim_compute_performance-ego0": 0.002433006503000981, "sim_compute_performance-npc0": 0.0022480898544567974, "sim_compute_performance-npc1": 0.0022771428613101736, "sim_compute_performance-npc2": 0.00220771597213104, "sim_compute_performance-npc3": 0.0022502135829765256}, "LFV-norm-techtrack-000-ego0": {"driven_any": 1.4053278356982355, "get_ui_image": 0.05211687705677408, "step_physics": 0.9086321227908752, "survival_time": 9.6, "driven_lanedir": 0.5378229428060199, "get_state_dump": 0.011314755276694816, "get_robot_state": 0.018201142395098593, "sim_render-ego0": 0.004001362953778993, "sim_render-npc0": 0.003777633676874823, "sim_render-npc1": 0.0038291728558317983, "sim_render-npc2": 0.003921150543529135, "sim_render-npc3": 0.003859910322594519, "get_duckie_state": 1.6849893362410946e-06, "in-drivable-lane": 4.95000000000001, "deviation-heading": 2.6014820831000502, "agent_compute-ego0": 0.010643846630432444, "agent_compute-npc0": 0.022005987908556054, "agent_compute-npc1": 0.029317710066088742, "agent_compute-npc2": 0.02723259258764395, "agent_compute-npc3": 0.04077450846143337, "complete-iteration": 1.2200744189128974, "set_robot_commands": 0.002335146918815652, "deviation-center-line": 0.4020719844429631, "driven_lanedir_consec": 0.5378229428060199, "sim_compute_sim_state": 0.05810744404175121, "sim_compute_performance-ego0": 0.0022955805526496216, "sim_compute_performance-npc0": 0.0020631767925203153, "sim_compute_performance-npc1": 0.002028775338681868, "sim_compute_performance-npc2": 0.00206385992969256, "sim_compute_performance-npc3": 0.0020093102529258927}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.667544686265139, "get_ui_image": 0.03196751645633152, "step_physics": 0.2043841513139861, "survival_time": 11.150000000000023, "driven_lanedir": 0.4901826575437944, "get_state_dump": 0.006851351686886379, "get_robot_state": 0.007549796785627093, "sim_render-ego0": 0.003978635583605085, "sim_render-npc0": 0.003979411508355822, "get_duckie_state": 1.4241252626691543e-06, "in-drivable-lane": 7.800000000000027, "deviation-heading": 0.5874169279911909, "agent_compute-ego0": 0.010436368840081351, "agent_compute-npc0": 0.02623865008354187, "complete-iteration": 0.3147206040365355, "set_robot_commands": 0.0023951455950737, "deviation-center-line": 0.35629316517739434, "driven_lanedir_consec": 0.4901826575437944, "sim_compute_sim_state": 0.010210788675716944, "sim_compute_performance-ego0": 0.002151743641921452, "sim_compute_performance-npc0": 0.0021054180605070932}}
set_robot_commands_max0.002531935186947093
set_robot_commands_mean0.002330685934511627
set_robot_commands_median0.002365146256944676
set_robot_commands_min0.0020605160372100606
sim_compute_performance-ego0_max0.002433006503000981
sim_compute_performance-ego0_mean0.002226234441065635
sim_compute_performance-ego0_median0.0022236620972855368
sim_compute_performance-ego0_min0.0020246070666904868
sim_compute_performance-npc0_max0.0022480898544567974
sim_compute_performance-npc0_mean0.0020694315468053563
sim_compute_performance-npc0_median0.0020842974265137043
sim_compute_performance-npc0_min0.001861041479737219
sim_compute_performance-npc1_max0.0022771428613101736
sim_compute_performance-npc1_mean0.002073906460177418
sim_compute_performance-npc1_median0.002028775338681868
sim_compute_performance-npc1_min0.00191580118054021
sim_compute_performance-npc2_max0.00220771597213104
sim_compute_performance-npc2_mean0.0020331526853227034
sim_compute_performance-npc2_median0.00206385992969256
sim_compute_performance-npc2_min0.00182788215414451
sim_compute_performance-npc3_max0.0022502135829765256
sim_compute_performance-npc3_mean0.002129761917951209
sim_compute_performance-npc3_median0.002129761917951209
sim_compute_performance-npc3_min0.0020093102529258927
sim_compute_sim_state_max0.06807243423301633
sim_compute_sim_state_mean0.04008406619676387
sim_compute_sim_state_median0.041026520939161114
sim_compute_sim_state_min0.010210788675716944
sim_render-ego0_max0.004315061729495265
sim_render-ego0_mean0.004033841444059442
sim_render-ego0_median0.003989999268692038
sim_render-ego0_min0.003840305509358427
sim_render-npc0_max0.004047820548049542
sim_render-npc0_mean0.0038535398255058985
sim_render-npc0_median0.003878522592615323
sim_render-npc0_min0.0036092935687434065
sim_render-npc1_max0.004260288567102256
sim_render-npc1_mean0.003907051385380604
sim_render-npc1_median0.0038291728558317983
sim_render-npc1_min0.003631692733207758
sim_render-npc2_max0.004158742287579705
sim_render-npc2_mean0.003922687060925494
sim_render-npc2_median0.003921150543529135
sim_render-npc2_min0.0036881683516676407
sim_render-npc3_max0.004150441714695522
sim_render-npc3_mean0.0040051760186450205
sim_render-npc3_median0.0040051760186450205
sim_render-npc3_min0.003859910322594519
simulation-passed1
step_physics_max0.9086321227908752
step_physics_mean0.6363678236877408
step_physics_median0.7162275103230509
step_physics_min0.2043841513139861
survival_time_max11.850000000000032
survival_time_mean9.85000000000001
survival_time_min6.799999999999984
No reset possible
5346212571Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simsuccessyesnogpu-prod-010:03:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.23974057674616897
survival_time_median5.424999999999988
deviation-center-line_median0.23310124682878197
in-drivable-lane_median2.799999999999992


other stats
agent_compute-ego0_max0.011033787632620098
agent_compute-ego0_mean0.01101156377262952
agent_compute-ego0_median0.01101156377262952
agent_compute-ego0_min0.010989339912638944
complete-iteration_max0.26086804446052103
complete-iteration_mean0.25248091997318245
complete-iteration_median0.25248091997318245
complete-iteration_min0.2440937954858439
deviation-center-line_max0.33643301407152215
deviation-center-line_mean0.23310124682878197
deviation-center-line_min0.12976947958604176
deviation-heading_max3.0449714976825573
deviation-heading_mean1.8836627406238904
deviation-heading_median1.8836627406238904
deviation-heading_min0.7223539835652234
driven_any_max1.0681241059453177
driven_any_mean0.7231944252080988
driven_any_median0.7231944252080988
driven_any_min0.37826474447088027
driven_lanedir_consec_max0.3545049150661136
driven_lanedir_consec_mean0.23974057674616897
driven_lanedir_consec_min0.1249762384262243
driven_lanedir_max0.3545049150661136
driven_lanedir_mean0.23974057674616897
driven_lanedir_median0.23974057674616897
driven_lanedir_min0.1249762384262243
get_duckie_state_max1.569457401503001e-06
get_duckie_state_mean1.5262806048688602e-06
get_duckie_state_median1.5262806048688602e-06
get_duckie_state_min1.4831038082347197e-06
get_robot_state_max0.003996526958137158
get_robot_state_mean0.0039744589827522304
get_robot_state_median0.0039744589827522304
get_robot_state_min0.0039523910073673025
get_state_dump_max0.005365063812559014
get_state_dump_mean0.0052871602167635515
get_state_dump_median0.0052871602167635515
get_state_dump_min0.005209256620968089
get_ui_image_max0.04022906316037209
get_ui_image_mean0.03927684811288204
get_ui_image_median0.03927684811288204
get_ui_image_min0.03832463306539199
in-drivable-lane_max3.4999999999999876
in-drivable-lane_mean2.799999999999992
in-drivable-lane_min2.0999999999999956
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.37826474447088027, "get_ui_image": 0.03832463306539199, "step_physics": 0.1834946309818941, "survival_time": 3.349999999999996, "driven_lanedir": 0.1249762384262243, "get_state_dump": 0.005209256620968089, "get_robot_state": 0.0039523910073673025, "sim_render-ego0": 0.0040870624430039346, "get_duckie_state": 1.4831038082347197e-06, "in-drivable-lane": 2.0999999999999956, "deviation-heading": 0.7223539835652234, "agent_compute-ego0": 0.010989339912638944, "complete-iteration": 0.26086804446052103, "set_robot_commands": 0.0022399425506591797, "deviation-center-line": 0.12976947958604176, "driven_lanedir_consec": 0.1249762384262243, "sim_compute_sim_state": 0.010265157503240249, "sim_compute_performance-ego0": 0.0022032681633444395}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.0681241059453177, "get_ui_image": 0.04022906316037209, "step_physics": 0.16256947548973638, "survival_time": 7.499999999999981, "driven_lanedir": 0.3545049150661136, "get_state_dump": 0.005365063812559014, "get_robot_state": 0.003996526958137158, "sim_render-ego0": 0.004171091989176163, "get_duckie_state": 1.569457401503001e-06, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 3.0449714976825573, "agent_compute-ego0": 0.011033787632620098, "complete-iteration": 0.2440937954858439, "set_robot_commands": 0.0023338621025843337, "deviation-center-line": 0.33643301407152215, "driven_lanedir_consec": 0.3545049150661136, "sim_compute_sim_state": 0.012086369343940783, "sim_compute_performance-ego0": 0.002202848724971544}}
set_robot_commands_max0.0023338621025843337
set_robot_commands_mean0.002286902326621757
set_robot_commands_median0.002286902326621757
set_robot_commands_min0.0022399425506591797
sim_compute_performance-ego0_max0.0022032681633444395
sim_compute_performance-ego0_mean0.0022030584441579916
sim_compute_performance-ego0_median0.0022030584441579916
sim_compute_performance-ego0_min0.002202848724971544
sim_compute_sim_state_max0.012086369343940783
sim_compute_sim_state_mean0.011175763423590517
sim_compute_sim_state_median0.011175763423590517
sim_compute_sim_state_min0.010265157503240249
sim_render-ego0_max0.004171091989176163
sim_render-ego0_mean0.004129077216090049
sim_render-ego0_median0.004129077216090049
sim_render-ego0_min0.0040870624430039346
simulation-passed1
step_physics_max0.1834946309818941
step_physics_mean0.17303205323581525
step_physics_median0.17303205323581525
step_physics_min0.16256947548973638
survival_time_max7.499999999999981
survival_time_mean5.424999999999988
survival_time_min3.349999999999996
No reset possible
5345112573Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-010:06:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3579094317793634
survival_time_median8.425000000000008
deviation-center-line_median0.21236679449239873
in-drivable-lane_median6.025000000000009


other stats
agent_compute-ego0_max0.010809561977647757
agent_compute-ego0_mean0.01061596566040981
agent_compute-ego0_median0.010640864152080022
agent_compute-ego0_min0.010372572359831436
complete-iteration_max0.21853974420730385
complete-iteration_mean0.1956941973549804
complete-iteration_median0.2005067483275852
complete-iteration_min0.16322354855744736
deviation-center-line_max0.5964967745601558
deviation-center-line_mean0.3037866553491125
deviation-center-line_min0.19391625785149663
deviation-heading_max4.030174130599222
deviation-heading_mean1.5662700472035307
deviation-heading_median0.8378098930105895
deviation-heading_min0.5592862721937217
driven_any_max2.5770107475902955
driven_any_mean1.360021889155406
driven_any_median1.219952871297259
driven_any_min0.4231710664368103
driven_lanedir_consec_max0.7194134144724139
driven_lanedir_consec_mean0.4165275566138344
driven_lanedir_consec_min0.23087794842419673
driven_lanedir_max0.7194134144724139
driven_lanedir_mean0.4165275566138344
driven_lanedir_median0.3579094317793634
driven_lanedir_min0.23087794842419673
get_duckie_state_max1.4830073085399942e-06
get_duckie_state_mean1.4259480571965357e-06
get_duckie_state_median1.414732770415775e-06
get_duckie_state_min1.3913193794145977e-06
get_robot_state_max0.003988974684969001
get_robot_state_mean0.003844457285038879
get_robot_state_median0.003805435754629456
get_robot_state_min0.003777982945927603
get_state_dump_max0.005011840697822221
get_state_dump_mean0.004879801171717253
get_state_dump_median0.004874024601606923
get_state_dump_min0.0047593147858329445
get_ui_image_max0.03769404802493707
get_ui_image_mean0.03210576027877669
get_ui_image_median0.03163928627233732
get_ui_image_min0.027450420545495076
in-drivable-lane_max10.30000000000009
in-drivable-lane_mean5.925000000000026
in-drivable-lane_min1.3499999999999952
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.7192218816906563, "get_ui_image": 0.03102035916179692, "step_physics": 0.12644862034998902, "survival_time": 5.399999999999989, "driven_lanedir": 0.41855318778047534, "get_state_dump": 0.005011840697822221, "get_robot_state": 0.003988974684969001, "sim_render-ego0": 0.003933827811424886, "get_duckie_state": 1.4830073085399942e-06, "in-drivable-lane": 2.3999999999999915, "deviation-heading": 0.9046951075035689, "agent_compute-ego0": 0.010612955880821298, "complete-iteration": 0.1929105815537479, "set_robot_commands": 0.002268524344907988, "deviation-center-line": 0.22380117884654163, "driven_lanedir_consec": 0.41855318778047534, "sim_compute_sim_state": 0.007469979994887605, "sim_compute_performance-ego0": 0.002064315550917879}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.5770107475902955, "get_ui_image": 0.03769404802493707, "step_physics": 0.13073871949475682, "survival_time": 16.6500000000001, "driven_lanedir": 0.7194134144724139, "get_state_dump": 0.004779314566515163, "get_robot_state": 0.003777982945927603, "sim_render-ego0": 0.0039635332758555155, "get_duckie_state": 1.426942334203663e-06, "in-drivable-lane": 10.30000000000009, "deviation-heading": 4.030174130599222, "agent_compute-ego0": 0.010668772423338748, "complete-iteration": 0.2081029151014225, "set_robot_commands": 0.0022925252686003725, "deviation-center-line": 0.5964967745601558, "driven_lanedir_consec": 0.7194134144724139, "sim_compute_sim_state": 0.01202360741392581, "sim_compute_performance-ego0": 0.0020729231977177237}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.4231710664368103, "get_ui_image": 0.032258213382877717, "step_physics": 0.14715708445196282, "survival_time": 3.599999999999995, "driven_lanedir": 0.29726567577825147, "get_state_dump": 0.004968734636698684, "get_robot_state": 0.003811251627255792, "sim_render-ego0": 0.004162732868978422, "get_duckie_state": 1.3913193794145977e-06, "in-drivable-lane": 1.3499999999999952, "deviation-heading": 0.7709246785176104, "agent_compute-ego0": 0.010809561977647757, "complete-iteration": 0.21853974420730385, "set_robot_commands": 0.002388738606074085, "deviation-center-line": 0.19391625785149663, "driven_lanedir_consec": 0.29726567577825147, "sim_compute_sim_state": 0.01073422170665166, "sim_compute_performance-ego0": 0.0021586908053045405}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7206838609038615, "get_ui_image": 0.027450420545495076, "step_physics": 0.10186532269353452, "survival_time": 11.450000000000028, "driven_lanedir": 0.23087794842419673, "get_state_dump": 0.0047593147858329445, "get_robot_state": 0.003799619882003121, "sim_render-ego0": 0.003974226246709409, "get_duckie_state": 1.4025232066278871e-06, "in-drivable-lane": 9.650000000000029, "deviation-heading": 0.5592862721937217, "agent_compute-ego0": 0.010372572359831436, "complete-iteration": 0.16322354855744736, "set_robot_commands": 0.0022808987161387568, "deviation-center-line": 0.20093241013825583, "driven_lanedir_consec": 0.23087794842419673, "sim_compute_sim_state": 0.006618902994238812, "sim_compute_performance-ego0": 0.002013558926789657}}
set_robot_commands_max0.002388738606074085
set_robot_commands_mean0.002307671733930301
set_robot_commands_median0.0022867119923695644
set_robot_commands_min0.002268524344907988
sim_compute_performance-ego0_max0.0021586908053045405
sim_compute_performance-ego0_mean0.00207737212018245
sim_compute_performance-ego0_median0.0020686193743178014
sim_compute_performance-ego0_min0.002013558926789657
sim_compute_sim_state_max0.01202360741392581
sim_compute_sim_state_mean0.009211678027425972
sim_compute_sim_state_median0.009102100850769634
sim_compute_sim_state_min0.006618902994238812
sim_render-ego0_max0.004162732868978422
sim_render-ego0_mean0.0040085800507420576
sim_render-ego0_median0.003968879761282462
sim_render-ego0_min0.003933827811424886
simulation-passed1
step_physics_max0.14715708445196282
step_physics_mean0.1265524367475608
step_physics_median0.12859366992237292
step_physics_min0.10186532269353452
survival_time_max16.6500000000001
survival_time_mean9.275000000000029
survival_time_min3.599999999999995
No reset possible
5343012577Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-010:17:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.46767534266050315
survival_time_median14.550000000000072
deviation-center-line_median0.4947914603921105
in-drivable-lane_median6.1250000000000435


other stats
agent_compute-ego0_max0.010821854746019518
agent_compute-ego0_mean0.010764780232527905
agent_compute-ego0_median0.010764780232527905
agent_compute-ego0_min0.010707705719036292
agent_compute-ego1_max0.01036662668795199
agent_compute-ego1_mean0.01036615751386668
agent_compute-ego1_median0.01036615751386668
agent_compute-ego1_min0.010365688339781366
agent_compute-ego2_max0.01074271266524856
agent_compute-ego2_mean0.010364389675881446
agent_compute-ego2_median0.010364389675881446
agent_compute-ego2_min0.009986066686514332
agent_compute-ego3_max0.010941555908134393
agent_compute-ego3_mean0.01064655913820571
agent_compute-ego3_median0.01064655913820571
agent_compute-ego3_min0.010351562368277029
complete-iteration_max1.030329172675674
complete-iteration_mean0.9510232901170892
complete-iteration_median0.9510232901170892
complete-iteration_min0.8717174075585044
deviation-center-line_max1.2340961821728105
deviation-center-line_mean0.5740882372190792
deviation-center-line_min0.18439074482977807
deviation-heading_max9.89336417759698
deviation-heading_mean3.8469412731858306
deviation-heading_median2.5994044932190894
deviation-heading_min0.7805520674724286
driven_any_max2.811085470195488
driven_any_mean1.6353907877707912
driven_any_median1.6388351926111284
driven_any_min0.38992907230453727
driven_lanedir_consec_max1.729279566578996
driven_lanedir_consec_mean0.6731111064412199
driven_lanedir_consec_min0.3192616717652883
driven_lanedir_max1.985679044301906
driven_lanedir_mean0.7183405276415334
driven_lanedir_median0.5144441989315507
driven_lanedir_min0.3192616717652883
get_duckie_state_max1.796731003769883e-06
get_duckie_state_mean1.6228418472211813e-06
get_duckie_state_median1.6228418472211813e-06
get_duckie_state_min1.4489526906724793e-06
get_robot_state_max0.01548899186624063
get_robot_state_mean0.015102832579374208
get_robot_state_median0.015102832579374208
get_robot_state_min0.014716673292507783
get_state_dump_max0.010343649365880468
get_state_dump_mean0.010063240668848531
get_state_dump_median0.010063240668848531
get_state_dump_min0.009782831971816596
get_ui_image_max0.05354465020669473
get_ui_image_mean0.052689509719668064
get_ui_image_median0.052689509719668064
get_ui_image_min0.0518343692326414
in-drivable-lane_max14.700000000000127
in-drivable-lane_mean7.787500000000053
in-drivable-lane_min3.149999999999989
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 2.811085470195488, "get_ui_image": 0.0518343692326414, "step_physics": 0.6877353283581813, "survival_time": 18.05000000000012, "driven_lanedir": 1.985679044301906, "get_state_dump": 0.009782831971816596, "get_robot_state": 0.014716673292507783, "sim_render-ego0": 0.003933566709908333, "sim_render-ego1": 0.003859352011706948, "sim_render-ego2": 0.003718962326892831, "sim_render-ego3": 0.003850750501643228, "get_duckie_state": 1.4489526906724793e-06, "in-drivable-lane": 5.4500000000000774, "deviation-heading": 1.1835461994210874, "agent_compute-ego0": 0.010707705719036292, "agent_compute-ego1": 0.010365688339781366, "agent_compute-ego2": 0.009986066686514332, "agent_compute-ego3": 0.010351562368277029, "complete-iteration": 0.8717174075585044, "set_robot_commands": 0.0022797156434032797, "deviation-center-line": 0.8433943002957107, "driven_lanedir_consec": 1.729279566578996, "sim_compute_sim_state": 0.03340826772194541, "sim_compute_performance-ego0": 0.0022130453784162825, "sim_compute_performance-ego1": 0.00199666405251013, "sim_compute_performance-ego2": 0.00197522811468135, "sim_compute_performance-ego3": 0.002007878946335935}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.281856013323797, "get_ui_image": 0.0518343692326414, "step_physics": 0.6877353283581813, "survival_time": 18.05000000000012, "driven_lanedir": 0.4319797592418459, "get_state_dump": 0.009782831971816596, "get_robot_state": 0.014716673292507783, "sim_render-ego0": 0.003933566709908333, "sim_render-ego1": 0.003859352011706948, "sim_render-ego2": 0.003718962326892831, "sim_render-ego3": 0.003850750501643228, "get_duckie_state": 1.4489526906724793e-06, "in-drivable-lane": 14.050000000000129, "deviation-heading": 2.5819444733430332, "agent_compute-ego0": 0.010707705719036292, "agent_compute-ego1": 0.010365688339781366, "agent_compute-ego2": 0.009986066686514332, "agent_compute-ego3": 0.010351562368277029, "complete-iteration": 0.8717174075585044, "set_robot_commands": 0.0022797156434032797, "deviation-center-line": 0.34051915970784424, "driven_lanedir_consec": 0.4319797592418459, "sim_compute_sim_state": 0.03340826772194541, "sim_compute_performance-ego0": 0.0022130453784162825, "sim_compute_performance-ego1": 0.00199666405251013, "sim_compute_performance-ego2": 0.00197522811468135, "sim_compute_performance-ego3": 0.002007878946335935}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 2.05404400432433, "get_ui_image": 0.0518343692326414, "step_physics": 0.6877353283581813, "survival_time": 18.05000000000012, "driven_lanedir": 0.3452608587421049, "get_state_dump": 0.009782831971816596, "get_robot_state": 0.014716673292507783, "sim_render-ego0": 0.003933566709908333, "sim_render-ego1": 0.003859352011706948, "sim_render-ego2": 0.003718962326892831, "sim_render-ego3": 0.003850750501643228, "get_duckie_state": 1.4489526906724793e-06, "in-drivable-lane": 14.700000000000127, "deviation-heading": 2.616864513095146, "agent_compute-ego0": 0.010707705719036292, "agent_compute-ego1": 0.010365688339781366, "agent_compute-ego2": 0.009986066686514332, "agent_compute-ego3": 0.010351562368277029, "complete-iteration": 0.8717174075585044, "set_robot_commands": 0.0022797156434032797, "deviation-center-line": 0.2744113396428254, "driven_lanedir_consec": 0.3452608587421049, "sim_compute_sim_state": 0.03340826772194541, "sim_compute_performance-ego0": 0.0022130453784162825, "sim_compute_performance-ego1": 0.00199666405251013, "sim_compute_performance-ego2": 0.00197522811468135, "sim_compute_performance-ego3": 0.002007878946335935}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 2.1921646557830226, "get_ui_image": 0.0518343692326414, "step_physics": 0.6877353283581813, "survival_time": 18.05000000000012, "driven_lanedir": 0.950247335154313, "get_state_dump": 0.009782831971816596, "get_robot_state": 0.014716673292507783, "sim_render-ego0": 0.003933566709908333, "sim_render-ego1": 0.003859352011706948, "sim_render-ego2": 0.003718962326892831, "sim_render-ego3": 0.003850750501643228, "get_duckie_state": 1.4489526906724793e-06, "in-drivable-lane": 5.900000000000056, "deviation-heading": 9.89336417759698, "agent_compute-ego0": 0.010707705719036292, "agent_compute-ego1": 0.010365688339781366, "agent_compute-ego2": 0.009986066686514332, "agent_compute-ego3": 0.010351562368277029, "complete-iteration": 0.8717174075585044, "set_robot_commands": 0.0022797156434032797, "deviation-center-line": 1.2340961821728105, "driven_lanedir_consec": 0.9383491558168096, "sim_compute_sim_state": 0.03340826772194541, "sim_compute_performance-ego0": 0.0022130453784162825, "sim_compute_performance-ego1": 0.00199666405251013, "sim_compute_performance-ego2": 0.00197522811468135, "sim_compute_performance-ego3": 0.002007878946335935}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 1.6265458788524405, "get_ui_image": 0.05354465020669473, "step_physics": 0.8412444451907733, "survival_time": 11.050000000000022, "driven_lanedir": 0.5969086386212554, "get_state_dump": 0.010343649365880468, "get_robot_state": 0.01548899186624063, "sim_render-ego0": 0.004131005690978454, "sim_render-ego1": 0.004102485673921602, "sim_render-ego2": 0.004033402279690579, "sim_render-ego3": 0.00400162817121626, "get_duckie_state": 1.796731003769883e-06, "in-drivable-lane": 4.099999999999986, "deviation-heading": 5.515599778378545, "agent_compute-ego0": 0.010821854746019518, "agent_compute-ego1": 0.01036662668795199, "agent_compute-ego2": 0.01074271266524856, "agent_compute-ego3": 0.010941555908134393, "complete-iteration": 1.030329172675674, "set_robot_commands": 0.0025496235838881483, "deviation-center-line": 0.6490637610763768, "driven_lanedir_consec": 0.5033709260791603, "sim_compute_sim_state": 0.03234985282829216, "sim_compute_performance-ego0": 0.0023141659057892123, "sim_compute_performance-ego1": 0.00209789125768988, "sim_compute_performance-ego2": 0.002042086274774225, "sim_compute_performance-ego3": 0.002054347648276939}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.6511245063698163, "get_ui_image": 0.05354465020669473, "step_physics": 0.8412444451907733, "survival_time": 11.050000000000022, "driven_lanedir": 0.7044487625693081, "get_state_dump": 0.010343649365880468, "get_robot_state": 0.01548899186624063, "sim_render-ego0": 0.004131005690978454, "sim_render-ego1": 0.004102485673921602, "sim_render-ego2": 0.004033402279690579, "sim_render-ego3": 0.00400162817121626, "get_duckie_state": 1.796731003769883e-06, "in-drivable-lane": 6.350000000000031, "deviation-heading": 0.7805520674724286, "agent_compute-ego0": 0.010821854746019518, "agent_compute-ego1": 0.01036662668795199, "agent_compute-ego2": 0.01074271266524856, "agent_compute-ego3": 0.010941555908134393, "complete-iteration": 1.030329172675674, "set_robot_commands": 0.0025496235838881483, "deviation-center-line": 0.20859790767505185, "driven_lanedir_consec": 0.7044487625693081, "sim_compute_sim_state": 0.03234985282829216, "sim_compute_performance-ego0": 0.0023141659057892123, "sim_compute_performance-ego1": 0.00209789125768988, "sim_compute_performance-ego2": 0.002042086274774225, "sim_compute_performance-ego3": 0.002054347648276939}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 1.076376701012898, "get_ui_image": 0.05354465020669473, "step_physics": 0.8412444451907733, "survival_time": 11.050000000000022, "driven_lanedir": 0.4129381507362462, "get_state_dump": 0.010343649365880468, "get_robot_state": 0.01548899186624063, "sim_render-ego0": 0.004131005690978454, "sim_render-ego1": 0.004102485673921602, "sim_render-ego2": 0.004033402279690579, "sim_render-ego3": 0.00400162817121626, "get_duckie_state": 1.796731003769883e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 7.197997781935392, "agent_compute-ego0": 0.010821854746019518, "agent_compute-ego1": 0.01036662668795199, "agent_compute-ego2": 0.01074271266524856, "agent_compute-ego3": 0.010941555908134393, "complete-iteration": 1.030329172675674, "set_robot_commands": 0.0025496235838881483, "deviation-center-line": 0.8582325023522362, "driven_lanedir_consec": 0.4129381507362462, "sim_compute_sim_state": 0.03234985282829216, "sim_compute_performance-ego0": 0.0023141659057892123, "sim_compute_performance-ego1": 0.00209789125768988, "sim_compute_performance-ego2": 0.002042086274774225, "sim_compute_performance-ego3": 0.002054347648276939}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.38992907230453727, "get_ui_image": 0.05354465020669473, "step_physics": 0.8412444451907733, "survival_time": 11.050000000000022, "driven_lanedir": 0.3192616717652883, "get_state_dump": 0.010343649365880468, "get_robot_state": 0.01548899186624063, "sim_render-ego0": 0.004131005690978454, "sim_render-ego1": 0.004102485673921602, "sim_render-ego2": 0.004033402279690579, "sim_render-ego3": 0.00400162817121626, "get_duckie_state": 1.796731003769883e-06, "in-drivable-lane": 8.600000000000023, "deviation-heading": 1.0056611942440323, "agent_compute-ego0": 0.010821854746019518, "agent_compute-ego1": 0.01036662668795199, "agent_compute-ego2": 0.01074271266524856, "agent_compute-ego3": 0.010941555908134393, "complete-iteration": 1.030329172675674, "set_robot_commands": 0.0025496235838881483, "deviation-center-line": 0.18439074482977807, "driven_lanedir_consec": 0.3192616717652883, "sim_compute_sim_state": 0.03234985282829216, "sim_compute_performance-ego0": 0.0023141659057892123, "sim_compute_performance-ego1": 0.00209789125768988, "sim_compute_performance-ego2": 0.002042086274774225, "sim_compute_performance-ego3": 0.002054347648276939}}
set_robot_commands_max0.0025496235838881483
set_robot_commands_mean0.002414669613645714
set_robot_commands_median0.002414669613645714
set_robot_commands_min0.0022797156434032797
sim_compute_performance-ego0_max0.0023141659057892123
sim_compute_performance-ego0_mean0.0022636056421027474
sim_compute_performance-ego0_median0.0022636056421027474
sim_compute_performance-ego0_min0.0022130453784162825
sim_compute_performance-ego1_max0.00209789125768988
sim_compute_performance-ego1_mean0.0020472776551000047
sim_compute_performance-ego1_median0.0020472776551000047
sim_compute_performance-ego1_min0.00199666405251013
sim_compute_performance-ego2_max0.002042086274774225
sim_compute_performance-ego2_mean0.0020086571947277873
sim_compute_performance-ego2_median0.0020086571947277873
sim_compute_performance-ego2_min0.00197522811468135
sim_compute_performance-ego3_max0.002054347648276939
sim_compute_performance-ego3_mean0.0020311132973064366
sim_compute_performance-ego3_median0.0020311132973064366
sim_compute_performance-ego3_min0.002007878946335935
sim_compute_sim_state_max0.03340826772194541
sim_compute_sim_state_mean0.03287906027511879
sim_compute_sim_state_median0.03287906027511879
sim_compute_sim_state_min0.03234985282829216
sim_render-ego0_max0.004131005690978454
sim_render-ego0_mean0.004032286200443394
sim_render-ego0_median0.004032286200443394
sim_render-ego0_min0.003933566709908333
sim_render-ego1_max0.004102485673921602
sim_render-ego1_mean0.003980918842814275
sim_render-ego1_median0.003980918842814275
sim_render-ego1_min0.003859352011706948
sim_render-ego2_max0.004033402279690579
sim_render-ego2_mean0.0038761823032917057
sim_render-ego2_median0.0038761823032917057
sim_render-ego2_min0.003718962326892831
sim_render-ego3_max0.00400162817121626
sim_render-ego3_mean0.003926189336429744
sim_render-ego3_median0.003926189336429744
sim_render-ego3_min0.003850750501643228
simulation-passed1
step_physics_max0.8412444451907733
step_physics_mean0.7644898867744774
step_physics_median0.7644898867744774
step_physics_min0.6877353283581813
survival_time_max18.05000000000012
survival_time_mean14.550000000000072
survival_time_min11.050000000000022
No reset possible
5338912574Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simabortednonogpu-prod-010:19:35
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5337911410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simabortednonogpu-prod-010:28:32
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5336612620Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-validationLFVIv-simabortednonogpu-prod-010:01:55
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5333112573Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simabortednonogpu-prod-010:06:45
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5327912547Bea Baselines 🐤template-rosaido5-LFVI_multi-sim-validationLFVIv-simabortednonogpu-prod-010:30:40
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5325612546Bea Baselines 🐤template-rosaido5-LFVI-sim-testingLFVIt-simhost-errornonogpu-prod-010:02:02
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [f18300df13234fd1b1fcfc1e5338d1be36f6766bb9df341ff101405aab5c3177,
│                 3c26c3abd991b26852a5f6ac35e6f1656b105c04f5aeb7350023d32fd962a100]
│      services: dict[7]
│                │ npc0:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:90d821dbc5a9437a132c21fee46800a415b04767409c23ae0a44fc4a4f33f5f3
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_NAME: npc0
│                │ │ │ AIDONODE_DATA_IN: /fifos/npc0-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc0-out
│                │ │ │ challenge_name: aido5-LFVI-sim-testing
│                │ │ │ challenge_step_name: LFVIt-sim
│                │ │ │ submission_id: 12546
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2020_12_02_17_38_41@sha256:a58d28a52a77d26cf2e8fc6906127b70003e987137f94eccfff45688dd97e117
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-01_7109a145a2d8}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_02_17_58_06-34146/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ npc1:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:90d821dbc5a9437a132c21fee46800a415b04767409c23ae0a44fc4a4f33f5f3
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_NAME: npc1
│                │ │ │ AIDONODE_DATA_IN: /fifos/npc1-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc1-out
│                │ │ │ challenge_name: aido5-LFVI-sim-testing
│                │ │ │ challenge_step_name: LFVIt-sim
│                │ │ │ submission_id: 12546
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2020_12_02_17_38_41@sha256:a58d28a52a77d26cf2e8fc6906127b70003e987137f94eccfff45688dd97e117
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-01_7109a145a2d8}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_02_17_58_06-34146/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ npc2:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:90d821dbc5a9437a132c21fee46800a415b04767409c23ae0a44fc4a4f33f5f3
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_NAME: npc2
│                │ │ │ AIDONODE_DATA_IN: /fifos/npc2-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc2-out
│                │ │ │ challenge_name: aido5-LFVI-sim-testing
│                │ │ │ challenge_step_name: LFVIt-sim
│                │ │ │ submission_id: 12546
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2020_12_02_17_38_41@sha256:a58d28a52a77d26cf2e8fc6906127b70003e987137f94eccfff45688dd97e117
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-01_7109a145a2d8}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_02_17_58_06-34146/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ npc3:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-minimal-agent-full@sha256:90d821dbc5a9437a132c21fee46800a415b04767409c23ae0a44fc4a4f33f5f3
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_NAME: npc3
│                │ │ │ AIDONODE_DATA_IN: /fifos/npc3-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/npc3-out
│                │ │ │ challenge_name: aido5-LFVI-sim-testing
│                │ │ │ challenge_step_name: LFVIt-sim
│                │ │ │ submission_id: 12546
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2020_12_02_17_38_41@sha256:a58d28a52a77d26cf2e8fc6906127b70003e987137f94eccfff45688dd97e117
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-01_7109a145a2d8}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_02_17_58_06-34146/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/aido5-lfvi-sim-testing-lfvit-sim-evaluator@sha256:a43ca7fe928ab20ca8791d659f6aa6eb6d9b2295a2d5d9c06d456ecb80e91600
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 20200922
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LFVI-sim-testing
│                │ │ │ challenge_step_name: LFVIt-sim
│                │ │ │ submission_id: 12546
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2020_12_02_17_38_41@sha256:a58d28a52a77d26cf2e8fc6906127b70003e987137f94eccfff45688dd97e117
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-01_7109a145a2d8}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_02_17_58_06-34146/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:dd7e5062f25d3dcefbc8cc778324751abdad27f4331a0723e8f991635dbfc727
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LFVI-sim-testing
│                │ │ │ challenge_step_name: LFVIt-sim
│                │ │ │ submission_id: 12546
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2020_12_02_17_38_41@sha256:a58d28a52a77d26cf2e8fc6906127b70003e987137f94eccfff45688dd97e117
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-01_7109a145a2d8}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_02_17_58_06-34146/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/andreacensi/aido-submissions@sha256:a58d28a52a77d26cf2e8fc6906127b70003e987137f94eccfff45688dd97e117
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: aido5-LFVI-sim-testing
│                │ │ │ challenge_step_name: LFVIt-sim
│                │ │ │ submission_id: 12546
│                │ │ │ submitter_name: Bea Baselines
│                │ │ │ SUBMISSION_CONTAINER: docker.io/andreacensi/aido-submissions:2020_12_02_17_38_41@sha256:a58d28a52a77d26cf2e8fc6906127b70003e987137f94eccfff45688dd97e117
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-01_7109a145a2d8}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LFVI-sim-testing/submission12546/LFVIt-sim-nogpu-prod-01_7109a145a2d8-job53256-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_02_17_58_06-34146/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: dict[2]
│                │ npc3: f18300df13234fd1b1fcfc1e5338d1be36f6766bb9df341ff101405aab5c3177
│                │ solution-ego0: 3c26c3abd991b26852a5f6ac35e6f1656b105c04f5aeb7350023d32fd962a100
│         names: dict[2]
│                │ f18300df13234fd1b1fcfc1e5338d1be36f6766bb9df341ff101405aab5c3177: nogpu-prod-01_7109a145a2d8-job53256-179045_npc3_1
│                │ 3c26c3abd991b26852a5f6ac35e6f1656b105c04f5aeb7350023d32fd962a100: nogpu-prod-01_7109a145a2d8-job53256-179045_solution-ego0_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |f18300df13234fd1b1fcfc1e5338d1be36f6766bb9df341ff101405aab5c3177
│         |3c26c3abd991b26852a5f6ac35e6f1656b105c04f5aeb7350023d32fd962a100
│         |
│  names: dict[2]
│         │ f18300df13234fd1b1fcfc1e5338d1be36f6766bb9df341ff101405aab5c3177: nogpu-prod-01_7109a145a2d8-job53256-179045_npc3_1
│         │ 3c26c3abd991b26852a5f6ac35e6f1656b105c04f5aeb7350023d32fd962a100: nogpu-prod-01_7109a145a2d8-job53256-179045_solution-ego0_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5322112479Bea Baselines 🐤straightaido5-LFV_multi-sim-testingLFVmultibodyv-simerrornonogpu-prod-010:07:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139952030298064
- M:video_aido:cmdline(in:/;out:/) 139952030296000
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5317911764Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-010:12:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139914611669552
- M:video_aido:cmdline(in:/;out:/) 139914611668256
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5313911771Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-010:10:25
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139843458214064
- M:video_aido:cmdline(in:/;out:/) 139843458215840
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5312712341Bea Baselines 🐤template-rosaido5-LFP-sim-validationLFP-simerrornonogpu-prod-010:02:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140188247016064
- M:video_aido:cmdline(in:/;out:/) 140188247015632
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5312111867Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-010:02:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5310811867Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-010:01:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5308412342Bea Baselines 🐤template-rosaido5-LFP-sim-testingLFP-simerrornonogpu-prod-010:02:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140565653366048
- M:video_aido:cmdline(in:/;out:/) 140564183268656
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5306812347Bea Baselines 🐤template-rosaido5-LFI-full-sim-validationLFVIv-simerrornonogpu-prod-010:02:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140656286088640
- M:video_aido:cmdline(in:/;out:/) 140656286126384
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5304512383Bea Baselines 🐤baseline-duckietownaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:09:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139619665623696
- M:video_aido:cmdline(in:/;out:/) 139619665554016
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5303912385Bea Baselines 🐤baseline-duckietownaido5-LFI-full-sim-testingLFVIv-simerrornonogpu-prod-010:04:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140499986878768
- M:video_aido:cmdline(in:/;out:/) 140499986879104
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5302912386Bea Baselines 🐤baseline-duckietownaido5-LFP-sim-validationLFP-simerrornonogpu-prod-010:13:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140513048933664
- M:video_aido:cmdline(in:/;out:/) 140513048885376
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5298312397Bea Baselines 🐤baseline-duckietownaido5-LFVI_multi-sim-validationLFVIv-simerrornonogpu-prod-010:17:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139859005848352
- M:video_aido:cmdline(in:/;out:/) 139859161277104
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5296812403Bea Baselines 🐤template-randomaido5-LFP-sim-testingLFP-simerrornonogpu-prod-010:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140442574896144
- M:video_aido:cmdline(in:/;out:/) 140442575826848
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5294112404Bea Baselines 🐤template-randomaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornonogpu-prod-010:03:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139738970067584
- M:video_aido:cmdline(in:/;out:/) 139738970070224
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5292812409Bea Baselines 🐤template-randomaido5-LF-sim-testingLFt-simerrornonogpu-prod-010:01:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140651045481920
- M:video_aido:cmdline(in:/;out:/) 140651045478848
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5291112413Bea Baselines 🐤template-randomaido5-LFVI_multi-sim-validationLFVIv-simerrornonogpu-prod-010:03:11
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140674923817472
- M:video_aido:cmdline(in:/;out:/) 140674923818096
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5290012436Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simhost-errornonogpu-prod-010:01:30
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5288812436Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simerrornonogpu-prod-010:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139714144276736
- M:video_aido:cmdline(in:/;out:/) 139714144285024
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5285912434Bea Baselines 🐤straightaido5-LFV_multi-sim-testingLFVmultibodyv-simerrornonogpu-prod-010:03:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140679095949728
- M:video_aido:cmdline(in:/;out:/) 140679095947664
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5284812432Bea Baselines 🐤straightaido5-LFP-sim-testingLFP-simabortednonogpu-prod-010:00:28
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5281712442Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simabortednonogpu-prod-010:02:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5280512410Bea Baselines 🐤template-randomaido5-LFV-sim-testingLFVv-simerrornonogpu-prod-010:02:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140471744112336
- M:video_aido:cmdline(in:/;out:/) 140471743725040
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5277112386Bea Baselines 🐤baseline-duckietownaido5-LFP-sim-validationLFP-simerrornonogpu-prod-010:02:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140267248532688
- M:video_aido:cmdline(in:/;out:/) 140267248530720
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5274212349Bea Baselines 🐤template-rosaido5-LFV-sim-testingLFVv-simerrornonogpu-prod-010:03:09
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139770031313728
- M:video_aido:cmdline(in:/;out:/) 139770031312656
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5266911772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednonogpu-prod-010:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525906845Daniil Lisusexercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:06:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140165392336784
- M:video_aido:cmdline(in:/;out:/) 140165392336256
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525296831Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:11:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140020961175632
- M:video_aido:cmdline(in:/;out:/) 140020961173760
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524726848Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-010:06:09
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 385 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524089315Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:08:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140713858572640
- M:video_aido:cmdline(in:/;out:/) 140713858573456
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
523699277Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-010:02:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
522809323Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:11:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139684403047872
- M:video_aido:cmdline(in:/;out:/) 139684403044752
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
522039772Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutnonogpu-prod-010:07:35
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
521699764Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:03:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140275395537648
- M:video_aido:cmdline(in:/;out:/) 140275395535344
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5209610007Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simtimeoutnonogpu-prod-010:10:55
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5204310034Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:09:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139990025838656
- M:video_aido:cmdline(in:/;out:/) 139990025848144
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5196410066Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-010:08:15
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5186810715Philippe Reddy 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:07:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140372430860240
- M:video_aido:cmdline(in:/;out:/) 140372430872288
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5178010741Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-010:10:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139910355737088
- M:video_aido:cmdline(in:/;out:/) 139910356436640
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5167510795Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:11:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140056724747360
- M:video_aido:cmdline(in:/;out:/) 140056724747024
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5164010809Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:03:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140316586554416
- M:video_aido:cmdline(in:/;out:/) 140316586554368
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5161710807Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:02:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140703179457728
- M:video_aido:cmdline(in:/;out:/) 140703179336480
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5154010835Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:08:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140385360522352
- M:video_aido:cmdline(in:/;out:/) 140385360519952
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5151711010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednonogpu-prod-010:01:50
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5145710863Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:03:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140215758079120
- M:video_aido:cmdline(in:/;out:/) 140215758080032
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5141910878Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-010:03:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 9 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5138210933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednonogpu-prod-010:01:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5131610897Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-010:05:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140674958810464
- M:video_aido:cmdline(in:/;out:/) 140674958687872
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5128310909Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-010:04:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5124210919Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:02:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139668624215584
- M:video_aido:cmdline(in:/;out:/) 139668624214432
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5121610949Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:03:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140175418079744
- M:video_aido:cmdline(in:/;out:/) 140175418077536
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5113110952Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:09:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140589837471808
- M:video_aido:cmdline(in:/;out:/) 140589837622624
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5105110971Himanshu Arora 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-010:08:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140256858585936
- M:video_aido:cmdline(in:/;out:/) 140256856616432
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5101410983Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-010:03:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 183 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5099911012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednonogpu-prod-010:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5092611003Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:08:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139623855751952
- M:video_aido:cmdline(in:/;out:/) 139623855755024
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5089811022Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-010:03:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5087711024Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-010:00:47
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5079911063Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:08:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139886345482880
- M:video_aido:cmdline(in:/;out:/) 139886346011216
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5077711286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-010:02:18
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5069011084Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-010:05:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139714383272256
- M:video_aido:cmdline(in:/;out:/) 139714383654576
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5063411131Melisande Tengreal-exercise-1aido5-LF-sim-validationLFv-simfailednonogpu-prod-010:02:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5058511129Melisande Tengsim-exercise-1aido5-LF-sim-validationLFv-simfailednonogpu-prod-010:02:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5057011305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-010:00:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5052811109Daniil Lisusreal-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-010:01:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140356480106752
- M:video_aido:cmdline(in:/;out:/) 140356480106560
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5049411278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-010:03:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5042311305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simtimeoutnonogpu-prod-010:05:21
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5039211220Étienne Boucher 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailednonogpu-prod-010:02:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>