Duckietown Challenges Home Challenges Submissions

Evaluator 4771

ID4771
evaluatornogpu-prod-04
ownerI don't have one 😀
machinenogpu-prod_f1b0bf41b8f7
processnogpu-prod-04_f1b0bf41b8f7
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success45 53417
# timeout2 50164
# failed16 49791
# error71 47642
# aborted31 47293
# host-error56 47924
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5790510771Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:08:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6148195940628044
survival_time_median8.72499999999999
deviation-center-line_median0.1834054053898561
in-drivable-lane_median5.224999999999994


other stats
agent_compute-ego0_max0.01522603860268226
agent_compute-ego0_mean0.013783174580866392
agent_compute-ego0_median0.01330527729544964
agent_compute-ego0_min0.01329610512988402
complete-iteration_max0.23908810168504716
complete-iteration_mean0.20964165368154392
complete-iteration_median0.2139853912535946
complete-iteration_min0.1715077305339394
deviation-center-line_max0.8746131716779814
deviation-center-line_mean0.336467366549992
deviation-center-line_min0.1044454837422745
deviation-heading_max4.077320331682576
deviation-heading_mean1.7048262260287792
deviation-heading_median1.04525850496508
deviation-heading_min0.6514675625023811
driven_any_max5.042320791680117
driven_any_mean2.381550185534684
driven_any_median1.561168783672598
driven_any_min1.3615423831134228
driven_lanedir_consec_max3.2856112355024587
driven_lanedir_consec_mean1.2705256194963912
driven_lanedir_consec_min0.5668520543574984
driven_lanedir_max3.2856112355024587
driven_lanedir_mean1.2705256194963912
driven_lanedir_median0.6148195940628044
driven_lanedir_min0.5668520543574984
get_duckie_state_max2.1122469760403777e-06
get_duckie_state_mean1.9546828432991896e-06
get_duckie_state_median1.9584274688876383e-06
get_duckie_state_min1.7896294593811034e-06
get_robot_state_max0.0043341242350064795
get_robot_state_mean0.004136228292349735
get_robot_state_median0.004119634207817587
get_robot_state_min0.0039715205187572855
get_state_dump_max0.00531080594429603
get_state_dump_mean0.005049464290892423
get_state_dump_median0.004993349675199773
get_state_dump_min0.004900351868874116
get_ui_image_max0.037241557240486146
get_ui_image_mean0.032325308818626906
get_ui_image_median0.03318950997660323
get_ui_image_min0.02568065808081502
in-drivable-lane_max8.40000000000012
in-drivable-lane_mean5.787500000000023
in-drivable-lane_min4.299999999999985
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.042320791680117, "get_ui_image": 0.030662593275013535, "step_physics": 0.1238346793864033, "survival_time": 25.200000000000223, "driven_lanedir": 3.2856112355024587, "get_state_dump": 0.005024009175819926, "get_robot_state": 0.004205042772954053, "sim_render-ego0": 0.004317737805961382, "get_duckie_state": 2.1122469760403777e-06, "in-drivable-lane": 8.40000000000012, "deviation-heading": 4.077320331682576, "agent_compute-ego0": 0.01329610512988402, "complete-iteration": 0.1982556201443814, "set_robot_commands": 0.0024841558815229055, "deviation-center-line": 0.8746131716779814, "driven_lanedir_consec": 3.2856112355024587, "sim_compute_sim_state": 0.011894628789165232, "sim_compute_performance-ego0": 0.0024161622075751276}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3949124132760131, "get_ui_image": 0.037241557240486146, "step_physics": 0.15974288284778596, "survival_time": 7.94999999999998, "driven_lanedir": 0.5668520543574984, "get_state_dump": 0.00496269017457962, "get_robot_state": 0.004034225642681122, "sim_render-ego0": 0.004271352291107177, "get_duckie_state": 1.7896294593811034e-06, "in-drivable-lane": 4.449999999999984, "deviation-heading": 1.4210483575056132, "agent_compute-ego0": 0.01330678164958954, "complete-iteration": 0.23908810168504716, "set_robot_commands": 0.002411459386348724, "deviation-center-line": 0.20968358456035405, "driven_lanedir_consec": 0.5668520543574984, "sim_compute_sim_state": 0.0106510728597641, "sim_compute_performance-ego0": 0.002354210615158081}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3615423831134228, "get_ui_image": 0.03571642667819292, "step_physics": 0.14915506197856024, "survival_time": 7.7499999999999805, "driven_lanedir": 0.5989593871391696, "get_state_dump": 0.00531080594429603, "get_robot_state": 0.0043341242350064795, "sim_render-ego0": 0.004672513558314397, "get_duckie_state": 2.110615754738832e-06, "in-drivable-lane": 4.299999999999985, "deviation-heading": 0.6694686524245466, "agent_compute-ego0": 0.01522603860268226, "complete-iteration": 0.22971516236280784, "set_robot_commands": 0.002707035113603641, "deviation-center-line": 0.1044454837422745, "driven_lanedir_consec": 0.5989593871391696, "sim_compute_sim_state": 0.009935490595988736, "sim_compute_performance-ego0": 0.0025308865767258862}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7274251540691827, "get_ui_image": 0.02568065808081502, "step_physics": 0.10944005831373924, "survival_time": 9.5, "driven_lanedir": 0.6306798009864392, "get_state_dump": 0.004900351868874116, "get_robot_state": 0.0039715205187572855, "sim_render-ego0": 0.0039979937188912434, "get_duckie_state": 1.8062391830364448e-06, "in-drivable-lane": 6.000000000000004, "deviation-heading": 0.6514675625023811, "agent_compute-ego0": 0.013303772941309744, "complete-iteration": 0.1715077305339394, "set_robot_commands": 0.0026175426563043243, "deviation-center-line": 0.1571272262193582, "driven_lanedir_consec": 0.6306798009864392, "sim_compute_sim_state": 0.005387322440821463, "sim_compute_performance-ego0": 0.0021042037384672316}}
set_robot_commands_max0.002707035113603641
set_robot_commands_mean0.0025550482594448986
set_robot_commands_median0.002550849268913615
set_robot_commands_min0.002411459386348724
sim_compute_performance-ego0_max0.0025308865767258862
sim_compute_performance-ego0_mean0.0023513657844815815
sim_compute_performance-ego0_median0.002385186411366604
sim_compute_performance-ego0_min0.0021042037384672316
sim_compute_sim_state_max0.011894628789165232
sim_compute_sim_state_mean0.009467128671434883
sim_compute_sim_state_median0.010293281727876418
sim_compute_sim_state_min0.005387322440821463
sim_render-ego0_max0.004672513558314397
sim_render-ego0_mean0.00431489934356855
sim_render-ego0_median0.004294545048534279
sim_render-ego0_min0.0039979937188912434
simulation-passed1
step_physics_max0.15974288284778596
step_physics_mean0.1355431706316222
step_physics_median0.13649487068248178
step_physics_min0.10944005831373924
survival_time_max25.200000000000223
survival_time_mean12.600000000000046
survival_time_min7.7499999999999805
No reset possible
5790110786Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:03:31
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5788210784Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:15:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6959790711489267
survival_time_median19.575000000000145
deviation-center-line_median0.908797111367774
in-drivable-lane_median4.975000000000037


other stats
agent_compute-ego0_max0.013580323784214676
agent_compute-ego0_mean0.0130431065877683
agent_compute-ego0_median0.013034669800479098
agent_compute-ego0_min0.012522762965900328
complete-iteration_max0.24792072844744523
complete-iteration_mean0.2057082546077018
complete-iteration_median0.19797049490355223
complete-iteration_min0.17897130017625745
deviation-center-line_max2.1286879696316365
deviation-center-line_mean1.0180384958595516
deviation-center-line_min0.12587179107102192
deviation-heading_max9.231661776586725
deviation-heading_mean5.101650421949353
deviation-heading_median5.2650610689908035
deviation-heading_min0.6448177732290822
driven_any_max7.416483668855816
driven_any_mean4.121079586350292
driven_any_median3.858746531987403
driven_any_min1.350341612570544
driven_lanedir_consec_max5.303701535421841
driven_lanedir_consec_mean2.8398597130255245
driven_lanedir_consec_min0.6637791743824045
driven_lanedir_max5.303701535421841
driven_lanedir_mean2.8450061934823068
driven_lanedir_median2.7062720320624902
driven_lanedir_min0.6637791743824045
get_duckie_state_max1.6491883879254578e-06
get_duckie_state_mean1.5147609606420568e-06
get_duckie_state_median1.5337762311909806e-06
get_duckie_state_min1.3423029922608077e-06
get_robot_state_max0.004009840594735115
get_robot_state_mean0.0038066493374032022
get_robot_state_median0.003852321194277987
get_robot_state_min0.003512114366321717
get_state_dump_max0.0050584404331863305
get_state_dump_mean0.004776017479670094
get_state_dump_median0.004797295237739684
get_state_dump_min0.004451039010014674
get_ui_image_max0.036327090151732584
get_ui_image_mean0.03138552596197424
get_ui_image_median0.03110904157468273
get_ui_image_min0.02699693054679891
in-drivable-lane_max9.499999999999762
in-drivable-lane_mean5.887499999999956
in-drivable-lane_min4.099999999999985
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.416483668855816, "get_ui_image": 0.02699693054679891, "step_physics": 0.11418696926362391, "survival_time": 37.25000000000002, "driven_lanedir": 5.303701535421841, "get_state_dump": 0.004451039010014674, "get_robot_state": 0.003512114366321717, "sim_render-ego0": 0.0037277083614236863, "get_duckie_state": 1.3423029922608077e-06, "in-drivable-lane": 9.499999999999762, "deviation-heading": 9.231661776586725, "agent_compute-ego0": 0.012522762965900328, "complete-iteration": 0.17897130017625745, "set_robot_commands": 0.002137977380215642, "deviation-center-line": 1.6031963125027653, "driven_lanedir_consec": 5.303701535421841, "sim_compute_sim_state": 0.009419757303539614, "sim_compute_performance-ego0": 0.00193334201066168}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.002151977569645, "get_ui_image": 0.036327090151732584, "step_physics": 0.1699936238419651, "survival_time": 29.85000000000029, "driven_lanedir": 4.713280140139978, "get_state_dump": 0.004756044783321113, "get_robot_state": 0.003834875531021169, "sim_render-ego0": 0.003953063368398609, "get_duckie_state": 1.5273939406991404e-06, "in-drivable-lane": 4.850000000000069, "deviation-heading": 8.91030084981301, "agent_compute-ego0": 0.013176585918286174, "complete-iteration": 0.24792072844744523, "set_robot_commands": 0.002217942256991281, "deviation-center-line": 2.1286879696316365, "driven_lanedir_consec": 4.709195499253962, "sim_compute_sim_state": 0.011450436202977414, "sim_compute_performance-ego0": 0.002118747369900196}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.350341612570544, "get_ui_image": 0.03349168133583798, "step_physics": 0.1419233592452517, "survival_time": 7.79999999999998, "driven_lanedir": 0.6637791743824045, "get_state_dump": 0.0050584404331863305, "get_robot_state": 0.004009840594735115, "sim_render-ego0": 0.004223144737778196, "get_duckie_state": 1.6491883879254578e-06, "in-drivable-lane": 4.099999999999985, "deviation-heading": 0.6448177732290822, "agent_compute-ego0": 0.013580323784214676, "complete-iteration": 0.21604206607599927, "set_robot_commands": 0.0023057870804124576, "deviation-center-line": 0.12587179107102192, "driven_lanedir_consec": 0.6637791743824045, "sim_compute_sim_state": 0.00909691099907942, "sim_compute_performance-ego0": 0.002252451173818795}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7153410864051608, "get_ui_image": 0.02872640181352748, "step_physics": 0.1154589257775781, "survival_time": 9.299999999999995, "driven_lanedir": 0.6992639239850025, "get_state_dump": 0.004838545692158256, "get_robot_state": 0.0038697668575348064, "sim_render-ego0": 0.004033254429618305, "get_duckie_state": 1.5401585216828209e-06, "in-drivable-lane": 5.100000000000004, "deviation-heading": 1.6198212881685958, "agent_compute-ego0": 0.01289275368267202, "complete-iteration": 0.17989892373110522, "set_robot_commands": 0.002365123779378473, "deviation-center-line": 0.21439791023278296, "driven_lanedir_consec": 0.6827626430438911, "sim_compute_sim_state": 0.0055283696893702215, "sim_compute_performance-ego0": 0.002100950893871287}}
set_robot_commands_max0.002365123779378473
set_robot_commands_mean0.0022567076242494635
set_robot_commands_median0.0022618646687018696
set_robot_commands_min0.002137977380215642
sim_compute_performance-ego0_max0.002252451173818795
sim_compute_performance-ego0_mean0.00210137286206299
sim_compute_performance-ego0_median0.0021098491318857415
sim_compute_performance-ego0_min0.00193334201066168
sim_compute_sim_state_max0.011450436202977414
sim_compute_sim_state_mean0.008873868548741667
sim_compute_sim_state_median0.009258334151309515
sim_compute_sim_state_min0.0055283696893702215
sim_render-ego0_max0.004223144737778196
sim_render-ego0_mean0.0039842927243047
sim_render-ego0_median0.003993158899008457
sim_render-ego0_min0.0037277083614236863
simulation-passed1
step_physics_max0.1699936238419651
step_physics_mean0.1353907195321047
step_physics_median0.1286911425114149
step_physics_min0.11418696926362391
survival_time_max37.25000000000002
survival_time_mean21.05000000000007
survival_time_min7.79999999999998
No reset possible
5787910786Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:03:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 19 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5786310791Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:09:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4025034785185587
survival_time_median13.77500000000006
deviation-center-line_median0.2391610096312946
in-drivable-lane_median11.275000000000048


other stats
agent_compute-ego0_max0.013813330156169475
agent_compute-ego0_mean0.012812749575181352
agent_compute-ego0_median0.012732934488988466
agent_compute-ego0_min0.011971799166578995
complete-iteration_max0.23691943486531575
complete-iteration_mean0.1902072316251997
complete-iteration_median0.1845939487324814
complete-iteration_min0.15472159417052017
deviation-center-line_max0.4434020817231499
deviation-center-line_mean0.2580149733158617
deviation-center-line_min0.11033579227770776
deviation-heading_max4.0267507217281135
deviation-heading_mean1.739627515395147
deviation-heading_median1.187648493035628
deviation-heading_min0.5564623537812183
driven_any_max5.243140436481754
driven_any_mean2.824393216429971
driven_any_median2.669782977413201
driven_any_min0.7148664744117297
driven_lanedir_consec_max0.6343486619424625
driven_lanedir_consec_mean0.42799784420841264
driven_lanedir_consec_min0.27263575785407057
driven_lanedir_max0.6367434194193435
driven_lanedir_mean0.4285965335776329
driven_lanedir_median0.4025034785185587
driven_lanedir_min0.27263575785407057
get_duckie_state_max1.984390200438053e-06
get_duckie_state_mean1.576913586020892e-06
get_duckie_state_median1.5079416583979146e-06
get_duckie_state_min1.3073808268496866e-06
get_robot_state_max0.004129801835886151
get_robot_state_mean0.0037485764483908184
get_robot_state_median0.003645209439467873
get_robot_state_min0.003574085078741375
get_state_dump_max0.005059283276588921
get_state_dump_mean0.004684092903363385
get_state_dump_median0.004589609943400106
get_state_dump_min0.004497868450064408
get_ui_image_max0.03552353117201063
get_ui_image_mean0.0308483001935945
get_ui_image_median0.031119488742137387
get_ui_image_min0.025630692118092588
in-drivable-lane_max20.75000000000019
in-drivable-lane_mean11.487500000000068
in-drivable-lane_min2.6499999999999915
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.3815480171065886, "get_ui_image": 0.02870972185249788, "step_physics": 0.1042757781155138, "survival_time": 12.40000000000004, "driven_lanedir": 0.5259207771214769, "get_state_dump": 0.0046635746477119416, "get_robot_state": 0.003690412245601057, "sim_render-ego0": 0.003974339090676671, "get_duckie_state": 1.5482845076595444e-06, "in-drivable-lane": 9.150000000000013, "deviation-heading": 1.6045336629264428, "agent_compute-ego0": 0.013022138411740224, "complete-iteration": 0.1730641638897509, "set_robot_commands": 0.002343218010592173, "deviation-center-line": 0.34373994502922217, "driven_lanedir_consec": 0.5259207771214769, "sim_compute_sim_state": 0.010216655501400131, "sim_compute_performance-ego0": 0.002070507371282003}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7148664744117297, "get_ui_image": 0.03552353117201063, "step_physics": 0.16254215505388048, "survival_time": 4.449999999999992, "driven_lanedir": 0.27908617991564055, "get_state_dump": 0.0045156452390882704, "get_robot_state": 0.0036000066333346896, "sim_render-ego0": 0.003887221548292372, "get_duckie_state": 1.4675988091362848e-06, "in-drivable-lane": 2.6499999999999915, "deviation-heading": 0.7707633231448136, "agent_compute-ego0": 0.012443730566236709, "complete-iteration": 0.23691943486531575, "set_robot_commands": 0.002215581470065647, "deviation-center-line": 0.13458207423336702, "driven_lanedir_consec": 0.27908617991564055, "sim_compute_sim_state": 0.010070170296563045, "sim_compute_performance-ego0": 0.0020265923606024847}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.243140436481754, "get_ui_image": 0.03352925563177689, "step_physics": 0.11693215598111854, "survival_time": 26.100000000000236, "driven_lanedir": 0.6367434194193435, "get_state_dump": 0.005059283276588921, "get_robot_state": 0.004129801835886151, "sim_render-ego0": 0.004257369907590673, "get_duckie_state": 1.984390200438053e-06, "in-drivable-lane": 20.75000000000019, "deviation-heading": 4.0267507217281135, "agent_compute-ego0": 0.013813330156169475, "complete-iteration": 0.19612373357521187, "set_robot_commands": 0.002524402355828659, "deviation-center-line": 0.4434020817231499, "driven_lanedir_consec": 0.6343486619424625, "sim_compute_sim_state": 0.013379258361874756, "sim_compute_performance-ego0": 0.002371678160891706}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.9580179377198137, "get_ui_image": 0.025630692118092588, "step_physics": 0.09557253357611203, "survival_time": 15.15000000000008, "driven_lanedir": 0.27263575785407057, "get_state_dump": 0.004497868450064408, "get_robot_state": 0.003574085078741375, "sim_render-ego0": 0.0037410329831273938, "get_duckie_state": 1.3073808268496866e-06, "in-drivable-lane": 13.40000000000008, "deviation-heading": 0.5564623537812183, "agent_compute-ego0": 0.011971799166578995, "complete-iteration": 0.15472159417052017, "set_robot_commands": 0.002183021683441965, "deviation-center-line": 0.11033579227770776, "driven_lanedir_consec": 0.27263575785407057, "sim_compute_sim_state": 0.005531310250884608, "sim_compute_performance-ego0": 0.0019302650501853544}}
set_robot_commands_max0.002524402355828659
set_robot_commands_mean0.002316555879982111
set_robot_commands_median0.00227939974032891
set_robot_commands_min0.002183021683441965
sim_compute_performance-ego0_max0.002371678160891706
sim_compute_performance-ego0_mean0.002099760735740387
sim_compute_performance-ego0_median0.002048549865942244
sim_compute_performance-ego0_min0.0019302650501853544
sim_compute_sim_state_max0.013379258361874756
sim_compute_sim_state_mean0.009799348602680636
sim_compute_sim_state_median0.010143412898981588
sim_compute_sim_state_min0.005531310250884608
sim_render-ego0_max0.004257369907590673
sim_render-ego0_mean0.003964990882421778
sim_render-ego0_median0.003930780319484522
sim_render-ego0_min0.0037410329831273938
simulation-passed1
step_physics_max0.16254215505388048
step_physics_mean0.11983065568165624
step_physics_median0.11060396704831618
step_physics_min0.09557253357611203
survival_time_max26.100000000000236
survival_time_mean14.525000000000087
survival_time_min4.449999999999992
No reset possible
5783510804Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:13:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2721931486142222
survival_time_median17.125000000000107
deviation-center-line_median0.6399048451122546
in-drivable-lane_median7.200000000000083


other stats
agent_compute-ego0_max0.01336566224601698
agent_compute-ego0_mean0.012899559364437284
agent_compute-ego0_median0.012817724457464118
agent_compute-ego0_min0.012597126296803922
complete-iteration_max0.2160394285502059
complete-iteration_mean0.19324867682877375
complete-iteration_median0.1927596636663969
complete-iteration_min0.1714359514320953
deviation-center-line_max0.9046828451397072
deviation-center-line_mean0.5979551838050664
deviation-center-line_min0.20732819985604883
deviation-heading_max4.219221631839349
deviation-heading_mean3.2193884535078565
deviation-heading_median3.650072229361062
deviation-heading_min1.3581877234699538
driven_any_max5.125279736867736
driven_any_mean2.989754595355008
driven_any_median2.754755967488392
driven_any_min1.3242267095755116
driven_lanedir_consec_max1.9432554035940597
driven_lanedir_consec_mean1.2712217054671424
driven_lanedir_consec_min0.5972451210460661
driven_lanedir_max1.9432554035940597
driven_lanedir_mean1.2712217054671424
driven_lanedir_median1.2721931486142222
driven_lanedir_min0.5972451210460661
get_duckie_state_max1.801313415691859e-06
get_duckie_state_mean1.6428953786631475e-06
get_duckie_state_median1.646111903182959e-06
get_duckie_state_min1.478044292594813e-06
get_robot_state_max0.003952491357459785
get_robot_state_mean0.003871426359628183
get_robot_state_median0.0038652851739873857
get_robot_state_min0.003802643733078174
get_state_dump_max0.005052264802944587
get_state_dump_mean0.004857223605767701
get_state_dump_median0.0048378724156375105
get_state_dump_min0.004700884788851195
get_ui_image_max0.0350855736250288
get_ui_image_mean0.030756802512005983
get_ui_image_median0.03085220823684164
get_ui_image_min0.026237219949311847
in-drivable-lane_max21.65000000000025
in-drivable-lane_mean10.212500000000103
in-drivable-lane_min4.799999999999997
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0216366327190616, "get_ui_image": 0.02823533073589808, "step_physics": 0.11096370766426354, "survival_time": 18.500000000000128, "driven_lanedir": 1.9432554035940597, "get_state_dump": 0.004957096917288644, "get_robot_state": 0.003883190874783498, "sim_render-ego0": 0.004049898157865211, "get_duckie_state": 1.801313415691859e-06, "in-drivable-lane": 6.3000000000000895, "deviation-heading": 3.4098986951108867, "agent_compute-ego0": 0.012848213997812606, "complete-iteration": 0.17998357860225872, "set_robot_commands": 0.002349314985249563, "deviation-center-line": 0.7173318222540908, "driven_lanedir_consec": 1.9432554035940597, "sim_compute_sim_state": 0.010381245548834376, "sim_compute_performance-ego0": 0.0022079938184218907}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3242267095755116, "get_ui_image": 0.0350855736250288, "step_physics": 0.1406665893083208, "survival_time": 8.84999999999999, "driven_lanedir": 0.5972451210460661, "get_state_dump": 0.004718647913986377, "get_robot_state": 0.003802643733078174, "sim_render-ego0": 0.0040651425886689945, "get_duckie_state": 1.648838600415862e-06, "in-drivable-lane": 4.799999999999997, "deviation-heading": 1.3581877234699538, "agent_compute-ego0": 0.01278723491711563, "complete-iteration": 0.2160394285502059, "set_robot_commands": 0.0023311416754561863, "deviation-center-line": 0.20732819985604883, "driven_lanedir_consec": 0.5972451210460661, "sim_compute_sim_state": 0.010303525442487738, "sim_compute_performance-ego0": 0.0021773054358664523}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.125279736867736, "get_ui_image": 0.0334690857377852, "step_physics": 0.12911066542501037, "survival_time": 32.15000000000031, "driven_lanedir": 1.5293166722388631, "get_state_dump": 0.005052264802944587, "get_robot_state": 0.003952491357459785, "sim_render-ego0": 0.00417774730587598, "get_duckie_state": 1.643385205950056e-06, "in-drivable-lane": 21.65000000000025, "deviation-heading": 4.219221631839349, "agent_compute-ego0": 0.01336566224601698, "complete-iteration": 0.2055357487305351, "set_robot_commands": 0.0023947887539123155, "deviation-center-line": 0.9046828451397072, "driven_lanedir_consec": 1.5293166722388631, "sim_compute_sim_state": 0.011710062900685375, "sim_compute_performance-ego0": 0.0022017848417625664}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.4878753022577222, "get_ui_image": 0.026237219949311847, "step_physics": 0.10962354835075667, "survival_time": 15.750000000000089, "driven_lanedir": 1.0150696249895812, "get_state_dump": 0.004700884788851195, "get_robot_state": 0.0038473794731912737, "sim_render-ego0": 0.003953878638110584, "get_duckie_state": 1.478044292594813e-06, "in-drivable-lane": 8.100000000000076, "deviation-heading": 3.890245763611237, "agent_compute-ego0": 0.012597126296803922, "complete-iteration": 0.1714359514320953, "set_robot_commands": 0.002264603783812704, "deviation-center-line": 0.5624778679704187, "driven_lanedir_consec": 1.0150696249895812, "sim_compute_sim_state": 0.006044455721408506, "sim_compute_performance-ego0": 0.002071881596046158}}
set_robot_commands_max0.0023947887539123155
set_robot_commands_mean0.0023349622996076923
set_robot_commands_median0.0023402283303528746
set_robot_commands_min0.002264603783812704
sim_compute_performance-ego0_max0.0022079938184218907
sim_compute_performance-ego0_mean0.002164741423024267
sim_compute_performance-ego0_median0.0021895451388145096
sim_compute_performance-ego0_min0.002071881596046158
sim_compute_sim_state_max0.011710062900685375
sim_compute_sim_state_mean0.009609822403354
sim_compute_sim_state_median0.010342385495661056
sim_compute_sim_state_min0.006044455721408506
sim_render-ego0_max0.00417774730587598
sim_render-ego0_mean0.004061666672630192
sim_render-ego0_median0.004057520373267103
sim_render-ego0_min0.003953878638110584
simulation-passed1
step_physics_max0.1406665893083208
step_physics_mean0.12259112768708784
step_physics_median0.12003718654463694
step_physics_min0.10962354835075667
survival_time_max32.15000000000031
survival_time_mean18.812500000000128
survival_time_min8.84999999999999
No reset possible
5776310844Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:45:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013666847961133564
agent_compute-ego0_mean0.01334543296637682
agent_compute-ego0_median0.013390237941630773
agent_compute-ego0_min0.012934408021112167
complete-iteration_max0.3514306154179633
complete-iteration_mean0.3019866430689949
complete-iteration_median0.3021335796353025
complete-iteration_min0.25224879758741137
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.5422763872106904e-06
get_duckie_state_mean1.5002404720360397e-06
get_duckie_state_median1.5086278033991044e-06
get_duckie_state_min1.4414298941352583e-06
get_robot_state_max0.0039040198631826585
get_robot_state_mean0.003796116448163391
get_robot_state_median0.0037693889016017232
get_robot_state_min0.003741668126267458
get_state_dump_max0.004773067495010973
get_state_dump_mean0.0047277537710362924
get_state_dump_median0.004743826379386909
get_state_dump_min0.00465029483036038
get_ui_image_max0.03557645669090659
get_ui_image_mean0.03108886854535436
get_ui_image_median0.030723721756724692
get_ui_image_min0.027331573977061457
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.028264916806693477, "step_physics": 0.21229217927918445, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.00465029483036038, "get_robot_state": 0.003741668126267458, "sim_render-ego0": 0.003936427320469229, "get_duckie_state": 1.4414298941352583e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.013150223486627964, "complete-iteration": 0.2790178085346206, "set_robot_commands": 0.002259497837063474, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008616336477884743, "sim_compute_performance-ego0": 0.0020169076276361497}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03557645669090659, "step_physics": 0.2732636418370383, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004722126913904449, "get_robot_state": 0.0037447725307137446, "sim_render-ego0": 0.004056528744153635, "get_duckie_state": 1.4991982592631142e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013666847961133564, "complete-iteration": 0.3514306154179633, "set_robot_commands": 0.002259972689054491, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011961777343241798, "sim_compute_performance-ego0": 0.002085686921080781}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03318252670675591, "step_physics": 0.25164090604408895, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004773067495010973, "get_robot_state": 0.0039040198631826585, "sim_render-ego0": 0.004114073976489725, "get_duckie_state": 1.5422763872106904e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.013630252396633584, "complete-iteration": 0.3252493507359844, "set_robot_commands": 0.002377229765194044, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009367206313032393, "sim_compute_performance-ego0": 0.0021628668465086265}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.027331573977061457, "step_physics": 0.1887143269665136, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004765525844869368, "get_robot_state": 0.003794005272489702, "sim_render-ego0": 0.003932508203409593, "get_duckie_state": 1.5180573475350943e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012934408021112167, "complete-iteration": 0.25224879758741137, "set_robot_commands": 0.002255661104442078, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006404691294369154, "sim_compute_performance-ego0": 0.0020223199874534895}}
set_robot_commands_max0.002377229765194044
set_robot_commands_mean0.002288090348938522
set_robot_commands_median0.0022597352630589823
set_robot_commands_min0.002255661104442078
sim_compute_performance-ego0_max0.0021628668465086265
sim_compute_performance-ego0_mean0.0020719453456697614
sim_compute_performance-ego0_median0.002054003454267135
sim_compute_performance-ego0_min0.0020169076276361497
sim_compute_sim_state_max0.011961777343241798
sim_compute_sim_state_mean0.00908750285713202
sim_compute_sim_state_median0.008991771395458568
sim_compute_sim_state_min0.006404691294369154
sim_render-ego0_max0.004114073976489725
sim_render-ego0_mean0.004009884561130546
sim_render-ego0_median0.0039964780323114325
sim_render-ego0_min0.003932508203409593
simulation-passed1
step_physics_max0.2732636418370383
step_physics_mean0.23147776353170632
step_physics_median0.2319665426616367
step_physics_min0.1887143269665136
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5774010854Dishank Bansal 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:16:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3532904876427725
survival_time_median23.5750000000002
deviation-center-line_median0.46356392643303074
in-drivable-lane_median11.200000000000127


other stats
agent_compute-ego0_max0.013885537040567844
agent_compute-ego0_mean0.01331241995322561
agent_compute-ego0_median0.013296588370978236
agent_compute-ego0_min0.012770966030378129
complete-iteration_max0.21837516416583144
complete-iteration_mean0.19150933554900984
complete-iteration_median0.19835996145580095
complete-iteration_min0.1509422551186059
deviation-center-line_max0.7373264116981635
deviation-center-line_mean0.4691280370315546
deviation-center-line_min0.2120578835619935
deviation-heading_max3.601936676639658
deviation-heading_mean1.93569502639408
deviation-heading_median1.6983632484408666
deviation-heading_min0.7441169320549295
driven_any_max10.422624304773745
driven_any_mean4.897710089598409
driven_any_median3.9324796019645865
driven_any_min1.3032568496907162
driven_lanedir_consec_max2.223078268524315
driven_lanedir_consec_mean1.4051840430198874
driven_lanedir_consec_min0.6910769282696889
driven_lanedir_max2.223078268524315
driven_lanedir_mean1.4543671217871177
driven_lanedir_median1.4516566451772337
driven_lanedir_min0.6910769282696889
get_duckie_state_max1.7268635402215976e-06
get_duckie_state_mean1.4256410178884804e-06
get_duckie_state_median1.3594455927719107e-06
get_duckie_state_min1.256809345788503e-06
get_robot_state_max0.0041277605425160254
get_robot_state_mean0.0037861372016118606
get_robot_state_median0.0037355722394568527
get_robot_state_min0.003545643785017714
get_state_dump_max0.005109551911042115
get_state_dump_mean0.004755396139109499
get_state_dump_median0.004702557562732592
get_state_dump_min0.0045069175199306975
get_ui_image_max0.036374037725883615
get_ui_image_mean0.03141718861530504
get_ui_image_median0.031889641640868084
get_ui_image_min0.025515433453600373
in-drivable-lane_max55.249999999998735
in-drivable-lane_mean19.874999999999755
in-drivable-lane_min1.8500000000000263
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4562950497630265, "get_ui_image": 0.029211019918863528, "step_physics": 0.10890085626356671, "survival_time": 15.10000000000008, "driven_lanedir": 2.223078268524315, "get_state_dump": 0.004806444589847779, "get_robot_state": 0.0038101728206420497, "sim_render-ego0": 0.003921422234462826, "get_duckie_state": 1.4556909945144906e-06, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 1.7217929780059418, "agent_compute-ego0": 0.013164750813651009, "complete-iteration": 0.17843387543958406, "set_robot_commands": 0.0022854954496075216, "deviation-center-line": 0.7373264116981635, "driven_lanedir_consec": 2.223078268524315, "sim_compute_sim_state": 0.010135568801325934, "sim_compute_performance-ego0": 0.0021034412258135603}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3032568496907162, "get_ui_image": 0.036374037725883615, "step_physics": 0.1417459075213873, "survival_time": 8.499999999999986, "driven_lanedir": 0.6910769282696889, "get_state_dump": 0.004598670535617405, "get_robot_state": 0.003660971658271656, "sim_render-ego0": 0.003887717486822117, "get_duckie_state": 1.263200191029331e-06, "in-drivable-lane": 3.899999999999994, "deviation-heading": 1.6749335188757912, "agent_compute-ego0": 0.013428425928305465, "complete-iteration": 0.21837516416583144, "set_robot_commands": 0.002220008805481314, "deviation-center-line": 0.3117580299847815, "driven_lanedir_consec": 0.6910769282696889, "sim_compute_sim_state": 0.01037312808789705, "sim_compute_performance-ego0": 0.001994799452218396}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.408664154166146, "get_ui_image": 0.03456826336287264, "step_physics": 0.1402158027868776, "survival_time": 32.05000000000032, "driven_lanedir": 2.152803516175907, "get_state_dump": 0.005109551911042115, "get_robot_state": 0.0041277605425160254, "sim_render-ego0": 0.004246702075375947, "get_duckie_state": 1.7268635402215976e-06, "in-drivable-lane": 18.50000000000026, "deviation-heading": 3.601936676639658, "agent_compute-ego0": 0.013885537040567844, "complete-iteration": 0.2182860474720179, "set_robot_commands": 0.0024549259203616703, "deviation-center-line": 0.61536982288128, "driven_lanedir_consec": 1.9560712011069843, "sim_compute_sim_state": 0.011261253342078854, "sim_compute_performance-ego0": 0.002303861011968595}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.422624304773745, "get_ui_image": 0.025515433453600373, "step_physics": 0.09074599756785574, "survival_time": 59.99999999999873, "driven_lanedir": 0.7505097741785605, "get_state_dump": 0.0045069175199306975, "get_robot_state": 0.003545643785017714, "sim_render-ego0": 0.00378181237563007, "get_duckie_state": 1.256809345788503e-06, "in-drivable-lane": 55.249999999998735, "deviation-heading": 0.7441169320549295, "agent_compute-ego0": 0.012770966030378129, "complete-iteration": 0.1509422551186059, "set_robot_commands": 0.0021303005758471333, "deviation-center-line": 0.2120578835619935, "driven_lanedir_consec": 0.7505097741785605, "sim_compute_sim_state": 0.005967414150825647, "sim_compute_performance-ego0": 0.0018944277751455697}}
set_robot_commands_max0.0024549259203616703
set_robot_commands_mean0.00227268268782441
set_robot_commands_median0.002252752127544418
set_robot_commands_min0.0021303005758471333
sim_compute_performance-ego0_max0.002303861011968595
sim_compute_performance-ego0_mean0.00207413236628653
sim_compute_performance-ego0_median0.0020491203390159782
sim_compute_performance-ego0_min0.0018944277751455697
sim_compute_sim_state_max0.011261253342078854
sim_compute_sim_state_mean0.009434341095531871
sim_compute_sim_state_median0.010254348444611492
sim_compute_sim_state_min0.005967414150825647
sim_render-ego0_max0.004246702075375947
sim_render-ego0_mean0.00395941354307274
sim_render-ego0_median0.003904569860642471
sim_render-ego0_min0.00378181237563007
simulation-passed1
step_physics_max0.1417459075213873
step_physics_mean0.12040214103492183
step_physics_median0.12455832952522217
step_physics_min0.09074599756785574
survival_time_max59.99999999999873
survival_time_mean28.912499999999778
survival_time_min8.499999999999986
No reset possible
5772710863Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:16:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6982068259838293
survival_time_median21.125000000000163
deviation-center-line_median0.3160495263294504
in-drivable-lane_median13.624999999999556


other stats
agent_compute-ego0_max0.013895989220040346
agent_compute-ego0_mean0.013482643196422096
agent_compute-ego0_median0.013660001522739638
agent_compute-ego0_min0.012714580520168764
complete-iteration_max0.24861978997989576
complete-iteration_mean0.19695907974074192
complete-iteration_median0.185325866267659
complete-iteration_min0.1685647964477539
deviation-center-line_max1.555192532803164
deviation-center-line_mean0.5756258037849012
deviation-center-line_min0.11521162967754046
deviation-heading_max8.297093664940773
deviation-heading_mean3.2260175411049516
deviation-heading_median1.9336524047151569
deviation-heading_min0.7396716900487199
driven_any_max9.481744913508985
driven_any_mean4.442538631096581
driven_any_median3.3693170132008663
driven_any_min1.5497755844756036
driven_lanedir_consec_max5.6580023034469775
driven_lanedir_consec_mean1.9182799927293912
driven_lanedir_consec_min0.6187040155029294
driven_lanedir_max5.743346675311093
driven_lanedir_mean1.9396160856954203
driven_lanedir_median0.6982068259838293
driven_lanedir_min0.6187040155029294
get_duckie_state_max1.8757216784418848e-06
get_duckie_state_mean1.7318543698103677e-06
get_duckie_state_median1.7539157972231016e-06
get_duckie_state_min1.5438642063533825e-06
get_robot_state_max0.004271891652321329
get_robot_state_mean0.004008638284090039
get_robot_state_median0.003950818172256565
get_robot_state_min0.0038610251395256967
get_state_dump_max0.005470976537587691
get_state_dump_mean0.005210453650381904
get_state_dump_median0.005148541096783988
get_state_dump_min0.005073755870371947
get_ui_image_max0.03867476813647212
get_ui_image_mean0.032007274484651835
get_ui_image_median0.031098987298864816
get_ui_image_min0.027156355204405607
in-drivable-lane_max27.45000000000032
in-drivable-lane_mean14.587499999999856
in-drivable-lane_min3.649999999999987
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.481744913508985, "get_ui_image": 0.028580308833838382, "step_physics": 0.1066145794295566, "survival_time": 54.54999999999904, "driven_lanedir": 5.743346675311093, "get_state_dump": 0.005073755870371947, "get_robot_state": 0.0038610251395256967, "sim_render-ego0": 0.004066226683256827, "get_duckie_state": 1.689889928796789e-06, "in-drivable-lane": 20.449999999999086, "deviation-heading": 8.297093664940773, "agent_compute-ego0": 0.012714580520168764, "complete-iteration": 0.1749523611732455, "set_robot_commands": 0.0022570294338268237, "deviation-center-line": 1.555192532803164, "driven_lanedir_consec": 5.6580023034469775, "sim_compute_sim_state": 0.009584846295716562, "sim_compute_performance-ego0": 0.002100351747575697}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5497755844756036, "get_ui_image": 0.03867476813647212, "step_physics": 0.16565815526611952, "survival_time": 9.750000000000004, "driven_lanedir": 0.770910493274019, "get_state_dump": 0.005470976537587691, "get_robot_state": 0.004271891652321329, "sim_render-ego0": 0.0044863053730555946, "get_duckie_state": 1.8757216784418848e-06, "in-drivable-lane": 3.649999999999987, "deviation-heading": 3.0833528519045603, "agent_compute-ego0": 0.013772356266878089, "complete-iteration": 0.24861978997989576, "set_robot_commands": 0.002539103128472153, "deviation-center-line": 0.45168548422372246, "driven_lanedir_consec": 0.770910493274019, "sim_compute_sim_state": 0.011274242887691577, "sim_compute_performance-ego0": 0.002351869125755466}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.010790544178676, "get_ui_image": 0.033617665763891254, "step_physics": 0.11886719327343248, "survival_time": 31.500000000000313, "driven_lanedir": 0.6187040155029294, "get_state_dump": 0.005077057519540923, "get_robot_state": 0.003897968071576344, "sim_render-ego0": 0.004316529079020118, "get_duckie_state": 1.5438642063533825e-06, "in-drivable-lane": 27.45000000000032, "deviation-heading": 0.7839519575257536, "agent_compute-ego0": 0.013895989220040346, "complete-iteration": 0.19569937136207255, "set_robot_commands": 0.002382924175111314, "deviation-center-line": 0.11521162967754046, "driven_lanedir_consec": 0.6187040155029294, "sim_compute_sim_state": 0.011379742962433685, "sim_compute_performance-ego0": 0.0021648951075534245}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7278434822230564, "get_ui_image": 0.027156355204405607, "step_physics": 0.10428910785251194, "survival_time": 10.750000000000018, "driven_lanedir": 0.6255031586936397, "get_state_dump": 0.005220024674027054, "get_robot_state": 0.004003668272936785, "sim_render-ego0": 0.004239851677859271, "get_duckie_state": 1.817941665649414e-06, "in-drivable-lane": 6.800000000000024, "deviation-heading": 0.7396716900487199, "agent_compute-ego0": 0.013547646778601189, "complete-iteration": 0.1685647964477539, "set_robot_commands": 0.0023374535419322827, "deviation-center-line": 0.18041356843517828, "driven_lanedir_consec": 0.6255031586936397, "sim_compute_sim_state": 0.0055178481119650385, "sim_compute_performance-ego0": 0.002142842169161196}}
set_robot_commands_max0.002539103128472153
set_robot_commands_mean0.0023791275698356435
set_robot_commands_median0.0023601888585217984
set_robot_commands_min0.0022570294338268237
sim_compute_performance-ego0_max0.002351869125755466
sim_compute_performance-ego0_mean0.0021899895375114458
sim_compute_performance-ego0_median0.0021538686383573103
sim_compute_performance-ego0_min0.002100351747575697
sim_compute_sim_state_max0.011379742962433685
sim_compute_sim_state_mean0.009439170064451717
sim_compute_sim_state_median0.010429544591704068
sim_compute_sim_state_min0.0055178481119650385
sim_render-ego0_max0.0044863053730555946
sim_render-ego0_mean0.004277228203297952
sim_render-ego0_median0.004278190378439694
sim_render-ego0_min0.004066226683256827
simulation-passed1
step_physics_max0.16565815526611952
step_physics_mean0.12385725895540511
step_physics_median0.11274088635149454
step_physics_min0.10428910785251194
survival_time_max54.54999999999904
survival_time_mean26.637499999999843
survival_time_min9.750000000000004
No reset possible
5770310872Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:05:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3645104644373983
survival_time_median6.949999999999983
deviation-center-line_median0.10404911578034828
in-drivable-lane_median5.199999999999982


other stats
agent_compute-ego0_max0.01390106781669285
agent_compute-ego0_mean0.013376670237715669
agent_compute-ego0_median0.013332488155647353
agent_compute-ego0_min0.012940636822875115
complete-iteration_max0.2289409978049142
complete-iteration_mean0.19059613116169527
complete-iteration_median0.18423387760482385
complete-iteration_min0.1649757716322192
deviation-center-line_max0.2582051476288134
deviation-center-line_mean0.13553680032407628
deviation-center-line_min0.07584382210679506
deviation-heading_max1.2514487894714017
deviation-heading_mean0.6947105338747328
deviation-heading_median0.5469027023720776
deviation-heading_min0.4335879412833743
driven_any_max2.3927281473961894
driven_any_mean1.5890876840473849
driven_any_median1.6449892063736398
driven_any_min0.6736441760460699
driven_lanedir_consec_max0.4994154002216295
driven_lanedir_consec_mean0.362985311804314
driven_lanedir_consec_min0.22350491812082973
driven_lanedir_max0.4994154002216295
driven_lanedir_mean0.362985311804314
driven_lanedir_median0.3645104644373983
driven_lanedir_min0.22350491812082973
get_duckie_state_max1.6353499721473372e-06
get_duckie_state_mean1.512251127602598e-06
get_duckie_state_median1.5120074100355454e-06
get_duckie_state_min1.3896397181919642e-06
get_robot_state_max0.004126597458208111
get_robot_state_mean0.003930817497501217
get_robot_state_median0.0039443686882161206
get_robot_state_min0.003707935155364516
get_state_dump_max0.005185270654982415
get_state_dump_mean0.004981027229642431
get_state_dump_median0.004956623111285842
get_state_dump_min0.004825592041015625
get_ui_image_max0.03389928681509835
get_ui_image_mean0.030805195867641327
get_ui_image_median0.03121524253406798
get_ui_image_min0.026891011587330992
in-drivable-lane_max7.150000000000006
in-drivable-lane_mean4.937499999999991
in-drivable-lane_min2.1999999999999953
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.3927281473961894, "get_ui_image": 0.02893317054590413, "step_physics": 0.09696104612992835, "survival_time": 9.6, "driven_lanedir": 0.4994154002216295, "get_state_dump": 0.004831908280367678, "get_robot_state": 0.003707935155364516, "sim_render-ego0": 0.003980476003854386, "get_duckie_state": 1.524396510939524e-06, "in-drivable-lane": 7.150000000000006, "deviation-heading": 1.2514487894714017, "agent_compute-ego0": 0.013104684612293934, "complete-iteration": 0.1649757716322192, "set_robot_commands": 0.002280056167760661, "deviation-center-line": 0.2582051476288134, "driven_lanedir_consec": 0.4994154002216295, "sim_compute_sim_state": 0.009089235197077144, "sim_compute_performance-ego0": 0.001993756220130723}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6736441760460699, "get_ui_image": 0.03389928681509835, "step_physics": 0.15487891605922155, "survival_time": 3.4499999999999957, "driven_lanedir": 0.22350491812082973, "get_state_dump": 0.004825592041015625, "get_robot_state": 0.0038569859095982143, "sim_render-ego0": 0.004023827825273787, "get_duckie_state": 1.3896397181919642e-06, "in-drivable-lane": 2.1999999999999953, "deviation-heading": 0.6031403401772738, "agent_compute-ego0": 0.013560291699000767, "complete-iteration": 0.2289409978049142, "set_robot_commands": 0.002264237403869629, "deviation-center-line": 0.07584382210679506, "driven_lanedir_consec": 0.22350491812082973, "sim_compute_sim_state": 0.009444219725472588, "sim_compute_performance-ego0": 0.0020920004163469588}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.6100493047098758, "get_ui_image": 0.033497314522231834, "step_physics": 0.1267533768778262, "survival_time": 6.849999999999984, "driven_lanedir": 0.3671094106697699, "get_state_dump": 0.005185270654982415, "get_robot_state": 0.004031751466834027, "sim_render-ego0": 0.00430797839510268, "get_duckie_state": 1.4996183091315671e-06, "in-drivable-lane": 5.049999999999983, "deviation-heading": 0.4906650645668814, "agent_compute-ego0": 0.01390106781669285, "complete-iteration": 0.20103232238603672, "set_robot_commands": 0.0023641862731049027, "deviation-center-line": 0.09567534171184965, "driven_lanedir_consec": 0.3671094106697699, "sim_compute_sim_state": 0.008706194767053577, "sim_compute_performance-ego0": 0.0021880485009456024}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.679929108037404, "get_ui_image": 0.026891011587330992, "step_physics": 0.1036816012691444, "survival_time": 7.049999999999983, "driven_lanedir": 0.3619115182050267, "get_state_dump": 0.005081337942204005, "get_robot_state": 0.004126597458208111, "sim_render-ego0": 0.004258080267570388, "get_duckie_state": 1.6353499721473372e-06, "in-drivable-lane": 5.349999999999982, "deviation-heading": 0.4335879412833743, "agent_compute-ego0": 0.012940636822875115, "complete-iteration": 0.16743543282361098, "set_robot_commands": 0.00242288179800544, "deviation-center-line": 0.11242288984884694, "driven_lanedir_consec": 0.3619115182050267, "sim_compute_sim_state": 0.005577490363322514, "sim_compute_performance-ego0": 0.002353918384498274}}
set_robot_commands_max0.00242288179800544
set_robot_commands_mean0.0023328404106851583
set_robot_commands_median0.002322121220432782
set_robot_commands_min0.002264237403869629
sim_compute_performance-ego0_max0.002353918384498274
sim_compute_performance-ego0_mean0.0021569308804803896
sim_compute_performance-ego0_median0.0021400244586462806
sim_compute_performance-ego0_min0.001993756220130723
sim_compute_sim_state_max0.009444219725472588
sim_compute_sim_state_mean0.008204285013231456
sim_compute_sim_state_median0.00889771498206536
sim_compute_sim_state_min0.005577490363322514
sim_render-ego0_max0.00430797839510268
sim_render-ego0_mean0.00414259062295031
sim_render-ego0_median0.004140954046422087
sim_render-ego0_min0.003980476003854386
simulation-passed1
step_physics_max0.15487891605922155
step_physics_mean0.12056873508403013
step_physics_median0.11521748907348532
step_physics_min0.09696104612992835
survival_time_max9.6
survival_time_mean6.737499999999991
survival_time_min3.4499999999999957
No reset possible
5768910873Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:05:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3296983655407444
survival_time_median8.599999999999987
deviation-center-line_median0.12870507709544873
in-drivable-lane_median6.5499999999999865


other stats
agent_compute-ego0_max0.013687992995640016
agent_compute-ego0_mean0.013054974860008926
agent_compute-ego0_median0.013118531714726309
agent_compute-ego0_min0.012294843014943073
complete-iteration_max0.25937240978456894
complete-iteration_mean0.1967979142021133
complete-iteration_median0.1822770165574824
complete-iteration_min0.16326521390891938
deviation-center-line_max0.3373569617000989
deviation-center-line_mean0.16972387694862562
deviation-center-line_min0.08412839190350607
deviation-heading_max1.6079604056088694
deviation-heading_mean0.903338751461065
deviation-heading_median0.7216133579014032
deviation-heading_min0.5621678844325843
driven_any_max2.3815485008005903
driven_any_mean1.466973008821275
driven_any_median1.5796484128698638
driven_any_min0.3270467087447803
driven_lanedir_consec_max0.5090735837348225
driven_lanedir_consec_mean0.33452764691926967
driven_lanedir_consec_min0.16964027286076755
driven_lanedir_max0.5090735837348225
driven_lanedir_mean0.33452764691926967
driven_lanedir_median0.3296983655407444
driven_lanedir_min0.16964027286076755
get_duckie_state_max1.5764525442412406e-06
get_duckie_state_mean1.4862169471946626e-06
get_duckie_state_median1.480441936968912e-06
get_duckie_state_min1.4075313705995858e-06
get_robot_state_max0.0039698142373100825
get_robot_state_mean0.003773864820982198
get_robot_state_median0.003761504090398022
get_robot_state_min0.0036026368658226655
get_state_dump_max0.004819739539668245
get_state_dump_mean0.004736691160296409
get_state_dump_median0.004784283597286115
get_state_dump_min0.004558457906945163
get_ui_image_max0.038473691580430514
get_ui_image_mean0.03177004602836752
get_ui_image_median0.030283427012145148
get_ui_image_min0.02803963850874927
in-drivable-lane_max9.200000000000015
in-drivable-lane_mean5.887499999999997
in-drivable-lane_min1.2499999999999982
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.3815485008005903, "get_ui_image": 0.02866029260627716, "step_physics": 0.0969041820510803, "survival_time": 12.40000000000004, "driven_lanedir": 0.5090735837348225, "get_state_dump": 0.004558457906945163, "get_robot_state": 0.0036026368658226655, "sim_render-ego0": 0.003787555847780771, "get_duckie_state": 1.4075313705995858e-06, "in-drivable-lane": 9.200000000000015, "deviation-heading": 1.6079604056088694, "agent_compute-ego0": 0.012294843014943073, "complete-iteration": 0.16326521390891938, "set_robot_commands": 0.002105150835581094, "deviation-center-line": 0.3373569617000989, "driven_lanedir_consec": 0.5090735837348225, "sim_compute_sim_state": 0.009338782015574506, "sim_compute_performance-ego0": 0.001925618773004616}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3270467087447803, "get_ui_image": 0.038473691580430514, "step_physics": 0.18040117227806235, "survival_time": 2.5999999999999988, "driven_lanedir": 0.16964027286076755, "get_state_dump": 0.004819739539668245, "get_robot_state": 0.003730584990303471, "sim_render-ego0": 0.004171699847815171, "get_duckie_state": 1.4934899672022409e-06, "in-drivable-lane": 1.2499999999999982, "deviation-heading": 0.7940910127859335, "agent_compute-ego0": 0.013687992995640016, "complete-iteration": 0.25937240978456894, "set_robot_commands": 0.002382026528412441, "deviation-center-line": 0.08412839190350607, "driven_lanedir_consec": 0.16964027286076755, "sim_compute_sim_state": 0.009549244394842183, "sim_compute_performance-ego0": 0.0020598060679885575}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.490552056564146, "get_ui_image": 0.03190656141801314, "step_physics": 0.11937920685970424, "survival_time": 8.199999999999982, "driven_lanedir": 0.353356195531638, "get_state_dump": 0.004754868420687589, "get_robot_state": 0.003792423190492572, "sim_render-ego0": 0.003920468417080966, "get_duckie_state": 1.5764525442412406e-06, "in-drivable-lane": 5.999999999999981, "deviation-heading": 0.649135703016873, "agent_compute-ego0": 0.012915355508977716, "complete-iteration": 0.18946885340141528, "set_robot_commands": 0.0021743254228071733, "deviation-center-line": 0.13158623115205742, "driven_lanedir_consec": 0.353356195531638, "sim_compute_sim_state": 0.008476341131961707, "sim_compute_performance-ego0": 0.0020450750986735025}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6687447691755817, "get_ui_image": 0.02803963850874927, "step_physics": 0.1105250166266004, "survival_time": 8.999999999999993, "driven_lanedir": 0.3060405355498508, "get_state_dump": 0.004813698773884641, "get_robot_state": 0.0039698142373100825, "sim_render-ego0": 0.004121644720846777, "get_duckie_state": 1.4673939067355836e-06, "in-drivable-lane": 7.099999999999992, "deviation-heading": 0.5621678844325843, "agent_compute-ego0": 0.013321707920474902, "complete-iteration": 0.17508517971354953, "set_robot_commands": 0.0024815317016938774, "deviation-center-line": 0.12582392303884005, "driven_lanedir_consec": 0.3060405355498508, "sim_compute_sim_state": 0.005540809578658467, "sim_compute_performance-ego0": 0.00217453024005363}}
set_robot_commands_max0.0024815317016938774
set_robot_commands_mean0.0022857586221236466
set_robot_commands_median0.0022781759756098073
set_robot_commands_min0.002105150835581094
sim_compute_performance-ego0_max0.00217453024005363
sim_compute_performance-ego0_mean0.0020512575449300767
sim_compute_performance-ego0_median0.00205244058333103
sim_compute_performance-ego0_min0.001925618773004616
sim_compute_sim_state_max0.009549244394842183
sim_compute_sim_state_mean0.008226294280259217
sim_compute_sim_state_median0.008907561573768107
sim_compute_sim_state_min0.005540809578658467
sim_render-ego0_max0.004171699847815171
sim_render-ego0_mean0.0040003422083809215
sim_render-ego0_median0.004021056568963871
sim_render-ego0_min0.003787555847780771
simulation-passed1
step_physics_max0.18040117227806235
step_physics_mean0.12680239445386182
step_physics_median0.11495211174315231
step_physics_min0.0969041820510803
survival_time_max12.40000000000004
survival_time_mean8.050000000000004
survival_time_min2.5999999999999988
No reset possible
5767910879Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:07:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.25320242502931933
survival_time_median10.750000000000018
deviation-center-line_median0.104674641875506
in-drivable-lane_median7.775000000000004


other stats
agent_compute-ego0_max0.013667394948560138
agent_compute-ego0_mean0.012972798971116552
agent_compute-ego0_median0.012959418331516905
agent_compute-ego0_min0.01230496427287226
complete-iteration_max0.25248783965443455
complete-iteration_mean0.1939713789071363
complete-iteration_median0.17737517456057314
complete-iteration_min0.16864732685296432
deviation-center-line_max0.5255825513660614
deviation-center-line_mean0.20835127342016507
deviation-center-line_min0.09847325856358696
deviation-heading_max1.6015425151782494
deviation-heading_mean0.8977631247291106
deviation-heading_median0.7066601909419955
deviation-heading_min0.5761896018542019
driven_any_max4.03769002248285
driven_any_mean2.1954686831250685
driven_any_median2.035622915198684
driven_any_min0.6729388796200564
driven_lanedir_consec_max0.7627676471867855
driven_lanedir_consec_mean0.3762956843555144
driven_lanedir_consec_min0.23601024017663352
driven_lanedir_max0.7627676471867855
driven_lanedir_mean0.3762956843555144
driven_lanedir_median0.25320242502931933
driven_lanedir_min0.23601024017663352
get_duckie_state_max1.7045005675285094e-06
get_duckie_state_mean1.6207083014859745e-06
get_duckie_state_median1.621574796246566e-06
get_duckie_state_min1.5351830459222562e-06
get_robot_state_max0.004137241563131643
get_robot_state_mean0.003942773070142951
get_robot_state_median0.003906444242674004
get_robot_state_min0.0038209622320921526
get_state_dump_max0.0051385552384132565
get_state_dump_mean0.004850832808266616
get_state_dump_median0.004783629476708041
get_state_dump_min0.004697517041237124
get_ui_image_max0.036919186281603435
get_ui_image_mean0.031080692744031427
get_ui_image_median0.030402261084407262
get_ui_image_min0.02659906252570774
in-drivable-lane_max18.550000000000153
in-drivable-lane_mean9.175000000000038
in-drivable-lane_min2.599999999999992
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.371065652931205, "get_ui_image": 0.0285903888363992, "step_physics": 0.10117396616166638, "survival_time": 12.35000000000004, "driven_lanedir": 0.7627676471867855, "get_state_dump": 0.004697517041237124, "get_robot_state": 0.003983397637644122, "sim_render-ego0": 0.00412806099460971, "get_duckie_state": 1.7045005675285094e-06, "in-drivable-lane": 8.000000000000014, "deviation-heading": 1.6015425151782494, "agent_compute-ego0": 0.01250315289343557, "complete-iteration": 0.17018784919092733, "set_robot_commands": 0.0024721045647898027, "deviation-center-line": 0.5255825513660614, "driven_lanedir_consec": 0.7627676471867855, "sim_compute_sim_state": 0.01033698070433832, "sim_compute_performance-ego0": 0.0022041730342372773}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6729388796200564, "get_ui_image": 0.036919186281603435, "step_physics": 0.17259951802187187, "survival_time": 4.249999999999993, "driven_lanedir": 0.2437208633579515, "get_state_dump": 0.0051385552384132565, "get_robot_state": 0.004137241563131643, "sim_render-ego0": 0.0042750585910885834, "get_duckie_state": 1.62734541782113e-06, "in-drivable-lane": 2.599999999999992, "deviation-heading": 0.7612370127794277, "agent_compute-ego0": 0.013667394948560138, "complete-iteration": 0.25248783965443455, "set_robot_commands": 0.002403156701908555, "deviation-center-line": 0.10612942243354236, "driven_lanedir_consec": 0.2437208633579515, "sim_compute_sim_state": 0.010971621025440303, "sim_compute_performance-ego0": 0.002274138982905898}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.03769002248285, "get_ui_image": 0.03221413333241532, "step_physics": 0.11107944279182248, "survival_time": 20.450000000000156, "driven_lanedir": 0.26268398670068716, "get_state_dump": 0.0047835495413803475, "get_robot_state": 0.003829490847703887, "sim_render-ego0": 0.004100764670023104, "get_duckie_state": 1.5351830459222562e-06, "in-drivable-lane": 18.550000000000153, "deviation-heading": 0.6520833691045633, "agent_compute-ego0": 0.01341568376959824, "complete-iteration": 0.18456249993021895, "set_robot_commands": 0.0022388865308063787, "deviation-center-line": 0.10321986131746964, "driven_lanedir_consec": 0.26268398670068716, "sim_compute_sim_state": 0.01069428397387993, "sim_compute_performance-ego0": 0.002114004623599169}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7001801774661631, "get_ui_image": 0.02659906252570774, "step_physics": 0.10683454119640848, "survival_time": 9.149999999999997, "driven_lanedir": 0.23601024017663352, "get_state_dump": 0.004783709412035735, "get_robot_state": 0.0038209622320921526, "sim_render-ego0": 0.003997425670209138, "get_duckie_state": 1.6158041746720024e-06, "in-drivable-lane": 7.549999999999995, "deviation-heading": 0.5761896018542019, "agent_compute-ego0": 0.01230496427287226, "complete-iteration": 0.16864732685296432, "set_robot_commands": 0.002354284991388736, "deviation-center-line": 0.09847325856358696, "driven_lanedir_consec": 0.23601024017663352, "sim_compute_sim_state": 0.0057094019392262335, "sim_compute_performance-ego0": 0.0021423451278520665}}
set_robot_commands_max0.0024721045647898027
set_robot_commands_mean0.0023671081972233684
set_robot_commands_median0.0023787208466486453
set_robot_commands_min0.0022388865308063787
sim_compute_performance-ego0_max0.002274138982905898
sim_compute_performance-ego0_mean0.0021836654421486025
sim_compute_performance-ego0_median0.002173259081044672
sim_compute_performance-ego0_min0.002114004623599169
sim_compute_sim_state_max0.010971621025440303
sim_compute_sim_state_mean0.009428071910721198
sim_compute_sim_state_median0.010515632339109123
sim_compute_sim_state_min0.0057094019392262335
sim_render-ego0_max0.0042750585910885834
sim_render-ego0_mean0.004125327481482633
sim_render-ego0_median0.004114412832316406
sim_render-ego0_min0.003997425670209138
simulation-passed1
step_physics_max0.17259951802187187
step_physics_mean0.1229218670429423
step_physics_median0.10895699199411547
step_physics_min0.10117396616166638
survival_time_max20.450000000000156
survival_time_mean11.550000000000049
survival_time_min4.249999999999993
No reset possible
5766310883Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4282749170803353
survival_time_median14.45000000000007
deviation-center-line_median0.24144637394238716
in-drivable-lane_median11.825000000000056


other stats
agent_compute-ego0_max0.060524747921870306
agent_compute-ego0_mean0.041599230730207035
agent_compute-ego0_median0.04646602135761953
agent_compute-ego0_min0.012940132283718786
complete-iteration_max0.28992904608066267
complete-iteration_mean0.21581789196086693
complete-iteration_median0.1937941213264429
complete-iteration_min0.1857542791099192
deviation-center-line_max0.7175540179799015
deviation-center-line_mean0.3204247114830856
deviation-center-line_min0.08125208006766661
deviation-heading_max4.196148198909592
deviation-heading_mean1.7886278361289083
deviation-heading_median1.2009108541494002
deviation-heading_min0.5565414373072409
driven_any_max5.368905873238152
driven_any_mean2.8270171953145766
driven_any_median2.8112980566895485
driven_any_min0.3165667946410585
driven_lanedir_consec_max1.4955822620597583
driven_lanedir_consec_mean0.627289585192666
driven_lanedir_consec_min0.15702624455023484
driven_lanedir_max1.4955822620597583
driven_lanedir_mean0.627289585192666
driven_lanedir_median0.4282749170803353
driven_lanedir_min0.15702624455023484
get_duckie_state_max1.3908950943961244e-06
get_duckie_state_mean1.352918336736948e-06
get_duckie_state_median1.3648763938859023e-06
get_duckie_state_min1.2910254647798626e-06
get_robot_state_max0.003788793866879472
get_robot_state_mean0.003668434938318436
get_robot_state_median0.003660690664549347
get_robot_state_min0.003563564557295579
get_state_dump_max0.004978540800849476
get_state_dump_mean0.00465117224799498
get_state_dump_median0.004565040633285928
get_state_dump_min0.004496066924558586
get_ui_image_max0.03611690264481764
get_ui_image_mean0.03120861314944931
get_ui_image_median0.03081925470129316
get_ui_image_min0.02707904055039328
in-drivable-lane_max17.900000000000148
in-drivable-lane_mean10.700000000000063
in-drivable-lane_min1.2499999999999984
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.3815474034452646, "get_ui_image": 0.02885733359310043, "step_physics": 0.0981794839881989, "survival_time": 12.40000000000004, "driven_lanedir": 0.5269715161385081, "get_state_dump": 0.004496066924558586, "get_robot_state": 0.003684258365248102, "sim_render-ego0": 0.0037128006119325936, "get_duckie_state": 1.3405060672377007e-06, "in-drivable-lane": 9.150000000000013, "deviation-heading": 1.6002259196181934, "agent_compute-ego0": 0.040570035038224185, "complete-iteration": 0.19318198391711375, "set_robot_commands": 0.002212580906818191, "deviation-center-line": 0.3421035702011235, "driven_lanedir_consec": 0.5269715161385081, "sim_compute_sim_state": 0.009460338148247286, "sim_compute_performance-ego0": 0.0019242332642336929}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3165667946410585, "get_ui_image": 0.03611690264481764, "step_physics": 0.16791394582161537, "survival_time": 2.549999999999999, "driven_lanedir": 0.15702624455023484, "get_state_dump": 0.00451963681441087, "get_robot_state": 0.003563564557295579, "sim_render-ego0": 0.003965038519639235, "get_duckie_state": 1.3892467205341045e-06, "in-drivable-lane": 1.2499999999999984, "deviation-heading": 0.8015957886806071, "agent_compute-ego0": 0.060524747921870306, "complete-iteration": 0.28992904608066267, "set_robot_commands": 0.0024249049333425667, "deviation-center-line": 0.08125208006766661, "driven_lanedir_consec": 0.15702624455023484, "sim_compute_sim_state": 0.008831051679757925, "sim_compute_performance-ego0": 0.001980419342334454}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.368905873238152, "get_ui_image": 0.03278117580948589, "step_physics": 0.1107262254875397, "survival_time": 26.700000000000244, "driven_lanedir": 1.4955822620597583, "get_state_dump": 0.004610444452160987, "get_robot_state": 0.003788793866879472, "sim_render-ego0": 0.004028896527869679, "get_duckie_state": 1.2910254647798626e-06, "in-drivable-lane": 17.900000000000148, "deviation-heading": 4.196148198909592, "agent_compute-ego0": 0.012940132283718786, "complete-iteration": 0.1857542791099192, "set_robot_commands": 0.0022980248816659517, "deviation-center-line": 0.7175540179799015, "driven_lanedir_consec": 1.4955822620597583, "sim_compute_sim_state": 0.012436631461170232, "sim_compute_performance-ego0": 0.0020584449589809524}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.2410487099338323, "get_ui_image": 0.02707904055039328, "step_physics": 0.09322086489812843, "survival_time": 16.5000000000001, "driven_lanedir": 0.32957831802216253, "get_state_dump": 0.004978540800849476, "get_robot_state": 0.003637122963850592, "sim_render-ego0": 0.0038749933963095674, "get_duckie_state": 1.3908950943961244e-06, "in-drivable-lane": 14.5000000000001, "deviation-heading": 0.5565414373072409, "agent_compute-ego0": 0.05236200767701486, "complete-iteration": 0.194406258735772, "set_robot_commands": 0.00226702502847078, "deviation-center-line": 0.14078917768365087, "driven_lanedir_consec": 0.32957831802216253, "sim_compute_sim_state": 0.004984460208351158, "sim_compute_performance-ego0": 0.0019164315883486653}}
set_robot_commands_max0.0024249049333425667
set_robot_commands_mean0.002300633937574372
set_robot_commands_median0.0022825249550683657
set_robot_commands_min0.002212580906818191
sim_compute_performance-ego0_max0.0020584449589809524
sim_compute_performance-ego0_mean0.001969882288474441
sim_compute_performance-ego0_median0.0019523263032840733
sim_compute_performance-ego0_min0.0019164315883486653
sim_compute_sim_state_max0.012436631461170232
sim_compute_sim_state_mean0.00892812037438165
sim_compute_sim_state_median0.009145694914002606
sim_compute_sim_state_min0.004984460208351158
sim_render-ego0_max0.004028896527869679
sim_render-ego0_mean0.0038954322639377687
sim_render-ego0_median0.003920015957974401
sim_render-ego0_min0.0037128006119325936
simulation-passed1
step_physics_max0.16791394582161537
step_physics_mean0.1175101300488706
step_physics_median0.1044528547378693
step_physics_min0.09322086489812843
survival_time_max26.700000000000244
survival_time_mean14.537500000000096
survival_time_min2.549999999999999
No reset possible
5764910893Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:07:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0999749491010182
survival_time_median13.575000000000058
deviation-center-line_median0.42735240266319285
in-drivable-lane_median4.950000000000058


other stats
agent_compute-ego0_max0.012584994424064204
agent_compute-ego0_mean0.012304622718278
agent_compute-ego0_median0.01247237913211555
agent_compute-ego0_min0.011688738184816696
complete-iteration_max0.22291365434538643
complete-iteration_mean0.1768227981414837
complete-iteration_median0.1678382435022813
complete-iteration_min0.14870105121598576
deviation-center-line_max0.6340229217444261
deviation-center-line_mean0.4067665319582692
deviation-center-line_min0.13833840076226475
deviation-heading_max2.161595577465223
deviation-heading_mean1.2805322318298928
deviation-heading_median1.111545157922488
deviation-heading_min0.7374430340093726
driven_any_max3.024985978774848
driven_any_mean2.1885207253423147
driven_any_median2.452676790836498
driven_any_min0.8237433409214134
driven_lanedir_consec_max2.1993570107364
driven_lanedir_consec_mean1.2164863233137284
driven_lanedir_consec_min0.4666383843164767
driven_lanedir_max2.1993570107364
driven_lanedir_mean1.2164863233137284
driven_lanedir_median1.0999749491010182
driven_lanedir_min0.4666383843164767
get_duckie_state_max1.3967729964346255e-06
get_duckie_state_mean1.3364343650098098e-06
get_duckie_state_median1.3499482700013385e-06
get_duckie_state_min1.249067923601936e-06
get_robot_state_max0.003650950935651671
get_robot_state_mean0.0035620860637673303
get_robot_state_median0.0035990456708495364
get_robot_state_min0.0033993019777185775
get_state_dump_max0.004653510593232654
get_state_dump_mean0.004549373352207601
get_state_dump_median0.004603248796671134
get_state_dump_min0.0043374852222554825
get_ui_image_max0.03630107078912123
get_ui_image_mean0.03038811946805402
get_ui_image_median0.029460952282585544
get_ui_image_min0.026329502517923768
in-drivable-lane_max9.400000000000066
in-drivable-lane_mean5.250000000000044
in-drivable-lane_min1.699999999999994
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4477854199302063, "get_ui_image": 0.02696565056548399, "step_physics": 0.0915109734324848, "survival_time": 13.550000000000058, "driven_lanedir": 2.1993570107364, "get_state_dump": 0.0043374852222554825, "get_robot_state": 0.0033993019777185775, "sim_render-ego0": 0.00357186356011559, "get_duckie_state": 1.249067923601936e-06, "in-drivable-lane": 1.8500000000000263, "deviation-heading": 1.2795275338390668, "agent_compute-ego0": 0.011688738184816696, "complete-iteration": 0.15432109464617336, "set_robot_commands": 0.00203724906725042, "deviation-center-line": 0.4400520106345957, "driven_lanedir_consec": 2.1993570107364, "sim_compute_sim_state": 0.008935615420341492, "sim_compute_performance-ego0": 0.0017944101025076473}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.8237433409214134, "get_ui_image": 0.03630107078912123, "step_physics": 0.14712993378909128, "survival_time": 5.249999999999989, "driven_lanedir": 0.4666383843164767, "get_state_dump": 0.00463301955528979, "get_robot_state": 0.003650950935651671, "sim_render-ego0": 0.0038943403172043136, "get_duckie_state": 1.3967729964346255e-06, "in-drivable-lane": 1.699999999999994, "deviation-heading": 0.9435627820059088, "agent_compute-ego0": 0.012584994424064204, "complete-iteration": 0.22291365434538643, "set_robot_commands": 0.0023586929969067845, "deviation-center-line": 0.41465279469179006, "driven_lanedir_consec": 0.4666383843164767, "sim_compute_sim_state": 0.010283818784749732, "sim_compute_performance-ego0": 0.0019884896728227723}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.024985978774848, "get_ui_image": 0.0319562539996871, "step_physics": 0.11034842643393092, "survival_time": 16.5500000000001, "driven_lanedir": 1.4745096041522383, "get_state_dump": 0.0045734780380524784, "get_robot_state": 0.003635388540934367, "sim_render-ego0": 0.003828701484634215, "get_duckie_state": 1.3436179563223598e-06, "in-drivable-lane": 8.05000000000009, "deviation-heading": 2.161595577465223, "agent_compute-ego0": 0.012525253267173308, "complete-iteration": 0.18135539235838924, "set_robot_commands": 0.0021331690880189457, "deviation-center-line": 0.6340229217444261, "driven_lanedir_consec": 1.4745096041522383, "sim_compute_sim_state": 0.010320160044244972, "sim_compute_performance-ego0": 0.0019477534006877115}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.45756816174279, "get_ui_image": 0.026329502517923768, "step_physics": 0.08851443891560201, "survival_time": 13.600000000000058, "driven_lanedir": 0.7254402940497984, "get_state_dump": 0.004653510593232654, "get_robot_state": 0.0035627028007647055, "sim_render-ego0": 0.003728289307255448, "get_duckie_state": 1.3562785836803171e-06, "in-drivable-lane": 9.400000000000066, "deviation-heading": 0.7374430340093726, "agent_compute-ego0": 0.012419504997057792, "complete-iteration": 0.14870105121598576, "set_robot_commands": 0.002139359603434692, "deviation-center-line": 0.13833840076226475, "driven_lanedir_consec": 0.7254402940497984, "sim_compute_sim_state": 0.005410117544097342, "sim_compute_performance-ego0": 0.001855749786991776}}
set_robot_commands_max0.0023586929969067845
set_robot_commands_mean0.0021671176889027106
set_robot_commands_median0.002136264345726819
set_robot_commands_min0.00203724906725042
sim_compute_performance-ego0_max0.0019884896728227723
sim_compute_performance-ego0_mean0.0018966007407524767
sim_compute_performance-ego0_median0.001901751593839744
sim_compute_performance-ego0_min0.0017944101025076473
sim_compute_sim_state_max0.010320160044244972
sim_compute_sim_state_mean0.008737427948358384
sim_compute_sim_state_median0.009609717102545611
sim_compute_sim_state_min0.005410117544097342
sim_render-ego0_max0.0038943403172043136
sim_render-ego0_mean0.003755798667302392
sim_render-ego0_median0.003778495395944832
sim_render-ego0_min0.00357186356011559
simulation-passed1
step_physics_max0.14712993378909128
step_physics_mean0.10937594314277724
step_physics_median0.10092969993320786
step_physics_min0.08851443891560201
survival_time_max16.5500000000001
survival_time_mean12.237500000000052
survival_time_min5.249999999999989
No reset possible
5764411428Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-erroryesnogpu-prod-040:02:16
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5759810912Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:28:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.10245637043729
survival_time_median53.82499999999908
deviation-center-line_median2.053765290780896
in-drivable-lane_median7.500000000000016


other stats
agent_compute-ego0_max0.03323834444660628
agent_compute-ego0_mean0.01761452892162685
agent_compute-ego0_median0.012547008039364194
agent_compute-ego0_min0.01212575516117273
complete-iteration_max0.20088616407142496
complete-iteration_mean0.18568687716076188
complete-iteration_median0.18960373776675107
complete-iteration_min0.16265386903812049
deviation-center-line_max2.3578284397279465
deviation-center-line_mean1.7538583267253216
deviation-center-line_min0.5500742856115473
deviation-heading_max8.061908403515844
deviation-heading_mean6.434386020802565
deviation-heading_median7.4518775491309
deviation-heading_min2.7718805814326135
driven_any_max9.454421890964095
driven_any_mean7.20945421917734
driven_any_median7.996940040125329
driven_any_min3.3895149054946065
driven_lanedir_consec_max8.670622875980607
driven_lanedir_consec_mean5.710714242272985
driven_lanedir_consec_min1.9673213522367563
driven_lanedir_max8.670622875980607
driven_lanedir_mean5.710714242272985
driven_lanedir_median6.10245637043729
driven_lanedir_min1.9673213522367563
get_duckie_state_max1.9833226873689726e-06
get_duckie_state_mean1.929466062494716e-06
get_duckie_state_median1.9320585197333714e-06
get_duckie_state_min1.870424523143149e-06
get_robot_state_max0.0037936806928686624
get_robot_state_mean0.0036821869936076567
get_robot_state_median0.0036814834874663617
get_robot_state_min0.0035721003066292415
get_state_dump_max0.004935836514068781
get_state_dump_mean0.00469124578724699
get_state_dump_median0.004622778596921834
get_state_dump_min0.004583589441075512
get_ui_image_max0.03479833643144696
get_ui_image_mean0.03013744442417156
get_ui_image_median0.030004292437533397
get_ui_image_min0.025742856390172496
in-drivable-lane_max20.649999999998823
in-drivable-lane_mean9.649999999999723
in-drivable-lane_min2.950000000000042
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.454421890964095, "get_ui_image": 0.027615239082228432, "step_physics": 0.09787209544154032, "survival_time": 59.99999999999873, "driven_lanedir": 6.147693647972307, "get_state_dump": 0.004583589441075512, "get_robot_state": 0.0035721003066292415, "sim_render-ego0": 0.003766034465348294, "get_duckie_state": 1.870424523143149e-06, "in-drivable-lane": 20.649999999998823, "deviation-heading": 6.844440502315854, "agent_compute-ego0": 0.01225126692893404, "complete-iteration": 0.16265386903812049, "set_robot_commands": 0.002146950371557231, "deviation-center-line": 1.8756525727348663, "driven_lanedir_consec": 6.147693647972307, "sim_compute_sim_state": 0.008840310186470279, "sim_compute_performance-ego0": 0.0019184921702973352}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.3895149054946065, "get_ui_image": 0.03479833643144696, "step_physics": 0.12464088880563085, "survival_time": 23.6500000000002, "driven_lanedir": 1.9673213522367563, "get_state_dump": 0.004607492861365467, "get_robot_state": 0.003655422085951149, "sim_render-ego0": 0.003899895692173439, "get_duckie_state": 1.9214324307341112e-06, "in-drivable-lane": 9.700000000000138, "deviation-heading": 2.7718805814326135, "agent_compute-ego0": 0.01212575516117273, "complete-iteration": 0.19949052756345723, "set_robot_commands": 0.0022957475879524327, "deviation-center-line": 0.5500742856115473, "driven_lanedir_consec": 1.9673213522367563, "sim_compute_sim_state": 0.011348839550581665, "sim_compute_performance-ego0": 0.002028126253860409}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.8082243879710775, "get_ui_image": 0.03239334579283836, "step_physics": 0.12562080099397735, "survival_time": 47.64999999999943, "driven_lanedir": 6.057219092902273, "get_state_dump": 0.004638064332478201, "get_robot_state": 0.0037936806928686624, "sim_render-ego0": 0.003997493340034405, "get_duckie_state": 1.9833226873689726e-06, "in-drivable-lane": 5.299999999999894, "deviation-heading": 8.059314595945946, "agent_compute-ego0": 0.01284274914979435, "complete-iteration": 0.20088616407142496, "set_robot_commands": 0.0022635599852108106, "deviation-center-line": 2.231878008826926, "driven_lanedir_consec": 6.057219092902273, "sim_compute_sim_state": 0.01313136033791916, "sim_compute_performance-ego0": 0.0021098534765983277}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.18565569227958, "get_ui_image": 0.025742856390172496, "step_physics": 0.09773654088092584, "survival_time": 59.99999999999873, "driven_lanedir": 8.670622875980607, "get_state_dump": 0.004935836514068781, "get_robot_state": 0.003707544888981574, "sim_render-ego0": 0.003935466698067671, "get_duckie_state": 1.9426846087326315e-06, "in-drivable-lane": 2.950000000000042, "deviation-heading": 8.061908403515844, "agent_compute-ego0": 0.03323834444660628, "complete-iteration": 0.1797169479700449, "set_robot_commands": 0.002245075200419938, "deviation-center-line": 2.3578284397279465, "driven_lanedir_consec": 8.670622875980607, "sim_compute_sim_state": 0.006105999863217216, "sim_compute_performance-ego0": 0.001976294680300799}}
set_robot_commands_max0.0022957475879524327
set_robot_commands_mean0.002237833286285103
set_robot_commands_median0.0022543175928153745
set_robot_commands_min0.002146950371557231
sim_compute_performance-ego0_max0.0021098534765983277
sim_compute_performance-ego0_mean0.002008191645264218
sim_compute_performance-ego0_median0.002002210467080604
sim_compute_performance-ego0_min0.0019184921702973352
sim_compute_sim_state_max0.01313136033791916
sim_compute_sim_state_mean0.00985662748454708
sim_compute_sim_state_median0.010094574868525972
sim_compute_sim_state_min0.006105999863217216
sim_render-ego0_max0.003997493340034405
sim_render-ego0_mean0.003899722548905952
sim_render-ego0_median0.003917681195120554
sim_render-ego0_min0.003766034465348294
simulation-passed1
step_physics_max0.12562080099397735
step_physics_mean0.11146758153051858
step_physics_median0.11125649212358556
step_physics_min0.09773654088092584
survival_time_max59.99999999999873
survival_time_mean47.82499999999927
survival_time_min23.6500000000002
No reset possible
5758510888Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:07:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.27960246196135397
survival_time_median12.450000000000042
deviation-center-line_median0.14035223102989786
in-drivable-lane_median9.750000000000032


other stats
agent_compute-ego0_max0.01346393086408314
agent_compute-ego0_mean0.013189489116282132
agent_compute-ego0_median0.013160822938430362
agent_compute-ego0_min0.012972379724184671
complete-iteration_max0.2525799175103505
complete-iteration_mean0.20500549760110617
complete-iteration_median0.19867828493951856
complete-iteration_min0.1700855030150371
deviation-center-line_max0.4715970248968454
deviation-center-line_mean0.20522164143904664
deviation-center-line_min0.06858507879954558
deviation-heading_max1.8221648036212192
deviation-heading_mean1.012000692508075
deviation-heading_median0.7799059206029639
deviation-heading_min0.6660261252051519
driven_any_max3.3039078657213103
driven_any_mean2.088012799350276
driven_any_median2.386749125491386
driven_any_min0.274645080697022
driven_lanedir_consec_max0.5617638858974955
driven_lanedir_consec_mean0.30795937553080255
driven_lanedir_consec_min0.11086869230300687
driven_lanedir_max0.5617638858974955
driven_lanedir_mean0.30795937553080255
driven_lanedir_median0.27960246196135397
driven_lanedir_min0.11086869230300687
get_duckie_state_max1.7818651701274671e-06
get_duckie_state_mean1.666343765238748e-06
get_duckie_state_median1.6619275096024012e-06
get_duckie_state_min1.5596548716227214e-06
get_robot_state_max0.004184985631390622
get_robot_state_mean0.003916721296127591
get_robot_state_median0.003903733458906215
get_robot_state_min0.003674432635307312
get_state_dump_max0.005213485736595957
get_state_dump_mean0.004919802932684216
get_state_dump_median0.004848156859274624
get_state_dump_min0.00476941227559166
get_ui_image_max0.03466698030630747
get_ui_image_mean0.031473202705279126
get_ui_image_median0.031935590942551315
get_ui_image_min0.027354648629706407
in-drivable-lane_max14.750000000000105
in-drivable-lane_mean8.862500000000042
in-drivable-lane_min1.1999999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.9580246516735103, "get_ui_image": 0.030846794184885527, "step_physics": 0.12381617568041148, "survival_time": 15.15000000000008, "driven_lanedir": 0.5617638858974955, "get_state_dump": 0.005213485736595957, "get_robot_state": 0.004184985631390622, "sim_render-ego0": 0.004369054185716729, "get_duckie_state": 1.7818651701274671e-06, "in-drivable-lane": 11.450000000000063, "deviation-heading": 1.8221648036212192, "agent_compute-ego0": 0.01346393086408314, "complete-iteration": 0.1979734983883406, "set_robot_commands": 0.002465906111817611, "deviation-center-line": 0.4715970248968454, "driven_lanedir_consec": 0.5617638858974955, "sim_compute_sim_state": 0.011128253842654982, "sim_compute_performance-ego0": 0.002366978086923298}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.274645080697022, "get_ui_image": 0.03466698030630747, "step_physics": 0.17929193377494812, "survival_time": 2.3499999999999996, "driven_lanedir": 0.11086869230300687, "get_state_dump": 0.004797657330830892, "get_robot_state": 0.003674432635307312, "sim_render-ego0": 0.00401797890663147, "get_duckie_state": 1.5596548716227214e-06, "in-drivable-lane": 1.1999999999999993, "deviation-heading": 0.8491469993863954, "agent_compute-ego0": 0.012972379724184671, "complete-iteration": 0.2525799175103505, "set_robot_commands": 0.0022087196509043374, "deviation-center-line": 0.06858507879954558, "driven_lanedir_consec": 0.11086869230300687, "sim_compute_sim_state": 0.0088205486536026, "sim_compute_performance-ego0": 0.002026935418446859}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.815473599309262, "get_ui_image": 0.03302438770021711, "step_physics": 0.12770272760975118, "survival_time": 9.750000000000004, "driven_lanedir": 0.23557716818507224, "get_state_dump": 0.004898656387718356, "get_robot_state": 0.003950999707591777, "sim_render-ego0": 0.004008808914495975, "get_duckie_state": 1.5813477185307717e-06, "in-drivable-lane": 8.050000000000002, "deviation-heading": 0.6660261252051519, "agent_compute-ego0": 0.013115870709321936, "complete-iteration": 0.1993830714906965, "set_robot_commands": 0.002289987340265391, "deviation-center-line": 0.09134492379341266, "driven_lanedir_consec": 0.23557716818507224, "sim_compute_sim_state": 0.00813465337364041, "sim_compute_performance-ego0": 0.002148130718542605}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.3039078657213103, "get_ui_image": 0.027354648629706407, "step_physics": 0.10697460952781428, "survival_time": 16.800000000000104, "driven_lanedir": 0.3236277557376357, "get_state_dump": 0.00476941227559166, "get_robot_state": 0.003856467210220654, "sim_render-ego0": 0.004001335857176286, "get_duckie_state": 1.742507300674031e-06, "in-drivable-lane": 14.750000000000105, "deviation-heading": 0.7106648418195324, "agent_compute-ego0": 0.013205775167538788, "complete-iteration": 0.1700855030150371, "set_robot_commands": 0.0022639916983131837, "deviation-center-line": 0.18935953826638305, "driven_lanedir_consec": 0.3236277557376357, "sim_compute_sim_state": 0.005418632433746972, "sim_compute_performance-ego0": 0.002132735549519253}}
set_robot_commands_max0.002465906111817611
set_robot_commands_mean0.0023071512003251305
set_robot_commands_median0.002276989519289287
set_robot_commands_min0.0022087196509043374
sim_compute_performance-ego0_max0.002366978086923298
sim_compute_performance-ego0_mean0.002168694943358004
sim_compute_performance-ego0_median0.0021404331340309293
sim_compute_performance-ego0_min0.002026935418446859
sim_compute_sim_state_max0.011128253842654982
sim_compute_sim_state_mean0.008375522075911242
sim_compute_sim_state_median0.008477601013621505
sim_compute_sim_state_min0.005418632433746972
sim_render-ego0_max0.004369054185716729
sim_render-ego0_mean0.0040992944660051146
sim_render-ego0_median0.004013393910563722
sim_render-ego0_min0.004001335857176286
simulation-passed1
step_physics_max0.17929193377494812
step_physics_mean0.13444636164823126
step_physics_median0.12575945164508134
step_physics_min0.10697460952781428
survival_time_max16.800000000000104
survival_time_mean11.012500000000047
survival_time_min2.3499999999999996
No reset possible
5755110894Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:09:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2656745576105215
survival_time_median13.525000000000055
deviation-center-line_median0.36710457795495816
in-drivable-lane_median5.700000000000047


other stats
agent_compute-ego0_max0.012676577976202917
agent_compute-ego0_mean0.012292757661648918
agent_compute-ego0_median0.012277704620516146
agent_compute-ego0_min0.01193904342936046
complete-iteration_max0.20337089257580893
complete-iteration_mean0.16544643876570836
complete-iteration_median0.1579220308528872
complete-iteration_min0.14257080078125
deviation-center-line_max0.4503518366200258
deviation-center-line_mean0.3292946299874311
deviation-center-line_min0.13261752741978217
deviation-heading_max1.6149493044597971
deviation-heading_mean1.1747632717165406
deviation-heading_median1.1791032792825775
deviation-heading_min0.7258972238412102
driven_any_max4.463130004559172
driven_any_mean2.557839552054874
driven_any_median2.442892941261886
driven_any_min0.8824423211365511
driven_lanedir_consec_max2.1401847734856143
driven_lanedir_consec_mean1.2926577957858685
driven_lanedir_consec_min0.4990972944368166
driven_lanedir_max2.1401847734856143
driven_lanedir_mean1.2926577957858685
driven_lanedir_median1.2656745576105215
driven_lanedir_min0.4990972944368166
get_duckie_state_max1.2267719615589489e-06
get_duckie_state_mean1.183312279357482e-06
get_duckie_state_median1.179590535316386e-06
get_duckie_state_min1.1472960852382078e-06
get_robot_state_max0.003551888316558647
get_robot_state_mean0.003494900371328594
get_robot_state_median0.0034873388644959904
get_robot_state_min0.0034530354397637503
get_state_dump_max0.004514483373556564
get_state_dump_mean0.0044562224111026555
get_state_dump_median0.004448196195162736
get_state_dump_min0.004414013880528587
get_ui_image_max0.03405417927673885
get_ui_image_mean0.028977081791453516
get_ui_image_median0.028292479720821564
get_ui_image_min0.02526918844743209
in-drivable-lane_max13.850000000000197
in-drivable-lane_mean6.762500000000071
in-drivable-lane_min1.7999999999999945
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.408651340714533, "get_ui_image": 0.026335863035116622, "step_physics": 0.08805482867938369, "survival_time": 13.350000000000056, "driven_lanedir": 2.1401847734856143, "get_state_dump": 0.004514483373556564, "get_robot_state": 0.0034827723431943066, "sim_render-ego0": 0.003607209049054046, "get_duckie_state": 1.194761760199248e-06, "in-drivable-lane": 1.9500000000000275, "deviation-heading": 1.294093969494296, "agent_compute-ego0": 0.01193904342936046, "complete-iteration": 0.15080175293025683, "set_robot_commands": 0.001989216057222281, "deviation-center-line": 0.38112609741239994, "driven_lanedir_consec": 2.1401847734856143, "sim_compute_sim_state": 0.008960082459805617, "sim_compute_performance-ego0": 0.0018348969630341031}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.8824423211365511, "get_ui_image": 0.03405417927673885, "step_physics": 0.131561673113278, "survival_time": 5.549999999999988, "driven_lanedir": 0.4990972944368166, "get_state_dump": 0.004443626318659101, "get_robot_state": 0.0034530354397637503, "sim_render-ego0": 0.003646039537021092, "get_duckie_state": 1.164419310433524e-06, "in-drivable-lane": 1.7999999999999945, "deviation-heading": 1.0641125890708596, "agent_compute-ego0": 0.012416096670286996, "complete-iteration": 0.20337089257580893, "set_robot_commands": 0.002013410840715681, "deviation-center-line": 0.4503518366200258, "driven_lanedir_consec": 0.4990972944368166, "sim_compute_sim_state": 0.009839319757052833, "sim_compute_performance-ego0": 0.001857651131493705}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.463130004559172, "get_ui_image": 0.030249096406526507, "step_physics": 0.0949026652318202, "survival_time": 23.900000000000205, "driven_lanedir": 1.7958387420851123, "get_state_dump": 0.004414013880528587, "get_robot_state": 0.003551888316558647, "sim_render-ego0": 0.003768448043217987, "get_duckie_state": 1.1472960852382078e-06, "in-drivable-lane": 13.850000000000197, "deviation-heading": 1.6149493044597971, "agent_compute-ego0": 0.012676577976202917, "complete-iteration": 0.16504230877551754, "set_robot_commands": 0.0021314148116460176, "deviation-center-line": 0.35308305849751637, "driven_lanedir_consec": 1.7958387420851123, "sim_compute_sim_state": 0.011402034062682214, "sim_compute_performance-ego0": 0.001861634483417041}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.477134541809239, "get_ui_image": 0.02526918844743209, "step_physics": 0.08425429257479582, "survival_time": 13.70000000000006, "driven_lanedir": 0.7355103731359309, "get_state_dump": 0.004452766071666371, "get_robot_state": 0.003491905385797674, "sim_render-ego0": 0.003687093908136541, "get_duckie_state": 1.2267719615589489e-06, "in-drivable-lane": 9.450000000000069, "deviation-heading": 0.7258972238412102, "agent_compute-ego0": 0.012139312570745294, "complete-iteration": 0.14257080078125, "set_robot_commands": 0.002041398828679865, "deviation-center-line": 0.13261752741978217, "driven_lanedir_consec": 0.7355103731359309, "sim_compute_sim_state": 0.0053087364543568, "sim_compute_performance-ego0": 0.001841794794256037}}
set_robot_commands_max0.0021314148116460176
set_robot_commands_mean0.0020438601345659614
set_robot_commands_median0.0020274048346977727
set_robot_commands_min0.001989216057222281
sim_compute_performance-ego0_max0.001861634483417041
sim_compute_performance-ego0_mean0.0018489943430502211
sim_compute_performance-ego0_median0.0018497229628748708
sim_compute_performance-ego0_min0.0018348969630341031
sim_compute_sim_state_max0.011402034062682214
sim_compute_sim_state_mean0.008877543183474366
sim_compute_sim_state_median0.009399701108429224
sim_compute_sim_state_min0.0053087364543568
sim_render-ego0_max0.003768448043217987
sim_render-ego0_mean0.003677197634357417
sim_render-ego0_median0.0036665667225788167
sim_render-ego0_min0.003607209049054046
simulation-passed1
step_physics_max0.131561673113278
step_physics_mean0.09969336489981942
step_physics_median0.09147874695560192
step_physics_min0.08425429257479582
survival_time_max23.900000000000205
survival_time_mean14.125000000000076
survival_time_min5.549999999999988
No reset possible
5750910906Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:14:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8621191514954075
survival_time_median16.050000000000093
deviation-center-line_median0.3746846700940242
in-drivable-lane_median10.475000000000088


other stats
agent_compute-ego0_max0.013032638665401577
agent_compute-ego0_mean0.012387202869502066
agent_compute-ego0_median0.012358987615350838
agent_compute-ego0_min0.011798197581905012
complete-iteration_max0.2323651491485027
complete-iteration_mean0.20296459855743815
complete-iteration_median0.2070593946895767
complete-iteration_min0.16537445570209638
deviation-center-line_max0.5968749646524574
deviation-center-line_mean0.37379381969630343
deviation-center-line_min0.14893097394470803
deviation-heading_max4.040692289044496
deviation-heading_mean2.209494086777303
deviation-heading_median2.009137849832883
deviation-heading_min0.7790083583989508
driven_any_max9.113822416181756
driven_any_mean3.783704597669424
driven_any_median2.471610725528082
driven_any_min1.0777745234397782
driven_lanedir_consec_max1.466836501614256
driven_lanedir_consec_mean0.8871597498366948
driven_lanedir_consec_min0.3575641947417083
driven_lanedir_max1.466836501614256
driven_lanedir_mean0.8871597498366948
driven_lanedir_median0.8621191514954075
driven_lanedir_min0.3575641947417083
get_duckie_state_max1.3687914249045864e-06
get_duckie_state_mean1.332809735331025e-06
get_duckie_state_median1.3321733465756531e-06
get_duckie_state_min1.2981008232682075e-06
get_robot_state_max0.0037572730671275745
get_robot_state_mean0.0036101106203857785
get_robot_state_median0.0036282962104676538
get_robot_state_min0.0034265769934802323
get_state_dump_max0.0050346777305839965
get_state_dump_mean0.004768330486645871
get_state_dump_median0.004818024806960632
get_state_dump_min0.004402594602078224
get_ui_image_max0.033669778278895786
get_ui_image_mean0.03029404529017535
get_ui_image_median0.0312343583927817
get_ui_image_min0.025037686096242222
in-drivable-lane_max50.949999999998695
in-drivable-lane_mean19.19999999999971
in-drivable-lane_min4.899999999999984
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.8412295127421783, "get_ui_image": 0.028976207984016435, "step_physics": 0.12071967274261666, "survival_time": 23.900000000000205, "driven_lanedir": 1.466836501614256, "get_state_dump": 0.004735560904962782, "get_robot_state": 0.0036846157902217856, "sim_render-ego0": 0.003959821509916747, "get_duckie_state": 1.3687914249045864e-06, "in-drivable-lane": 15.85000000000019, "deviation-heading": 2.043175558693571, "agent_compute-ego0": 0.01249076429140095, "complete-iteration": 0.18954689666971036, "set_robot_commands": 0.002179322511517678, "deviation-center-line": 0.5209728180710668, "driven_lanedir_consec": 1.466836501614256, "sim_compute_sim_state": 0.010690954881321662, "sim_compute_performance-ego0": 0.002015856959874545}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.0777745234397782, "get_ui_image": 0.033669778278895786, "step_physics": 0.16067370716829477, "survival_time": 7.99999999999998, "driven_lanedir": 0.3575641947417083, "get_state_dump": 0.0050346777305839965, "get_robot_state": 0.0034265769934802323, "sim_render-ego0": 0.003622626665956485, "get_duckie_state": 1.304638311729668e-06, "in-drivable-lane": 4.899999999999984, "deviation-heading": 1.9751001409721949, "agent_compute-ego0": 0.012227210939300726, "complete-iteration": 0.2323651491485027, "set_robot_commands": 0.002009807906535842, "deviation-center-line": 0.22839652211698164, "driven_lanedir_consec": 0.3575641947417083, "sim_compute_sim_state": 0.00981133769017569, "sim_compute_performance-ego0": 0.0018046450170670976}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.1019919383139851, "get_ui_image": 0.033492508801546965, "step_physics": 0.1517511714588512, "survival_time": 8.199999999999982, "driven_lanedir": 0.4489084952169038, "get_state_dump": 0.004900488708958481, "get_robot_state": 0.0037572730671275745, "sim_render-ego0": 0.004038439374981505, "get_duckie_state": 1.3597083814216385e-06, "in-drivable-lane": 5.0999999999999845, "deviation-heading": 0.7790083583989508, "agent_compute-ego0": 0.013032638665401577, "complete-iteration": 0.22457189270944303, "set_robot_commands": 0.0022789579449277934, "deviation-center-line": 0.14893097394470803, "driven_lanedir_consec": 0.4489084952169038, "sim_compute_sim_state": 0.009138445420698686, "sim_compute_performance-ego0": 0.0020838347348299895}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.113822416181756, "get_ui_image": 0.025037686096242222, "step_physics": 0.1059420970357725, "survival_time": 59.99999999999873, "driven_lanedir": 1.2753298077739113, "get_state_dump": 0.004402594602078224, "get_robot_state": 0.0035719766307135206, "sim_render-ego0": 0.0036969605730931823, "get_duckie_state": 1.2981008232682075e-06, "in-drivable-lane": 50.949999999998695, "deviation-heading": 4.040692289044496, "agent_compute-ego0": 0.011798197581905012, "complete-iteration": 0.16537445570209638, "set_robot_commands": 0.0021167889324254932, "deviation-center-line": 0.5968749646524574, "driven_lanedir_consec": 1.2753298077739113, "sim_compute_sim_state": 0.006819323040265822, "sim_compute_performance-ego0": 0.0019028419062656528}}
set_robot_commands_max0.0022789579449277934
set_robot_commands_mean0.002146219323851702
set_robot_commands_median0.0021480557219715857
set_robot_commands_min0.002009807906535842
sim_compute_performance-ego0_max0.0020838347348299895
sim_compute_performance-ego0_mean0.001951794654509321
sim_compute_performance-ego0_median0.001959349433070099
sim_compute_performance-ego0_min0.0018046450170670976
sim_compute_sim_state_max0.010690954881321662
sim_compute_sim_state_mean0.009115015258115464
sim_compute_sim_state_median0.009474891555437188
sim_compute_sim_state_min0.006819323040265822
sim_render-ego0_max0.004038439374981505
sim_render-ego0_mean0.00382946203098698
sim_render-ego0_median0.003828391041504965
sim_render-ego0_min0.003622626665956485
simulation-passed1
step_physics_max0.16067370716829477
step_physics_mean0.13477166210138378
step_physics_median0.13623542210073392
step_physics_min0.1059420970357725
survival_time_max59.99999999999873
survival_time_mean25.02499999999972
survival_time_min7.99999999999998
No reset possible
5749611426Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-testingLFP-simhost-erroryesnogpu-prod-040:04:10
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5732810960Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:36:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.755512725763792
survival_time_median59.99999999999873
deviation-center-line_median3.193721705347145
in-drivable-lane_median10.5999999999998


other stats
agent_compute-ego0_max0.08648877814695409
agent_compute-ego0_mean0.05400429180879355
agent_compute-ego0_median0.058460072414960394
agent_compute-ego0_min0.01260824425829936
complete-iteration_max0.27353604012583815
complete-iteration_mean0.2211549615027272
complete-iteration_median0.21166212551620872
complete-iteration_min0.1877595548526532
deviation-center-line_max3.441322012288808
deviation-center-line_mean3.1560160645238735
deviation-center-line_min2.795298835112396
deviation-heading_max13.208659504837463
deviation-heading_mean12.791514087612718
deviation-heading_median12.92195655704348
deviation-heading_min12.113483731526443
driven_any_max11.064885577105152
driven_any_mean10.346969876349927
driven_any_median10.627380288245009
driven_any_min9.068233351804556
driven_lanedir_consec_max6.725407343808097
driven_lanedir_consec_mean5.36207672843945
driven_lanedir_consec_min3.2118741184221204
driven_lanedir_max9.079651082776152
driven_lanedir_mean7.95406013741141
driven_lanedir_median7.904533824597812
driven_lanedir_min6.927521817673865
get_duckie_state_max1.3344293827816013e-06
get_duckie_state_mean1.2681239967592443e-06
get_duckie_state_median1.275468313356937e-06
get_duckie_state_min1.1871299775415018e-06
get_robot_state_max0.003694261142752947
get_robot_state_mean0.0036117317913175366
get_robot_state_median0.0036255537203803926
get_robot_state_min0.003501558581756414
get_state_dump_max0.00471388311012897
get_state_dump_mean0.004613776992515212
get_state_dump_median0.004648693410709932
get_state_dump_min0.004443838038512015
get_ui_image_max0.03395104825149269
get_ui_image_mean0.02979074837161239
get_ui_image_median0.02962395769670345
get_ui_image_min0.02596402984154995
in-drivable-lane_max18.44999999999976
in-drivable-lane_mean12.29999999999978
in-drivable-lane_min9.549999999999764
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.064885577105152, "get_ui_image": 0.02740616881777901, "step_physics": 0.10165325707936664, "survival_time": 59.99999999999873, "driven_lanedir": 9.079651082776152, "get_state_dump": 0.00471388311012897, "get_robot_state": 0.003657227253338181, "sim_render-ego0": 0.0038137693984820185, "get_duckie_state": 1.3028652245158656e-06, "in-drivable-lane": 9.549999999999764, "deviation-heading": 12.698294513146449, "agent_compute-ego0": 0.03233683317726002, "complete-iteration": 0.1877595548526532, "set_robot_commands": 0.0022063322805742935, "deviation-center-line": 2.795298835112396, "driven_lanedir_consec": 5.789576154943033, "sim_compute_sim_state": 0.00984790005552878, "sim_compute_performance-ego0": 0.0020358228961395086}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.330730296774757, "get_ui_image": 0.03395104825149269, "step_physics": 0.1287818403664874, "survival_time": 59.99999999999873, "driven_lanedir": 6.927521817673865, "get_state_dump": 0.004443838038512015, "get_robot_state": 0.003501558581756414, "sim_render-ego0": 0.00364928718014224, "get_duckie_state": 1.1871299775415018e-06, "in-drivable-lane": 18.44999999999976, "deviation-heading": 13.208659504837463, "agent_compute-ego0": 0.08458331165266077, "complete-iteration": 0.27353604012583815, "set_robot_commands": 0.0021262160943608596, "deviation-center-line": 3.0169724281247827, "driven_lanedir_consec": 3.2118741184221204, "sim_compute_sim_state": 0.010530942881931175, "sim_compute_performance-ego0": 0.001877223919273713}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.924030279715256, "get_ui_image": 0.0318417465756279, "step_physics": 0.1167301472577326, "survival_time": 59.99999999999873, "driven_lanedir": 8.826497071671188, "get_state_dump": 0.004643563128430877, "get_robot_state": 0.003694261142752947, "sim_render-ego0": 0.0038334513385528137, "get_duckie_state": 1.3344293827816013e-06, "in-drivable-lane": 10.699999999999998, "deviation-heading": 12.113483731526443, "agent_compute-ego0": 0.01260824425829936, "complete-iteration": 0.1885640772058009, "set_robot_commands": 0.00216357197789328, "deviation-center-line": 3.3704709825695076, "driven_lanedir_consec": 6.725407343808097, "sim_compute_sim_state": 0.010963711710794086, "sim_compute_performance-ego0": 0.001988918755473344}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.068233351804556, "get_ui_image": 0.02596402984154995, "step_physics": 0.10031524697184108, "survival_time": 52.54999999999915, "driven_lanedir": 6.982570577524436, "get_state_dump": 0.004653823692988987, "get_robot_state": 0.0035938801874226037, "sim_render-ego0": 0.0036936694678244937, "get_duckie_state": 1.2480714021980083e-06, "in-drivable-lane": 10.4999999999996, "deviation-heading": 13.145618600940516, "agent_compute-ego0": 0.08648877814695409, "complete-iteration": 0.23476017382661651, "set_robot_commands": 0.0022372913904516417, "deviation-center-line": 3.441322012288808, "driven_lanedir_consec": 5.7214492965845505, "sim_compute_sim_state": 0.005853221896936685, "sim_compute_performance-ego0": 0.0018653645261612229}}
set_robot_commands_max0.0022372913904516417
set_robot_commands_mean0.002183352935820018
set_robot_commands_median0.0021849521292337864
set_robot_commands_min0.0021262160943608596
sim_compute_performance-ego0_max0.0020358228961395086
sim_compute_performance-ego0_mean0.0019418325242619471
sim_compute_performance-ego0_median0.0019330713373735288
sim_compute_performance-ego0_min0.0018653645261612229
sim_compute_sim_state_max0.010963711710794086
sim_compute_sim_state_mean0.00929894413629768
sim_compute_sim_state_median0.010189421468729976
sim_compute_sim_state_min0.005853221896936685
sim_render-ego0_max0.0038334513385528137
sim_render-ego0_mean0.003747544346250391
sim_render-ego0_median0.003753719433153256
sim_render-ego0_min0.00364928718014224
simulation-passed1
step_physics_max0.1287818403664874
step_physics_mean0.11187012291885694
step_physics_median0.10919170216854962
step_physics_min0.10031524697184108
survival_time_max59.99999999999873
survival_time_mean58.13749999999884
survival_time_min52.54999999999915
No reset possible
5723410987Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:17:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7777570705297684
survival_time_median16.675000000000104
deviation-center-line_median0.523669216220997
in-drivable-lane_median11.350000000000083


other stats
agent_compute-ego0_max0.013008101948962047
agent_compute-ego0_mean0.012816967026882117
agent_compute-ego0_median0.012934940083216034
agent_compute-ego0_min0.01238988599213434
complete-iteration_max0.2074362118200136
complete-iteration_mean0.18556706581312968
complete-iteration_median0.1836188804153545
complete-iteration_min0.16759429060179612
deviation-center-line_max2.3490956919276673
deviation-center-line_mean0.8911533597249452
deviation-center-line_min0.16817931453011936
deviation-heading_max15.055725078325043
deviation-heading_mean5.490280962453523
deviation-heading_median3.1648807121857008
deviation-heading_min0.5756373471176499
driven_any_max9.296203911157864
driven_any_mean4.317916257196552
driven_any_median2.7986965423389183
driven_any_min2.378068032950507
driven_lanedir_consec_max3.052334434125283
driven_lanedir_consec_mean1.2398294372798515
driven_lanedir_consec_min0.35146917393458765
driven_lanedir_max3.11872585527144
driven_lanedir_mean1.256427292566391
driven_lanedir_median0.7777570705297684
driven_lanedir_min0.35146917393458765
get_duckie_state_max1.7923075002390188e-06
get_duckie_state_mean1.5166733584107406e-06
get_duckie_state_median1.5017409502955589e-06
get_duckie_state_min1.2709040328128253e-06
get_robot_state_max0.0039418969121012655
get_robot_state_mean0.0038165629511762895
get_robot_state_median0.0038317816357911526
get_robot_state_min0.0036607916210215858
get_state_dump_max0.004794238111954942
get_state_dump_mean0.004716713085938309
get_state_dump_median0.004747194035932303
get_state_dump_min0.004578226159933689
get_ui_image_max0.03468682457715037
get_ui_image_mean0.03004245674534577
get_ui_image_median0.029656580680676184
get_ui_image_min0.026169841042880355
in-drivable-lane_max29.199999999999612
in-drivable-lane_mean15.287499999999948
in-drivable-lane_min9.250000000000014
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.378068032950507, "get_ui_image": 0.028194224084173884, "step_physics": 0.12043288704398628, "survival_time": 14.250000000000068, "driven_lanedir": 0.5015936445657831, "get_state_dump": 0.0047331131421602685, "get_robot_state": 0.0039418969121012655, "sim_render-ego0": 0.0040348159683334245, "get_duckie_state": 1.7923075002390188e-06, "in-drivable-lane": 9.250000000000014, "deviation-heading": 2.966924996617123, "agent_compute-ego0": 0.012975462666758293, "complete-iteration": 0.1889128051437698, "set_robot_commands": 0.002321675107195661, "deviation-center-line": 0.44504069767087073, "driven_lanedir_consec": 0.5015936445657831, "sim_compute_sim_state": 0.009958662353195513, "sim_compute_performance-ego0": 0.0022143884138627486}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.9049144602995347, "get_ui_image": 0.03468682457715037, "step_physics": 0.13186641544654062, "survival_time": 18.900000000000137, "driven_lanedir": 1.0539204964937536, "get_state_dump": 0.004578226159933689, "get_robot_state": 0.003762041358645799, "sim_render-ego0": 0.0039560360770112294, "get_duckie_state": 1.411010218798957e-06, "in-drivable-lane": 10.400000000000096, "deviation-heading": 3.362836427754278, "agent_compute-ego0": 0.013008101948962047, "complete-iteration": 0.2074362118200136, "set_robot_commands": 0.0023163396639056446, "deviation-center-line": 0.6022977347711234, "driven_lanedir_consec": 1.0539204964937536, "sim_compute_sim_state": 0.01102009297675382, "sim_compute_performance-ego0": 0.0021495089367385904}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.296203911157864, "get_ui_image": 0.03111893727717848, "step_physics": 0.1046970662824518, "survival_time": 59.99999999999873, "driven_lanedir": 3.11872585527144, "get_state_dump": 0.004794238111954942, "get_robot_state": 0.0036607916210215858, "sim_render-ego0": 0.003906834234702994, "get_duckie_state": 1.2709040328128253e-06, "in-drivable-lane": 29.199999999999612, "deviation-heading": 15.055725078325043, "agent_compute-ego0": 0.01238988599213434, "complete-iteration": 0.17832495568693926, "set_robot_commands": 0.0021608878333403804, "deviation-center-line": 2.3490956919276673, "driven_lanedir_consec": 3.052334434125283, "sim_compute_sim_state": 0.013473546673713576, "sim_compute_performance-ego0": 0.0020365500628799324}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6924786243783014, "get_ui_image": 0.026169841042880355, "step_physics": 0.10537951157010834, "survival_time": 14.45000000000007, "driven_lanedir": 0.35146917393458765, "get_state_dump": 0.004761274929704337, "get_robot_state": 0.0039015219129365066, "sim_render-ego0": 0.004054685296683476, "get_duckie_state": 1.5924716817921603e-06, "in-drivable-lane": 12.30000000000007, "deviation-heading": 0.5756373471176499, "agent_compute-ego0": 0.012894417499673778, "complete-iteration": 0.16759429060179612, "set_robot_commands": 0.0022331846171411976, "deviation-center-line": 0.16817931453011936, "driven_lanedir_consec": 0.35146917393458765, "sim_compute_sim_state": 0.005985999929493871, "sim_compute_performance-ego0": 0.0021168988326500204}}
set_robot_commands_max0.002321675107195661
set_robot_commands_mean0.002258021805395721
set_robot_commands_median0.002274762140523421
set_robot_commands_min0.0021608878333403804
sim_compute_performance-ego0_max0.0022143884138627486
sim_compute_performance-ego0_mean0.002129336561532823
sim_compute_performance-ego0_median0.0021332038846943054
sim_compute_performance-ego0_min0.0020365500628799324
sim_compute_sim_state_max0.013473546673713576
sim_compute_sim_state_mean0.010109575483289194
sim_compute_sim_state_median0.010489377664974663
sim_compute_sim_state_min0.005985999929493871
sim_render-ego0_max0.004054685296683476
sim_render-ego0_mean0.003988092894182781
sim_render-ego0_median0.003995426022672327
sim_render-ego0_min0.003906834234702994
simulation-passed1
step_physics_max0.13186641544654062
step_physics_mean0.11559397008577176
step_physics_median0.11290619930704732
step_physics_min0.1046970662824518
survival_time_max59.99999999999873
survival_time_mean26.89999999999975
survival_time_min14.250000000000068
No reset possible
5722710988Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:05:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.46725208415814934
survival_time_median6.099999999999986
deviation-center-line_median0.13544356018779144
in-drivable-lane_median4.024999999999988


other stats
agent_compute-ego0_max0.01327757927977923
agent_compute-ego0_mean0.012644656367435496
agent_compute-ego0_median0.012474070252433637
agent_compute-ego0_min0.012352905685095478
complete-iteration_max0.1981369175957245
complete-iteration_mean0.17178205531126722
complete-iteration_median0.16720430125415814
complete-iteration_min0.1545827011410281
deviation-center-line_max0.22466086791584303
deviation-center-line_mean0.14659460900004054
deviation-center-line_min0.09083044770873616
deviation-heading_max2.502307964174239
deviation-heading_mean1.1398169080271794
deviation-heading_median0.8568946037695092
deviation-heading_min0.3431704603954601
driven_any_max2.997176333460239
driven_any_mean1.7639723039666215
driven_any_median1.4890505324603942
driven_any_min1.0806118174854586
driven_lanedir_consec_max0.5940430228054884
driven_lanedir_consec_mean0.451466616311077
driven_lanedir_consec_min0.277319274122521
driven_lanedir_max0.5940430228054884
driven_lanedir_mean0.451466616311077
driven_lanedir_median0.46725208415814934
driven_lanedir_min0.277319274122521
get_duckie_state_max1.422789415367219e-06
get_duckie_state_mean1.340284148934519e-06
get_duckie_state_median1.349971381151874e-06
get_duckie_state_min1.2384044180671087e-06
get_robot_state_max0.003668133546466287
get_robot_state_mean0.0035575211738355
get_robot_state_median0.0035638002957296563
get_robot_state_min0.003434350557416399
get_state_dump_max0.0046174680586341475
get_state_dump_mean0.004547741055062804
get_state_dump_median0.004580970689713507
get_state_dump_min0.004411554782190056
get_ui_image_max0.03576816864384031
get_ui_image_mean0.030512494913033823
get_ui_image_median0.029805989711805782
get_ui_image_min0.026669831584683425
in-drivable-lane_max9.550000000000018
in-drivable-lane_mean5.187499999999995
in-drivable-lane_min3.149999999999989
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.997176333460239, "get_ui_image": 0.028885216848087696, "step_physics": 0.09441215017063898, "survival_time": 12.30000000000004, "driven_lanedir": 0.277319274122521, "get_state_dump": 0.004565876987781602, "get_robot_state": 0.003668133546466287, "sim_render-ego0": 0.003835956094718655, "get_duckie_state": 1.422789415367219e-06, "in-drivable-lane": 9.550000000000018, "deviation-heading": 2.502307964174239, "agent_compute-ego0": 0.012534262197703002, "complete-iteration": 0.16242417729335276, "set_robot_commands": 0.0021615520662624345, "deviation-center-line": 0.22466086791584303, "driven_lanedir_consec": 0.277319274122521, "sim_compute_sim_state": 0.010261097417669255, "sim_compute_performance-ego0": 0.0020112035728176597}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3208652778810128, "get_ui_image": 0.03576816864384031, "step_physics": 0.123285985687404, "survival_time": 5.09999999999999, "driven_lanedir": 0.38083027626268695, "get_state_dump": 0.004596064391645413, "get_robot_state": 0.0035086141049283223, "sim_render-ego0": 0.003907979113384358, "get_duckie_state": 1.2939416089104217e-06, "in-drivable-lane": 3.1499999999999924, "deviation-heading": 1.3367539207759742, "agent_compute-ego0": 0.01327757927977923, "complete-iteration": 0.1981369175957245, "set_robot_commands": 0.002209989769944867, "deviation-center-line": 0.14642868557592434, "driven_lanedir_consec": 0.38083027626268695, "sim_compute_sim_state": 0.009549034451975406, "sim_compute_performance-ego0": 0.0019482131143218103}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0806118174854586, "get_ui_image": 0.030726762575523876, "step_physics": 0.10550156932010828, "survival_time": 5.299999999999989, "driven_lanedir": 0.5940430228054884, "get_state_dump": 0.004411554782190056, "get_robot_state": 0.003434350557416399, "sim_render-ego0": 0.0037187727812294648, "get_duckie_state": 1.4060011533933263e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 0.3770352867630442, "agent_compute-ego0": 0.012413878307164271, "complete-iteration": 0.17198442521496354, "set_robot_commands": 0.0020220903592689013, "deviation-center-line": 0.09083044770873616, "driven_lanedir_consec": 0.5940430228054884, "sim_compute_sim_state": 0.00781993554017254, "sim_compute_performance-ego0": 0.001851064022456374}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6572357870397756, "get_ui_image": 0.026669831584683425, "step_physics": 0.0939582663474323, "survival_time": 6.8999999999999835, "driven_lanedir": 0.5536738920536117, "get_state_dump": 0.0046174680586341475, "get_robot_state": 0.0036189864865309902, "sim_render-ego0": 0.003936993990013068, "get_duckie_state": 1.2384044180671087e-06, "in-drivable-lane": 4.899999999999983, "deviation-heading": 0.3431704603954601, "agent_compute-ego0": 0.012352905685095478, "complete-iteration": 0.1545827011410281, "set_robot_commands": 0.0022261554388691195, "deviation-center-line": 0.12445843479965854, "driven_lanedir_consec": 0.5536738920536117, "sim_compute_sim_state": 0.005140963218194975, "sim_compute_performance-ego0": 0.001974179590348717}}
set_robot_commands_max0.0022261554388691195
set_robot_commands_mean0.0021549469085863308
set_robot_commands_median0.0021857709181036505
set_robot_commands_min0.0020220903592689013
sim_compute_performance-ego0_max0.0020112035728176597
sim_compute_performance-ego0_mean0.0019461650749861405
sim_compute_performance-ego0_median0.0019611963523352635
sim_compute_performance-ego0_min0.001851064022456374
sim_compute_sim_state_max0.010261097417669255
sim_compute_sim_state_mean0.008192757657003044
sim_compute_sim_state_median0.008684484996073973
sim_compute_sim_state_min0.005140963218194975
sim_render-ego0_max0.003936993990013068
sim_render-ego0_mean0.0038499254948363864
sim_render-ego0_median0.0038719676040515063
sim_render-ego0_min0.0037187727812294648
simulation-passed1
step_physics_max0.123285985687404
step_physics_mean0.1042894928813959
step_physics_median0.09995685974537365
step_physics_min0.0939582663474323
survival_time_max12.30000000000004
survival_time_mean7.400000000000001
survival_time_min5.09999999999999
No reset possible
5713311011Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:20:37
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8294860505284607
survival_time_median38.19999999999993
deviation-center-line_median1.1397107237975406
in-drivable-lane_median4.175000000000047


other stats
agent_compute-ego0_max0.013890539727559903
agent_compute-ego0_mean0.013072169508975206
agent_compute-ego0_median0.012958813924094748
agent_compute-ego0_min0.01248051046015142
complete-iteration_max0.23621773138278868
complete-iteration_mean0.18767751992047976
complete-iteration_median0.17395463351534005
complete-iteration_min0.1665830812684503
deviation-center-line_max4.409916193971367
deviation-center-line_mean1.7113483874897075
deviation-center-line_min0.1560559083923818
deviation-heading_max11.031870081384152
deviation-heading_mean5.354160018053045
deviation-heading_median4.369387046285085
deviation-heading_min1.6459958982578562
driven_any_max8.351319254409939
driven_any_mean4.902766262185931
driven_any_median5.478814491437172
driven_any_min0.30211681145944447
driven_lanedir_consec_max8.165304460974927
driven_lanedir_consec_mean3.4931040368066264
driven_lanedir_consec_min0.14813958519465764
driven_lanedir_max8.165304460974927
driven_lanedir_mean3.5527866170100495
driven_lanedir_median2.948851210935307
driven_lanedir_min0.14813958519465764
get_duckie_state_max1.5170343460575228e-06
get_duckie_state_mean1.404422028268576e-06
get_duckie_state_median1.3888607036839336e-06
get_duckie_state_min1.322932359648914e-06
get_robot_state_max0.00409606026440132
get_robot_state_mean0.003949297141186248
get_robot_state_median0.003982302802411623
get_robot_state_min0.003736522695520422
get_state_dump_max0.005317653097757479
get_state_dump_mean0.005106931377383332
get_state_dump_median0.0051323568182818175
get_state_dump_min0.004845358775212215
get_ui_image_max0.036785558956425365
get_ui_image_mean0.030929676218700797
get_ui_image_median0.02997659078856302
get_ui_image_min0.026979964341251775
in-drivable-lane_max29.39999999999969
in-drivable-lane_mean9.437499999999943
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.878067655597407, "get_ui_image": 0.028811167901562105, "step_physics": 0.0997918059748988, "survival_time": 30.950000000000305, "driven_lanedir": 3.867830953435068, "get_state_dump": 0.005174577620721633, "get_robot_state": 0.0039532273046432006, "sim_render-ego0": 0.004154879816116825, "get_duckie_state": 1.5170343460575228e-06, "in-drivable-lane": 6.900000000000098, "deviation-heading": 3.662022072794221, "agent_compute-ego0": 0.013207523668965986, "complete-iteration": 0.1709486053835961, "set_robot_commands": 0.00232443424963182, "deviation-center-line": 1.1619967006609555, "driven_lanedir_consec": 3.867830953435068, "sim_compute_sim_state": 0.011265599727630617, "sim_compute_performance-ego0": 0.0021610813756142893}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.30211681145944447, "get_ui_image": 0.036785558956425365, "step_physics": 0.15620873614055356, "survival_time": 4.049999999999994, "driven_lanedir": 0.14813958519465764, "get_state_dump": 0.005317653097757479, "get_robot_state": 0.00409606026440132, "sim_render-ego0": 0.004377274978451613, "get_duckie_state": 1.322932359648914e-06, "in-drivable-lane": 1.4499999999999948, "deviation-heading": 1.6459958982578562, "agent_compute-ego0": 0.013890539727559903, "complete-iteration": 0.23621773138278868, "set_robot_commands": 0.0025035026596813667, "deviation-center-line": 0.1560559083923818, "driven_lanedir_consec": 0.14813958519465764, "sim_compute_sim_state": 0.01071162340117664, "sim_compute_performance-ego0": 0.0022278210011924186}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.079561327276935, "get_ui_image": 0.031142013675563934, "step_physics": 0.10625957892491268, "survival_time": 45.449999999999555, "driven_lanedir": 2.0298714684355454, "get_state_dump": 0.004845358775212215, "get_robot_state": 0.003736522695520422, "sim_render-ego0": 0.0040368030359456825, "get_duckie_state": 1.3587239024403331e-06, "in-drivable-lane": 29.39999999999969, "deviation-heading": 5.076752019775949, "agent_compute-ego0": 0.01248051046015142, "complete-iteration": 0.176960661647084, "set_robot_commands": 0.002250646234868647, "deviation-center-line": 1.1174247469341252, "driven_lanedir_consec": 1.791141147621853, "sim_compute_sim_state": 0.010072584728618245, "sim_compute_performance-ego0": 0.0020392040629963297}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.351319254409939, "get_ui_image": 0.026979964341251775, "step_physics": 0.1024771641930573, "survival_time": 59.99999999999873, "driven_lanedir": 8.165304460974927, "get_state_dump": 0.0050901360158420025, "get_robot_state": 0.004011378300180046, "sim_render-ego0": 0.004123676230170943, "get_duckie_state": 1.4189975049275345e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.031870081384152, "agent_compute-ego0": 0.012710104179223513, "complete-iteration": 0.1665830812684503, "set_robot_commands": 0.0023846390046843085, "deviation-center-line": 4.409916193971367, "driven_lanedir_consec": 8.165304460974927, "sim_compute_sim_state": 0.006508584820559182, "sim_compute_performance-ego0": 0.0022013501064862737}}
set_robot_commands_max0.0025035026596813667
set_robot_commands_mean0.0023658055372165355
set_robot_commands_median0.002354536627158064
set_robot_commands_min0.002250646234868647
sim_compute_performance-ego0_max0.0022278210011924186
sim_compute_performance-ego0_mean0.002157364136572328
sim_compute_performance-ego0_median0.0021812157410502813
sim_compute_performance-ego0_min0.0020392040629963297
sim_compute_sim_state_max0.011265599727630617
sim_compute_sim_state_mean0.00963959816949617
sim_compute_sim_state_median0.01039210406489744
sim_compute_sim_state_min0.006508584820559182
sim_render-ego0_max0.004377274978451613
sim_render-ego0_mean0.0041731585151712665
sim_render-ego0_median0.004139278023143884
sim_render-ego0_min0.0040368030359456825
simulation-passed1
step_physics_max0.15620873614055356
step_physics_mean0.11618432130835556
step_physics_median0.10436837155898498
step_physics_min0.0997918059748988
survival_time_max59.99999999999873
survival_time_mean35.11249999999965
survival_time_min4.049999999999994
No reset possible
5712211313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-040:00:54
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5709111312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-040:00:52
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5708411312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-040:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5708211024Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 66, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 62, in compute_action
              ||     action = self.model.predict(observation)
              ||   File "/workspace/model.py", line 118, in predict
              ||     output = self.model(images)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/site-packages/torchvision/models/squeezenet.py", line 100, in forward
              ||     x = self.features(x)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/container.py", line 117, in forward
              ||     input = module(input)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/conv.py", line 423, in forward
              ||     return self._conv_forward(input, self.weight)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/conv.py", line 419, in _conv_forward
              ||     return F.conv2d(input, weight, self.bias, self.stride,
              || TypeError: conv2d(): argument 'input' (position 1) must be Tensor, not numpy.ndarray
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
              ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
              || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7fa30c8578e0>>.
              || │       f: <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7fa30c8578e0>>
              || │    args: {context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7fa305b883a0>}
              || │ argspec: ([self, context], None, None, None, [], None, {context: <class 'zuper_nodes_wrapper.interface.Context'>} )
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5706811026Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:01:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 68, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 63, in compute_action
              ||     observation = self.preprocessor.toTensor(observation).to(self._device)
              ||   File "/workspace/wrappers.py", line 23, in toTensor
              ||     return self.compose_obs(obs)
              ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/transforms.py", line 67, in __call__
              ||     img = t(img)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/transforms.py", line 226, in forward
              ||     return F.normalize(tensor, self.mean, self.std, self.inplace)
              ||   File "/usr/local/lib/python3.8/site-packages/torchvision/transforms/functional.py", line 284, in normalize
              ||     tensor.sub_(mean).div_(std)
              || RuntimeError: The size of tensor a (120) must match the size of tensor b (3) at non-singleton dimension 0
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5704711278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5704011425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-040:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5702311283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:52
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5700711284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:01:28
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5698911284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5696611427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-040:04:07
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5680711080Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:31:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.000181007857016
survival_time_median59.99999999999873
deviation-center-line_median2.407866872934968
in-drivable-lane_median6.449999999999755


other stats
agent_compute-ego0_max0.01294200009450031
agent_compute-ego0_mean0.012570422017806795
agent_compute-ego0_median0.012579409605656736
agent_compute-ego0_min0.012180868765413402
complete-iteration_max0.19350896497112133
complete-iteration_mean0.17575465364335552
complete-iteration_median0.17826155282178588
complete-iteration_min0.15298654395872904
deviation-center-line_max2.9327677859653036
deviation-center-line_mean2.42564286271216
deviation-center-line_min1.954069919013401
deviation-heading_max13.132541900720865
deviation-heading_mean12.552788415236622
deviation-heading_median12.845216496130272
deviation-heading_min11.388178767965076
driven_any_max9.69032278319782
driven_any_mean8.683355382785068
driven_any_median9.487412735904195
driven_any_min6.068273276134057
driven_lanedir_consec_max6.236283698135226
driven_lanedir_consec_mean5.34580441555792
driven_lanedir_consec_min3.1465719483824217
driven_lanedir_max8.307985275431642
driven_lanedir_mean7.0566173093161515
driven_lanedir_median8.159619908205553
driven_lanedir_min3.5992441454218578
get_duckie_state_max1.459494915532629e-06
get_duckie_state_mean1.3797290900152067e-06
get_duckie_state_median1.3670853829999253e-06
get_duckie_state_min1.3252506785283477e-06
get_robot_state_max0.00374189900121125
get_robot_state_mean0.003670693905364138
get_robot_state_median0.0037346317011748226
get_robot_state_min0.003471613217895655
get_state_dump_max0.004695612623927794
get_state_dump_mean0.0045650893886681745
get_state_dump_median0.004587623896348685
get_state_dump_min0.004389497138047534
get_ui_image_max0.03301721027590541
get_ui_image_mean0.02977154950575539
get_ui_image_median0.030249400996447205
get_ui_image_min0.025570185754221743
in-drivable-lane_max13.349999999999746
in-drivable-lane_mean7.849999999999786
in-drivable-lane_min5.149999999999888
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.542444699051575, "get_ui_image": 0.028228999970854568, "step_physics": 0.1043320325490934, "survival_time": 59.99999999999873, "driven_lanedir": 8.077507528924155, "get_state_dump": 0.004674177185681142, "get_robot_state": 0.00374189900121125, "sim_render-ego0": 0.003908335021096007, "get_duckie_state": 1.459494915532629e-06, "in-drivable-lane": 6.799999999999681, "deviation-heading": 12.748172152778592, "agent_compute-ego0": 0.012727070013549705, "complete-iteration": 0.17217868551624307, "set_robot_commands": 0.002299373691822468, "deviation-center-line": 2.6958305181335107, "driven_lanedir_consec": 6.236283698135226, "sim_compute_sim_state": 0.010113749079263578, "sim_compute_performance-ego0": 0.0020623832419948912}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.068273276134057, "get_ui_image": 0.03301721027590541, "step_physics": 0.12210792569113296, "survival_time": 41.399999999999785, "driven_lanedir": 3.5992441454218578, "get_state_dump": 0.004389497138047534, "get_robot_state": 0.003471613217895655, "sim_render-ego0": 0.003698161772853359, "get_duckie_state": 1.3252506785283477e-06, "in-drivable-lane": 13.349999999999746, "deviation-heading": 13.132541900720865, "agent_compute-ego0": 0.012180868765413402, "complete-iteration": 0.19350896497112133, "set_robot_commands": 0.0020725594786309216, "deviation-center-line": 1.954069919013401, "driven_lanedir_consec": 3.1465719483824217, "sim_compute_sim_state": 0.010607749619156084, "sim_compute_performance-ego0": 0.001882938194044824}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.69032278319782, "get_ui_image": 0.03226980202203984, "step_physics": 0.11024675897317168, "survival_time": 59.99999999999873, "driven_lanedir": 8.307985275431642, "get_state_dump": 0.004695612623927794, "get_robot_state": 0.003728435001802087, "sim_render-ego0": 0.003928487644306726, "get_duckie_state": 1.3852496627566222e-06, "in-drivable-lane": 6.099999999999829, "deviation-heading": 11.388178767965076, "agent_compute-ego0": 0.01294200009450031, "complete-iteration": 0.18434442012732868, "set_robot_commands": 0.002280378024048055, "deviation-center-line": 2.119903227736426, "driven_lanedir_consec": 5.825784400506926, "sim_compute_sim_state": 0.012118243059448952, "sim_compute_performance-ego0": 0.0020443325138012635}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.432380772756815, "get_ui_image": 0.025570185754221743, "step_physics": 0.09266969167024865, "survival_time": 59.99999999999873, "driven_lanedir": 8.24173228748695, "get_state_dump": 0.0045010706070162275, "get_robot_state": 0.003740828400547558, "sim_render-ego0": 0.003806639273498179, "get_duckie_state": 1.3489211032432284e-06, "in-drivable-lane": 5.149999999999888, "deviation-heading": 12.942260839481952, "agent_compute-ego0": 0.012431749197763766, "complete-iteration": 0.15298654395872904, "set_robot_commands": 0.002166098301654851, "deviation-center-line": 2.9327677859653036, "driven_lanedir_consec": 6.174577615207106, "sim_compute_sim_state": 0.006100678622573738, "sim_compute_performance-ego0": 0.001916823438760343}}
set_robot_commands_max0.002299373691822468
set_robot_commands_mean0.0022046023740390735
set_robot_commands_median0.0022232381628514526
set_robot_commands_min0.0020725594786309216
sim_compute_performance-ego0_max0.0020623832419948912
sim_compute_performance-ego0_mean0.001976619347150331
sim_compute_performance-ego0_median0.0019805779762808035
sim_compute_performance-ego0_min0.001882938194044824
sim_compute_sim_state_max0.012118243059448952
sim_compute_sim_state_mean0.00973510509511059
sim_compute_sim_state_median0.010360749349209832
sim_compute_sim_state_min0.006100678622573738
sim_render-ego0_max0.003928487644306726
sim_render-ego0_mean0.003835405927938568
sim_render-ego0_median0.003857487147297093
sim_render-ego0_min0.003698161772853359
simulation-passed1
step_physics_max0.12210792569113296
step_physics_mean0.10733910222091166
step_physics_median0.10728939576113251
step_physics_min0.09266969167024865
survival_time_max59.99999999999873
survival_time_mean55.34999999999899
survival_time_min41.399999999999785
No reset possible
5677011301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:06:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5676111301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5670311280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:06:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5666511282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:29
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5579311422Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-041:18:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.001196471460364
survival_time_median59.99999999999873
deviation-center-line_median2.8284583824579927
in-drivable-lane_median0.2499999999999898


other stats
agent_compute-ego0_max0.0434517246995937
agent_compute-ego0_mean0.04133620250234993
agent_compute-ego0_median0.04133620250234993
agent_compute-ego0_min0.03922068030510616
agent_compute-ego1_max0.04113571490971472
agent_compute-ego1_mean0.039660957731077015
agent_compute-ego1_median0.039660957731077015
agent_compute-ego1_min0.03818620055243931
agent_compute-ego2_max0.04130372437311152
agent_compute-ego2_mean0.039903449079178456
agent_compute-ego2_median0.039903449079178456
agent_compute-ego2_min0.03850317378524539
agent_compute-ego3_max0.04162785472917517
agent_compute-ego3_mean0.03998899837020632
agent_compute-ego3_median0.03998899837020632
agent_compute-ego3_min0.03835014201123748
complete-iteration_max1.100057575128954
complete-iteration_mean1.0456525125074745
complete-iteration_median1.0456525125074745
complete-iteration_min0.9912474498859948
deviation-center-line_max6.993703781443878
deviation-center-line_mean4.01432596940849
deviation-center-line_min1.3112380783100015
deviation-heading_max42.18086494270505
deviation-heading_mean21.65934424154137
deviation-heading_median16.638001158592214
deviation-heading_min9.265108930633524
driven_any_max14.590333044504993
driven_any_mean7.933737918584841
driven_any_median8.415174702140996
driven_any_min0.5037835326522511
driven_lanedir_consec_max14.286955591091672
driven_lanedir_consec_mean7.614939087860101
driven_lanedir_consec_min0.4823308543395137
driven_lanedir_max14.286955591091672
driven_lanedir_mean7.639603581184144
driven_lanedir_median8.00119812087957
driven_lanedir_min0.4823308543395137
get_duckie_state_max1.6631730688700171e-06
get_duckie_state_mean1.633197044353501e-06
get_duckie_state_median1.633197044353501e-06
get_duckie_state_min1.6032210198369849e-06
get_robot_state_max0.013675853672075232
get_robot_state_mean0.01336395472511463
get_robot_state_median0.01336395472511463
get_robot_state_min0.013052055778154027
get_state_dump_max0.008855042707711631
get_state_dump_mean0.008716273863647105
get_state_dump_median0.008716273863647105
get_state_dump_min0.008577505019582578
get_ui_image_max0.047319682611216114
get_ui_image_mean0.04603338231651312
get_ui_image_median0.04603338231651312
get_ui_image_min0.04474708202181013
in-drivable-lane_max1.4499999999999948
in-drivable-lane_mean0.4499999999999942
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 14.590274250259988, "get_ui_image": 0.04474708202181013, "step_physics": 0.7188050036227872, "survival_time": 59.99999999999873, "driven_lanedir": 14.285870115338705, "get_state_dump": 0.008577505019582578, "get_robot_state": 0.013052055778154027, "sim_render-ego0": 0.003494517392262531, "sim_render-ego1": 0.0034540920432263073, "sim_render-ego2": 0.0034398982963593774, "sim_render-ego3": 0.0033926977702322648, "get_duckie_state": 1.6032210198369849e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.65141140471916, "agent_compute-ego0": 0.03922068030510616, "agent_compute-ego1": 0.03818620055243931, "agent_compute-ego2": 0.03850317378524539, "agent_compute-ego3": 0.03835014201123748, "complete-iteration": 0.9912474498859948, "set_robot_commands": 0.002200657481654895, "deviation-center-line": 2.869488261734872, "driven_lanedir_consec": 14.285870115338705, "sim_compute_sim_state": 0.022563375898642303, "sim_compute_performance-ego0": 0.0018572102577660505, "sim_compute_performance-ego1": 0.0017258140268571966, "sim_compute_performance-ego2": 0.0017548353844737132, "sim_compute_performance-ego3": 0.0017040061712463531}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 2.2400890986044524, "get_ui_image": 0.04474708202181013, "step_physics": 0.7188050036227872, "survival_time": 59.99999999999873, "driven_lanedir": 1.900791696912732, "get_state_dump": 0.008577505019582578, "get_robot_state": 0.013052055778154027, "sim_render-ego0": 0.003494517392262531, "sim_render-ego1": 0.0034540920432263073, "sim_render-ego2": 0.0034398982963593774, "sim_render-ego3": 0.0033926977702322648, "get_duckie_state": 1.6032210198369849e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 38.71500900662983, "agent_compute-ego0": 0.03922068030510616, "agent_compute-ego1": 0.03818620055243931, "agent_compute-ego2": 0.03850317378524539, "agent_compute-ego3": 0.03835014201123748, "complete-iteration": 0.9912474498859948, "set_robot_commands": 0.002200657481654895, "deviation-center-line": 6.000862773390881, "driven_lanedir_consec": 1.900791696912732, "sim_compute_sim_state": 0.022563375898642303, "sim_compute_performance-ego0": 0.0018572102577660505, "sim_compute_performance-ego1": 0.0017258140268571966, "sim_compute_performance-ego2": 0.0017548353844737132, "sim_compute_performance-ego3": 0.0017040061712463531}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 14.59026030567754, "get_ui_image": 0.04474708202181013, "step_physics": 0.7188050036227872, "survival_time": 59.99999999999873, "driven_lanedir": 14.286955591091672, "get_state_dump": 0.008577505019582578, "get_robot_state": 0.013052055778154027, "sim_render-ego0": 0.003494517392262531, "sim_render-ego1": 0.0034540920432263073, "sim_render-ego2": 0.0034398982963593774, "sim_render-ego3": 0.0033926977702322648, "get_duckie_state": 1.6032210198369849e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.77473756366386, "agent_compute-ego0": 0.03922068030510616, "agent_compute-ego1": 0.03818620055243931, "agent_compute-ego2": 0.03850317378524539, "agent_compute-ego3": 0.03835014201123748, "complete-iteration": 0.9912474498859948, "set_robot_commands": 0.002200657481654895, "deviation-center-line": 2.7783831944119246, "driven_lanedir_consec": 14.286955591091672, "sim_compute_sim_state": 0.022563375898642303, "sim_compute_performance-ego0": 0.0018572102577660505, "sim_compute_performance-ego1": 0.0017258140268571966, "sim_compute_performance-ego2": 0.0017548353844737132, "sim_compute_performance-ego3": 0.0017040061712463531}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.9929039380973048, "get_ui_image": 0.04474708202181013, "step_physics": 0.7188050036227872, "survival_time": 59.99999999999873, "driven_lanedir": 0.8491677542940025, "get_state_dump": 0.008577505019582578, "get_robot_state": 0.013052055778154027, "sim_render-ego0": 0.003494517392262531, "sim_render-ego1": 0.0034540920432263073, "sim_render-ego2": 0.0034398982963593774, "sim_render-ego3": 0.0033926977702322648, "get_duckie_state": 1.6032210198369849e-06, "in-drivable-lane": 0.14999999999999947, "deviation-heading": 42.18086494270505, "agent_compute-ego0": 0.03922068030510616, "agent_compute-ego1": 0.03818620055243931, "agent_compute-ego2": 0.03850317378524539, "agent_compute-ego3": 0.03835014201123748, "complete-iteration": 0.9912474498859948, "set_robot_commands": 0.002200657481654895, "deviation-center-line": 6.993703781443878, "driven_lanedir_consec": 0.6900128436534608, "sim_compute_sim_state": 0.022563375898642303, "sim_compute_performance-ego0": 0.0018572102577660505, "sim_compute_performance-ego1": 0.0017258140268571966, "sim_compute_performance-ego2": 0.0017548353844737132, "sim_compute_performance-ego3": 0.0017040061712463531}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 14.590333044504993, "get_ui_image": 0.047319682611216114, "step_physics": 0.8089637819873006, "survival_time": 59.99999999999873, "driven_lanedir": 14.247864647958828, "get_state_dump": 0.008855042707711631, "get_robot_state": 0.013675853672075232, "sim_render-ego0": 0.003673246758466557, "sim_render-ego1": 0.003691151775388694, "sim_render-ego2": 0.0036134283111851776, "sim_render-ego3": 0.0035780768509609913, "get_duckie_state": 1.6631730688700171e-06, "in-drivable-lane": 0.3499999999999801, "deviation-heading": 9.265108930633524, "agent_compute-ego0": 0.0434517246995937, "agent_compute-ego1": 0.04113571490971472, "agent_compute-ego2": 0.04130372437311152, "agent_compute-ego3": 0.04162785472917517, "complete-iteration": 1.100057575128954, "set_robot_commands": 0.002311091935207802, "deviation-center-line": 2.5364267256779445, "driven_lanedir_consec": 14.247863021476014, "sim_compute_sim_state": 0.022606725597461, "sim_compute_performance-ego0": 0.0019547657406796624, "sim_compute_performance-ego1": 0.0018836262819669728, "sim_compute_performance-ego2": 0.0018299334650730512, "sim_compute_performance-ego3": 0.0018846885449284815}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 14.59032274871394, "get_ui_image": 0.047319682611216114, "step_physics": 0.8089637819873006, "survival_time": 59.99999999999873, "driven_lanedir": 14.101604544846406, "get_state_dump": 0.008855042707711631, "get_robot_state": 0.013675853672075232, "sim_render-ego0": 0.003673246758466557, "sim_render-ego1": 0.003691151775388694, "sim_render-ego2": 0.0036134283111851776, "sim_render-ego3": 0.0035780768509609913, "get_duckie_state": 1.6631730688700171e-06, "in-drivable-lane": 0.7499999999999822, "deviation-heading": 10.034716398430716, "agent_compute-ego0": 0.0434517246995937, "agent_compute-ego1": 0.04113571490971472, "agent_compute-ego2": 0.04130372437311152, "agent_compute-ego3": 0.04162785472917517, "complete-iteration": 1.100057575128954, "set_robot_commands": 0.002311091935207802, "deviation-center-line": 2.787428503181114, "driven_lanedir_consec": 14.101601246007997, "sim_compute_sim_state": 0.022606725597461, "sim_compute_performance-ego0": 0.0019547657406796624, "sim_compute_performance-ego1": 0.0018836262819669728, "sim_compute_performance-ego2": 0.0018299334650730512, "sim_compute_performance-ego3": 0.0018846885449284815}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.5037835326522511, "get_ui_image": 0.047319682611216114, "step_physics": 0.8089637819873006, "survival_time": 59.99999999999873, "driven_lanedir": 0.4823308543395137, "get_state_dump": 0.008855042707711631, "get_robot_state": 0.013675853672075232, "sim_render-ego0": 0.003673246758466557, "sim_render-ego1": 0.003691151775388694, "sim_render-ego2": 0.0036134283111851776, "sim_render-ego3": 0.0035780768509609913, "get_duckie_state": 1.6631730688700171e-06, "in-drivable-lane": 0.0, "deviation-heading": 29.15164093202824, "agent_compute-ego0": 0.0434517246995937, "agent_compute-ego1": 0.04113571490971472, "agent_compute-ego2": 0.04130372437311152, "agent_compute-ego3": 0.04162785472917517, "complete-iteration": 1.100057575128954, "set_robot_commands": 0.002311091935207802, "deviation-center-line": 6.837076437117302, "driven_lanedir_consec": 0.4823308543395137, "sim_compute_sim_state": 0.022606725597461, "sim_compute_performance-ego0": 0.0019547657406796624, "sim_compute_performance-ego1": 0.0018836262819669728, "sim_compute_performance-ego2": 0.0018299334650730512, "sim_compute_performance-ego3": 0.0018846885449284815}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.3719364301682642, "get_ui_image": 0.047319682611216114, "step_physics": 0.8089637819873006, "survival_time": 59.99999999999873, "driven_lanedir": 0.96224344469129, "get_state_dump": 0.008855042707711631, "get_robot_state": 0.013675853672075232, "sim_render-ego0": 0.003673246758466557, "sim_render-ego1": 0.003691151775388694, "sim_render-ego2": 0.0036134283111851776, "sim_render-ego3": 0.0035780768509609913, "get_duckie_state": 1.6631730688700171e-06, "in-drivable-lane": 1.4499999999999948, "deviation-heading": 22.50126475352057, "agent_compute-ego0": 0.0434517246995937, "agent_compute-ego1": 0.04113571490971472, "agent_compute-ego2": 0.04130372437311152, "agent_compute-ego3": 0.04162785472917517, "complete-iteration": 1.100057575128954, "set_robot_commands": 0.002311091935207802, "deviation-center-line": 1.3112380783100015, "driven_lanedir_consec": 0.924087334060722, "sim_compute_sim_state": 0.022606725597461, "sim_compute_performance-ego0": 0.0019547657406796624, "sim_compute_performance-ego1": 0.0018836262819669728, "sim_compute_performance-ego2": 0.0018299334650730512, "sim_compute_performance-ego3": 0.0018846885449284815}}
set_robot_commands_max0.002311091935207802
set_robot_commands_mean0.002255874708431349
set_robot_commands_median0.002255874708431349
set_robot_commands_min0.002200657481654895
sim_compute_performance-ego0_max0.0019547657406796624
sim_compute_performance-ego0_mean0.0019059879992228564
sim_compute_performance-ego0_median0.0019059879992228564
sim_compute_performance-ego0_min0.0018572102577660505
sim_compute_performance-ego1_max0.0018836262819669728
sim_compute_performance-ego1_mean0.0018047201544120848
sim_compute_performance-ego1_median0.0018047201544120848
sim_compute_performance-ego1_min0.0017258140268571966
sim_compute_performance-ego2_max0.0018299334650730512
sim_compute_performance-ego2_mean0.0017923844247733822
sim_compute_performance-ego2_median0.0017923844247733822
sim_compute_performance-ego2_min0.0017548353844737132
sim_compute_performance-ego3_max0.0018846885449284815
sim_compute_performance-ego3_mean0.001794347358087417
sim_compute_performance-ego3_median0.001794347358087417
sim_compute_performance-ego3_min0.0017040061712463531
sim_compute_sim_state_max0.022606725597461
sim_compute_sim_state_mean0.02258505074805165
sim_compute_sim_state_median0.02258505074805165
sim_compute_sim_state_min0.022563375898642303
sim_render-ego0_max0.003673246758466557
sim_render-ego0_mean0.003583882075364544
sim_render-ego0_median0.003583882075364544
sim_render-ego0_min0.003494517392262531
sim_render-ego1_max0.003691151775388694
sim_render-ego1_mean0.0035726219093075006
sim_render-ego1_median0.0035726219093075006
sim_render-ego1_min0.0034540920432263073
sim_render-ego2_max0.0036134283111851776
sim_render-ego2_mean0.0035266633037722775
sim_render-ego2_median0.0035266633037722775
sim_render-ego2_min0.0034398982963593774
sim_render-ego3_max0.0035780768509609913
sim_render-ego3_mean0.003485387310596628
sim_render-ego3_median0.003485387310596628
sim_render-ego3_min0.0033926977702322648
simulation-passed1
step_physics_max0.8089637819873006
step_physics_mean0.7638843928050438
step_physics_median0.7638843928050438
step_physics_min0.7188050036227872
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5576211287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5573311299Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5538611222Charlie Gauthier 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:17:14
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6949189647539169
survival_time_median24.424999999999955
deviation-center-line_median0.4264026029731502
in-drivable-lane_median4.974999999999936


other stats
agent_compute-ego0_max0.012511794431221916
agent_compute-ego0_mean0.01156678554306296
agent_compute-ego0_median0.01148736191549894
agent_compute-ego0_min0.010780623910032046
complete-iteration_max0.2575604830469404
complete-iteration_mean0.21431315309241983
complete-iteration_median0.2123125667296731
complete-iteration_min0.17506699586339275
deviation-center-line_max1.1827859614915466
deviation-center-line_mean0.5419588561342562
deviation-center-line_min0.132244257099178
deviation-heading_max9.688947405776892
deviation-heading_mean4.223650961026495
deviation-heading_median3.1000687093442147
deviation-heading_min1.0055190196406605
driven_any_max7.916963499379584
driven_any_mean3.726054019261728
driven_any_median3.1013253205455364
driven_any_min0.7846019365762544
driven_lanedir_consec_max2.504958741527527
driven_lanedir_consec_mean1.0491087488881758
driven_lanedir_consec_min0.3016383245173424
driven_lanedir_max4.413436154788031
driven_lanedir_mean1.5311686028005125
driven_lanedir_median0.6949189647539169
driven_lanedir_min0.32140032690618425
get_duckie_state_max1.3598352291505149e-06
get_duckie_state_mean1.2921887088488757e-06
get_duckie_state_median1.2726505685033529e-06
get_duckie_state_min1.2636184692382812e-06
get_robot_state_max0.003620435355803452
get_robot_state_mean0.0035693561607257405
get_robot_state_median0.0035687732175930086
get_robot_state_min0.003519442851913491
get_state_dump_max0.004624545574188232
get_state_dump_mean0.0045157748036654625
get_state_dump_median0.004501514022393399
get_state_dump_min0.004435525595686818
get_ui_image_max0.033013531139918735
get_ui_image_mean0.027834028935855477
get_ui_image_median0.02719892456978852
get_ui_image_min0.02392473546392614
in-drivable-lane_max50.79999999999865
in-drivable-lane_mean15.862499999999628
in-drivable-lane_min2.6999999999999904
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.072931597638702, "get_ui_image": 0.024978659231850817, "step_physics": 0.1144548769822254, "survival_time": 39.24999999999991, "driven_lanedir": 4.413436154788031, "get_state_dump": 0.004435525595686818, "get_robot_state": 0.003519442851913491, "sim_render-ego0": 0.003661202413738532, "get_duckie_state": 1.3598352291505149e-06, "in-drivable-lane": 3.5499999999998657, "deviation-heading": 9.688947405776892, "agent_compute-ego0": 0.011731787492300718, "complete-iteration": 0.17506699586339275, "set_robot_commands": 0.002009405434586619, "deviation-center-line": 1.1827859614915466, "driven_lanedir_consec": 2.504958741527527, "sim_compute_sim_state": 0.008274450253590979, "sim_compute_performance-ego0": 0.001911931062169354}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7846019365762544, "get_ui_image": 0.033013531139918735, "step_physics": 0.18671972751617433, "survival_time": 6.949999999999983, "driven_lanedir": 0.4571169094198302, "get_state_dump": 0.004624545574188232, "get_robot_state": 0.003584270817892892, "sim_render-ego0": 0.0038669705390930176, "get_duckie_state": 1.2636184692382812e-06, "in-drivable-lane": 2.6999999999999904, "deviation-heading": 1.5408260462646548, "agent_compute-ego0": 0.01124293633869716, "complete-iteration": 0.2575604830469404, "set_robot_commands": 0.0022001470838274276, "deviation-center-line": 0.1442038465193749, "driven_lanedir_consec": 0.4571169094198302, "sim_compute_sim_state": 0.010163819789886477, "sim_compute_performance-ego0": 0.002061688899993897}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.129719043452371, "get_ui_image": 0.02941918990772623, "step_physics": 0.161890254737182, "survival_time": 9.6, "driven_lanedir": 0.32140032690618425, "get_state_dump": 0.004556075278959126, "get_robot_state": 0.0035532756172931257, "sim_render-ego0": 0.003736305730948176, "get_duckie_state": 1.2785659552855814e-06, "in-drivable-lane": 6.400000000000005, "deviation-heading": 1.0055190196406605, "agent_compute-ego0": 0.012511794431221916, "complete-iteration": 0.22782406041041556, "set_robot_commands": 0.0020502181868479043, "deviation-center-line": 0.132244257099178, "driven_lanedir_consec": 0.3016383245173424, "sim_compute_sim_state": 0.008118017967500835, "sim_compute_performance-ego0": 0.0019037686481377003}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.916963499379584, "get_ui_image": 0.02392473546392614, "step_physics": 0.1403603311581576, "survival_time": 59.99999999999873, "driven_lanedir": 0.9327210200880036, "get_state_dump": 0.004446952765827671, "get_robot_state": 0.003620435355803452, "sim_render-ego0": 0.0037392847345433166, "get_duckie_state": 1.2667351817211244e-06, "in-drivable-lane": 50.79999999999865, "deviation-heading": 4.659311372423774, "agent_compute-ego0": 0.010780623910032046, "complete-iteration": 0.19680107304893069, "set_robot_commands": 0.002076524381931378, "deviation-center-line": 0.7086013594269255, "driven_lanedir_consec": 0.9327210200880036, "sim_compute_sim_state": 0.005811624185528783, "sim_compute_performance-ego0": 0.0019624777181658716}}
set_robot_commands_max0.0022001470838274276
set_robot_commands_mean0.0020840737717983324
set_robot_commands_median0.0020633712843896412
set_robot_commands_min0.002009405434586619
sim_compute_performance-ego0_max0.002061688899993897
sim_compute_performance-ego0_mean0.0019599665821167056
sim_compute_performance-ego0_median0.0019372043901676127
sim_compute_performance-ego0_min0.0019037686481377003
sim_compute_sim_state_max0.010163819789886477
sim_compute_sim_state_mean0.008091978049126767
sim_compute_sim_state_median0.008196234110545906
sim_compute_sim_state_min0.005811624185528783
sim_render-ego0_max0.0038669705390930176
sim_render-ego0_mean0.0037509408545807607
sim_render-ego0_median0.003737795232745746
sim_render-ego0_min0.003661202413738532
simulation-passed1
step_physics_max0.18671972751617433
step_physics_mean0.15085629759843483
step_physics_median0.1511252929476698
step_physics_min0.1144548769822254
survival_time_max59.99999999999873
survival_time_mean28.949999999999655
survival_time_min6.949999999999983
No reset possible
5535111285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5530811307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:13
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5525011308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5523111308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5520511303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5518711303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:01:01
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5515611289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5510211290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5507911305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5505911311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:00:59
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5483311358Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:24:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6770371843428422
survival_time_median37.55
deviation-center-line_median0.6347324595072928
in-drivable-lane_median22.825000000000067


other stats
agent_compute-ego0_max0.04373193839309019
agent_compute-ego0_mean0.03200559171918487
agent_compute-ego0_median0.035982491756839076
agent_compute-ego0_min0.012325444969971134
complete-iteration_max0.2270316779613495
complete-iteration_mean0.20111431181026151
complete-iteration_median0.19609349904444123
complete-iteration_min0.1852385711908142
deviation-center-line_max1.2390892543755436
deviation-center-line_mean0.7554435089821052
deviation-center-line_min0.5132198625382919
deviation-heading_max5.353690211027596
deviation-heading_mean4.186482145253789
deviation-heading_median4.071346915555644
deviation-heading_min3.2495445388762754
driven_any_max12.378139835931984
driven_any_mean8.152244160804427
driven_any_median7.454557017261099
driven_any_min5.32172277276353
driven_lanedir_consec_max3.5708608011902108
driven_lanedir_consec_mean2.115008409604728
driven_lanedir_consec_min1.5350984685430151
driven_lanedir_max4.306776077176655
driven_lanedir_mean2.3808280852345787
driven_lanedir_median1.7553351463944669
driven_lanedir_min1.7058659709727269
get_duckie_state_max1.3054585924335557e-06
get_duckie_state_mean1.2236987691818e-06
get_duckie_state_median1.2098842999464055e-06
get_duckie_state_min1.1695678844008335e-06
get_robot_state_max0.003692118158626389
get_robot_state_mean0.0036377545902149862
get_robot_state_median0.0036433810887138863
get_robot_state_min0.0035721380248057853
get_state_dump_max0.004771140568396624
get_state_dump_mean0.004593856754208881
get_state_dump_median0.004560481618035099
get_state_dump_min0.004483323212368701
get_ui_image_max0.03456510499466297
get_ui_image_mean0.030164349995003947
get_ui_image_median0.030490158095419412
get_ui_image_min0.025111978794513993
in-drivable-lane_max50.34999999999913
in-drivable-lane_mean28.94999999999988
in-drivable-lane_min19.80000000000025
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.655916920815894, "get_ui_image": 0.02814747626874961, "step_physics": 0.10671081729963712, "survival_time": 40.74999999999982, "driven_lanedir": 4.306776077176655, "get_state_dump": 0.004771140568396624, "get_robot_state": 0.0036704572392444986, "sim_render-ego0": 0.003853524432462805, "get_duckie_state": 1.3054585924335557e-06, "in-drivable-lane": 21.049999999999965, "deviation-heading": 5.353690211027596, "agent_compute-ego0": 0.02934275655185475, "complete-iteration": 0.18965557246815928, "set_robot_commands": 0.0022715745018977744, "deviation-center-line": 1.2390892543755436, "driven_lanedir_consec": 3.5708608011902108, "sim_compute_sim_state": 0.008774799166941176, "sim_compute_performance-ego0": 0.0020239394085080015}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.253197113706304, "get_ui_image": 0.03456510499466297, "step_physics": 0.12264344546684, "survival_time": 34.350000000000186, "driven_lanedir": 1.7058659709727269, "get_state_dump": 0.0045029240292172095, "get_robot_state": 0.0036163049381832744, "sim_render-ego0": 0.0037738809058832567, "get_duckie_state": 1.1695678844008335e-06, "in-drivable-lane": 24.600000000000172, "deviation-heading": 4.717891471638124, "agent_compute-ego0": 0.0426222269618234, "complete-iteration": 0.2270316779613495, "set_robot_commands": 0.0021918450677117637, "deviation-center-line": 0.6864215381749612, "driven_lanedir_consec": 1.6406668362236512, "sim_compute_sim_state": 0.011138924332552178, "sim_compute_performance-ego0": 0.001889180998469508}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.32172277276353, "get_ui_image": 0.03283283992208921, "step_physics": 0.13066610541503476, "survival_time": 28.300000000000267, "driven_lanedir": 1.7134075324620337, "get_state_dump": 0.004618039206852989, "get_robot_state": 0.003692118158626389, "sim_render-ego0": 0.003932870464560426, "get_duckie_state": 1.2463362759383268e-06, "in-drivable-lane": 19.80000000000025, "deviation-heading": 3.424802359473163, "agent_compute-ego0": 0.012325444969971134, "complete-iteration": 0.20253142562072324, "set_robot_commands": 0.002223948322275959, "deviation-center-line": 0.5830433808396245, "driven_lanedir_consec": 1.7134075324620337, "sim_compute_sim_state": 0.010153481569239705, "sim_compute_performance-ego0": 0.001999574573792688}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.378139835931984, "get_ui_image": 0.025111978794513993, "step_physics": 0.09457029172721056, "survival_time": 59.99999999999873, "driven_lanedir": 1.7972627603269, "get_state_dump": 0.004483323212368701, "get_robot_state": 0.0035721380248057853, "sim_render-ego0": 0.003741176201838637, "get_duckie_state": 1.1734323239544845e-06, "in-drivable-lane": 50.34999999999913, "deviation-heading": 3.2495445388762754, "agent_compute-ego0": 0.04373193839309019, "complete-iteration": 0.1852385711908142, "set_robot_commands": 0.002190430694376797, "deviation-center-line": 0.5132198625382919, "driven_lanedir_consec": 1.5350984685430151, "sim_compute_sim_state": 0.005824156545977311, "sim_compute_performance-ego0": 0.0019283997426918404}}
set_robot_commands_max0.0022715745018977744
set_robot_commands_mean0.0022194496465655733
set_robot_commands_median0.002207896694993861
set_robot_commands_min0.002190430694376797
sim_compute_performance-ego0_max0.0020239394085080015
sim_compute_performance-ego0_mean0.0019602736808655096
sim_compute_performance-ego0_median0.0019639871582422643
sim_compute_performance-ego0_min0.001889180998469508
sim_compute_sim_state_max0.011138924332552178
sim_compute_sim_state_mean0.008972840403677592
sim_compute_sim_state_median0.00946414036809044
sim_compute_sim_state_min0.005824156545977311
sim_render-ego0_max0.003932870464560426
sim_render-ego0_mean0.0038253630011862807
sim_render-ego0_median0.0038137026691730303
sim_render-ego0_min0.003741176201838637
simulation-passed1
step_physics_max0.13066610541503476
step_physics_mean0.1136476649771806
step_physics_median0.11467713138323855
step_physics_min0.09457029172721056
survival_time_max59.99999999999873
survival_time_mean40.84999999999975
survival_time_min28.300000000000267
No reset possible
5478211364Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:08:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7278130405753896
survival_time_median11.65000000000003
deviation-center-line_median0.22322719136013244
in-drivable-lane_median4.975000000000003


other stats
agent_compute-ego0_max0.012557769479010637
agent_compute-ego0_mean0.012192364609040506
agent_compute-ego0_median0.012254515667350923
agent_compute-ego0_min0.011702657622449538
complete-iteration_max0.2085597978319441
complete-iteration_mean0.1802160278342016
complete-iteration_median0.17522491979643814
complete-iteration_min0.16185447391198607
deviation-center-line_max0.5646988585605588
deviation-center-line_mean0.29382527778078243
deviation-center-line_min0.16414786984230623
deviation-heading_max1.7494792660364629
deviation-heading_mean1.182707756723976
deviation-heading_median1.0949114181892785
deviation-heading_min0.7915289244808839
driven_any_max3.2173573031015694
driven_any_mean2.149667723493025
driven_any_median2.0543585474091173
driven_any_min1.2725964960522964
driven_lanedir_consec_max2.197130547097069
driven_lanedir_consec_mean1.0834369465955327
driven_lanedir_consec_min0.6809911581342825
driven_lanedir_max2.197130547097069
driven_lanedir_mean1.0834369465955327
driven_lanedir_median0.7278130405753896
driven_lanedir_min0.6809911581342825
get_duckie_state_max1.491819109235491e-06
get_duckie_state_mean1.37548978189965e-06
get_duckie_state_median1.37675638530864e-06
get_duckie_state_min1.2566272477458297e-06
get_robot_state_max0.003820019108908517
get_robot_state_mean0.003648794649159787
get_robot_state_median0.0036081400491241224
get_robot_state_min0.003558879389482386
get_state_dump_max0.004764076398343456
get_state_dump_mean0.004649781394898245
get_state_dump_median0.004638160141488364
get_state_dump_min0.004558728898272794
get_ui_image_max0.035695152282714845
get_ui_image_mean0.03019659650699301
get_ui_image_median0.029361075145814992
get_ui_image_min0.026369083453627193
in-drivable-lane_max15.950000000000154
in-drivable-lane_mean7.025000000000047
in-drivable-lane_min2.2000000000000313
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.448492432935204, "get_ui_image": 0.026369083453627193, "step_physics": 0.09899615803185632, "survival_time": 13.550000000000058, "driven_lanedir": 2.197130547097069, "get_state_dump": 0.004558728898272794, "get_robot_state": 0.003558879389482386, "sim_render-ego0": 0.0037265086875242345, "get_duckie_state": 1.2779937070958757e-06, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 1.7494792660364629, "agent_compute-ego0": 0.011702657622449538, "complete-iteration": 0.16235102713108063, "set_robot_commands": 0.0020808840499204747, "deviation-center-line": 0.5646988585605588, "driven_lanedir_consec": 2.197130547097069, "sim_compute_sim_state": 0.009366027572575738, "sim_compute_performance-ego0": 0.0019070883007610544}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2725964960522964, "get_ui_image": 0.035695152282714845, "step_physics": 0.13432929856436593, "survival_time": 8.699999999999989, "driven_lanedir": 0.7475312901629048, "get_state_dump": 0.004675408772059849, "get_robot_state": 0.0036107798985072544, "sim_render-ego0": 0.0038137449537004745, "get_duckie_state": 1.491819109235491e-06, "in-drivable-lane": 3.849999999999998, "deviation-heading": 1.3943652295318183, "agent_compute-ego0": 0.012201698848179407, "complete-iteration": 0.2085597978319441, "set_robot_commands": 0.002173628125871931, "deviation-center-line": 0.24139514449600263, "driven_lanedir_consec": 0.7475312901629048, "sim_compute_sim_state": 0.010020648411342077, "sim_compute_performance-ego0": 0.001948011943272182}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.2173573031015694, "get_ui_image": 0.03139156805244006, "step_physics": 0.11770005990986836, "survival_time": 19.900000000000148, "driven_lanedir": 0.7080947909878745, "get_state_dump": 0.004600911510916879, "get_robot_state": 0.003605500199740991, "sim_render-ego0": 0.003874003737791439, "get_duckie_state": 1.2566272477458297e-06, "in-drivable-lane": 15.950000000000154, "deviation-heading": 0.7954576068467382, "agent_compute-ego0": 0.012557769479010637, "complete-iteration": 0.1880988124617957, "set_robot_commands": 0.002134119956415698, "deviation-center-line": 0.20505923822426225, "driven_lanedir_consec": 0.7080947909878745, "sim_compute_sim_state": 0.010214309644579587, "sim_compute_performance-ego0": 0.0019332818817674067}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6602246618830303, "get_ui_image": 0.027330582239189927, "step_physics": 0.09969763123259252, "survival_time": 9.750000000000004, "driven_lanedir": 0.6809911581342825, "get_state_dump": 0.004764076398343456, "get_robot_state": 0.003820019108908517, "sim_render-ego0": 0.004058448635801977, "get_duckie_state": 1.4755190635214046e-06, "in-drivable-lane": 6.1000000000000085, "deviation-heading": 0.7915289244808839, "agent_compute-ego0": 0.01230733248652244, "complete-iteration": 0.16185447391198607, "set_robot_commands": 0.0023844290752800144, "deviation-center-line": 0.16414786984230623, "driven_lanedir_consec": 0.6809911581342825, "sim_compute_sim_state": 0.005350376878465925, "sim_compute_performance-ego0": 0.002049500844916519}}
set_robot_commands_max0.0023844290752800144
set_robot_commands_mean0.0021932653018720298
set_robot_commands_median0.002153874041143814
set_robot_commands_min0.0020808840499204747
sim_compute_performance-ego0_max0.002049500844916519
sim_compute_performance-ego0_mean0.0019594707426792905
sim_compute_performance-ego0_median0.0019406469125197944
sim_compute_performance-ego0_min0.0019070883007610544
sim_compute_sim_state_max0.010214309644579587
sim_compute_sim_state_mean0.008737840626740831
sim_compute_sim_state_median0.009693337991958907
sim_compute_sim_state_min0.005350376878465925
sim_render-ego0_max0.004058448635801977
sim_render-ego0_mean0.0038681765037045313
sim_render-ego0_median0.0038438743457459568
sim_render-ego0_min0.0037265086875242345
simulation-passed1
step_physics_max0.13432929856436593
step_physics_mean0.11268078693467078
step_physics_median0.10869884557123044
step_physics_min0.09899615803185632
survival_time_max19.900000000000148
survival_time_mean12.975000000000048
survival_time_min8.699999999999989
No reset possible
5475011378Martin Cote 🇨🇦template-rosaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:06:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5451554840690362
survival_time_median4.92499999999999
deviation-center-line_median0.13345829042078855
in-drivable-lane_median3.0499999999999923


other stats
agent_compute-ego0_max0.01361055374145508
agent_compute-ego0_mean0.01288306517050052
agent_compute-ego0_median0.012901349031943874
agent_compute-ego0_min0.012119008876659253
complete-iteration_max0.21818495061662463
complete-iteration_mean0.2045330378445976
complete-iteration_median0.2165565936056979
complete-iteration_min0.16683401355036984
deviation-center-line_max0.18018289117048128
deviation-center-line_mean0.13723283495574104
deviation-center-line_min0.10183186781090588
deviation-heading_max1.4803106035539149
deviation-heading_mean0.8063164578025408
deviation-heading_median0.6930242547627264
deviation-heading_min0.3589067181307953
driven_any_max1.6727987961684123
driven_any_mean1.2800301392697473
driven_any_median1.2028096038163008
driven_any_min1.0417025532779756
driven_lanedir_consec_max0.6553472666265712
driven_lanedir_consec_mean0.4830094378208671
driven_lanedir_consec_min0.18637951651882467
driven_lanedir_max0.6553472666265712
driven_lanedir_mean0.4830094378208671
driven_lanedir_median0.5451554840690362
driven_lanedir_min0.18637951651882467
get_duckie_state_max1.6718375973585174e-06
get_duckie_state_mean1.4041863985686742e-06
get_duckie_state_median1.3982808148419415e-06
get_duckie_state_min1.1483463672322965e-06
get_robot_state_max0.0038841591940985782
get_robot_state_mean0.003761602826252554
get_robot_state_median0.00377892985899597
get_robot_state_min0.0036043923929196977
get_state_dump_max0.005094721582200792
get_state_dump_mean0.004975341756027124
get_state_dump_median0.004996110993387662
get_state_dump_min0.004814423455132379
get_ui_image_max0.03549686265647958
get_ui_image_mean0.03143042948734189
get_ui_image_median0.03205302701732977
get_ui_image_min0.026118801258228443
in-drivable-lane_max3.649999999999987
in-drivable-lane_mean2.9749999999999908
in-drivable-lane_min2.1499999999999924
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.0417025532779756, "get_ui_image": 0.029528263138561713, "step_physics": 0.1472337362242908, "survival_time": 4.049999999999994, "driven_lanedir": 0.18637951651882467, "get_state_dump": 0.005022944473638767, "get_robot_state": 0.003835186725709496, "sim_render-ego0": 0.004001698842862758, "get_duckie_state": 1.6718375973585174e-06, "in-drivable-lane": 3.0999999999999934, "deviation-heading": 0.3589067181307953, "agent_compute-ego0": 0.01313266230792534, "complete-iteration": 0.2153949359568154, "set_robot_commands": 0.00221516737123815, "deviation-center-line": 0.10183186781090588, "driven_lanedir_consec": 0.18637951651882467, "sim_compute_sim_state": 0.00821685791015625, "sim_compute_performance-ego0": 0.0021066578423104636}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3364952151965803, "get_ui_image": 0.03549686265647958, "step_physics": 0.142837918132817, "survival_time": 5.399999999999989, "driven_lanedir": 0.4541460854576525, "get_state_dump": 0.004969277513136558, "get_robot_state": 0.0036043923929196977, "sim_render-ego0": 0.004023820982066864, "get_duckie_state": 1.1483463672322965e-06, "in-drivable-lane": 2.999999999999991, "deviation-heading": 1.4803106035539149, "agent_compute-ego0": 0.012670035755962409, "complete-iteration": 0.21771825125458044, "set_robot_commands": 0.0021627014930095147, "deviation-center-line": 0.18018289117048128, "driven_lanedir_consec": 0.4541460854576525, "sim_compute_sim_state": 0.00978299237172538, "sim_compute_performance-ego0": 0.0020782356962151484}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.069123992436021, "get_ui_image": 0.03457779089609782, "step_physics": 0.14366586473253035, "survival_time": 4.449999999999992, "driven_lanedir": 0.6361648826804199, "get_state_dump": 0.005094721582200792, "get_robot_state": 0.0038841591940985782, "sim_render-ego0": 0.00416712760925293, "get_duckie_state": 1.4702479044596357e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 0.4479327536970647, "agent_compute-ego0": 0.01361055374145508, "complete-iteration": 0.21818495061662463, "set_robot_commands": 0.0024563948313395183, "deviation-center-line": 0.16059094252208866, "driven_lanedir_consec": 0.6361648826804199, "sim_compute_sim_state": 0.00851940843794081, "sim_compute_performance-ego0": 0.0021044837103949654}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6727987961684123, "get_ui_image": 0.026118801258228443, "step_physics": 0.10650663552460848, "survival_time": 6.699999999999984, "driven_lanedir": 0.6553472666265712, "get_state_dump": 0.004814423455132379, "get_robot_state": 0.003722672992282443, "sim_render-ego0": 0.004041848359284578, "get_duckie_state": 1.3263137252242478e-06, "in-drivable-lane": 3.649999999999987, "deviation-heading": 0.9381157558283882, "agent_compute-ego0": 0.012119008876659253, "complete-iteration": 0.16683401355036984, "set_robot_commands": 0.0021772102073386863, "deviation-center-line": 0.1063256383194884, "driven_lanedir_consec": 0.6553472666265712, "sim_compute_sim_state": 0.005274728492454246, "sim_compute_performance-ego0": 0.0019701993023907697}}
set_robot_commands_max0.0024563948313395183
set_robot_commands_mean0.0022528684757314676
set_robot_commands_median0.0021961887892884184
set_robot_commands_min0.0021627014930095147
sim_compute_performance-ego0_max0.0021066578423104636
sim_compute_performance-ego0_mean0.0020648941378278367
sim_compute_performance-ego0_median0.0020913597033050567
sim_compute_performance-ego0_min0.0019701993023907697
sim_compute_sim_state_max0.00978299237172538
sim_compute_sim_state_mean0.007948496803069171
sim_compute_sim_state_median0.008368133174048529
sim_compute_sim_state_min0.005274728492454246
sim_render-ego0_max0.00416712760925293
sim_render-ego0_mean0.004058623948366783
sim_render-ego0_median0.004032834670675721
sim_render-ego0_min0.004001698842862758
simulation-passed1
step_physics_max0.1472337362242908
step_physics_mean0.13506103865356167
step_physics_median0.1432518914326737
step_physics_min0.10650663552460848
survival_time_max6.699999999999984
survival_time_mean5.14999999999999
survival_time_min4.049999999999994
No reset possible
5473211424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:01:04
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5468311387Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:03:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5465911449Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:24
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5465311449Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5459511435Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:03:35
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5458911439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:01:13
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5452711466Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:22:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1588834663186174
survival_time_median43.149999999999686
deviation-center-line_median0.5590286299736581
in-drivable-lane_median25.474999999999884


other stats
agent_compute-ego0_max0.012777048404207368
agent_compute-ego0_mean0.012570039581252468
agent_compute-ego0_median0.012538871969640182
agent_compute-ego0_min0.01242536598152214
complete-iteration_max0.22074610703474992
complete-iteration_mean0.19737849117074355
complete-iteration_median0.19983801606177296
complete-iteration_min0.16909182552467827
deviation-center-line_max1.4622540545780665
deviation-center-line_mean0.6889342339973374
deviation-center-line_min0.17542562146396712
deviation-heading_max5.759650819960426
deviation-heading_mean3.818575862356777
deviation-heading_median4.237270716965567
deviation-heading_min1.0401111955355478
driven_any_max10.95159382885002
driven_any_mean7.360554270294216
driven_any_median8.594278294155771
driven_any_min1.3020666640153016
driven_lanedir_consec_max4.340900383913199
driven_lanedir_consec_mean1.8217626805447504
driven_lanedir_consec_min0.6283834056285662
driven_lanedir_max5.434679973957967
driven_lanedir_mean2.1278049853211307
driven_lanedir_median1.2240782808489952
driven_lanedir_min0.6283834056285662
get_duckie_state_max1.3860233823197273e-06
get_duckie_state_mean1.3200831837415305e-06
get_duckie_state_median1.302536915143223e-06
get_duckie_state_min1.2892355223599483e-06
get_robot_state_max0.0037553449278896296
get_robot_state_mean0.003727412339469197
get_robot_state_median0.00372513169789776
get_robot_state_min0.0037040410341916386
get_state_dump_max0.004743856554628997
get_state_dump_mean0.004674765886579404
get_state_dump_median0.004677758694001561
get_state_dump_min0.004599689603685499
get_ui_image_max0.03711875001867335
get_ui_image_mean0.03147000165927464
get_ui_image_median0.031159601362964317
get_ui_image_min0.026442053892496577
in-drivable-lane_max51.74999999999889
in-drivable-lane_mean26.574999999999665
in-drivable-lane_min3.599999999999987
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.819967000931021, "get_ui_image": 0.02902882578495141, "step_physics": 0.12129800047103742, "survival_time": 37.99999999999998, "driven_lanedir": 5.434679973957967, "get_state_dump": 0.004737192948450397, "get_robot_state": 0.003736858768939346, "sim_render-ego0": 0.003838292872545441, "get_duckie_state": 1.3860233823197273e-06, "in-drivable-lane": 12.749999999999964, "deviation-heading": 5.3038939027677525, "agent_compute-ego0": 0.012777048404207368, "complete-iteration": 0.19070154044693935, "set_robot_commands": 0.002237394510838111, "deviation-center-line": 1.4622540545780665, "driven_lanedir_consec": 4.340900383913199, "sim_compute_sim_state": 0.010925758840533343, "sim_compute_performance-ego0": 0.002028388200075648}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3020666640153016, "get_ui_image": 0.03711875001867335, "step_physics": 0.1450628700789872, "survival_time": 7.099999999999983, "driven_lanedir": 0.6283834056285662, "get_state_dump": 0.004599689603685499, "get_robot_state": 0.0037040410341916386, "sim_render-ego0": 0.003741726175054803, "get_duckie_state": 1.3071340280812937e-06, "in-drivable-lane": 3.599999999999987, "deviation-heading": 1.0401111955355478, "agent_compute-ego0": 0.01242536598152214, "complete-iteration": 0.22074610703474992, "set_robot_commands": 0.0022638010811972453, "deviation-center-line": 0.17542562146396712, "driven_lanedir_consec": 0.6283834056285662, "sim_compute_sim_state": 0.00973650458809379, "sim_compute_performance-ego0": 0.0020040398711091154}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.95159382885002, "get_ui_image": 0.03329037694097722, "step_physics": 0.13423106760865067, "survival_time": 56.59999999999892, "driven_lanedir": 0.786672451877578, "get_state_dump": 0.004743856554628997, "get_robot_state": 0.0037553449278896296, "sim_render-ego0": 0.0038396577759327766, "get_duckie_state": 1.2979398022051525e-06, "in-drivable-lane": 51.74999999999889, "deviation-heading": 3.1706475311633806, "agent_compute-ego0": 0.012640685605876547, "complete-iteration": 0.20897449167660664, "set_robot_commands": 0.0022833812373566184, "deviation-center-line": 0.3260268779372609, "driven_lanedir_consec": 0.7584449158349745, "sim_compute_sim_state": 0.012064643592194762, "sim_compute_performance-ego0": 0.0020355620640942406}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.36858958738052, "get_ui_image": 0.026442053892496577, "step_physics": 0.10756235803172162, "survival_time": 48.29999999999939, "driven_lanedir": 1.6614841098204125, "get_state_dump": 0.004618324439552725, "get_robot_state": 0.003713404626856175, "sim_render-ego0": 0.003794889292278112, "get_duckie_state": 1.2892355223599483e-06, "in-drivable-lane": 38.19999999999981, "deviation-heading": 5.759650819960426, "agent_compute-ego0": 0.012437058333403816, "complete-iteration": 0.16909182552467827, "set_robot_commands": 0.0022322660641438466, "deviation-center-line": 0.7920303820100554, "driven_lanedir_consec": 1.5593220168022603, "sim_compute_sim_state": 0.006229225334238488, "sim_compute_performance-ego0": 0.001974923164422904}}
set_robot_commands_max0.0022833812373566184
set_robot_commands_mean0.0022542107233839556
set_robot_commands_median0.002250597796017678
set_robot_commands_min0.0022322660641438466
sim_compute_performance-ego0_max0.0020355620640942406
sim_compute_performance-ego0_mean0.002010728324925477
sim_compute_performance-ego0_median0.002016214035592382
sim_compute_performance-ego0_min0.001974923164422904
sim_compute_sim_state_max0.012064643592194762
sim_compute_sim_state_mean0.009739033088765095
sim_compute_sim_state_median0.010331131714313569
sim_compute_sim_state_min0.006229225334238488
sim_render-ego0_max0.0038396577759327766
sim_render-ego0_mean0.003803641528952783
sim_render-ego0_median0.003816591082411776
sim_render-ego0_min0.003741726175054803
simulation-passed1
step_physics_max0.1450628700789872
step_physics_mean0.12703857404759925
step_physics_median0.12776453403984406
step_physics_min0.10756235803172162
survival_time_max56.59999999999892
survival_time_mean37.49999999999957
survival_time_min7.099999999999983
No reset possible
5449211500Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:11:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7018837090059852
survival_time_median16.525000000000098
deviation-center-line_median0.27007772782961764
in-drivable-lane_median9.924999999999953


other stats
agent_compute-ego0_max0.012614068850665024
agent_compute-ego0_mean0.012194760876391705
agent_compute-ego0_median0.012228984971079267
agent_compute-ego0_min0.011707004712743252
complete-iteration_max0.21683472534860243
complete-iteration_mean0.18370079824310415
complete-iteration_median0.18152703762923225
complete-iteration_min0.15491439236534965
deviation-center-line_max1.5722608820549295
deviation-center-line_mean0.5693518478368788
deviation-center-line_min0.1649910536333504
deviation-heading_max6.219237584779776
deviation-heading_mean2.6652245003497668
deviation-heading_median1.7138263349792835
deviation-heading_min1.0140077466607238
driven_any_max7.390311649509728
driven_any_mean3.538586406251695
driven_any_median2.849609877860443
driven_any_min1.064814219776164
driven_lanedir_consec_max4.668178105569918
driven_lanedir_consec_mean1.6803955350067894
driven_lanedir_consec_min0.6496366164452694
driven_lanedir_max4.668178105569918
driven_lanedir_mean1.6836218489397137
driven_lanedir_median0.7067115277333788
driven_lanedir_min0.6528862347221789
get_duckie_state_max1.392364501953125e-06
get_duckie_state_mean1.3059675615369872e-06
get_duckie_state_median1.297166852789786e-06
get_duckie_state_min1.2371720386152508e-06
get_robot_state_max0.004038806510182609
get_robot_state_mean0.0038078769671540816
get_robot_state_median0.003788276170154506
get_robot_state_min0.003616149018124706
get_state_dump_max0.0047914559862255
get_state_dump_mean0.004721232136355481
get_state_dump_median0.004744992394215997
get_state_dump_min0.004603487770764434
get_ui_image_max0.03782154025046478
get_ui_image_mean0.03126136488069702
get_ui_image_median0.0300885643097592
get_ui_image_min0.027046790652804905
in-drivable-lane_max17.600000000000193
in-drivable-lane_mean10.050000000000022
in-drivable-lane_min2.7499999999999902
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.390311649509728, "get_ui_image": 0.02810710585083948, "step_physics": 0.09526054264784528, "survival_time": 35.65000000000011, "driven_lanedir": 4.668178105569918, "get_state_dump": 0.004603487770764434, "get_robot_state": 0.003616149018124706, "sim_render-ego0": 0.00368799649032892, "get_duckie_state": 1.2371720386152508e-06, "in-drivable-lane": 14.14999999999988, "deviation-heading": 6.219237584779776, "agent_compute-ego0": 0.011707004712743252, "complete-iteration": 0.16090505964615764, "set_robot_commands": 0.002170397453949231, "deviation-center-line": 1.5722608820549295, "driven_lanedir_consec": 4.668178105569918, "sim_compute_sim_state": 0.009697817620776948, "sim_compute_performance-ego0": 0.001961149755312281}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.684291846155222, "get_ui_image": 0.03782154025046478, "step_physics": 0.1390023153152824, "survival_time": 10.600000000000016, "driven_lanedir": 0.6666021169842522, "get_state_dump": 0.00476175070928296, "get_robot_state": 0.003848897459361474, "sim_render-ego0": 0.003898087801507941, "get_duckie_state": 1.3241745496579738e-06, "in-drivable-lane": 5.700000000000025, "deviation-heading": 2.3277897920829127, "agent_compute-ego0": 0.012614068850665024, "complete-iteration": 0.21683472534860243, "set_robot_commands": 0.0022461212856668823, "deviation-center-line": 0.36445055342542976, "driven_lanedir_consec": 0.656946479529465, "sim_compute_sim_state": 0.010454647977587205, "sim_compute_performance-ego0": 0.0020886116744207105}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.064814219776164, "get_ui_image": 0.032070022768678916, "step_physics": 0.13253363676830732, "survival_time": 5.599999999999988, "driven_lanedir": 0.6528862347221789, "get_state_dump": 0.0047914559862255, "get_robot_state": 0.004038806510182609, "sim_render-ego0": 0.003814853398145827, "get_duckie_state": 1.2701591559215984e-06, "in-drivable-lane": 2.7499999999999902, "deviation-heading": 1.0140077466607238, "agent_compute-ego0": 0.012335595831406854, "complete-iteration": 0.2021490156123069, "set_robot_commands": 0.0022298530139754306, "deviation-center-line": 0.1757049022338055, "driven_lanedir_consec": 0.6496366164452694, "sim_compute_sim_state": 0.008241953048030886, "sim_compute_performance-ego0": 0.001997171250064816}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.014927909565665, "get_ui_image": 0.027046790652804905, "step_physics": 0.09291008843315972, "survival_time": 22.450000000000184, "driven_lanedir": 0.7468209384825053, "get_state_dump": 0.004728234079149034, "get_robot_state": 0.003727654880947537, "sim_render-ego0": 0.003777619997660319, "get_duckie_state": 1.392364501953125e-06, "in-drivable-lane": 17.600000000000193, "deviation-heading": 1.099862877875654, "agent_compute-ego0": 0.012122374110751682, "complete-iteration": 0.15491439236534965, "set_robot_commands": 0.0022330506642659507, "deviation-center-line": 0.1649910536333504, "driven_lanedir_consec": 0.7468209384825053, "sim_compute_sim_state": 0.006287494765387641, "sim_compute_performance-ego0": 0.0019839143753051756}}
set_robot_commands_max0.0022461212856668823
set_robot_commands_mean0.002219855604464374
set_robot_commands_median0.00223145183912069
set_robot_commands_min0.002170397453949231
sim_compute_performance-ego0_max0.0020886116744207105
sim_compute_performance-ego0_mean0.002007711763775746
sim_compute_performance-ego0_median0.001990542812684996
sim_compute_performance-ego0_min0.001961149755312281
sim_compute_sim_state_max0.010454647977587205
sim_compute_sim_state_mean0.00867047835294567
sim_compute_sim_state_median0.008969885334403918
sim_compute_sim_state_min0.006287494765387641
sim_render-ego0_max0.003898087801507941
sim_render-ego0_mean0.003794639421910752
sim_render-ego0_median0.003796236697903073
sim_render-ego0_min0.00368799649032892
simulation-passed1
step_physics_max0.1390023153152824
step_physics_mean0.11492664579114868
step_physics_median0.1138970897080763
step_physics_min0.09291008843315972
survival_time_max35.65000000000011
survival_time_mean18.57500000000007
survival_time_min5.599999999999988
No reset possible
5442511544Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:30:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.613759218051278
survival_time_median59.99999999999873
deviation-center-line_median3.793594416968492
in-drivable-lane_median0.3499999999999801


other stats
agent_compute-ego0_max0.012278768641069271
agent_compute-ego0_mean0.01208386321931468
agent_compute-ego0_median0.012053342385653356
agent_compute-ego0_min0.011949999464882744
complete-iteration_max0.22089959719496705
complete-iteration_mean0.1962656717846593
complete-iteration_median0.19641981027604735
complete-iteration_min0.17132346939157556
deviation-center-line_max4.430795618164128
deviation-center-line_mean3.13534564693186
deviation-center-line_min0.5233981356263285
deviation-heading_max13.562004880282627
deviation-heading_mean10.377501739248167
deviation-heading_median12.575581098040365
deviation-heading_min2.796839880629305
driven_any_max12.691260212417172
driven_any_mean9.129073550517123
driven_any_median11.03629394892739
driven_any_min1.7524460917965483
driven_lanedir_consec_max12.20982847421566
driven_lanedir_consec_mean8.682713805257983
driven_lanedir_consec_min1.2935083107137135
driven_lanedir_max12.20982847421566
driven_lanedir_mean8.683529959698639
driven_lanedir_median10.613759218051278
driven_lanedir_min1.2967729284763394
get_duckie_state_max1.4497675963186602e-06
get_duckie_state_mean1.4314385752572482e-06
get_duckie_state_median1.4408026364478497e-06
get_duckie_state_min1.3943814318146335e-06
get_robot_state_max0.003968735916429912
get_robot_state_mean0.003805791533814588
get_robot_state_median0.00376096708025644
get_robot_state_min0.00373249605831556
get_state_dump_max0.005006159672034372
get_state_dump_mean0.004784655769224887
get_state_dump_median0.004750130972596231
get_state_dump_min0.0046322014596727155
get_ui_image_max0.035662283012015336
get_ui_image_mean0.0312057544892038
get_ui_image_median0.03124796024071585
get_ui_image_min0.02666481446336817
in-drivable-lane_max2.2000000000000313
in-drivable-lane_mean0.7249999999999979
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.691260212417172, "get_ui_image": 0.029085213298305285, "step_physics": 0.11421100920582691, "survival_time": 59.99999999999873, "driven_lanedir": 12.20982847421566, "get_state_dump": 0.004750387952488526, "get_robot_state": 0.0037680148681335703, "sim_render-ego0": 0.003827919273154126, "get_duckie_state": 1.3943814318146335e-06, "in-drivable-lane": 0.6999999999999602, "deviation-heading": 11.612998626221868, "agent_compute-ego0": 0.012096670644666432, "complete-iteration": 0.18189480124067803, "set_robot_commands": 0.0022594511856345906, "deviation-center-line": 3.3933689433125127, "driven_lanedir_consec": 12.20982847421566, "sim_compute_sim_state": 0.009748951183766945, "sim_compute_performance-ego0": 0.0020538367002234667}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.85611270421207, "get_ui_image": 0.035662283012015336, "step_physics": 0.14287282942137453, "survival_time": 59.99999999999873, "driven_lanedir": 10.432159991585578, "get_state_dump": 0.0047498739927039355, "get_robot_state": 0.00373249605831556, "sim_render-ego0": 0.003864974800891225, "get_duckie_state": 1.447782429132136e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.538163569858863, "agent_compute-ego0": 0.012010014126640276, "complete-iteration": 0.22089959719496705, "set_robot_commands": 0.002218961120148086, "deviation-center-line": 4.430795618164128, "driven_lanedir_consec": 10.432159991585578, "sim_compute_sim_state": 0.013619794535894974, "sim_compute_performance-ego0": 0.0020754720448058015}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.21647519364271, "get_ui_image": 0.03341070718312641, "step_physics": 0.1341255316627115, "survival_time": 59.99999999999873, "driven_lanedir": 10.79535844451698, "get_state_dump": 0.005006159672034372, "get_robot_state": 0.003968735916429912, "sim_render-ego0": 0.003997269915502137, "get_duckie_state": 1.4497675963186602e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.562004880282627, "agent_compute-ego0": 0.012278768641069271, "complete-iteration": 0.2109448193114167, "set_robot_commands": 0.002358452664326867, "deviation-center-line": 4.1938198906244715, "driven_lanedir_consec": 10.79535844451698, "sim_compute_sim_state": 0.01353608658669096, "sim_compute_performance-ego0": 0.002163607115352481}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7524460917965483, "get_ui_image": 0.02666481446336817, "step_physics": 0.11036686323307178, "survival_time": 10.750000000000018, "driven_lanedir": 1.2967729284763394, "get_state_dump": 0.0046322014596727155, "get_robot_state": 0.003753919292379309, "sim_render-ego0": 0.00381775697072347, "get_duckie_state": 1.4338228437635637e-06, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 2.796839880629305, "agent_compute-ego0": 0.011949999464882744, "complete-iteration": 0.17132346939157556, "set_robot_commands": 0.002401338683234321, "deviation-center-line": 0.5233981356263285, "driven_lanedir_consec": 1.2935083107137135, "sim_compute_sim_state": 0.005552318361070421, "sim_compute_performance-ego0": 0.002093702554702759}}
set_robot_commands_max0.002401338683234321
set_robot_commands_mean0.0023095509133359664
set_robot_commands_median0.002308951924980729
set_robot_commands_min0.002218961120148086
sim_compute_performance-ego0_max0.002163607115352481
sim_compute_performance-ego0_mean0.002096654603771127
sim_compute_performance-ego0_median0.00208458729975428
sim_compute_performance-ego0_min0.0020538367002234667
sim_compute_sim_state_max0.013619794535894974
sim_compute_sim_state_mean0.010614287666855824
sim_compute_sim_state_median0.011642518885228954
sim_compute_sim_state_min0.005552318361070421
sim_render-ego0_max0.003997269915502137
sim_render-ego0_mean0.00387698024006774
sim_render-ego0_median0.003846447037022675
sim_render-ego0_min0.00381775697072347
simulation-passed1
step_physics_max0.14287282942137453
step_physics_mean0.1253940583807462
step_physics_median0.1241682704342692
step_physics_min0.11036686323307178
survival_time_max59.99999999999873
survival_time_mean47.687499999999055
survival_time_min10.750000000000018
No reset possible
5442111624Anthony Courchesne 🇨🇦TNetR1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5442011624Anthony Courchesne 🇨🇦TNetR1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5441411624Anthony Courchesne 🇨🇦TNetR1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:02:24
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 35, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 51, in check_tensorflow_gpu
              ||     raise Exception(msg)
              || Exception: Could not find gpu device.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 35, in init
              || |     self.check_tensorflow_gpu()
              || |   File "solution.py", line 51, in check_tensorflow_gpu
              || |     raise Exception(msg)
              || | Exception: Could not find gpu device.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5427911607Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:37:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.6294552747299065
survival_time_median59.99999999999873
deviation-center-line_median2.2261958234121395
in-drivable-lane_median20.999999999999616


other stats
agent_compute-ego0_max0.013043543976808368
agent_compute-ego0_mean0.012267169198308212
agent_compute-ego0_median0.012172739869053418
agent_compute-ego0_min0.011679653078317642
complete-iteration_max0.21177613288536357
complete-iteration_mean0.1863605235706736
complete-iteration_median0.1900134785526457
complete-iteration_min0.15363900429203944
deviation-center-line_max3.8689677296057794
deviation-center-line_mean2.261521526042952
deviation-center-line_min0.7247267277417502
deviation-heading_max13.146511196887452
deviation-heading_mean9.02483209278465
deviation-heading_median9.046255763686949
deviation-heading_min4.860305646877247
driven_any_max13.426716048172992
driven_any_mean11.426193918744728
driven_any_median10.942020791440264
driven_any_min10.394018043925394
driven_lanedir_consec_max13.07530404337506
driven_lanedir_consec_mean7.067330301544568
driven_lanedir_consec_min1.9351066133433992
driven_lanedir_max13.07530404337506
driven_lanedir_mean7.149363705112494
driven_lanedir_median6.793522081865758
driven_lanedir_min1.9351066133433992
get_duckie_state_max1.4741851527129086e-06
get_duckie_state_mean1.365079752392967e-06
get_duckie_state_median1.3517995956636885e-06
get_duckie_state_min1.2825346655315825e-06
get_robot_state_max0.003961190891504089
get_robot_state_mean0.003686471945365005
get_robot_state_median0.0036472362046634822
get_robot_state_min0.0034902244806289673
get_state_dump_max0.004809093713561859
get_state_dump_mean0.00459254575909309
get_state_dump_median0.004570566323517827
get_state_dump_min0.004419956675774847
get_ui_image_max0.034122673498403026
get_ui_image_mean0.030224537292683377
get_ui_image_median0.031152180031469964
get_ui_image_min0.02447111560939055
in-drivable-lane_max48.449999999998774
in-drivable-lane_mean22.612499999999503
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 13.426716048172992, "get_ui_image": 0.02867469263513519, "step_physics": 0.11262286513373812, "survival_time": 59.99999999999873, "driven_lanedir": 13.07530404337506, "get_state_dump": 0.004681927873927489, "get_robot_state": 0.003740738670990727, "sim_render-ego0": 0.003755642512160277, "get_duckie_state": 1.4176078878969674e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.653769566977935, "agent_compute-ego0": 0.012565357103435126, "complete-iteration": 0.180059231488929, "set_robot_commands": 0.002206243543601056, "deviation-center-line": 2.99691441668432, "driven_lanedir_consec": 13.07530404337506, "sim_compute_sim_state": 0.009705925861266533, "sim_compute_performance-ego0": 0.002010968801480944}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.394018043925394, "get_ui_image": 0.03362966742780474, "step_physics": 0.12746607036226326, "survival_time": 57.54999999999887, "driven_lanedir": 4.074077647431004, "get_state_dump": 0.004459204773108165, "get_robot_state": 0.0034902244806289673, "sim_render-ego0": 0.0035675596445798874, "get_duckie_state": 1.2825346655315825e-06, "in-drivable-lane": 35.5499999999996, "deviation-heading": 6.43874196039596, "agent_compute-ego0": 0.011679653078317642, "complete-iteration": 0.19996772561636236, "set_robot_commands": 0.002055846775571505, "deviation-center-line": 1.455477230139959, "driven_lanedir_consec": 3.7459440331593017, "sim_compute_sim_state": 0.011677909849418534, "sim_compute_performance-ego0": 0.0018532942566606733}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.637444759905712, "get_ui_image": 0.034122673498403026, "step_physics": 0.1363506990110348, "survival_time": 59.99999999999873, "driven_lanedir": 1.9351066133433992, "get_state_dump": 0.004809093713561859, "get_robot_state": 0.003961190891504089, "sim_render-ego0": 0.00405058674173093, "get_duckie_state": 1.4741851527129086e-06, "in-drivable-lane": 48.449999999998774, "deviation-heading": 4.860305646877247, "agent_compute-ego0": 0.013043543976808368, "complete-iteration": 0.21177613288536357, "set_robot_commands": 0.0023871794231329034, "deviation-center-line": 0.7247267277417502, "driven_lanedir_consec": 1.9351066133433992, "sim_compute_sim_state": 0.010769115697335045, "sim_compute_performance-ego0": 0.002180480837921219}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.246596822974816, "get_ui_image": 0.02447111560939055, "step_physics": 0.0958567046801514, "survival_time": 59.99999999999873, "driven_lanedir": 9.512966516300512, "get_state_dump": 0.004419956675774847, "get_robot_state": 0.0035537337383362375, "sim_render-ego0": 0.0035604116422349864, "get_duckie_state": 1.2859913034304096e-06, "in-drivable-lane": 6.449999999999633, "deviation-heading": 13.146511196887452, "agent_compute-ego0": 0.01178012263467171, "complete-iteration": 0.15363900429203944, "set_robot_commands": 0.002060637883004499, "deviation-center-line": 3.8689677296057794, "driven_lanedir_consec": 9.512966516300512, "sim_compute_sim_state": 0.005943537353973008, "sim_compute_performance-ego0": 0.0019090022770788747}}
set_robot_commands_max0.0023871794231329034
set_robot_commands_mean0.0021774769063274907
set_robot_commands_median0.0021334407133027774
set_robot_commands_min0.002055846775571505
sim_compute_performance-ego0_max0.002180480837921219
sim_compute_performance-ego0_mean0.001988436543285428
sim_compute_performance-ego0_median0.00195998553927991
sim_compute_performance-ego0_min0.0018532942566606733
sim_compute_sim_state_max0.011677909849418534
sim_compute_sim_state_mean0.00952412219049828
sim_compute_sim_state_median0.010237520779300789
sim_compute_sim_state_min0.005943537353973008
sim_render-ego0_max0.00405058674173093
sim_render-ego0_mean0.00373355013517652
sim_render-ego0_median0.0036616010783700817
sim_render-ego0_min0.0035604116422349864
simulation-passed1
step_physics_max0.1363506990110348
step_physics_mean0.1180740847967969
step_physics_median0.1200444677480007
step_physics_min0.0958567046801514
survival_time_max59.99999999999873
survival_time_mean59.38749999999876
survival_time_min57.54999999999887
No reset possible
5420711633Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:19:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2083577857445946
survival_time_median29.699999999999967
deviation-center-line_median0.3796537933464144
in-drivable-lane_median13.149999999999824


other stats
agent_compute-ego0_max0.013627669407592476
agent_compute-ego0_mean0.013453323945976514
agent_compute-ego0_median0.013517629978824093
agent_compute-ego0_min0.013150366418665394
complete-iteration_max0.2185392034464869
complete-iteration_mean0.1950138271240137
complete-iteration_median0.19507407191522932
complete-iteration_min0.17136796121910922
deviation-center-line_max3.16990992768948
deviation-center-line_mean1.0007373168573528
deviation-center-line_min0.07373175304710272
deviation-heading_max10.644561824029733
deviation-heading_mean3.644646111662391
deviation-heading_median1.689503756501528
deviation-heading_min0.555015109616776
driven_any_max14.07821355351655
driven_any_mean7.085190614281724
driven_any_median6.47114149812514
driven_any_min1.3202659073600662
driven_lanedir_consec_max10.83204996704288
driven_lanedir_consec_mean3.465221390098563
driven_lanedir_consec_min0.6121200218621827
driven_lanedir_max10.83204996704288
driven_lanedir_mean3.465221390098563
driven_lanedir_median1.2083577857445946
driven_lanedir_min0.6121200218621827
get_duckie_state_max1.6159481472439236e-06
get_duckie_state_mean1.515357962995791e-06
get_duckie_state_median1.5127468081092218e-06
get_duckie_state_min1.4199900885207963e-06
get_robot_state_max0.004000986171608695
get_robot_state_mean0.0039041592935993106
get_robot_state_median0.003923199803436214
get_robot_state_min0.0037692513959161167
get_state_dump_max0.005093934413217271
get_state_dump_mean0.004989273739819211
get_state_dump_median0.004999527233255977
get_state_dump_min0.004864106079547618
get_ui_image_max0.0344796739775559
get_ui_image_mean0.030921487906893606
get_ui_image_median0.03126261352312128
get_ui_image_min0.02668105060377597
in-drivable-lane_max38.44999999999981
in-drivable-lane_mean17.13749999999986
in-drivable-lane_min3.7999999999999865
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.07821355351655, "get_ui_image": 0.02841724344931673, "step_physics": 0.11005288794276914, "survival_time": 59.99999999999873, "driven_lanedir": 10.83204996704288, "get_state_dump": 0.005000079501975486, "get_robot_state": 0.00393235991142076, "sim_render-ego0": 0.00393854271462319, "get_duckie_state": 1.4199900885207963e-06, "in-drivable-lane": 15.549999999999589, "deviation-heading": 10.644561824029733, "agent_compute-ego0": 0.013150366418665394, "complete-iteration": 0.17838101760235356, "set_robot_commands": 0.002300028201443865, "deviation-center-line": 3.16990992768948, "driven_lanedir_consec": 10.83204996704288, "sim_compute_sim_state": 0.009386516828322589, "sim_compute_performance-ego0": 0.002101823352556443}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3202659073600662, "get_ui_image": 0.0344796739775559, "step_physics": 0.14359245957999395, "survival_time": 7.199999999999982, "driven_lanedir": 0.6121200218621827, "get_state_dump": 0.00499897496453647, "get_robot_state": 0.0037692513959161167, "sim_render-ego0": 0.003974482108806742, "get_duckie_state": 1.5406773008149246e-06, "in-drivable-lane": 3.7999999999999865, "deviation-heading": 1.2901313134139532, "agent_compute-ego0": 0.013445671673478751, "complete-iteration": 0.2185392034464869, "set_robot_commands": 0.002295221131423424, "deviation-center-line": 0.2295501669252521, "driven_lanedir_consec": 0.6121200218621827, "sim_compute_sim_state": 0.009797165311616042, "sim_compute_performance-ego0": 0.0020832768801985115}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.995425118791032, "get_ui_image": 0.034107983596925816, "step_physics": 0.13415701602532612, "survival_time": 18.400000000000126, "driven_lanedir": 1.7550257821944657, "get_state_dump": 0.005093934413217271, "get_robot_state": 0.004000986171608695, "sim_render-ego0": 0.004184675087450643, "get_duckie_state": 1.6159481472439236e-06, "in-drivable-lane": 10.75000000000006, "deviation-heading": 2.088876199589103, "agent_compute-ego0": 0.013589588284169432, "complete-iteration": 0.2117671262281051, "set_robot_commands": 0.0024827024154869845, "deviation-center-line": 0.5297574197675767, "driven_lanedir_consec": 1.7550257821944657, "sim_compute_sim_state": 0.01175574816985505, "sim_compute_performance-ego0": 0.002287763244091334}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.946857877459248, "get_ui_image": 0.02668105060377597, "step_physics": 0.10743669731753462, "survival_time": 40.99999999999981, "driven_lanedir": 0.6616897892947233, "get_state_dump": 0.004864106079547618, "get_robot_state": 0.003914039695451669, "sim_render-ego0": 0.003985021059173323, "get_duckie_state": 1.484816315403519e-06, "in-drivable-lane": 38.44999999999981, "deviation-heading": 0.555015109616776, "agent_compute-ego0": 0.013627669407592476, "complete-iteration": 0.17136796121910922, "set_robot_commands": 0.0023837702283034516, "deviation-center-line": 0.07373175304710272, "driven_lanedir_consec": 0.6616897892947233, "sim_compute_sim_state": 0.006255551174410077, "sim_compute_performance-ego0": 0.0021207988915577006}}
set_robot_commands_max0.0024827024154869845
set_robot_commands_mean0.002365430494164431
set_robot_commands_median0.0023418992148736585
set_robot_commands_min0.002295221131423424
sim_compute_performance-ego0_max0.002287763244091334
sim_compute_performance-ego0_mean0.0021484155921009974
sim_compute_performance-ego0_median0.0021113111220570717
sim_compute_performance-ego0_min0.0020832768801985115
sim_compute_sim_state_max0.01175574816985505
sim_compute_sim_state_mean0.00929874537105094
sim_compute_sim_state_median0.009591841069969315
sim_compute_sim_state_min0.006255551174410077
sim_render-ego0_max0.004184675087450643
sim_render-ego0_mean0.004020680242513475
sim_render-ego0_median0.003979751583990033
sim_render-ego0_min0.00393854271462319
simulation-passed1
step_physics_max0.14359245957999395
step_physics_mean0.12380976521640596
step_physics_median0.12210495198404764
step_physics_min0.10743669731753462
survival_time_max59.99999999999873
survival_time_mean31.649999999999665
survival_time_min7.199999999999982
No reset possible
5413711653Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:30:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.527401877739733
survival_time_median59.99999999999873
deviation-center-line_median2.5385997546998884
in-drivable-lane_median14.44999999999951


other stats
agent_compute-ego0_max0.012745285312103094
agent_compute-ego0_mean0.012580704880589938
agent_compute-ego0_median0.012568919690414414
agent_compute-ego0_min0.012439694829427828
complete-iteration_max0.3107169070002121
complete-iteration_mean0.244550677870644
complete-iteration_median0.2315004850605147
complete-iteration_min0.20448483436133444
deviation-center-line_max4.093503479123582
deviation-center-line_mean2.480492462408426
deviation-center-line_min0.7512668611103476
deviation-heading_max17.36251042772277
deviation-heading_mean9.659691551588027
deviation-heading_median9.120920482637594
deviation-heading_min3.0344148133541564
driven_any_max11.406011766124024
driven_any_mean8.784538638327566
driven_any_median11.0376476092
driven_any_min1.6568475687862378
driven_lanedir_consec_max8.436505136358655
driven_lanedir_consec_mean4.722228505439965
driven_lanedir_consec_min1.397605129921739
driven_lanedir_max8.436505136358655
driven_lanedir_mean4.752485807234309
driven_lanedir_median4.5879164813284214
driven_lanedir_min1.397605129921739
get_duckie_state_max1.34415670199557e-06
get_duckie_state_mean1.3122421662955308e-06
get_duckie_state_median1.3055392538643495e-06
get_duckie_state_min1.293733455457854e-06
get_robot_state_max0.003895094867126184
get_robot_state_mean0.003831974850103011
get_robot_state_median0.003832934003984005
get_robot_state_min0.0037669365253178502
get_state_dump_max0.004747097393334736
get_state_dump_mean0.004704981485070704
get_state_dump_median0.004700039646012102
get_state_dump_min0.004672749254923875
get_ui_image_max0.038195223302885134
get_ui_image_mean0.03220416921035244
get_ui_image_median0.03164297426670021
get_ui_image_min0.02733550500512421
in-drivable-lane_max45.44999999999905
in-drivable-lane_mean18.974999999999525
in-drivable-lane_min1.550000000000022
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.406011766124024, "get_ui_image": 0.029490533418996843, "step_physics": 0.14757684208173538, "survival_time": 59.99999999999873, "driven_lanedir": 6.877355205055616, "get_state_dump": 0.0047077124164463776, "get_robot_state": 0.0037669365253178502, "sim_render-ego0": 0.00385589067584569, "get_duckie_state": 1.34415670199557e-06, "in-drivable-lane": 18.849999999999245, "deviation-heading": 13.476434926501549, "agent_compute-ego0": 0.012745285312103094, "complete-iteration": 0.21616913019667855, "set_robot_commands": 0.002339371237329996, "deviation-center-line": 3.4287122044181886, "driven_lanedir_consec": 6.877355205055616, "sim_compute_sim_state": 0.009512859617641426, "sim_compute_performance-ego0": 0.0020890865198877036}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6568475687862378, "get_ui_image": 0.038195223302885134, "step_physics": 0.23181731799780497, "survival_time": 10.800000000000018, "driven_lanedir": 1.397605129921739, "get_state_dump": 0.004747097393334736, "get_robot_state": 0.003895094867126184, "sim_render-ego0": 0.0039853390460739485, "get_duckie_state": 1.3173450522708454e-06, "in-drivable-lane": 1.550000000000022, "deviation-heading": 3.0344148133541564, "agent_compute-ego0": 0.012493485129923316, "complete-iteration": 0.3107169070002121, "set_robot_commands": 0.002319735865439138, "deviation-center-line": 0.7512668611103476, "driven_lanedir_consec": 1.397605129921739, "sim_compute_sim_state": 0.010974395110310498, "sim_compute_performance-ego0": 0.0022027459562099475}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.18519119181274, "get_ui_image": 0.033795415114403565, "step_physics": 0.17054037448270035, "survival_time": 59.99999999999873, "driven_lanedir": 8.436505136358655, "get_state_dump": 0.004672749254923875, "get_robot_state": 0.003828384794859366, "sim_render-ego0": 0.0039450143596512595, "get_duckie_state": 1.293733455457854e-06, "in-drivable-lane": 10.049999999999775, "deviation-heading": 17.36251042772277, "agent_compute-ego0": 0.012644354250905517, "complete-iteration": 0.24683183992435095, "set_robot_commands": 0.0023127981864046196, "deviation-center-line": 4.093503479123582, "driven_lanedir_consec": 8.436505136358655, "sim_compute_sim_state": 0.012855264963853568, "sim_compute_performance-ego0": 0.00215224937832822}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.89010402658726, "get_ui_image": 0.02733550500512421, "step_physics": 0.14152680368447285, "survival_time": 59.99999999999873, "driven_lanedir": 2.2984777576012276, "get_state_dump": 0.004692366875577826, "get_robot_state": 0.003837483213108644, "sim_render-ego0": 0.003860005927423355, "get_duckie_state": 1.293733455457854e-06, "in-drivable-lane": 45.44999999999905, "deviation-heading": 4.76540603877364, "agent_compute-ego0": 0.012439694829427828, "complete-iteration": 0.20448483436133444, "set_robot_commands": 0.002344718483663618, "deviation-center-line": 1.648487304981588, "driven_lanedir_consec": 2.17744855042385, "sim_compute_sim_state": 0.006290907665255862, "sim_compute_performance-ego0": 0.0020740504665835314}}
set_robot_commands_max0.002344718483663618
set_robot_commands_mean0.0023291559432093434
set_robot_commands_median0.002329553551384567
set_robot_commands_min0.0023127981864046196
sim_compute_performance-ego0_max0.0022027459562099475
sim_compute_performance-ego0_mean0.00212953308025235
sim_compute_performance-ego0_median0.002120667949107962
sim_compute_performance-ego0_min0.0020740504665835314
sim_compute_sim_state_max0.012855264963853568
sim_compute_sim_state_mean0.009908356839265338
sim_compute_sim_state_median0.010243627363975962
sim_compute_sim_state_min0.006290907665255862
sim_render-ego0_max0.0039853390460739485
sim_render-ego0_mean0.0039115625022485626
sim_render-ego0_median0.003902510143537307
sim_render-ego0_min0.00385589067584569
simulation-passed1
step_physics_max0.23181731799780497
step_physics_mean0.1728653345616784
step_physics_median0.15905860828221788
step_physics_min0.14152680368447285
survival_time_max59.99999999999873
survival_time_mean47.69999999999905
survival_time_min10.800000000000018
No reset possible
5408311670Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:18:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9576782365488303
survival_time_median31.525000000000297
deviation-center-line_median1.6337343814164234
in-drivable-lane_median11.100000000000133


other stats
agent_compute-ego0_max0.013903333642388467
agent_compute-ego0_mean0.013117632150867508
agent_compute-ego0_median0.013083085376905184
agent_compute-ego0_min0.012401024207271186
complete-iteration_max0.2677597029734466
complete-iteration_mean0.23940588392392473
complete-iteration_median0.24528725643782137
complete-iteration_min0.1992893198466096
deviation-center-line_max1.6921000252251646
deviation-center-line_mean1.3127647828929685
deviation-center-line_min0.29149034351386194
deviation-heading_max9.807446387998326
deviation-heading_mean6.629680449011582
deviation-heading_median7.907337046222915
deviation-heading_min0.8966013156021747
driven_any_max10.503479676664249
driven_any_mean7.184729641548875
driven_any_median8.094156924705397
driven_any_min2.0471250401204584
driven_lanedir_consec_max5.053941806227295
driven_lanedir_consec_mean2.9536644611654075
driven_lanedir_consec_min0.8453595653366757
driven_lanedir_max5.053941806227295
driven_lanedir_mean3.529742212717192
driven_lanedir_median4.109833739652399
driven_lanedir_min0.8453595653366757
get_duckie_state_max1.632561117915784e-06
get_duckie_state_mean1.4485653320372343e-06
get_duckie_state_median1.4331852558414983e-06
get_duckie_state_min1.2953296985501558e-06
get_robot_state_max0.004069933110037766
get_robot_state_mean0.003910594888449646
get_robot_state_median0.003902616131971336
get_robot_state_min0.003767214179818147
get_state_dump_max0.0052679487540897
get_state_dump_mean0.005026737685847196
get_state_dump_median0.005061627318494948
get_state_dump_min0.004715747352309186
get_ui_image_max0.03513658248772055
get_ui_image_mean0.03178278434591088
get_ui_image_median0.032423484713545565
get_ui_image_min0.02714758546883183
in-drivable-lane_max22.09999999999971
in-drivable-lane_mean12.337499999999991
in-drivable-lane_min5.049999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.35315294017711, "get_ui_image": 0.030108184125932497, "step_physics": 0.15761863397929343, "survival_time": 32.50000000000029, "driven_lanedir": 5.053941806227295, "get_state_dump": 0.005150314849642564, "get_robot_state": 0.003992003046788745, "sim_render-ego0": 0.00410002680601246, "get_duckie_state": 1.5147453812043972e-06, "in-drivable-lane": 11.100000000000112, "deviation-heading": 7.626161491207116, "agent_compute-ego0": 0.013439775795064947, "complete-iteration": 0.2293368627398794, "set_robot_commands": 0.002374195283459079, "deviation-center-line": 1.6921000252251646, "driven_lanedir_consec": 5.053941806227295, "sim_compute_sim_state": 0.010248384534305509, "sim_compute_performance-ego0": 0.0022063240660683534}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.835160909233684, "get_ui_image": 0.034738785301158634, "step_physics": 0.1851802592963175, "survival_time": 30.5500000000003, "driven_lanedir": 4.15662190890445, "get_state_dump": 0.004972939787347332, "get_robot_state": 0.003767214179818147, "sim_render-ego0": 0.0038477088890823664, "get_duckie_state": 1.2953296985501558e-06, "in-drivable-lane": 11.100000000000154, "deviation-heading": 9.807446387998326, "agent_compute-ego0": 0.01272639495874542, "complete-iteration": 0.26123765013576333, "set_robot_commands": 0.0023199347109576457, "deviation-center-line": 1.5946581837318778, "driven_lanedir_consec": 3.669933748085102, "sim_compute_sim_state": 0.01154498259226481, "sim_compute_performance-ego0": 0.0020485586590237087}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.0471250401204584, "get_ui_image": 0.03513658248772055, "step_physics": 0.19002093568360065, "survival_time": 8.79999999999999, "driven_lanedir": 0.8453595653366757, "get_state_dump": 0.0052679487540897, "get_robot_state": 0.004069933110037766, "sim_render-ego0": 0.004136113797203969, "get_duckie_state": 1.632561117915784e-06, "in-drivable-lane": 5.049999999999995, "deviation-heading": 0.8966013156021747, "agent_compute-ego0": 0.013903333642388467, "complete-iteration": 0.2677597029734466, "set_robot_commands": 0.0024343048785365907, "deviation-center-line": 0.29149034351386194, "driven_lanedir_consec": 0.8453595653366757, "sim_compute_sim_state": 0.010435167679005423, "sim_compute_performance-ego0": 0.0022510337290790796}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.503479676664249, "get_ui_image": 0.02714758546883183, "step_physics": 0.13664314345093523, "survival_time": 40.59999999999983, "driven_lanedir": 4.063045570400348, "get_state_dump": 0.004715747352309186, "get_robot_state": 0.003813229217153927, "sim_render-ego0": 0.003874018916637989, "get_duckie_state": 1.3516251304785997e-06, "in-drivable-lane": 22.09999999999971, "deviation-heading": 8.188512601238713, "agent_compute-ego0": 0.012401024207271186, "complete-iteration": 0.1992893198466096, "set_robot_commands": 0.0023415645843355712, "deviation-center-line": 1.6728105791009689, "driven_lanedir_consec": 2.245422725012558, "sim_compute_sim_state": 0.006221718453833098, "sim_compute_performance-ego0": 0.002041696768991768}}
set_robot_commands_max0.0024343048785365907
set_robot_commands_mean0.0023674998643222218
set_robot_commands_median0.002357879933897325
set_robot_commands_min0.0023199347109576457
sim_compute_performance-ego0_max0.0022510337290790796
sim_compute_performance-ego0_mean0.0021369033057907273
sim_compute_performance-ego0_median0.0021274413625460313
sim_compute_performance-ego0_min0.002041696768991768
sim_compute_sim_state_max0.01154498259226481
sim_compute_sim_state_mean0.00961256331485221
sim_compute_sim_state_median0.010341776106655466
sim_compute_sim_state_min0.006221718453833098
sim_render-ego0_max0.004136113797203969
sim_render-ego0_mean0.003989467102234196
sim_render-ego0_median0.0039870228613252245
sim_render-ego0_min0.0038477088890823664
simulation-passed1
step_physics_max0.19002093568360065
step_physics_mean0.1673657431025367
step_physics_median0.17139944663780549
step_physics_min0.13664314345093523
survival_time_max40.59999999999983
survival_time_mean28.112500000000104
survival_time_min8.79999999999999
No reset possible
5404411684Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:12:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3238502941096453
survival_time_median20.75000000000016
deviation-center-line_median0.6906317944125747
in-drivable-lane_median8.800000000000091


other stats
agent_compute-ego0_max0.014156773538872748
agent_compute-ego0_mean0.01314634917662562
agent_compute-ego0_median0.013030076944209124
agent_compute-ego0_min0.01236846927921148
complete-iteration_max0.29787238541337635
complete-iteration_mean0.2505771317617055
complete-iteration_median0.2496484444362772
complete-iteration_min0.20513925276089123
deviation-center-line_max1.4271668351914522
deviation-center-line_mean0.7517649534143709
deviation-center-line_min0.19862938964088167
deviation-heading_max5.648563218454463
deviation-heading_mean3.9466597630087983
deviation-heading_median4.671489512730057
deviation-heading_min0.7950968081206174
driven_any_max8.768199856378182
driven_any_mean6.486597426169696
driven_any_median7.816211348118941
driven_any_min1.5457671520627174
driven_lanedir_consec_max5.2930646785774425
driven_lanedir_consec_mean2.6772141531113594
driven_lanedir_consec_min0.7680913456487051
driven_lanedir_max5.2930646785774425
driven_lanedir_mean2.6935031256997526
driven_lanedir_median2.3564282392864317
driven_lanedir_min0.7680913456487051
get_duckie_state_max1.6062530045656814e-06
get_duckie_state_mean1.4600560744647675e-06
get_duckie_state_median1.4646601351563676e-06
get_duckie_state_min1.3046510229806532e-06
get_robot_state_max0.004037659447472375
get_robot_state_mean0.003936162486737167
get_robot_state_median0.004010483307705566
get_robot_state_min0.0036860238840651614
get_state_dump_max0.005311039919705735
get_state_dump_mean0.005098751504616143
get_state_dump_median0.005159569793057563
get_state_dump_min0.004764826512643708
get_ui_image_max0.03792037054435494
get_ui_image_mean0.03174549594272612
get_ui_image_median0.031440278737022494
get_ui_image_min0.026181055752504536
in-drivable-lane_max16.10000000000013
in-drivable-lane_mean9.050000000000075
in-drivable-lane_min2.499999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.381258985709438, "get_ui_image": 0.029564266269271437, "step_physics": 0.1754205447059494, "survival_time": 22.15000000000018, "driven_lanedir": 5.2930646785774425, "get_state_dump": 0.005025024349625046, "get_robot_state": 0.004037659447472375, "sim_render-ego0": 0.004101474542875547, "get_duckie_state": 1.4917270557300463e-06, "in-drivable-lane": 7.100000000000094, "deviation-heading": 5.648563218454463, "agent_compute-ego0": 0.012915034014899452, "complete-iteration": 0.24634655101879224, "set_robot_commands": 0.0024100585026783986, "deviation-center-line": 1.4271668351914522, "driven_lanedir_consec": 5.2930646785774425, "sim_compute_sim_state": 0.010461810472849251, "sim_compute_performance-ego0": 0.0023124443518148887}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.251163710528444, "get_ui_image": 0.03792037054435494, "step_physics": 0.21617052358450348, "survival_time": 19.35000000000014, "driven_lanedir": 2.614875563149798, "get_state_dump": 0.005311039919705735, "get_robot_state": 0.004035807147468489, "sim_render-ego0": 0.004123406311900345, "get_duckie_state": 1.6062530045656814e-06, "in-drivable-lane": 10.500000000000089, "deviation-heading": 5.091211246113547, "agent_compute-ego0": 0.013145119873518796, "complete-iteration": 0.29787238541337635, "set_robot_commands": 0.0024275294284230656, "deviation-center-line": 0.7746930384440945, "driven_lanedir_consec": 2.549719672796225, "sim_compute_sim_state": 0.012344439619595242, "sim_compute_performance-ego0": 0.0022865896372450995}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.5457671520627174, "get_ui_image": 0.03331629120477355, "step_physics": 0.17792591718163822, "survival_time": 4.99999999999999, "driven_lanedir": 0.7680913456487051, "get_state_dump": 0.0052941152364900795, "get_robot_state": 0.003985159467942644, "sim_render-ego0": 0.004072703937492748, "get_duckie_state": 1.4375932145826887e-06, "in-drivable-lane": 2.499999999999993, "deviation-heading": 0.7950968081206174, "agent_compute-ego0": 0.014156773538872748, "complete-iteration": 0.2529503378537622, "set_robot_commands": 0.0024625523255603146, "deviation-center-line": 0.19862938964088167, "driven_lanedir_consec": 0.7680913456487051, "sim_compute_sim_state": 0.009404071486822449, "sim_compute_performance-ego0": 0.0022303326295153927}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.768199856378182, "get_ui_image": 0.026181055752504536, "step_physics": 0.14421889249858938, "survival_time": 23.250000000000195, "driven_lanedir": 2.097980915423066, "get_state_dump": 0.004764826512643708, "get_robot_state": 0.0036860238840651614, "sim_render-ego0": 0.003746602156643192, "get_duckie_state": 1.3046510229806532e-06, "in-drivable-lane": 16.10000000000013, "deviation-heading": 4.251767779346568, "agent_compute-ego0": 0.01236846927921148, "complete-iteration": 0.20513925276089123, "set_robot_commands": 0.002255198269954567, "deviation-center-line": 0.6065705503810549, "driven_lanedir_consec": 2.097980915423066, "sim_compute_sim_state": 0.005864072255310582, "sim_compute_performance-ego0": 0.001969075509918606}}
set_robot_commands_max0.0024625523255603146
set_robot_commands_mean0.0023888346316540865
set_robot_commands_median0.002418793965550732
set_robot_commands_min0.002255198269954567
sim_compute_performance-ego0_max0.0023124443518148887
sim_compute_performance-ego0_mean0.0021996105321234966
sim_compute_performance-ego0_median0.002258461133380246
sim_compute_performance-ego0_min0.001969075509918606
sim_compute_sim_state_max0.012344439619595242
sim_compute_sim_state_mean0.00951859845864438
sim_compute_sim_state_median0.00993294097983585
sim_compute_sim_state_min0.005864072255310582
sim_render-ego0_max0.004123406311900345
sim_render-ego0_mean0.004011046737227958
sim_render-ego0_median0.004087089240184147
sim_render-ego0_min0.003746602156643192
simulation-passed1
step_physics_max0.21617052358450348
step_physics_mean0.1784339694926701
step_physics_median0.1766732309437938
step_physics_min0.14421889249858938
survival_time_max23.250000000000195
survival_time_mean17.437500000000128
survival_time_min4.99999999999999
No reset possible
5400011698Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-040:10:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5388511575Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:50:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median18.303633698642408
survival_time_median59.99999999999873
deviation-center-line_median3.3180867505965717
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.13478662727476656
agent_compute-ego0_mean0.11164448213616972
agent_compute-ego0_median0.1216293321263284
agent_compute-ego0_min0.06853263701725562
complete-iteration_max0.4267681871822334
complete-iteration_mean0.35875853045000616
complete-iteration_median0.3422990118236367
complete-iteration_min0.32366791097051795
deviation-center-line_max3.472099080552775
deviation-center-line_mean3.311910872128734
deviation-center-line_min3.139370906769015
deviation-heading_max17.205475785596317
deviation-heading_mean13.64863885856559
deviation-heading_median13.89557637714567
deviation-heading_min9.597926894374703
driven_any_max22.726335253997256
driven_any_mean19.32822924306029
driven_any_median18.99920130795308
driven_any_min16.58817910233773
driven_lanedir_consec_max22.307963397155383
driven_lanedir_consec_mean18.625951504033424
driven_lanedir_consec_min15.588575221693509
driven_lanedir_max22.307963397155383
driven_lanedir_mean18.625951504033424
driven_lanedir_median18.303633698642408
driven_lanedir_min15.588575221693509
get_duckie_state_max1.4376580764808625e-06
get_duckie_state_mean1.4146301371171808e-06
get_duckie_state_median1.4168138210223576e-06
get_duckie_state_min1.3872348299431465e-06
get_robot_state_max0.004071559636023122
get_robot_state_mean0.004034204298411679
get_robot_state_median0.004047863489384457
get_robot_state_min0.0039695305788546775
get_state_dump_max0.005357407610382664
get_state_dump_mean0.005096109830568871
get_state_dump_median0.005027465776638822
get_state_dump_min0.004972100158615176
get_ui_image_max0.04198649443754249
get_ui_image_mean0.03543335874312922
get_ui_image_median0.03416065341924053
get_ui_image_min0.03142563369649336
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 22.726335253997256, "get_ui_image": 0.033202925093664314, "step_physics": 0.14883290520317846, "survival_time": 59.99999999999873, "driven_lanedir": 22.307963397155383, "get_state_dump": 0.005357407610382664, "get_robot_state": 0.004071559636023122, "sim_render-ego0": 0.004139501784465196, "get_duckie_state": 1.4186004714902294e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.597926894374703, "agent_compute-ego0": 0.12125547104930004, "complete-iteration": 0.3321025855932307, "set_robot_commands": 0.002631337517604145, "deviation-center-line": 3.2564217121334385, "driven_lanedir_consec": 22.307963397155383, "sim_compute_sim_state": 0.010284624528527558, "sim_compute_performance-ego0": 0.002232819770793931}, "LF-norm-zigzag-000-ego0": {"driven_any": 19.43824582584689, "get_ui_image": 0.04198649443754249, "step_physics": 0.21767739808926673, "survival_time": 59.99999999999873, "driven_lanedir": 18.75990640889168, "get_state_dump": 0.004972100158615176, "get_robot_state": 0.004053783654968109, "sim_render-ego0": 0.004099170333836895, "get_duckie_state": 1.3872348299431465e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.632290201752683, "agent_compute-ego0": 0.13478662727476656, "complete-iteration": 0.4267681871822334, "set_robot_commands": 0.002595150699027869, "deviation-center-line": 3.472099080552775, "driven_lanedir_consec": 18.75990640889168, "sim_compute_sim_state": 0.014252023633374064, "sim_compute_performance-ego0": 0.0022521435867042766}, "LF-norm-techtrack-000-ego0": {"driven_any": 18.56015679005927, "get_ui_image": 0.03511838174481674, "step_physics": 0.18857691845826363, "survival_time": 59.99999999999873, "driven_lanedir": 17.84736098839313, "get_state_dump": 0.005020103684869237, "get_robot_state": 0.0039695305788546775, "sim_render-ego0": 0.004042395743402613, "get_duckie_state": 1.415027170554486e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.158862552538652, "agent_compute-ego0": 0.06853263701725562, "complete-iteration": 0.32366791097051795, "set_robot_commands": 0.0024634009098430955, "deviation-center-line": 3.379751789059705, "driven_lanedir_consec": 17.84736098839313, "sim_compute_sim_state": 0.013616130314302088, "sim_compute_performance-ego0": 0.002232239903458747}, "LF-norm-small_loop-000-ego0": {"driven_any": 16.58817910233773, "get_ui_image": 0.03142563369649336, "step_physics": 0.1743797330832501, "survival_time": 59.99999999999873, "driven_lanedir": 15.588575221693509, "get_state_dump": 0.005034827868408406, "get_robot_state": 0.004041943323800804, "sim_render-ego0": 0.004045357414328188, "get_duckie_state": 1.4376580764808625e-06, "in-drivable-lane": 0.0, "deviation-heading": 17.205475785596317, "agent_compute-ego0": 0.12200319320335674, "complete-iteration": 0.3524954380540427, "set_robot_commands": 0.0025506359055874053, "deviation-center-line": 3.139370906769015, "driven_lanedir_consec": 15.588575221693509, "sim_compute_sim_state": 0.006714536188841859, "sim_compute_performance-ego0": 0.0022074014916209556}}
set_robot_commands_max0.002631337517604145
set_robot_commands_mean0.002560131258015629
set_robot_commands_median0.002572893302307637
set_robot_commands_min0.0024634009098430955
sim_compute_performance-ego0_max0.0022521435867042766
sim_compute_performance-ego0_mean0.0022311511881444777
sim_compute_performance-ego0_median0.002232529837126339
sim_compute_performance-ego0_min0.0022074014916209556
sim_compute_sim_state_max0.014252023633374064
sim_compute_sim_state_mean0.011216828666261391
sim_compute_sim_state_median0.01195037742141482
sim_compute_sim_state_min0.006714536188841859
sim_render-ego0_max0.004139501784465196
sim_render-ego0_mean0.004081606319008223
sim_render-ego0_median0.004072263874082542
sim_render-ego0_min0.004042395743402613
simulation-passed1
step_physics_max0.21767739808926673
step_physics_mean0.18236673870848977
step_physics_median0.18147832577075687
step_physics_min0.14883290520317846
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5385211745Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:30:38
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1176, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 758, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5383211754Étienne Boucher 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:24:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.6505811809220288
survival_time_median47.29999999999945
deviation-center-line_median1.569473602115308
in-drivable-lane_median9.5249999999998


other stats
agent_compute-ego0_max0.013256715199631716
agent_compute-ego0_mean0.013055833064175298
agent_compute-ego0_median0.013071838964329474
agent_compute-ego0_min0.012822939128410524
complete-iteration_max0.26488514353589315
complete-iteration_mean0.21780144648639527
complete-iteration_median0.21611131904976552
complete-iteration_min0.17409800431015687
deviation-center-line_max3.3740821118594995
deviation-center-line_mean1.663355575247464
deviation-center-line_min0.14039298489974086
deviation-heading_max19.09704501568433
deviation-heading_mean7.640310636593178
deviation-heading_median5.247038947886603
deviation-heading_min0.9701196349151748
driven_any_max9.776721574967848
driven_any_mean6.283011185981482
driven_any_median7.446651985208247
driven_any_min0.4620191985415862
driven_lanedir_consec_max6.344415399046452
driven_lanedir_consec_mean2.966309284762583
driven_lanedir_consec_min0.21965937815982217
driven_lanedir_max6.3470860817167605
driven_lanedir_mean2.96697695543016
driven_lanedir_median2.6505811809220288
driven_lanedir_min0.21965937815982217
get_duckie_state_max1.6978292754202178e-06
get_duckie_state_mean1.6343501433127689e-06
get_duckie_state_median1.6280017165702313e-06
get_duckie_state_min1.5835678646903948e-06
get_robot_state_max0.004034673295369963
get_robot_state_mean0.00395575036519194
get_robot_state_median0.003959842983323093
get_robot_state_min0.00386864219875161
get_state_dump_max0.0050276401566296085
get_state_dump_mean0.004949265923790355
get_state_dump_median0.0049572748429824
get_state_dump_min0.0048548738525670135
get_ui_image_max0.037553124311493664
get_ui_image_mean0.03190470075829703
get_ui_image_median0.03181562700306016
get_ui_image_min0.02643442471557414
in-drivable-lane_max56.249999999998735
in-drivable-lane_mean19.349999999999586
in-drivable-lane_min2.0999999999999925
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.39973445746743, "get_ui_image": 0.02983883775144096, "step_physics": 0.14087156868298584, "survival_time": 59.99999999999873, "driven_lanedir": 0.4848789677484211, "get_state_dump": 0.0048548738525670135, "get_robot_state": 0.003955823992015321, "sim_render-ego0": 0.004007545339376305, "get_duckie_state": 1.6335940777908058e-06, "in-drivable-lane": 56.249999999998735, "deviation-heading": 1.9835630231391148, "agent_compute-ego0": 0.01290813989186664, "complete-iteration": 0.21124690398884055, "set_robot_commands": 0.0023488897169559424, "deviation-center-line": 0.40615110844889857, "driven_lanedir_consec": 0.4848789677484211, "sim_compute_sim_state": 0.010147347239828628, "sim_compute_performance-ego0": 0.0022200474036325525}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.4620191985415862, "get_ui_image": 0.037553124311493664, "step_physics": 0.1854580204661299, "survival_time": 4.049999999999994, "driven_lanedir": 0.21965937815982217, "get_state_dump": 0.0050276401566296085, "get_robot_state": 0.004034673295369963, "sim_render-ego0": 0.004271687530889743, "get_duckie_state": 1.622409355349657e-06, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 0.9701196349151748, "agent_compute-ego0": 0.012822939128410524, "complete-iteration": 0.26488514353589315, "set_robot_commands": 0.002394807047960235, "deviation-center-line": 0.14039298489974086, "driven_lanedir_consec": 0.21965937815982217, "sim_compute_sim_state": 0.01098148706482678, "sim_compute_performance-ego0": 0.002243356006901439}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.4935695129490645, "get_ui_image": 0.03379241625467936, "step_physics": 0.14348409014174776, "survival_time": 34.60000000000017, "driven_lanedir": 4.816283394095636, "get_state_dump": 0.004955542896045063, "get_robot_state": 0.003963861974630865, "sim_render-ego0": 0.004059984226419468, "get_duckie_state": 1.6978292754202178e-06, "in-drivable-lane": 3.1999999999999105, "deviation-heading": 8.51051487263409, "agent_compute-ego0": 0.013235538036792309, "complete-iteration": 0.2209757341106905, "set_robot_commands": 0.0023954516709452926, "deviation-center-line": 2.7327960957817172, "driven_lanedir_consec": 4.816283394095636, "sim_compute_sim_state": 0.0127396218876474, "sim_compute_performance-ego0": 0.0022473472881454756}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.776721574967848, "get_ui_image": 0.02643442471557414, "step_physics": 0.11069767838413767, "survival_time": 59.99999999999873, "driven_lanedir": 6.3470860817167605, "get_state_dump": 0.004959006789919737, "get_robot_state": 0.00386864219875161, "sim_render-ego0": 0.003911352078186086, "get_duckie_state": 1.5835678646903948e-06, "in-drivable-lane": 15.849999999999689, "deviation-heading": 19.09704501568433, "agent_compute-ego0": 0.013256715199631716, "complete-iteration": 0.17409800431015687, "set_robot_commands": 0.0023223420761705536, "deviation-center-line": 3.3740821118594995, "driven_lanedir_consec": 6.344415399046452, "sim_compute_sim_state": 0.006434178967757785, "sim_compute_performance-ego0": 0.002120514297167725}}
set_robot_commands_max0.0023954516709452926
set_robot_commands_mean0.002365372628008006
set_robot_commands_median0.002371848382458089
set_robot_commands_min0.0023223420761705536
sim_compute_performance-ego0_max0.0022473472881454756
sim_compute_performance-ego0_mean0.002207816248961798
sim_compute_performance-ego0_median0.002231701705266996
sim_compute_performance-ego0_min0.002120514297167725
sim_compute_sim_state_max0.0127396218876474
sim_compute_sim_state_mean0.010075658790015148
sim_compute_sim_state_median0.010564417152327702
sim_compute_sim_state_min0.006434178967757785
sim_render-ego0_max0.004271687530889743
sim_render-ego0_mean0.004062642293717901
sim_render-ego0_median0.004033764782897887
sim_render-ego0_min0.003911352078186086
simulation-passed1
step_physics_max0.1854580204661299
step_physics_mean0.1451278394187503
step_physics_median0.1421778294123668
step_physics_min0.11069767838413767
survival_time_max59.99999999999873
survival_time_mean39.662499999999405
survival_time_min4.049999999999994
No reset possible
5382511756Ayman Shams 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:03:37
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 109 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5381711757Ayman Shams 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-040:04:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 127 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5378011775Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:28:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.704895178305396
survival_time_median50.67499999999926
deviation-center-line_median1.5787990514614938
in-drivable-lane_median13.899999999999444


other stats
agent_compute-ego0_max0.013109714455074736
agent_compute-ego0_mean0.012755962695349806
agent_compute-ego0_median0.01303971390885406
agent_compute-ego0_min0.011834708508616364
complete-iteration_max0.24613679477713885
complete-iteration_mean0.21271148538199208
complete-iteration_median0.20687424909500848
complete-iteration_min0.1909606485608125
deviation-center-line_max3.565165738298228
deviation-center-line_mean1.711285915388815
deviation-center-line_min0.12237982033404415
deviation-heading_max14.13470120403198
deviation-heading_mean7.495214001566635
deviation-heading_median7.52205808366578
deviation-heading_min0.8020386349029999
driven_any_max11.731286532485685
driven_any_mean8.337513726403172
driven_any_median9.962021199860342
driven_any_min1.694725973406324
driven_lanedir_consec_max9.333171035264687
driven_lanedir_consec_mean4.8516149517581475
driven_lanedir_consec_min0.6634984151571057
driven_lanedir_max9.333171035264687
driven_lanedir_mean4.860798708099724
driven_lanedir_median4.723262690988551
driven_lanedir_min0.6634984151571057
get_duckie_state_max1.836279647534932e-06
get_duckie_state_mean1.7089379441276994e-06
get_duckie_state_median1.7291378407251268e-06
get_duckie_state_min1.541196447525612e-06
get_robot_state_max0.0042134934001498755
get_robot_state_mean0.004084858002377232
get_robot_state_median0.004087957007002005
get_robot_state_min0.003950024595355043
get_state_dump_max0.005497146977318658
get_state_dump_mean0.005315675972383929
get_state_dump_median0.005359434507467297
get_state_dump_min0.005046687897282465
get_ui_image_max0.03831279883277505
get_ui_image_mean0.03270241274020253
get_ui_image_median0.031917421047054854
get_ui_image_min0.028662010033925375
in-drivable-lane_max38.9999999999993
in-drivable-lane_mean18.212499999999547
in-drivable-lane_min6.0499999999999945
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.926808889340785, "get_ui_image": 0.028960395829774627, "step_physics": 0.1231150233706232, "survival_time": 45.39999999999956, "driven_lanedir": 6.260369135831893, "get_state_dump": 0.005046687897282465, "get_robot_state": 0.003950024595355043, "sim_render-ego0": 0.003967669406215219, "get_duckie_state": 1.541196447525612e-06, "in-drivable-lane": 16.449999999999395, "deviation-heading": 8.054382225087389, "agent_compute-ego0": 0.011834708508616364, "complete-iteration": 0.1909606485608125, "set_robot_commands": 0.002339185005498536, "deviation-center-line": 1.8161493297639932, "driven_lanedir_consec": 6.223634110465582, "sim_compute_sim_state": 0.009461471349886149, "sim_compute_performance-ego0": 0.002194162773745026}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.731286532485685, "get_ui_image": 0.03831279883277505, "step_physics": 0.16114984960182818, "survival_time": 59.99999999999873, "driven_lanedir": 9.333171035264687, "get_state_dump": 0.0054709893479930865, "get_robot_state": 0.004138849061494266, "sim_render-ego0": 0.0042198055689777565, "get_duckie_state": 1.836279647534932e-06, "in-drivable-lane": 11.349999999999492, "deviation-heading": 14.13470120403198, "agent_compute-ego0": 0.013055574089958706, "complete-iteration": 0.24613679477713885, "set_robot_commands": 0.0024287390966995074, "deviation-center-line": 3.565165738298228, "driven_lanedir_consec": 9.333171035264687, "sim_compute_sim_state": 0.014916222657291816, "sim_compute_performance-ego0": 0.0023397369051257537}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.9972335103799, "get_ui_image": 0.034874446264335085, "step_physics": 0.13752006952251708, "survival_time": 55.94999999999896, "driven_lanedir": 3.1861562461452086, "get_state_dump": 0.005247879666941507, "get_robot_state": 0.004037064952509744, "sim_render-ego0": 0.004108177764075143, "get_duckie_state": 1.666162695203509e-06, "in-drivable-lane": 38.9999999999993, "deviation-heading": 6.989733942244172, "agent_compute-ego0": 0.013023853727749416, "complete-iteration": 0.2181054745401655, "set_robot_commands": 0.002389516574995858, "deviation-center-line": 1.341448773158994, "driven_lanedir_consec": 3.1861562461452086, "sim_compute_sim_state": 0.014537738263607025, "sim_compute_performance-ego0": 0.0022614517382213047}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.694725973406324, "get_ui_image": 0.028662010033925375, "step_physics": 0.129136500093672, "survival_time": 8.949999999999992, "driven_lanedir": 0.6634984151571057, "get_state_dump": 0.005497146977318658, "get_robot_state": 0.0042134934001498755, "sim_render-ego0": 0.0042775988578796385, "get_duckie_state": 1.7921129862467448e-06, "in-drivable-lane": 6.0499999999999945, "deviation-heading": 0.8020386349029999, "agent_compute-ego0": 0.013109714455074736, "complete-iteration": 0.19564302364985148, "set_robot_commands": 0.0025352014435662163, "deviation-center-line": 0.12237982033404415, "driven_lanedir_consec": 0.6634984151571057, "sim_compute_sim_state": 0.005825771225823296, "sim_compute_performance-ego0": 0.0022811055183410644}}
set_robot_commands_max0.0025352014435662163
set_robot_commands_mean0.002423160530190029
set_robot_commands_median0.002409127835847683
set_robot_commands_min0.002339185005498536
sim_compute_performance-ego0_max0.0023397369051257537
sim_compute_performance-ego0_mean0.0022691142338582874
sim_compute_performance-ego0_median0.0022712786282811847
sim_compute_performance-ego0_min0.002194162773745026
sim_compute_sim_state_max0.014916222657291816
sim_compute_sim_state_mean0.011185300874152072
sim_compute_sim_state_median0.011999604806746588
sim_compute_sim_state_min0.005825771225823296
sim_render-ego0_max0.0042775988578796385
sim_render-ego0_mean0.00414331289928694
sim_render-ego0_median0.004163991666526449
sim_render-ego0_min0.003967669406215219
simulation-passed1
step_physics_max0.16114984960182818
step_physics_mean0.1377303606471601
step_physics_median0.13332828480809455
step_physics_min0.1231150233706232
survival_time_max59.99999999999873
survival_time_mean42.57499999999931
survival_time_min8.949999999999992
No reset possible
5375811777Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-040:17:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9961358231500235
survival_time_median24.07500000000021
deviation-center-line_median1.319057554112669
in-drivable-lane_median12.22499999999988


other stats
agent_compute-ego0_max0.013265286722490863
agent_compute-ego0_mean0.012803809897330707
agent_compute-ego0_median0.012974765475047346
agent_compute-ego0_min0.012000421916737275
complete-iteration_max0.24798810770223428
complete-iteration_mean0.2050420442255061
complete-iteration_median0.20494376935494352
complete-iteration_min0.16229253048990286
deviation-center-line_max1.9165275105878985
deviation-center-line_mean1.1765917534537584
deviation-center-line_min0.1517243950017974
deviation-heading_max7.653836352743865
deviation-heading_mean4.319339819083024
deviation-heading_median4.384133919347862
deviation-heading_min0.8552550848925035
driven_any_max8.389182948098837
driven_any_mean5.643180932634992
driven_any_median5.020946100250109
driven_any_min4.141648581940915
driven_lanedir_consec_max5.617035952005122
driven_lanedir_consec_mean3.065309467808618
driven_lanedir_consec_min0.6519302729293031
driven_lanedir_max5.617035952005122
driven_lanedir_mean3.065309467808618
driven_lanedir_median2.9961358231500235
driven_lanedir_min0.6519302729293031
get_duckie_state_max2.301914591184804e-06
get_duckie_state_mean2.187145926709171e-06
get_duckie_state_median2.1986021550992247e-06
get_duckie_state_min2.0494648054534313e-06
get_robot_state_max0.004040735370510227
get_robot_state_mean0.00382555947453138
get_robot_state_median0.003813842511590634
get_robot_state_min0.0036338175044340246
get_state_dump_max0.00602806649787846
get_state_dump_mean0.005293941596222242
get_state_dump_median0.005075135366640788
get_state_dump_min0.004997429153728933
get_ui_image_max0.03809637866177402
get_ui_image_mean0.03114453996909529
get_ui_image_median0.030846315796826704
get_ui_image_min0.02478914962095373
in-drivable-lane_max22.30000000000023
in-drivable-lane_mean12.687500000000012
in-drivable-lane_min4.000000000000057
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.389182948098837, "get_ui_image": 0.02824823258828289, "step_physics": 0.11782988573126404, "survival_time": 40.24999999999985, "driven_lanedir": 5.617035952005122, "get_state_dump": 0.00602806649787846, "get_robot_state": 0.003747017448652471, "sim_render-ego0": 0.004079769622007612, "get_duckie_state": 2.1235818602606915e-06, "in-drivable-lane": 14.649999999999622, "deviation-heading": 7.653836352743865, "agent_compute-ego0": 0.013265286722490863, "complete-iteration": 0.1878702566582275, "set_robot_commands": 0.0023048622140813407, "deviation-center-line": 1.9165275105878985, "driven_lanedir_consec": 5.617035952005122, "sim_compute_sim_state": 0.010123795078646752, "sim_compute_performance-ego0": 0.002146109162134213}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.643895906935303, "get_ui_image": 0.03809637866177402, "step_physics": 0.16729088196387656, "survival_time": 22.700000000000188, "driven_lanedir": 3.737349624031707, "get_state_dump": 0.005148518216478956, "get_robot_state": 0.004040735370510227, "sim_render-ego0": 0.004083131433843257, "get_duckie_state": 2.2736224499377575e-06, "in-drivable-lane": 4.000000000000057, "deviation-heading": 5.4885704225762, "agent_compute-ego0": 0.012745394025530134, "complete-iteration": 0.24798810770223428, "set_robot_commands": 0.002420538074367649, "deviation-center-line": 1.595850372187255, "driven_lanedir_consec": 3.737349624031707, "sim_compute_sim_state": 0.0118452936738402, "sim_compute_performance-ego0": 0.0022116629631964715}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.141648581940915, "get_ui_image": 0.03344439900537052, "step_physics": 0.1465164988253598, "survival_time": 21.250000000000167, "driven_lanedir": 2.2549220222683406, "get_state_dump": 0.004997429153728933, "get_robot_state": 0.0038806675745287978, "sim_render-ego0": 0.004010076254186496, "get_duckie_state": 2.301914591184804e-06, "in-drivable-lane": 9.80000000000014, "deviation-heading": 3.279697416119525, "agent_compute-ego0": 0.01320413692456456, "complete-iteration": 0.22201728205165952, "set_robot_commands": 0.0024454985426065508, "deviation-center-line": 1.0422647360380832, "driven_lanedir_consec": 2.2549220222683406, "sim_compute_sim_state": 0.01125729307882103, "sim_compute_performance-ego0": 0.0021549211421483}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.397996293564915, "get_ui_image": 0.02478914962095373, "step_physics": 0.10310427581562716, "survival_time": 25.450000000000227, "driven_lanedir": 0.6519302729293031, "get_state_dump": 0.00500175251680262, "get_robot_state": 0.0036338175044340246, "sim_render-ego0": 0.003712120710634718, "get_duckie_state": 2.0494648054534313e-06, "in-drivable-lane": 22.30000000000023, "deviation-heading": 0.8552550848925035, "agent_compute-ego0": 0.012000421916737275, "complete-iteration": 0.16229253048990286, "set_robot_commands": 0.002181595914504107, "deviation-center-line": 0.1517243950017974, "driven_lanedir_consec": 0.6519302729293031, "sim_compute_sim_state": 0.005839315582724178, "sim_compute_performance-ego0": 0.001936480110766841}}
set_robot_commands_max0.0024454985426065508
set_robot_commands_mean0.002338123686389912
set_robot_commands_median0.002362700144224495
set_robot_commands_min0.002181595914504107
sim_compute_performance-ego0_max0.0022116629631964715
sim_compute_performance-ego0_mean0.0021122933445614565
sim_compute_performance-ego0_median0.0021505151521412566
sim_compute_performance-ego0_min0.001936480110766841
sim_compute_sim_state_max0.0118452936738402
sim_compute_sim_state_mean0.00976642435350804
sim_compute_sim_state_median0.01069054407873389
sim_compute_sim_state_min0.005839315582724178
sim_render-ego0_max0.004083131433843257
sim_render-ego0_mean0.003971274505168021
sim_render-ego0_median0.004044922938097054
sim_render-ego0_min0.003712120710634718
simulation-passed1
step_physics_max0.16729088196387656
step_physics_mean0.1336853855840319
step_physics_median0.13217319227831192
step_physics_min0.10310427581562716
survival_time_max40.24999999999985
survival_time_mean27.412500000000108
survival_time_min21.250000000000167
No reset possible
5372411867Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-040:10:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5371812322Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-040:01:45
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5368412718Bea Baselines 🐤template-randomaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessyesnogpu-prod-040:12:19
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6824877811914045
survival_time_median5.899999999999987
deviation-center-line_median0.12472377253302876
in-drivable-lane_median3.4999999999999876


other stats
agent_compute-ego0_max0.012178316116333007
agent_compute-ego0_mean0.011000330345112594
agent_compute-ego0_median0.011033596311296736
agent_compute-ego0_min0.01017746003735967
agent_compute-ego1_max0.012078871045793806
agent_compute-ego1_mean0.0108216133753077
agent_compute-ego1_median0.011034883771623883
agent_compute-ego1_min0.009664413928985595
complete-iteration_max0.7972103232429141
complete-iteration_mean0.658188720929618
complete-iteration_median0.7624323667798724
complete-iteration_min0.23830008268356323
deviation-center-line_max0.3720891524232108
deviation-center-line_mean0.14685622741377286
deviation-center-line_min0.05518112651933551
deviation-heading_max0.867080540349331
deviation-heading_mean0.5357711264887624
deviation-heading_median0.5079772825538268
deviation-heading_min0.26252044590060647
driven_any_max3.446854510378138
driven_any_mean1.820198672632691
driven_any_median1.6714945309441915
driven_any_min0.8190735567943087
driven_lanedir_consec_max1.3675792451083173
driven_lanedir_consec_mean0.7011373480211068
driven_lanedir_consec_min0.11975322687645118
driven_lanedir_max1.3675792451083173
driven_lanedir_mean0.7011373480211068
driven_lanedir_median0.6824877811914045
driven_lanedir_min0.11975322687645118
get_duckie_state_max1.7656598772321429e-06
get_duckie_state_mean1.6927556926701345e-06
get_duckie_state_median1.7075311569940477e-06
get_duckie_state_min1.633167266845703e-06
get_robot_state_max0.01467992878761612
get_robot_state_mean0.013493883787226131
get_robot_state_median0.014638430731637135
get_robot_state_min0.006981604099273682
get_state_dump_max0.0097919612371621
get_state_dump_mean0.009184248288090871
get_state_dump_median0.00963651248386928
get_state_dump_min0.006214036941528321
get_ui_image_max0.04678606305803571
get_ui_image_mean0.04267156967882062
get_ui_image_median0.04539528982979911
get_ui_image_min0.02907893657684326
in-drivable-lane_max7.7499999999999885
in-drivable-lane_mean4.346428571428561
in-drivable-lane_min2.499999999999991
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.6675608627969534, "get_ui_image": 0.042629672699615734, "step_physics": 0.46080099434411825, "survival_time": 5.899999999999987, "driven_lanedir": 0.7346281785949911, "get_state_dump": 0.0097919612371621, "get_robot_state": 0.01467992878761612, "sim_render-ego0": 0.0037454396736722032, "sim_render-ego1": 0.003771884100777762, "sim_render-ego2": 0.003830861644584591, "sim_render-ego3": 0.003716038054778796, "get_duckie_state": 1.6348702566964285e-06, "in-drivable-lane": 3.8499999999999863, "deviation-heading": 0.469738838674098, "agent_compute-ego0": 0.01017746003735967, "agent_compute-ego1": 0.009929685031666476, "agent_compute-ego2": 0.010350752277534549, "agent_compute-ego3": 0.009953977681007706, "complete-iteration": 0.6248677918890945, "set_robot_commands": 0.002266080439591608, "deviation-center-line": 0.09483029131067588, "driven_lanedir_consec": 0.7346281785949911, "sim_compute_sim_state": 0.024229334182098133, "sim_compute_performance-ego0": 0.0021259985050233474, "sim_compute_performance-ego1": 0.0019320399821305472, "sim_compute_performance-ego2": 0.00196360339637564, "sim_compute_performance-ego3": 0.00193261298812738}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.2509378169054304, "get_ui_image": 0.042629672699615734, "step_physics": 0.46080099434411825, "survival_time": 5.899999999999987, "driven_lanedir": 1.3675792451083173, "get_state_dump": 0.0097919612371621, "get_robot_state": 0.01467992878761612, "sim_render-ego0": 0.0037454396736722032, "sim_render-ego1": 0.003771884100777762, "sim_render-ego2": 0.003830861644584591, "sim_render-ego3": 0.003716038054778796, "get_duckie_state": 1.6348702566964285e-06, "in-drivable-lane": 2.499999999999991, "deviation-heading": 0.6629283611959488, "agent_compute-ego0": 0.01017746003735967, "agent_compute-ego1": 0.009929685031666476, "agent_compute-ego2": 0.010350752277534549, "agent_compute-ego3": 0.009953977681007706, "complete-iteration": 0.6248677918890945, "set_robot_commands": 0.002266080439591608, "deviation-center-line": 0.3720891524232108, "driven_lanedir_consec": 1.3675792451083173, "sim_compute_sim_state": 0.024229334182098133, "sim_compute_performance-ego0": 0.0021259985050233474, "sim_compute_performance-ego1": 0.0019320399821305472, "sim_compute_performance-ego2": 0.00196360339637564, "sim_compute_performance-ego3": 0.00193261298812738}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.6203586225454043, "get_ui_image": 0.042629672699615734, "step_physics": 0.46080099434411825, "survival_time": 5.899999999999987, "driven_lanedir": 1.2561576430034282, "get_state_dump": 0.0097919612371621, "get_robot_state": 0.01467992878761612, "sim_render-ego0": 0.0037454396736722032, "sim_render-ego1": 0.003771884100777762, "sim_render-ego2": 0.003830861644584591, "sim_render-ego3": 0.003716038054778796, "get_duckie_state": 1.6348702566964285e-06, "in-drivable-lane": 2.7499999999999902, "deviation-heading": 0.5462157264335555, "agent_compute-ego0": 0.01017746003735967, "agent_compute-ego1": 0.009929685031666476, "agent_compute-ego2": 0.010350752277534549, "agent_compute-ego3": 0.009953977681007706, "complete-iteration": 0.6248677918890945, "set_robot_commands": 0.002266080439591608, "deviation-center-line": 0.14039104003872624, "driven_lanedir_consec": 1.2561576430034282, "sim_compute_sim_state": 0.024229334182098133, "sim_compute_performance-ego0": 0.0021259985050233474, "sim_compute_performance-ego1": 0.0019320399821305472, "sim_compute_performance-ego2": 0.00196360339637564, "sim_compute_performance-ego3": 0.00193261298812738}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.667560862796993, "get_ui_image": 0.042629672699615734, "step_physics": 0.46080099434411825, "survival_time": 5.899999999999987, "driven_lanedir": 0.719009961023402, "get_state_dump": 0.0097919612371621, "get_robot_state": 0.01467992878761612, "sim_render-ego0": 0.0037454396736722032, "sim_render-ego1": 0.003771884100777762, "sim_render-ego2": 0.003830861644584591, "sim_render-ego3": 0.003716038054778796, "get_duckie_state": 1.6348702566964285e-06, "in-drivable-lane": 3.899999999999986, "deviation-heading": 0.4254966176967258, "agent_compute-ego0": 0.01017746003735967, "agent_compute-ego1": 0.009929685031666476, "agent_compute-ego2": 0.010350752277534549, "agent_compute-ego3": 0.009953977681007706, "complete-iteration": 0.6248677918890945, "set_robot_commands": 0.002266080439591608, "deviation-center-line": 0.07109220477049745, "driven_lanedir_consec": 0.719009961023402, "sim_compute_sim_state": 0.024229334182098133, "sim_compute_performance-ego0": 0.0021259985050233474, "sim_compute_performance-ego1": 0.0019320399821305472, "sim_compute_performance-ego2": 0.00196360339637564, "sim_compute_performance-ego3": 0.00193261298812738}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.3478761906085373, "get_ui_image": 0.04678606305803571, "step_physics": 0.6163659345536004, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7173980024822183, "get_state_dump": 0.009609376816522509, "get_robot_state": 0.014638430731637135, "sim_render-ego0": 0.003981871831984747, "sim_render-ego1": 0.003835691724504743, "sim_render-ego2": 0.003874170212518602, "sim_render-ego3": 0.0038843858809698194, "get_duckie_state": 1.7075311569940477e-06, "in-drivable-lane": 3.0499999999999914, "deviation-heading": 0.867080540349331, "agent_compute-ego0": 0.011033596311296736, "agent_compute-ego1": 0.011034883771623883, "agent_compute-ego2": 0.010564624695550829, "agent_compute-ego3": 0.010845452263241722, "complete-iteration": 0.7972103232429141, "set_robot_commands": 0.0022724537622360957, "deviation-center-line": 0.18524260463403516, "driven_lanedir_consec": 0.7173980024822183, "sim_compute_sim_state": 0.03326393990289597, "sim_compute_performance-ego0": 0.0021678061712355843, "sim_compute_performance-ego1": 0.002007209687005906, "sim_compute_performance-ego2": 0.002036587397257487, "sim_compute_performance-ego3": 0.002005715597243536}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.413599166315601, "get_ui_image": 0.04678606305803571, "step_physics": 0.6163659345536004, "survival_time": 5.1999999999999895, "driven_lanedir": 0.11975322687645118, "get_state_dump": 0.009609376816522509, "get_robot_state": 0.014638430731637135, "sim_render-ego0": 0.003981871831984747, "sim_render-ego1": 0.003835691724504743, "sim_render-ego2": 0.003874170212518602, "sim_render-ego3": 0.0038843858809698194, "get_duckie_state": 1.7075311569940477e-06, "in-drivable-lane": 4.54999999999999, "deviation-heading": 0.41633267011024633, "agent_compute-ego0": 0.011033596311296736, "agent_compute-ego1": 0.011034883771623883, "agent_compute-ego2": 0.010564624695550829, "agent_compute-ego3": 0.010845452263241722, "complete-iteration": 0.7972103232429141, "set_robot_commands": 0.0022724537622360957, "deviation-center-line": 0.05518112651933551, "driven_lanedir_consec": 0.11975322687645118, "sim_compute_sim_state": 0.03326393990289597, "sim_compute_performance-ego0": 0.0021678061712355843, "sim_compute_performance-ego1": 0.002007209687005906, "sim_compute_performance-ego2": 0.002036587397257487, "sim_compute_performance-ego3": 0.002005715597243536}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.8859035020838468, "get_ui_image": 0.04678606305803571, "step_physics": 0.6163659345536004, "survival_time": 5.1999999999999895, "driven_lanedir": 0.9084889312577556, "get_state_dump": 0.009609376816522509, "get_robot_state": 0.014638430731637135, "sim_render-ego0": 0.003981871831984747, "sim_render-ego1": 0.003835691724504743, "sim_render-ego2": 0.003874170212518602, "sim_render-ego3": 0.0038843858809698194, "get_duckie_state": 1.7075311569940477e-06, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 0.7560294458114469, "agent_compute-ego0": 0.011033596311296736, "agent_compute-ego1": 0.011034883771623883, "agent_compute-ego2": 0.010564624695550829, "agent_compute-ego3": 0.010845452263241722, "complete-iteration": 0.7972103232429141, "set_robot_commands": 0.0022724537622360957, "deviation-center-line": 0.2274030062822905, "driven_lanedir_consec": 0.9084889312577556, "sim_compute_sim_state": 0.03326393990289597, "sim_compute_performance-ego0": 0.0021678061712355843, "sim_compute_performance-ego1": 0.002007209687005906, "sim_compute_performance-ego2": 0.002036587397257487, "sim_compute_performance-ego3": 0.002005715597243536}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.3478761906085472, "get_ui_image": 0.04678606305803571, "step_physics": 0.6163659345536004, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6255720679354082, "get_state_dump": 0.009609376816522509, "get_robot_state": 0.014638430731637135, "sim_render-ego0": 0.003981871831984747, "sim_render-ego1": 0.003835691724504743, "sim_render-ego2": 0.003874170212518602, "sim_render-ego3": 0.0038843858809698194, "get_duckie_state": 1.7075311569940477e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 0.7506184812162171, "agent_compute-ego0": 0.011033596311296736, "agent_compute-ego1": 0.011034883771623883, "agent_compute-ego2": 0.010564624695550829, "agent_compute-ego3": 0.010845452263241722, "complete-iteration": 0.7972103232429141, "set_robot_commands": 0.0022724537622360957, "deviation-center-line": 0.1970464118524351, "driven_lanedir_consec": 0.6255720679354082, "sim_compute_sim_state": 0.03326393990289597, "sim_compute_performance-ego0": 0.0021678061712355843, "sim_compute_performance-ego1": 0.002007209687005906, "sim_compute_performance-ego2": 0.002036587397257487, "sim_compute_performance-ego3": 0.002005715597243536}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8190735567943087, "get_ui_image": 0.04539528982979911, "step_physics": 0.5911154447283063, "survival_time": 8.699999999999989, "driven_lanedir": 0.204271039946744, "get_state_dump": 0.00963651248386928, "get_robot_state": 0.014419431686401368, "sim_render-ego0": 0.003831393378121512, "sim_render-ego1": 0.003750668934413365, "sim_render-ego2": 0.003647300175258091, "sim_render-ego3": 0.003557959965297154, "get_duckie_state": 1.7656598772321429e-06, "in-drivable-lane": 7.7499999999999885, "deviation-heading": 0.5956547684236475, "agent_compute-ego0": 0.012178316116333007, "agent_compute-ego1": 0.012078871045793806, "agent_compute-ego2": 0.011630394799368724, "agent_compute-ego3": 0.010888933454241072, "complete-iteration": 0.7624323667798724, "set_robot_commands": 0.0022076688494001117, "deviation-center-line": 0.06316401342706499, "driven_lanedir_consec": 0.204271039946744, "sim_compute_sim_state": 0.023372415815080917, "sim_compute_performance-ego0": 0.002109091622488839, "sim_compute_performance-ego1": 0.001875801086425781, "sim_compute_performance-ego2": 0.0018923773084368023, "sim_compute_performance-ego3": 0.0019125434330531529}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.9291785515511695, "get_ui_image": 0.04539528982979911, "step_physics": 0.5911154447283063, "survival_time": 8.699999999999989, "driven_lanedir": 0.6475775599005906, "get_state_dump": 0.00963651248386928, "get_robot_state": 0.014419431686401368, "sim_render-ego0": 0.003831393378121512, "sim_render-ego1": 0.003750668934413365, "sim_render-ego2": 0.003647300175258091, "sim_render-ego3": 0.003557959965297154, "get_duckie_state": 1.7656598772321429e-06, "in-drivable-lane": 6.849999999999988, "deviation-heading": 0.26252044590060647, "agent_compute-ego0": 0.012178316116333007, "agent_compute-ego1": 0.012078871045793806, "agent_compute-ego2": 0.011630394799368724, "agent_compute-ego3": 0.010888933454241072, "complete-iteration": 0.7624323667798724, "set_robot_commands": 0.0022076688494001117, "deviation-center-line": 0.0775485848193056, "driven_lanedir_consec": 0.6475775599005906, "sim_compute_sim_state": 0.023372415815080917, "sim_compute_performance-ego0": 0.002109091622488839, "sim_compute_performance-ego1": 0.001875801086425781, "sim_compute_performance-ego2": 0.0018923773084368023, "sim_compute_performance-ego3": 0.0019125434330531529}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.446854510378138, "get_ui_image": 0.04539528982979911, "step_physics": 0.5911154447283063, "survival_time": 8.699999999999989, "driven_lanedir": 0.5656387472941029, "get_state_dump": 0.00963651248386928, "get_robot_state": 0.014419431686401368, "sim_render-ego0": 0.003831393378121512, "sim_render-ego1": 0.003750668934413365, "sim_render-ego2": 0.003647300175258091, "sim_render-ego3": 0.003557959965297154, "get_duckie_state": 1.7656598772321429e-06, "in-drivable-lane": 7.049999999999987, "deviation-heading": 0.2665393864559088, "agent_compute-ego0": 0.012178316116333007, "agent_compute-ego1": 0.012078871045793806, "agent_compute-ego2": 0.011630394799368724, "agent_compute-ego3": 0.010888933454241072, "complete-iteration": 0.7624323667798724, "set_robot_commands": 0.0022076688494001117, "deviation-center-line": 0.1858875809975676, "driven_lanedir_consec": 0.5656387472941029, "sim_compute_sim_state": 0.023372415815080917, "sim_compute_performance-ego0": 0.002109091622488839, "sim_compute_performance-ego1": 0.001875801086425781, "sim_compute_performance-ego2": 0.0018923773084368023, "sim_compute_performance-ego3": 0.0019125434330531529}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.6754281990913904, "get_ui_image": 0.04539528982979911, "step_physics": 0.5911154447283063, "survival_time": 8.699999999999989, "driven_lanedir": 0.531623736296337, "get_state_dump": 0.00963651248386928, "get_robot_state": 0.014419431686401368, "sim_render-ego0": 0.003831393378121512, "sim_render-ego1": 0.003750668934413365, "sim_render-ego2": 0.003647300175258091, "sim_render-ego3": 0.003557959965297154, "get_duckie_state": 1.7656598772321429e-06, "in-drivable-lane": 7.099999999999988, "deviation-heading": 0.3765924624405937, "agent_compute-ego0": 0.012178316116333007, "agent_compute-ego1": 0.012078871045793806, "agent_compute-ego2": 0.011630394799368724, "agent_compute-ego3": 0.010888933454241072, "complete-iteration": 0.7624323667798724, "set_robot_commands": 0.0022076688494001117, "deviation-center-line": 0.09654869044461176, "driven_lanedir_consec": 0.531623736296337, "sim_compute_sim_state": 0.023372415815080917, "sim_compute_performance-ego0": 0.002109091622488839, "sim_compute_performance-ego1": 0.001875801086425781, "sim_compute_performance-ego2": 0.0018923773084368023, "sim_compute_performance-ego3": 0.0019125434330531529}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.7160571722130875, "get_ui_image": 0.02907893657684326, "step_physics": 0.1525096869468689, "survival_time": 4.94999999999999, "driven_lanedir": 0.7912652802573135, "get_state_dump": 0.006214036941528321, "get_robot_state": 0.006981604099273682, "sim_render-ego0": 0.003619782924652099, "sim_render-ego1": 0.003495771884918213, "get_duckie_state": 1.633167266845703e-06, "in-drivable-lane": 2.79999999999999, "deviation-heading": 0.27730149789233977, "agent_compute-ego0": 0.010223567485809326, "agent_compute-ego1": 0.009664413928985595, "complete-iteration": 0.23830008268356323, "set_robot_commands": 0.0020589613914489746, "deviation-center-line": 0.1090565050273313, "driven_lanedir_consec": 0.7912652802573135, "sim_compute_sim_state": 0.008478713035583497, "sim_compute_performance-ego0": 0.0019676351547241212, "sim_compute_performance-ego1": 0.001837451457977295}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.694516212168272, "get_ui_image": 0.02907893657684326, "step_physics": 0.1525096869468689, "survival_time": 4.94999999999999, "driven_lanedir": 0.6269592523184353, "get_state_dump": 0.006214036941528321, "get_robot_state": 0.006981604099273682, "sim_render-ego0": 0.003619782924652099, "sim_render-ego1": 0.003495771884918213, "get_duckie_state": 1.633167266845703e-06, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 0.8277465282420078, "agent_compute-ego0": 0.010223567485809326, "agent_compute-ego1": 0.009664413928985595, "complete-iteration": 0.23830008268356323, "set_robot_commands": 0.0020589613914489746, "deviation-center-line": 0.18050597124573223, "driven_lanedir_consec": 0.6269592523184353, "sim_compute_sim_state": 0.008478713035583497, "sim_compute_performance-ego0": 0.0019676351547241212, "sim_compute_performance-ego1": 0.001837451457977295}}
set_robot_commands_max0.0022724537622360957
set_robot_commands_mean0.0022216239277006583
set_robot_commands_median0.002266080439591608
set_robot_commands_min0.0020589613914489746
sim_compute_performance-ego0_max0.0021678061712355843
sim_compute_performance-ego0_mean0.0021104896788885228
sim_compute_performance-ego0_median0.0021259985050233474
sim_compute_performance-ego0_min0.0019676351547241212
sim_compute_performance-ego1_max0.002007209687005906
sim_compute_performance-ego1_mean0.0019239361384431092
sim_compute_performance-ego1_median0.0019320399821305472
sim_compute_performance-ego1_min0.001837451457977295
sim_compute_sim_state_max0.03326393990289597
sim_compute_sim_state_mean0.02431572754796194
sim_compute_sim_state_median0.024229334182098133
sim_compute_sim_state_min0.008478713035583497
sim_render-ego0_max0.003981871831984747
sim_render-ego0_mean0.0038195989560298607
sim_render-ego0_median0.003831393378121512
sim_render-ego0_min0.003619782924652099
sim_render-ego1_max0.003835691724504743
sim_render-ego1_mean0.003744608772044279
sim_render-ego1_median0.003771884100777762
sim_render-ego1_min0.003495771884918213
simulation-passed1
step_physics_max0.6163659345536004
step_physics_mean0.49843920488555976
step_physics_median0.5911154447283063
step_physics_min0.1525096869468689
survival_time_max8.699999999999989
survival_time_mean6.364285714285702
survival_time_min4.94999999999999
No reset possible
5363312584Bea Baselines 🐤template-rosaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-040:18:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.226987115824696
survival_time_median8.399999999999984
deviation-center-line_median0.11110166767598026
in-drivable-lane_median5.799999999999984


other stats
agent_compute-ego0_max0.013209945750686358
agent_compute-ego0_mean0.012901919864336924
agent_compute-ego0_median0.013101092457065922
agent_compute-ego0_min0.011818062727618367
agent_compute-ego1_max0.013204607032459868
agent_compute-ego1_mean0.012545236113594116
agent_compute-ego1_median0.012644089320126702
agent_compute-ego1_min0.011816498580252289
complete-iteration_max0.9994082520989812
complete-iteration_mean0.8856124597227601
complete-iteration_median0.9852638075337607
complete-iteration_min0.26532896612859835
deviation-center-line_max1.3970233169057948
deviation-center-line_mean0.31320440919325543
deviation-center-line_min0.048988558921003234
deviation-heading_max4.15090295510997
deviation-heading_mean1.4143119047375954
deviation-heading_median0.8257990161343652
deviation-heading_min0.4203237804505287
driven_any_max3.027481684218784
driven_any_mean1.2989751896317665
driven_any_median1.214271026294589
driven_any_min0.16665764543758865
driven_lanedir_consec_max1.0664448577562466
driven_lanedir_consec_mean0.3065542120638156
driven_lanedir_consec_min0.09266953295494784
driven_lanedir_max1.0664448577562466
driven_lanedir_mean0.3065542120638156
driven_lanedir_median0.226987115824696
driven_lanedir_min0.09266953295494784
get_duckie_state_max2.3051831849227996e-06
get_duckie_state_mean2.115952964759988e-06
get_duckie_state_median2.0782902555645635e-06
get_duckie_state_min1.917978760543143e-06
get_robot_state_max0.014794375064104972
get_robot_state_mean0.013289817390427042
get_robot_state_median0.01415542293997372
get_robot_state_min0.006872412505423187
get_state_dump_max0.009767519651785404
get_state_dump_mean0.008970838914529478
get_state_dump_median0.009376654085123316
get_state_dump_min0.005915865017350312
get_ui_image_max0.04834661963423328
get_ui_image_mean0.043174563785692566
get_ui_image_median0.04656569221440483
get_ui_image_min0.029460007977333797
in-drivable-lane_max9.650000000000016
in-drivable-lane_mean5.642857142857137
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.22672366893435816, "get_ui_image": 0.04146865741261896, "step_physics": 0.823184868074813, "survival_time": 10.550000000000017, "driven_lanedir": 0.21699239326790076, "get_state_dump": 0.009376654085123316, "get_robot_state": 0.01412835660970436, "sim_render-ego0": 0.003833242182461721, "sim_render-ego1": 0.003712347093618141, "sim_render-ego2": 0.0036914865925626937, "sim_render-ego3": 0.003697260370794332, "get_duckie_state": 2.0782902555645635e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.15090295510997, "agent_compute-ego0": 0.013209945750686358, "agent_compute-ego1": 0.01215138075486669, "agent_compute-ego2": 0.012481294712930356, "agent_compute-ego3": 0.012030463173704329, "complete-iteration": 0.9823070663326192, "set_robot_commands": 0.002219222626596127, "deviation-center-line": 1.3970233169057948, "driven_lanedir_consec": 0.21699239326790076, "sim_compute_sim_state": 0.012177546069307148, "sim_compute_performance-ego0": 0.002045166942308534, "sim_compute_performance-ego1": 0.0019454146331211303, "sim_compute_performance-ego2": 0.00194369172150234, "sim_compute_performance-ego3": 0.0019597062524759545}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 3.027481684218784, "get_ui_image": 0.04146865741261896, "step_physics": 0.823184868074813, "survival_time": 10.550000000000017, "driven_lanedir": 1.0664448577562466, "get_state_dump": 0.009376654085123316, "get_robot_state": 0.01412835660970436, "sim_render-ego0": 0.003833242182461721, "sim_render-ego1": 0.003712347093618141, "sim_render-ego2": 0.0036914865925626937, "sim_render-ego3": 0.003697260370794332, "get_duckie_state": 2.0782902555645635e-06, "in-drivable-lane": 6.000000000000028, "deviation-heading": 2.394764314479693, "agent_compute-ego0": 0.013209945750686358, "agent_compute-ego1": 0.01215138075486669, "agent_compute-ego2": 0.012481294712930356, "agent_compute-ego3": 0.012030463173704329, "complete-iteration": 0.9823070663326192, "set_robot_commands": 0.002219222626596127, "deviation-center-line": 0.4157302181255023, "driven_lanedir_consec": 1.0664448577562466, "sim_compute_sim_state": 0.012177546069307148, "sim_compute_performance-ego0": 0.002045166942308534, "sim_compute_performance-ego1": 0.0019454146331211303, "sim_compute_performance-ego2": 0.00194369172150234, "sim_compute_performance-ego3": 0.0019597062524759545}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 0.576135554190002, "get_ui_image": 0.04146865741261896, "step_physics": 0.823184868074813, "survival_time": 10.550000000000017, "driven_lanedir": 0.128471635003659, "get_state_dump": 0.009376654085123316, "get_robot_state": 0.01412835660970436, "sim_render-ego0": 0.003833242182461721, "sim_render-ego1": 0.003712347093618141, "sim_render-ego2": 0.0036914865925626937, "sim_render-ego3": 0.003697260370794332, "get_duckie_state": 2.0782902555645635e-06, "in-drivable-lane": 9.650000000000016, "deviation-heading": 0.6328204432515473, "agent_compute-ego0": 0.013209945750686358, "agent_compute-ego1": 0.01215138075486669, "agent_compute-ego2": 0.012481294712930356, "agent_compute-ego3": 0.012030463173704329, "complete-iteration": 0.9823070663326192, "set_robot_commands": 0.002219222626596127, "deviation-center-line": 0.05137533735159628, "driven_lanedir_consec": 0.128471635003659, "sim_compute_sim_state": 0.012177546069307148, "sim_compute_performance-ego0": 0.002045166942308534, "sim_compute_performance-ego1": 0.0019454146331211303, "sim_compute_performance-ego2": 0.00194369172150234, "sim_compute_performance-ego3": 0.0019597062524759545}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.1673636578277526, "get_ui_image": 0.04146865741261896, "step_physics": 0.823184868074813, "survival_time": 10.550000000000017, "driven_lanedir": 0.23698183838149123, "get_state_dump": 0.009376654085123316, "get_robot_state": 0.01412835660970436, "sim_render-ego0": 0.003833242182461721, "sim_render-ego1": 0.003712347093618141, "sim_render-ego2": 0.0036914865925626937, "sim_render-ego3": 0.003697260370794332, "get_duckie_state": 2.0782902555645635e-06, "in-drivable-lane": 9.350000000000016, "deviation-heading": 0.4755252855836223, "agent_compute-ego0": 0.013209945750686358, "agent_compute-ego1": 0.01215138075486669, "agent_compute-ego2": 0.012481294712930356, "agent_compute-ego3": 0.012030463173704329, "complete-iteration": 0.9823070663326192, "set_robot_commands": 0.002219222626596127, "deviation-center-line": 0.10171485871722202, "driven_lanedir_consec": 0.23698183838149123, "sim_compute_sim_state": 0.012177546069307148, "sim_compute_performance-ego0": 0.002045166942308534, "sim_compute_performance-ego1": 0.0019454146331211303, "sim_compute_performance-ego2": 0.00194369172150234, "sim_compute_performance-ego3": 0.0019597062524759545}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.2611783947614257, "get_ui_image": 0.04656569221440483, "step_physics": 0.8212807003189536, "survival_time": 6.749999999999984, "driven_lanedir": 0.19637083170560676, "get_state_dump": 0.009295829955269308, "get_robot_state": 0.01415542293997372, "sim_render-ego0": 0.003680672715691959, "sim_render-ego1": 0.0037097755600424376, "sim_render-ego2": 0.0037065884646247417, "sim_render-ego3": 0.0036614291808184456, "get_duckie_state": 2.0633725559010225e-06, "in-drivable-lane": 5.699999999999984, "deviation-heading": 0.4775561158709501, "agent_compute-ego0": 0.01293664995361777, "agent_compute-ego1": 0.012644089320126702, "agent_compute-ego2": 0.013501570505254409, "agent_compute-ego3": 0.01213067419388715, "complete-iteration": 0.9994082520989812, "set_robot_commands": 0.0021986628279966466, "deviation-center-line": 0.09734455856281132, "driven_lanedir_consec": 0.19637083170560676, "sim_compute_sim_state": 0.025518990614834952, "sim_compute_performance-ego0": 0.002026591230841244, "sim_compute_performance-ego1": 0.001864403486251831, "sim_compute_performance-ego2": 0.0018633113187902111, "sim_compute_performance-ego3": 0.0018767398946425496}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.8295299709859167, "get_ui_image": 0.04656569221440483, "step_physics": 0.8212807003189536, "survival_time": 6.749999999999984, "driven_lanedir": 0.15381207603090685, "get_state_dump": 0.009295829955269308, "get_robot_state": 0.01415542293997372, "sim_render-ego0": 0.003680672715691959, "sim_render-ego1": 0.0037097755600424376, "sim_render-ego2": 0.0037065884646247417, "sim_render-ego3": 0.0036614291808184456, "get_duckie_state": 2.0633725559010225e-06, "in-drivable-lane": 5.249999999999986, "deviation-heading": 1.622658832229277, "agent_compute-ego0": 0.01293664995361777, "agent_compute-ego1": 0.012644089320126702, "agent_compute-ego2": 0.013501570505254409, "agent_compute-ego3": 0.01213067419388715, "complete-iteration": 0.9994082520989812, "set_robot_commands": 0.0021986628279966466, "deviation-center-line": 0.1204884766347385, "driven_lanedir_consec": 0.15381207603090685, "sim_compute_sim_state": 0.025518990614834952, "sim_compute_performance-ego0": 0.002026591230841244, "sim_compute_performance-ego1": 0.001864403486251831, "sim_compute_performance-ego2": 0.0018633113187902111, "sim_compute_performance-ego3": 0.0018767398946425496}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.6338924745296846, "get_ui_image": 0.04656569221440483, "step_physics": 0.8212807003189536, "survival_time": 6.749999999999984, "driven_lanedir": 0.09266953295494784, "get_state_dump": 0.009295829955269308, "get_robot_state": 0.01415542293997372, "sim_render-ego0": 0.003680672715691959, "sim_render-ego1": 0.0037097755600424376, "sim_render-ego2": 0.0037065884646247417, "sim_render-ego3": 0.0036614291808184456, "get_duckie_state": 2.0633725559010225e-06, "in-drivable-lane": 5.8999999999999835, "deviation-heading": 0.7133805648740048, "agent_compute-ego0": 0.01293664995361777, "agent_compute-ego1": 0.012644089320126702, "agent_compute-ego2": 0.013501570505254409, "agent_compute-ego3": 0.01213067419388715, "complete-iteration": 0.9994082520989812, "set_robot_commands": 0.0021986628279966466, "deviation-center-line": 0.048988558921003234, "driven_lanedir_consec": 0.09266953295494784, "sim_compute_sim_state": 0.025518990614834952, "sim_compute_performance-ego0": 0.002026591230841244, "sim_compute_performance-ego1": 0.001864403486251831, "sim_compute_performance-ego2": 0.0018633113187902111, "sim_compute_performance-ego3": 0.0018767398946425496}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.5531671969060489, "get_ui_image": 0.04656569221440483, "step_physics": 0.8212807003189536, "survival_time": 6.749999999999984, "driven_lanedir": 0.253316232229273, "get_state_dump": 0.009295829955269308, "get_robot_state": 0.01415542293997372, "sim_render-ego0": 0.003680672715691959, "sim_render-ego1": 0.0037097755600424376, "sim_render-ego2": 0.0037065884646247417, "sim_render-ego3": 0.0036614291808184456, "get_duckie_state": 2.0633725559010225e-06, "in-drivable-lane": 5.449999999999983, "deviation-heading": 0.685970632229032, "agent_compute-ego0": 0.01293664995361777, "agent_compute-ego1": 0.012644089320126702, "agent_compute-ego2": 0.013501570505254409, "agent_compute-ego3": 0.01213067419388715, "complete-iteration": 0.9994082520989812, "set_robot_commands": 0.0021986628279966466, "deviation-center-line": 0.0929944578616826, "driven_lanedir_consec": 0.253316232229273, "sim_compute_sim_state": 0.025518990614834952, "sim_compute_performance-ego0": 0.002026591230841244, "sim_compute_performance-ego1": 0.001864403486251831, "sim_compute_performance-ego2": 0.0018633113187902111, "sim_compute_performance-ego3": 0.0018767398946425496}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.16665764543758865, "get_ui_image": 0.04834661963423328, "step_physics": 0.8010281796991472, "survival_time": 8.399999999999984, "driven_lanedir": 0.13991846971920507, "get_state_dump": 0.009767519651785404, "get_robot_state": 0.014794375064104972, "sim_render-ego0": 0.0039520432963173775, "sim_render-ego1": 0.003911601015801965, "sim_render-ego2": 0.0038096128836185975, "sim_render-ego3": 0.003817108255871654, "get_duckie_state": 2.3051831849227996e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.058214404648655, "agent_compute-ego0": 0.013101092457065922, "agent_compute-ego1": 0.013204607032459868, "agent_compute-ego2": 0.01304706031754172, "agent_compute-ego3": 0.012539674544475488, "complete-iteration": 0.9852638075337607, "set_robot_commands": 0.0024247804336999293, "deviation-center-line": 1.3027175363481909, "driven_lanedir_consec": 0.13991846971920507, "sim_compute_sim_state": 0.026095901015242177, "sim_compute_performance-ego0": 0.002114146418825409, "sim_compute_performance-ego1": 0.0020522337693434497, "sim_compute_performance-ego2": 0.0020019232168705507, "sim_compute_performance-ego3": 0.001984549697334245}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.2133462649666744, "get_ui_image": 0.04834661963423328, "step_physics": 0.8010281796991472, "survival_time": 8.399999999999984, "driven_lanedir": 0.2477140565287228, "get_state_dump": 0.009767519651785404, "get_robot_state": 0.014794375064104972, "sim_render-ego0": 0.0039520432963173775, "sim_render-ego1": 0.003911601015801965, "sim_render-ego2": 0.0038096128836185975, "sim_render-ego3": 0.003817108255871654, "get_duckie_state": 2.3051831849227996e-06, "in-drivable-lane": 6.599999999999985, "deviation-heading": 1.4525964743925694, "agent_compute-ego0": 0.013101092457065922, "agent_compute-ego1": 0.013204607032459868, "agent_compute-ego2": 0.01304706031754172, "agent_compute-ego3": 0.012539674544475488, "complete-iteration": 0.9852638075337607, "set_robot_commands": 0.0024247804336999293, "deviation-center-line": 0.12306918390838316, "driven_lanedir_consec": 0.2477140565287228, "sim_compute_sim_state": 0.026095901015242177, "sim_compute_performance-ego0": 0.002114146418825409, "sim_compute_performance-ego1": 0.0020522337693434497, "sim_compute_performance-ego2": 0.0020019232168705507, "sim_compute_performance-ego3": 0.001984549697334245}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.9122126346905808, "get_ui_image": 0.04834661963423328, "step_physics": 0.8010281796991472, "survival_time": 8.399999999999984, "driven_lanedir": 0.6677657231291401, "get_state_dump": 0.009767519651785404, "get_robot_state": 0.014794375064104972, "sim_render-ego0": 0.0039520432963173775, "sim_render-ego1": 0.003911601015801965, "sim_render-ego2": 0.0038096128836185975, "sim_render-ego3": 0.003817108255871654, "get_duckie_state": 2.3051831849227996e-06, "in-drivable-lane": 5.649999999999986, "deviation-heading": 0.9382174673947256, "agent_compute-ego0": 0.013101092457065922, "agent_compute-ego1": 0.013204607032459868, "agent_compute-ego2": 0.01304706031754172, "agent_compute-ego3": 0.012539674544475488, "complete-iteration": 0.9852638075337607, "set_robot_commands": 0.0024247804336999293, "deviation-center-line": 0.24303246257978656, "driven_lanedir_consec": 0.6677657231291401, "sim_compute_sim_state": 0.026095901015242177, "sim_compute_performance-ego0": 0.002114146418825409, "sim_compute_performance-ego1": 0.0020522337693434497, "sim_compute_performance-ego2": 0.0020019232168705507, "sim_compute_performance-ego3": 0.001984549697334245}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.8630131027788056, "get_ui_image": 0.04834661963423328, "step_physics": 0.8010281796991472, "survival_time": 8.399999999999984, "driven_lanedir": 0.1543607208160771, "get_state_dump": 0.009767519651785404, "get_robot_state": 0.014794375064104972, "sim_render-ego0": 0.0039520432963173775, "sim_render-ego1": 0.003911601015801965, "sim_render-ego2": 0.0038096128836185975, "sim_render-ego3": 0.003817108255871654, "get_duckie_state": 2.3051831849227996e-06, "in-drivable-lane": 7.399999999999984, "deviation-heading": 0.4847410090311637, "agent_compute-ego0": 0.013101092457065922, "agent_compute-ego1": 0.013204607032459868, "agent_compute-ego2": 0.01304706031754172, "agent_compute-ego3": 0.012539674544475488, "complete-iteration": 0.9852638075337607, "set_robot_commands": 0.0024247804336999293, "deviation-center-line": 0.08348991452663596, "driven_lanedir_consec": 0.1543607208160771, "sim_compute_sim_state": 0.026095901015242177, "sim_compute_performance-ego0": 0.002114146418825409, "sim_compute_performance-ego1": 0.0020522337693434497, "sim_compute_performance-ego2": 0.0020019232168705507, "sim_compute_performance-ego3": 0.001984549697334245}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.7778036177504448, "get_ui_image": 0.029460007977333797, "step_physics": 0.17683433727094322, "survival_time": 7.79999999999998, "driven_lanedir": 0.2565040372782885, "get_state_dump": 0.005915865017350312, "get_robot_state": 0.006872412505423187, "sim_render-ego0": 0.003484548277156368, "sim_render-ego1": 0.0033995239597976587, "get_duckie_state": 1.917978760543143e-06, "in-drivable-lane": 6.549999999999979, "deviation-heading": 0.4203237804505287, "agent_compute-ego0": 0.011818062727618367, "agent_compute-ego1": 0.011816498580252289, "complete-iteration": 0.26532896612859835, "set_robot_commands": 0.0020092991506977446, "deviation-center-line": 0.10111201938960732, "driven_lanedir_consec": 0.2565040372782885, "sim_compute_sim_state": 0.008022238494484288, "sim_compute_performance-ego0": 0.001819847495692551, "sim_compute_performance-ego1": 0.0017577007317998606}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.977146786866662, "get_ui_image": 0.029460007977333797, "step_physics": 0.17683433727094322, "survival_time": 7.79999999999998, "driven_lanedir": 0.48043656409195235, "get_state_dump": 0.005915865017350312, "get_robot_state": 0.006872412505423187, "sim_render-ego0": 0.003484548277156368, "sim_render-ego1": 0.0033995239597976587, "get_duckie_state": 1.917978760543143e-06, "in-drivable-lane": 5.499999999999983, "deviation-heading": 1.2926943867806, "agent_compute-ego0": 0.011818062727618367, "agent_compute-ego1": 0.011816498580252289, "complete-iteration": 0.26532896612859835, "set_robot_commands": 0.0020092991506977446, "deviation-center-line": 0.20578082887262103, "driven_lanedir_consec": 0.48043656409195235, "sim_compute_sim_state": 0.008022238494484288, "sim_compute_performance-ego0": 0.001819847495692551, "sim_compute_performance-ego1": 0.0017577007317998606}}
set_robot_commands_max0.0024247804336999293
set_robot_commands_mean0.002242090132469021
set_robot_commands_median0.002219222626596127
set_robot_commands_min0.0020092991506977446
sim_compute_performance-ego0_max0.002114146418825409
sim_compute_performance-ego0_mean0.0020273795256632752
sim_compute_performance-ego0_median0.002045166942308534
sim_compute_performance-ego0_min0.001819847495692551
sim_compute_performance-ego1_max0.0020522337693434497
sim_compute_performance-ego1_mean0.0019259720727475265
sim_compute_performance-ego1_median0.0019454146331211303
sim_compute_performance-ego1_min0.0017577007317998606
sim_compute_sim_state_max0.026095901015242177
sim_compute_sim_state_mean0.019372444841893263
sim_compute_sim_state_median0.025518990614834952
sim_compute_sim_state_min0.008022238494484288
sim_render-ego0_max0.0039520432963173775
sim_render-ego0_mean0.003773780666585498
sim_render-ego0_median0.003833242182461721
sim_render-ego0_min0.003484548277156368
sim_render-ego1_max0.003911601015801965
sim_render-ego1_mean0.0037238530426746777
sim_render-ego1_median0.003712347093618141
sim_render-ego1_min0.0033995239597976587
simulation-passed1
step_physics_max0.823184868074813
step_physics_mean0.7239745476366817
step_physics_median0.8212807003189536
step_physics_min0.17683433727094322
survival_time_max10.550000000000017
survival_time_mean8.45714285714285
survival_time_min6.749999999999984
No reset possible
5362212690Bea Baselines 🐤template-randomaido5-LFI-sim-validationLFVIv-simabortedyesnogpu-prod-040:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5361212695Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simabortedyesnogpu-prod-040:02:41
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5359212588Bea Baselines 🐤template-rosaido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-040:06:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4690277657722523
survival_time_median7.899999999999992
deviation-center-line_median0.1687422081684406
in-drivable-lane_median5.549999999999994


other stats
agent_compute-ego0_max0.013663018071973648
agent_compute-ego0_mean0.01328029361317945
agent_compute-ego0_median0.013300487022718284
agent_compute-ego0_min0.01285718233530758
complete-iteration_max0.20458713737693993
complete-iteration_mean0.19244110866531117
complete-iteration_median0.19859147183844708
complete-iteration_min0.1679943536074107
deviation-center-line_max0.21508197411642663
deviation-center-line_mean0.1746301482537205
deviation-center-line_min0.14595420256157418
deviation-heading_max1.3949160143012116
deviation-heading_mean0.7025986678139454
deviation-heading_median0.5401760227851946
deviation-heading_min0.3351266113841809
driven_any_max2.8531294991698855
driven_any_mean1.9763189512353248
driven_any_median2.161095773883704
driven_any_min0.7299547580040048
driven_lanedir_consec_max0.7131667249425937
driven_lanedir_consec_mean0.510998136063955
driven_lanedir_consec_min0.392770287768722
driven_lanedir_max0.7131667249425937
driven_lanedir_mean0.510998136063955
driven_lanedir_median0.4690277657722523
driven_lanedir_min0.392770287768722
get_duckie_state_max1.670205019374582e-06
get_duckie_state_mean1.6202979135823586e-06
get_duckie_state_median1.6547477916805214e-06
get_duckie_state_min1.5014910515938097e-06
get_robot_state_max0.003913140742578239
get_robot_state_mean0.003839947290840964
get_robot_state_median0.003874950506108606
get_robot_state_min0.003696747408568404
get_state_dump_max0.005083068508968175
get_state_dump_mean0.004973566871105909
get_state_dump_median0.004988680281792784
get_state_dump_min0.004833838411869893
get_ui_image_max0.036007015462865166
get_ui_image_mean0.031259547643766
get_ui_image_median0.03126797750761606
get_ui_image_min0.02649522009696669
in-drivable-lane_max8.850000000000016
in-drivable-lane_mean5.312499999999999
in-drivable-lane_min1.2999999999999954
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.7299547580040048, "get_ui_image": 0.029664500339611155, "step_physics": 0.13645989186054952, "survival_time": 3.649999999999995, "driven_lanedir": 0.5362079481354032, "get_state_dump": 0.004994402060637603, "get_robot_state": 0.003889373830846838, "sim_render-ego0": 0.004121384105166873, "get_duckie_state": 1.6528206902581292e-06, "in-drivable-lane": 1.2999999999999954, "deviation-heading": 0.5863752179387443, "agent_compute-ego0": 0.013663018071973648, "complete-iteration": 0.20458713737693993, "set_robot_commands": 0.0024074960399318385, "deviation-center-line": 0.15632883005742876, "driven_lanedir_consec": 0.5362079481354032, "sim_compute_sim_state": 0.0070357773755047774, "sim_compute_performance-ego0": 0.002254618180764688}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.623632880850544, "get_ui_image": 0.036007015462865166, "step_physics": 0.12282925621073514, "survival_time": 9.299999999999995, "driven_lanedir": 0.7131667249425937, "get_state_dump": 0.004982958502947965, "get_robot_state": 0.003860527181370373, "sim_render-ego0": 0.003960252445649336, "get_duckie_state": 1.670205019374582e-06, "in-drivable-lane": 6.250000000000003, "deviation-heading": 1.3949160143012116, "agent_compute-ego0": 0.013080670871836616, "complete-iteration": 0.20129514633015516, "set_robot_commands": 0.0023805240896296372, "deviation-center-line": 0.21508197411642663, "driven_lanedir_consec": 0.7131667249425937, "sim_compute_sim_state": 0.011851630746362044, "sim_compute_performance-ego0": 0.0022447529961081114}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.8531294991698855, "get_ui_image": 0.03287145467562096, "step_physics": 0.11749753216716732, "survival_time": 10.650000000000016, "driven_lanedir": 0.40184758340910154, "get_state_dump": 0.005083068508968175, "get_robot_state": 0.003913140742578239, "sim_render-ego0": 0.004057564468027275, "get_duckie_state": 1.6566748931029133e-06, "in-drivable-lane": 8.850000000000016, "deviation-heading": 0.4939768276316449, "agent_compute-ego0": 0.013520303173599956, "complete-iteration": 0.195887797346739, "set_robot_commands": 0.002404451370239258, "deviation-center-line": 0.14595420256157418, "driven_lanedir_consec": 0.40184758340910154, "sim_compute_sim_state": 0.014257201524538417, "sim_compute_performance-ego0": 0.0021853859179487853}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6985586669168646, "get_ui_image": 0.02649522009696669, "step_physics": 0.1054858542580641, "survival_time": 6.499999999999985, "driven_lanedir": 0.392770287768722, "get_state_dump": 0.004833838411869893, "get_robot_state": 0.003696747408568404, "sim_render-ego0": 0.003834669826594928, "get_duckie_state": 1.5014910515938097e-06, "in-drivable-lane": 4.849999999999984, "deviation-heading": 0.3351266113841809, "agent_compute-ego0": 0.01285718233530758, "complete-iteration": 0.1679943536074107, "set_robot_commands": 0.0022489096372182134, "deviation-center-line": 0.1811555862794524, "driven_lanedir_consec": 0.392770287768722, "sim_compute_sim_state": 0.006465791745950247, "sim_compute_performance-ego0": 0.001990716875964449}}
set_robot_commands_max0.0024074960399318385
set_robot_commands_mean0.0023603452842547367
set_robot_commands_median0.0023924877299344475
set_robot_commands_min0.0022489096372182134
sim_compute_performance-ego0_max0.002254618180764688
sim_compute_performance-ego0_mean0.002168868492696508
sim_compute_performance-ego0_median0.002215069457028448
sim_compute_performance-ego0_min0.001990716875964449
sim_compute_sim_state_max0.014257201524538417
sim_compute_sim_state_mean0.009902600348088871
sim_compute_sim_state_median0.00944370406093341
sim_compute_sim_state_min0.006465791745950247
sim_render-ego0_max0.004121384105166873
sim_render-ego0_mean0.003993467711359603
sim_render-ego0_median0.004008908456838305
sim_render-ego0_min0.003834669826594928
simulation-passed1
step_physics_max0.13645989186054952
step_physics_mean0.12056813362412902
step_physics_median0.12016339418895122
step_physics_min0.1054858542580641
survival_time_max10.650000000000016
survival_time_mean7.524999999999999
survival_time_min3.649999999999995
No reset possible
5358812593Bea Baselines 🐤template-randomaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-040:00:39
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5356112598Bea Baselines 🐤template-randomaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessyesnogpu-prod-040:12:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6824877811914045
survival_time_median5.899999999999987
deviation-center-line_median0.12472377253302876
in-drivable-lane_median3.4999999999999876


other stats
agent_compute-ego0_max0.012123090199061805
agent_compute-ego0_mean0.010788694909688422
agent_compute-ego0_median0.010876085644676571
agent_compute-ego0_min0.00978489637374878
agent_compute-ego1_max0.011901130676269533
agent_compute-ego1_mean0.010396793838881072
agent_compute-ego1_median0.010332965850830078
agent_compute-ego1_min0.008926470279693604
complete-iteration_max0.802783641361055
complete-iteration_mean0.6622016959821954
complete-iteration_median0.7754182992662703
complete-iteration_min0.2326043605804443
deviation-center-line_max0.3720891524232108
deviation-center-line_mean0.14685622741377286
deviation-center-line_min0.05518112651933551
deviation-heading_max0.867080540349331
deviation-heading_mean0.5357711264887624
deviation-heading_median0.5079772825538268
deviation-heading_min0.26252044590060647
driven_any_max3.446854510378138
driven_any_mean1.820198672632691
driven_any_median1.6714945309441915
driven_any_min0.8190735567943087
driven_lanedir_consec_max1.3675792451083173
driven_lanedir_consec_mean0.7011373480211068
driven_lanedir_consec_min0.11975322687645118
driven_lanedir_max1.3675792451083173
driven_lanedir_mean0.7011373480211068
driven_lanedir_median0.6824877811914045
driven_lanedir_min0.11975322687645118
get_duckie_state_max1.456557201738117e-06
get_duckie_state_mean1.344467077602525e-06
get_duckie_state_median1.4282408214750744e-06
get_duckie_state_min1.0967254638671874e-06
get_robot_state_max0.013650060701770942
get_robot_state_mean0.012585627994522086
get_robot_state_median0.013614179974510556
get_robot_state_min0.006503956317901611
get_state_dump_max0.009880426551113607
get_state_dump_mean0.008871350579378174
get_state_dump_median0.009254982357933409
get_state_dump_min0.00561384916305542
get_ui_image_max0.0466080075218564
get_ui_image_mean0.042730642194125874
get_ui_image_median0.04572907311575753
get_ui_image_min0.028799302577972412
in-drivable-lane_max7.7499999999999885
in-drivable-lane_mean4.346428571428561
in-drivable-lane_min2.499999999999991
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.6675608627969534, "get_ui_image": 0.042820515752840446, "step_physics": 0.4638832016151492, "survival_time": 5.899999999999987, "driven_lanedir": 0.7346281785949911, "get_state_dump": 0.009880426551113607, "get_robot_state": 0.013650060701770942, "sim_render-ego0": 0.0035200279299952403, "sim_render-ego1": 0.003471184177558963, "sim_render-ego2": 0.003496692962005358, "sim_render-ego3": 0.003502020314961922, "get_duckie_state": 1.456557201738117e-06, "in-drivable-lane": 3.8499999999999863, "deviation-heading": 0.469738838674098, "agent_compute-ego0": 0.00986880815329672, "agent_compute-ego1": 0.009691446769137342, "agent_compute-ego2": 0.010160858891591304, "agent_compute-ego3": 0.009517517410406543, "complete-iteration": 0.6232018150201365, "set_robot_commands": 0.002089452342826779, "deviation-center-line": 0.09483029131067588, "driven_lanedir_consec": 0.7346281785949911, "sim_compute_sim_state": 0.02381088152653029, "sim_compute_performance-ego0": 0.001956010065158876, "sim_compute_performance-ego1": 0.001839082782008067, "sim_compute_performance-ego2": 0.0018045341267305265, "sim_compute_performance-ego3": 0.0017928195600750063}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.2509378169054304, "get_ui_image": 0.042820515752840446, "step_physics": 0.4638832016151492, "survival_time": 5.899999999999987, "driven_lanedir": 1.3675792451083173, "get_state_dump": 0.009880426551113607, "get_robot_state": 0.013650060701770942, "sim_render-ego0": 0.0035200279299952403, "sim_render-ego1": 0.003471184177558963, "sim_render-ego2": 0.003496692962005358, "sim_render-ego3": 0.003502020314961922, "get_duckie_state": 1.456557201738117e-06, "in-drivable-lane": 2.499999999999991, "deviation-heading": 0.6629283611959488, "agent_compute-ego0": 0.00986880815329672, "agent_compute-ego1": 0.009691446769137342, "agent_compute-ego2": 0.010160858891591304, "agent_compute-ego3": 0.009517517410406543, "complete-iteration": 0.6232018150201365, "set_robot_commands": 0.002089452342826779, "deviation-center-line": 0.3720891524232108, "driven_lanedir_consec": 1.3675792451083173, "sim_compute_sim_state": 0.02381088152653029, "sim_compute_performance-ego0": 0.001956010065158876, "sim_compute_performance-ego1": 0.001839082782008067, "sim_compute_performance-ego2": 0.0018045341267305265, "sim_compute_performance-ego3": 0.0017928195600750063}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.6203586225454043, "get_ui_image": 0.042820515752840446, "step_physics": 0.4638832016151492, "survival_time": 5.899999999999987, "driven_lanedir": 1.2561576430034282, "get_state_dump": 0.009880426551113607, "get_robot_state": 0.013650060701770942, "sim_render-ego0": 0.0035200279299952403, "sim_render-ego1": 0.003471184177558963, "sim_render-ego2": 0.003496692962005358, "sim_render-ego3": 0.003502020314961922, "get_duckie_state": 1.456557201738117e-06, "in-drivable-lane": 2.7499999999999902, "deviation-heading": 0.5462157264335555, "agent_compute-ego0": 0.00986880815329672, "agent_compute-ego1": 0.009691446769137342, "agent_compute-ego2": 0.010160858891591304, "agent_compute-ego3": 0.009517517410406543, "complete-iteration": 0.6232018150201365, "set_robot_commands": 0.002089452342826779, "deviation-center-line": 0.14039104003872624, "driven_lanedir_consec": 1.2561576430034282, "sim_compute_sim_state": 0.02381088152653029, "sim_compute_performance-ego0": 0.001956010065158876, "sim_compute_performance-ego1": 0.001839082782008067, "sim_compute_performance-ego2": 0.0018045341267305265, "sim_compute_performance-ego3": 0.0017928195600750063}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.667560862796993, "get_ui_image": 0.042820515752840446, "step_physics": 0.4638832016151492, "survival_time": 5.899999999999987, "driven_lanedir": 0.719009961023402, "get_state_dump": 0.009880426551113607, "get_robot_state": 0.013650060701770942, "sim_render-ego0": 0.0035200279299952403, "sim_render-ego1": 0.003471184177558963, "sim_render-ego2": 0.003496692962005358, "sim_render-ego3": 0.003502020314961922, "get_duckie_state": 1.456557201738117e-06, "in-drivable-lane": 3.899999999999986, "deviation-heading": 0.4254966176967258, "agent_compute-ego0": 0.00986880815329672, "agent_compute-ego1": 0.009691446769137342, "agent_compute-ego2": 0.010160858891591304, "agent_compute-ego3": 0.009517517410406543, "complete-iteration": 0.6232018150201365, "set_robot_commands": 0.002089452342826779, "deviation-center-line": 0.07109220477049745, "driven_lanedir_consec": 0.719009961023402, "sim_compute_sim_state": 0.02381088152653029, "sim_compute_performance-ego0": 0.001956010065158876, "sim_compute_performance-ego1": 0.001839082782008067, "sim_compute_performance-ego2": 0.0018045341267305265, "sim_compute_performance-ego3": 0.0017928195600750063}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.3478761906085373, "get_ui_image": 0.0466080075218564, "step_physics": 0.6276041689373199, "survival_time": 5.1999999999999895, "driven_lanedir": 0.7173980024822183, "get_state_dump": 0.009254982357933409, "get_robot_state": 0.013614179974510556, "sim_render-ego0": 0.003591185524350121, "sim_render-ego1": 0.003620177223568871, "sim_render-ego2": 0.003512552806309291, "sim_render-ego3": 0.0035330545334588915, "get_duckie_state": 1.4282408214750744e-06, "in-drivable-lane": 3.0499999999999914, "deviation-heading": 0.867080540349331, "agent_compute-ego0": 0.010876085644676571, "agent_compute-ego1": 0.010332965850830078, "agent_compute-ego2": 0.01030534335545131, "agent_compute-ego3": 0.01051996321905227, "complete-iteration": 0.802783641361055, "set_robot_commands": 0.0020950044904436385, "deviation-center-line": 0.18524260463403516, "driven_lanedir_consec": 0.7173980024822183, "sim_compute_sim_state": 0.03339133716764904, "sim_compute_performance-ego0": 0.0020251932598295665, "sim_compute_performance-ego1": 0.00185043698265439, "sim_compute_performance-ego2": 0.0018631458282470704, "sim_compute_performance-ego3": 0.0017635254632859005}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.413599166315601, "get_ui_image": 0.0466080075218564, "step_physics": 0.6276041689373199, "survival_time": 5.1999999999999895, "driven_lanedir": 0.11975322687645118, "get_state_dump": 0.009254982357933409, "get_robot_state": 0.013614179974510556, "sim_render-ego0": 0.003591185524350121, "sim_render-ego1": 0.003620177223568871, "sim_render-ego2": 0.003512552806309291, "sim_render-ego3": 0.0035330545334588915, "get_duckie_state": 1.4282408214750744e-06, "in-drivable-lane": 4.54999999999999, "deviation-heading": 0.41633267011024633, "agent_compute-ego0": 0.010876085644676571, "agent_compute-ego1": 0.010332965850830078, "agent_compute-ego2": 0.01030534335545131, "agent_compute-ego3": 0.01051996321905227, "complete-iteration": 0.802783641361055, "set_robot_commands": 0.0020950044904436385, "deviation-center-line": 0.05518112651933551, "driven_lanedir_consec": 0.11975322687645118, "sim_compute_sim_state": 0.03339133716764904, "sim_compute_performance-ego0": 0.0020251932598295665, "sim_compute_performance-ego1": 0.00185043698265439, "sim_compute_performance-ego2": 0.0018631458282470704, "sim_compute_performance-ego3": 0.0017635254632859005}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.8859035020838468, "get_ui_image": 0.0466080075218564, "step_physics": 0.6276041689373199, "survival_time": 5.1999999999999895, "driven_lanedir": 0.9084889312577556, "get_state_dump": 0.009254982357933409, "get_robot_state": 0.013614179974510556, "sim_render-ego0": 0.003591185524350121, "sim_render-ego1": 0.003620177223568871, "sim_render-ego2": 0.003512552806309291, "sim_render-ego3": 0.0035330545334588915, "get_duckie_state": 1.4282408214750744e-06, "in-drivable-lane": 2.6499999999999906, "deviation-heading": 0.7560294458114469, "agent_compute-ego0": 0.010876085644676571, "agent_compute-ego1": 0.010332965850830078, "agent_compute-ego2": 0.01030534335545131, "agent_compute-ego3": 0.01051996321905227, "complete-iteration": 0.802783641361055, "set_robot_commands": 0.0020950044904436385, "deviation-center-line": 0.2274030062822905, "driven_lanedir_consec": 0.9084889312577556, "sim_compute_sim_state": 0.03339133716764904, "sim_compute_performance-ego0": 0.0020251932598295665, "sim_compute_performance-ego1": 0.00185043698265439, "sim_compute_performance-ego2": 0.0018631458282470704, "sim_compute_performance-ego3": 0.0017635254632859005}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.3478761906085472, "get_ui_image": 0.0466080075218564, "step_physics": 0.6276041689373199, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6255720679354082, "get_state_dump": 0.009254982357933409, "get_robot_state": 0.013614179974510556, "sim_render-ego0": 0.003591185524350121, "sim_render-ego1": 0.003620177223568871, "sim_render-ego2": 0.003512552806309291, "sim_render-ego3": 0.0035330545334588915, "get_duckie_state": 1.4282408214750744e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 0.7506184812162171, "agent_compute-ego0": 0.010876085644676571, "agent_compute-ego1": 0.010332965850830078, "agent_compute-ego2": 0.01030534335545131, "agent_compute-ego3": 0.01051996321905227, "complete-iteration": 0.802783641361055, "set_robot_commands": 0.0020950044904436385, "deviation-center-line": 0.1970464118524351, "driven_lanedir_consec": 0.6255720679354082, "sim_compute_sim_state": 0.03339133716764904, "sim_compute_performance-ego0": 0.0020251932598295665, "sim_compute_performance-ego1": 0.00185043698265439, "sim_compute_performance-ego2": 0.0018631458282470704, "sim_compute_performance-ego3": 0.0017635254632859005}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8190735567943087, "get_ui_image": 0.04572907311575753, "step_physics": 0.6076237201690674, "survival_time": 8.699999999999989, "driven_lanedir": 0.204271039946744, "get_state_dump": 0.009107393537248884, "get_robot_state": 0.013533479145595006, "sim_render-ego0": 0.0037278229849679128, "sim_render-ego1": 0.0036484077998570033, "sim_render-ego2": 0.0035436834607805523, "sim_render-ego3": 0.00348578998020717, "get_duckie_state": 1.2724740164620536e-06, "in-drivable-lane": 7.7499999999999885, "deviation-heading": 0.5956547684236475, "agent_compute-ego0": 0.012123090199061805, "agent_compute-ego1": 0.011901130676269533, "agent_compute-ego2": 0.011327366147722517, "agent_compute-ego3": 0.010907328469412668, "complete-iteration": 0.7754182992662703, "set_robot_commands": 0.0021439906529017857, "deviation-center-line": 0.06316401342706499, "driven_lanedir_consec": 0.204271039946744, "sim_compute_sim_state": 0.022635752814156668, "sim_compute_performance-ego0": 0.001992692947387695, "sim_compute_performance-ego1": 0.0018682289123535156, "sim_compute_performance-ego2": 0.0018120970044817244, "sim_compute_performance-ego3": 0.001803562981741769}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.9291785515511695, "get_ui_image": 0.04572907311575753, "step_physics": 0.6076237201690674, "survival_time": 8.699999999999989, "driven_lanedir": 0.6475775599005906, "get_state_dump": 0.009107393537248884, "get_robot_state": 0.013533479145595006, "sim_render-ego0": 0.0037278229849679128, "sim_render-ego1": 0.0036484077998570033, "sim_render-ego2": 0.0035436834607805523, "sim_render-ego3": 0.00348578998020717, "get_duckie_state": 1.2724740164620536e-06, "in-drivable-lane": 6.849999999999988, "deviation-heading": 0.26252044590060647, "agent_compute-ego0": 0.012123090199061805, "agent_compute-ego1": 0.011901130676269533, "agent_compute-ego2": 0.011327366147722517, "agent_compute-ego3": 0.010907328469412668, "complete-iteration": 0.7754182992662703, "set_robot_commands": 0.0021439906529017857, "deviation-center-line": 0.0775485848193056, "driven_lanedir_consec": 0.6475775599005906, "sim_compute_sim_state": 0.022635752814156668, "sim_compute_performance-ego0": 0.001992692947387695, "sim_compute_performance-ego1": 0.0018682289123535156, "sim_compute_performance-ego2": 0.0018120970044817244, "sim_compute_performance-ego3": 0.001803562981741769}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.446854510378138, "get_ui_image": 0.04572907311575753, "step_physics": 0.6076237201690674, "survival_time": 8.699999999999989, "driven_lanedir": 0.5656387472941029, "get_state_dump": 0.009107393537248884, "get_robot_state": 0.013533479145595006, "sim_render-ego0": 0.0037278229849679128, "sim_render-ego1": 0.0036484077998570033, "sim_render-ego2": 0.0035436834607805523, "sim_render-ego3": 0.00348578998020717, "get_duckie_state": 1.2724740164620536e-06, "in-drivable-lane": 7.049999999999987, "deviation-heading": 0.2665393864559088, "agent_compute-ego0": 0.012123090199061805, "agent_compute-ego1": 0.011901130676269533, "agent_compute-ego2": 0.011327366147722517, "agent_compute-ego3": 0.010907328469412668, "complete-iteration": 0.7754182992662703, "set_robot_commands": 0.0021439906529017857, "deviation-center-line": 0.1858875809975676, "driven_lanedir_consec": 0.5656387472941029, "sim_compute_sim_state": 0.022635752814156668, "sim_compute_performance-ego0": 0.001992692947387695, "sim_compute_performance-ego1": 0.0018682289123535156, "sim_compute_performance-ego2": 0.0018120970044817244, "sim_compute_performance-ego3": 0.001803562981741769}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.6754281990913904, "get_ui_image": 0.04572907311575753, "step_physics": 0.6076237201690674, "survival_time": 8.699999999999989, "driven_lanedir": 0.531623736296337, "get_state_dump": 0.009107393537248884, "get_robot_state": 0.013533479145595006, "sim_render-ego0": 0.0037278229849679128, "sim_render-ego1": 0.0036484077998570033, "sim_render-ego2": 0.0035436834607805523, "sim_render-ego3": 0.00348578998020717, "get_duckie_state": 1.2724740164620536e-06, "in-drivable-lane": 7.099999999999988, "deviation-heading": 0.3765924624405937, "agent_compute-ego0": 0.012123090199061805, "agent_compute-ego1": 0.011901130676269533, "agent_compute-ego2": 0.011327366147722517, "agent_compute-ego3": 0.010907328469412668, "complete-iteration": 0.7754182992662703, "set_robot_commands": 0.0021439906529017857, "deviation-center-line": 0.09654869044461176, "driven_lanedir_consec": 0.531623736296337, "sim_compute_sim_state": 0.022635752814156668, "sim_compute_performance-ego0": 0.001992692947387695, "sim_compute_performance-ego1": 0.0018682289123535156, "sim_compute_performance-ego2": 0.0018120970044817244, "sim_compute_performance-ego3": 0.001803562981741769}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.7160571722130875, "get_ui_image": 0.028799302577972412, "step_physics": 0.15122034311294555, "survival_time": 4.94999999999999, "driven_lanedir": 0.7912652802573135, "get_state_dump": 0.00561384916305542, "get_robot_state": 0.006503956317901611, "sim_render-ego0": 0.0033093953132629396, "sim_render-ego1": 0.00321169376373291, "get_duckie_state": 1.0967254638671874e-06, "in-drivable-lane": 2.79999999999999, "deviation-heading": 0.27730149789233977, "agent_compute-ego0": 0.00978489637374878, "agent_compute-ego1": 0.008926470279693604, "complete-iteration": 0.2326043605804443, "set_robot_commands": 0.0019335246086120603, "deviation-center-line": 0.1090565050273313, "driven_lanedir_consec": 0.7912652802573135, "sim_compute_sim_state": 0.007918350696563721, "sim_compute_performance-ego0": 0.0017208242416381836, "sim_compute_performance-ego1": 0.0016641759872436524}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.694516212168272, "get_ui_image": 0.028799302577972412, "step_physics": 0.15122034311294555, "survival_time": 4.94999999999999, "driven_lanedir": 0.6269592523184353, "get_state_dump": 0.00561384916305542, "get_robot_state": 0.006503956317901611, "sim_render-ego0": 0.0033093953132629396, "sim_render-ego1": 0.00321169376373291, "get_duckie_state": 1.0967254638671874e-06, "in-drivable-lane": 2.8999999999999897, "deviation-heading": 0.8277465282420078, "agent_compute-ego0": 0.00978489637374878, "agent_compute-ego1": 0.008926470279693604, "complete-iteration": 0.2326043605804443, "set_robot_commands": 0.0019335246086120603, "deviation-center-line": 0.18050597124573223, "driven_lanedir_consec": 0.6269592523184353, "sim_compute_sim_state": 0.007918350696563721, "sim_compute_performance-ego0": 0.0017208242416381836, "sim_compute_performance-ego1": 0.0016641759872436524}}
set_robot_commands_max0.0021439906529017857
set_robot_commands_mean0.0020843456544223523
set_robot_commands_median0.0020950044904436385
set_robot_commands_min0.0019335246086120603
sim_compute_performance-ego0_max0.0020251932598295665
sim_compute_performance-ego0_mean0.0019526595409129228
sim_compute_performance-ego0_median0.001992692947387695
sim_compute_performance-ego0_min0.0017208242416381836
sim_compute_performance-ego1_max0.0018682289123535156
sim_compute_performance-ego1_mean0.0018256676201822285
sim_compute_performance-ego1_median0.00185043698265439
sim_compute_performance-ego1_min0.0016641759872436524
sim_compute_sim_state_max0.03339133716764904
sim_compute_sim_state_mean0.023942041959033673
sim_compute_sim_state_median0.02381088152653029
sim_compute_sim_state_min0.007918350696563721
sim_render-ego0_max0.0037278229849679128
sim_render-ego0_mean0.00356963831312707
sim_render-ego0_median0.003591185524350121
sim_render-ego0_min0.0033093953132629396
sim_render-ego1_max0.0036484077998570033
sim_render-ego1_mean0.0035273188808146554
sim_render-ego1_median0.003620177223568871
sim_render-ego1_min0.00321169376373291
simulation-passed1
step_physics_max0.6276041689373199
step_physics_mean0.507063217793717
step_physics_median0.6076237201690674
step_physics_min0.15122034311294555
survival_time_max8.699999999999989
survival_time_mean6.364285714285702
survival_time_min4.94999999999999
No reset possible
5354512602Bea Baselines 🐤template-randomaido5-LFI-full-sim-validationLFVIv-simsuccessyesnogpu-prod-040:02:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6587966891077274
survival_time_median4.82499999999999
deviation-center-line_median0.18372681341530445
in-drivable-lane_median2.6749999999999927


other stats
agent_compute-ego0_max0.010678549607594809
agent_compute-ego0_mean0.01066158666755214
agent_compute-ego0_median0.01066158666755214
agent_compute-ego0_min0.01064462372750947
complete-iteration_max0.20726095885038376
complete-iteration_mean0.20681968892011984
complete-iteration_median0.20681968892011984
complete-iteration_min0.20637841898985584
deviation-center-line_max0.22270545771576217
deviation-center-line_mean0.18372681341530445
deviation-center-line_min0.14474816911484673
deviation-heading_max0.9254423888501632
deviation-heading_mean0.9131948861321344
deviation-heading_median0.9131948861321344
deviation-heading_min0.9009473834141052
driven_any_max1.7167609354270057
driven_any_mean1.6960945672591825
driven_any_median1.6960945672591825
driven_any_min1.6754281990913595
driven_lanedir_consec_max0.8731138199226813
driven_lanedir_consec_mean0.6587966891077274
driven_lanedir_consec_min0.4444795582927734
driven_lanedir_max0.8919331054681621
driven_lanedir_mean0.6682063318804677
driven_lanedir_median0.6682063318804677
driven_lanedir_min0.4444795582927734
get_duckie_state_max2.1010637283325195e-06
get_duckie_state_mean2.0800666375593706e-06
get_duckie_state_median2.0800666375593706e-06
get_duckie_state_min2.0590695467862217e-06
get_robot_state_max0.003799470762411753
get_robot_state_mean0.00368786629552793
get_robot_state_median0.00368786629552793
get_robot_state_min0.003576261828644107
get_state_dump_max0.004583102961381276
get_state_dump_mean0.0045648208546518075
get_state_dump_median0.0045648208546518075
get_state_dump_min0.004546538747922339
get_ui_image_max0.03736994912226995
get_ui_image_mean0.037277633230192495
get_ui_image_median0.037277633230192495
get_ui_image_min0.03718531733811504
in-drivable-lane_max3.249999999999993
in-drivable-lane_mean2.6749999999999927
in-drivable-lane_min2.0999999999999925
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 1.6754281990913595, "get_ui_image": 0.03736994912226995, "step_physics": 0.13190030554930368, "survival_time": 4.749999999999991, "driven_lanedir": 0.8919331054681621, "get_state_dump": 0.004583102961381276, "get_robot_state": 0.003799470762411753, "sim_render-ego0": 0.003758393228054046, "get_duckie_state": 2.1010637283325195e-06, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 0.9009473834141052, "agent_compute-ego0": 0.010678549607594809, "complete-iteration": 0.20726095885038376, "set_robot_commands": 0.002159165839354197, "deviation-center-line": 0.22270545771576217, "driven_lanedir_consec": 0.8731138199226813, "sim_compute_sim_state": 0.010876275599002838, "sim_compute_performance-ego0": 0.0020498037338256836}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7167609354270057, "get_ui_image": 0.03718531733811504, "step_physics": 0.1329860037023371, "survival_time": 4.899999999999991, "driven_lanedir": 0.4444795582927734, "get_state_dump": 0.004546538747922339, "get_robot_state": 0.003576261828644107, "sim_render-ego0": 0.003726841223360312, "get_duckie_state": 2.0590695467862217e-06, "in-drivable-lane": 3.249999999999993, "deviation-heading": 0.9254423888501632, "agent_compute-ego0": 0.01064462372750947, "complete-iteration": 0.20637841898985584, "set_robot_commands": 0.0021889017085836393, "deviation-center-line": 0.14474816911484673, "driven_lanedir_consec": 0.4444795582927734, "sim_compute_sim_state": 0.009470838488954489, "sim_compute_performance-ego0": 0.0019672687607582167}}
set_robot_commands_max0.0021889017085836393
set_robot_commands_mean0.002174033773968918
set_robot_commands_median0.002174033773968918
set_robot_commands_min0.002159165839354197
sim_compute_performance-ego0_max0.0020498037338256836
sim_compute_performance-ego0_mean0.00200853624729195
sim_compute_performance-ego0_median0.00200853624729195
sim_compute_performance-ego0_min0.0019672687607582167
sim_compute_sim_state_max0.010876275599002838
sim_compute_sim_state_mean0.010173557043978662
sim_compute_sim_state_median0.010173557043978662
sim_compute_sim_state_min0.009470838488954489
sim_render-ego0_max0.003758393228054046
sim_render-ego0_mean0.00374261722570718
sim_render-ego0_median0.00374261722570718
sim_render-ego0_min0.003726841223360312
simulation-passed1
step_physics_max0.1329860037023371
step_physics_mean0.1324431546258204
step_physics_median0.1324431546258204
step_physics_min0.13190030554930368
survival_time_max4.899999999999991
survival_time_mean4.82499999999999
survival_time_min4.749999999999991
No reset possible
5349012681Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-040:37:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4247199481693422
survival_time_median33.04999999999936
deviation-center-line_median1.6261348662939132
in-drivable-lane_median12.449999999999523


other stats
agent_compute-ego0_max0.012633019541820618
agent_compute-ego0_mean0.012156927586328088
agent_compute-ego0_median0.012156927586328088
agent_compute-ego0_min0.011680835630835556
agent_compute-npc0_max0.0458465031441999
agent_compute-npc0_mean0.04393892569020397
agent_compute-npc0_median0.04393892569020397
agent_compute-npc0_min0.04203134823620804
agent_compute-npc1_max0.04586080806042928
agent_compute-npc1_mean0.03868717390832296
agent_compute-npc1_median0.03868717390832296
agent_compute-npc1_min0.03151353975621665
agent_compute-npc2_max0.03804694742683963
agent_compute-npc2_mean0.034455622158363126
agent_compute-npc2_median0.034455622158363126
agent_compute-npc2_min0.030864296889886626
complete-iteration_max1.3235104764927237
complete-iteration_mean1.1484776164731616
complete-iteration_median1.1484776164731616
complete-iteration_min0.9734447564535994
deviation-center-line_max2.9692095916382386
deviation-center-line_mean1.6261348662939132
deviation-center-line_min0.2830601409495878
deviation-heading_max12.972755278926549
deviation-heading_mean7.110307822561778
deviation-heading_median7.110307822561778
deviation-heading_min1.2478603661970091
driven_any_max7.913638348248197
driven_any_mean4.292700624157337
driven_any_median4.292700624157337
driven_any_min0.6717629000664771
driven_lanedir_consec_max2.2006259570271465
driven_lanedir_consec_mean1.4247199481693422
driven_lanedir_consec_min0.648813939311538
driven_lanedir_max4.087418259507885
driven_lanedir_mean2.37335833871666
driven_lanedir_median2.37335833871666
driven_lanedir_min0.6592984179254355
get_duckie_state_max1.537909019400337e-06
get_duckie_state_mean1.489056153084156e-06
get_duckie_state_median1.489056153084156e-06
get_duckie_state_min1.4402032867679752e-06
get_robot_state_max0.015240677389673746
get_robot_state_mean0.014614977680571515
get_robot_state_median0.014614977680571515
get_robot_state_min0.01398927797146929
get_state_dump_max0.009940050920777078
get_state_dump_mean0.009574856434874357
get_state_dump_median0.009574856434874357
get_state_dump_min0.009209661948971631
get_ui_image_max0.05359767021287192
get_ui_image_mean0.05196618982973829
get_ui_image_median0.05196618982973829
get_ui_image_min0.05033470944660466
in-drivable-lane_max24.899999999999046
in-drivable-lane_mean12.449999999999523
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 0.6717629000664771, "get_ui_image": 0.05033470944660466, "step_physics": 0.7145954612793961, "survival_time": 6.099999999999986, "driven_lanedir": 0.6592984179254355, "get_state_dump": 0.009209661948971631, "get_robot_state": 0.01398927797146929, "sim_render-ego0": 0.0036698415027401313, "sim_render-npc0": 0.003764261075151645, "sim_render-npc1": 0.003675061512768753, "sim_render-npc2": 0.0038550093891174817, "get_duckie_state": 1.4402032867679752e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.2478603661970091, "agent_compute-ego0": 0.011680835630835556, "agent_compute-npc0": 0.04203134823620804, "agent_compute-npc1": 0.03151353975621665, "agent_compute-npc2": 0.030864296889886626, "complete-iteration": 0.9734447564535994, "set_robot_commands": 0.0021907410970548303, "deviation-center-line": 0.2830601409495878, "driven_lanedir_consec": 0.648813939311538, "sim_compute_sim_state": 0.03744455081660573, "sim_compute_performance-ego0": 0.002011673237250103, "sim_compute_performance-npc0": 0.0019450129532232515, "sim_compute_performance-npc1": 0.0019012505446023087, "sim_compute_performance-npc2": 0.001955181602540055}, "LFVI-norm-udem1-000-ego0": {"driven_any": 7.913638348248197, "get_ui_image": 0.05359767021287192, "step_physics": 1.027380559962556, "survival_time": 59.99999999999873, "driven_lanedir": 4.087418259507885, "get_state_dump": 0.009940050920777078, "get_robot_state": 0.015240677389673746, "sim_render-ego0": 0.004046194162297309, "sim_render-npc0": 0.004192988143971719, "sim_render-npc1": 0.0040360642511779125, "sim_render-npc2": 0.004036288178036552, "get_duckie_state": 1.537909019400337e-06, "in-drivable-lane": 24.899999999999046, "deviation-heading": 12.972755278926549, "agent_compute-ego0": 0.012633019541820618, "agent_compute-npc0": 0.0458465031441999, "agent_compute-npc1": 0.04586080806042928, "agent_compute-npc2": 0.03804694742683963, "complete-iteration": 1.3235104764927237, "set_robot_commands": 0.002595391102774157, "deviation-center-line": 2.9692095916382386, "driven_lanedir_consec": 2.2006259570271465, "sim_compute_sim_state": 0.03967723441461441, "sim_compute_performance-ego0": 0.002285851725531458, "sim_compute_performance-npc0": 0.002161087342642626, "sim_compute_performance-npc1": 0.002184456532245671, "sim_compute_performance-npc2": 0.0021570747242085045}}
set_robot_commands_max0.002595391102774157
set_robot_commands_mean0.0023930660999144935
set_robot_commands_median0.0023930660999144935
set_robot_commands_min0.0021907410970548303
sim_compute_performance-ego0_max0.002285851725531458
sim_compute_performance-ego0_mean0.0021487624813907808
sim_compute_performance-ego0_median0.0021487624813907808
sim_compute_performance-ego0_min0.002011673237250103
sim_compute_performance-npc0_max0.002161087342642626
sim_compute_performance-npc0_mean0.0020530501479329387
sim_compute_performance-npc0_median0.0020530501479329387
sim_compute_performance-npc0_min0.0019450129532232515
sim_compute_performance-npc1_max0.002184456532245671
sim_compute_performance-npc1_mean0.00204285353842399
sim_compute_performance-npc1_median0.00204285353842399
sim_compute_performance-npc1_min0.0019012505446023087
sim_compute_performance-npc2_max0.0021570747242085045
sim_compute_performance-npc2_mean0.00205612816337428
sim_compute_performance-npc2_median0.00205612816337428
sim_compute_performance-npc2_min0.001955181602540055
sim_compute_sim_state_max0.03967723441461441
sim_compute_sim_state_mean0.03856089261561007
sim_compute_sim_state_median0.03856089261561007
sim_compute_sim_state_min0.03744455081660573
sim_render-ego0_max0.004046194162297309
sim_render-ego0_mean0.00385801783251872
sim_render-ego0_median0.00385801783251872
sim_render-ego0_min0.0036698415027401313
sim_render-npc0_max0.004192988143971719
sim_render-npc0_mean0.003978624609561682
sim_render-npc0_median0.003978624609561682
sim_render-npc0_min0.003764261075151645
sim_render-npc1_max0.0040360642511779125
sim_render-npc1_mean0.003855562881973333
sim_render-npc1_median0.003855562881973333
sim_render-npc1_min0.003675061512768753
sim_render-npc2_max0.004036288178036552
sim_render-npc2_mean0.003945648783577017
sim_render-npc2_median0.003945648783577017
sim_render-npc2_min0.0038550093891174817
simulation-passed1
step_physics_max1.027380559962556
step_physics_mean0.8709880106209761
step_physics_median0.8709880106209761
step_physics_min0.7145954612793961
survival_time_max59.99999999999873
survival_time_mean33.04999999999936
survival_time_min6.099999999999986
No reset possible
5341712568Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessyesnogpu-prod-040:40:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5845020784009587
survival_time_median22.05000000000018
deviation-center-line_median0.36159514613690735
in-drivable-lane_median17.650000000000187


other stats
agent_compute-ego0_max0.010319224310137027
agent_compute-ego0_mean0.00989952630701832
agent_compute-ego0_median0.010009248989420636
agent_compute-ego0_min0.009264598999704634
agent_compute-ego1_max0.01042486100175262
agent_compute-ego1_mean0.010044976767535158
agent_compute-ego1_median0.010176554484969926
agent_compute-ego1_min0.009359650313854218
complete-iteration_max1.105459290993939
complete-iteration_mean0.7701469114881212
complete-iteration_median0.8243650224953215
complete-iteration_min0.2446401459830148
deviation-center-line_max0.6128060296104244
deviation-center-line_mean0.37163603052463456
deviation-center-line_min0.13131467496691465
deviation-heading_max3.914823649869822
deviation-heading_mean1.69923675229233
deviation-heading_median1.7837659422502474
deviation-heading_min0.5703639195063125
driven_any_max5.114746336331455
driven_any_mean2.0430849429179028
driven_any_median1.672675359708932
driven_any_min0.8124423795237465
driven_lanedir_consec_max0.977662661166671
driven_lanedir_consec_mean0.5932421336189245
driven_lanedir_consec_min0.1964323403421724
driven_lanedir_max0.977662661166671
driven_lanedir_mean0.5932421336189245
driven_lanedir_median0.5845020784009587
driven_lanedir_min0.1964323403421724
get_duckie_state_max1.5227545442149718e-06
get_duckie_state_mean1.441750697768224e-06
get_duckie_state_median1.521132111009969e-06
get_duckie_state_min1.1292951447623118e-06
get_robot_state_max0.01474181203499971
get_robot_state_mean0.013153919139803016
get_robot_state_median0.014353870806111469
get_robot_state_min0.006530704242842538
get_state_dump_max0.009606865750460096
get_state_dump_mean0.008955357063079513
get_state_dump_median0.0096056261753065
get_state_dump_min0.005879821521895272
get_ui_image_max0.04889120215000861
get_ui_image_mean0.04324787385131441
get_ui_image_median0.04806008058435777
get_ui_image_min0.02755738581929888
in-drivable-lane_max27.550000000000328
in-drivable-lane_mean16.92142857142874
in-drivable-lane_min7.300000000000029
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.669702128629466, "get_ui_image": 0.040637582835584586, "step_physics": 0.48358763326512705, "survival_time": 15.10000000000008, "driven_lanedir": 0.8756474193632071, "get_state_dump": 0.009191347034064065, "get_robot_state": 0.013677682026778118, "sim_render-ego0": 0.003613608898502765, "sim_render-ego1": 0.0036117369585698194, "sim_render-ego2": 0.003583402916936591, "sim_render-ego3": 0.003612873971265535, "get_duckie_state": 1.4375932145826887e-06, "in-drivable-lane": 8.900000000000095, "deviation-heading": 2.1492018701903586, "agent_compute-ego0": 0.00968756927515414, "agent_compute-ego1": 0.0098761780427234, "agent_compute-ego2": 0.01022650935862324, "agent_compute-ego3": 0.00988753321934061, "complete-iteration": 0.6433698037276567, "set_robot_commands": 0.002162827910369772, "deviation-center-line": 0.6128060296104244, "driven_lanedir_consec": 0.8756474193632071, "sim_compute_sim_state": 0.026016064602943145, "sim_compute_performance-ego0": 0.001992292530072404, "sim_compute_performance-ego1": 0.001857552197900149, "sim_compute_performance-ego2": 0.0018408424390031167, "sim_compute_performance-ego3": 0.0018259487529792408}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.97804980373683, "get_ui_image": 0.040637582835584586, "step_physics": 0.48358763326512705, "survival_time": 15.10000000000008, "driven_lanedir": 0.3294444869160553, "get_state_dump": 0.009191347034064065, "get_robot_state": 0.013677682026778118, "sim_render-ego0": 0.003613608898502765, "sim_render-ego1": 0.0036117369585698194, "sim_render-ego2": 0.003583402916936591, "sim_render-ego3": 0.003612873971265535, "get_duckie_state": 1.4375932145826887e-06, "in-drivable-lane": 11.70000000000006, "deviation-heading": 2.3793594057095864, "agent_compute-ego0": 0.00968756927515414, "agent_compute-ego1": 0.0098761780427234, "agent_compute-ego2": 0.01022650935862324, "agent_compute-ego3": 0.00988753321934061, "complete-iteration": 0.6433698037276567, "set_robot_commands": 0.002162827910369772, "deviation-center-line": 0.35672508523152285, "driven_lanedir_consec": 0.3294444869160553, "sim_compute_sim_state": 0.026016064602943145, "sim_compute_performance-ego0": 0.001992292530072404, "sim_compute_performance-ego1": 0.001857552197900149, "sim_compute_performance-ego2": 0.0018408424390031167, "sim_compute_performance-ego3": 0.0018259487529792408}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.317023512748307, "get_ui_image": 0.040637582835584586, "step_physics": 0.48358763326512705, "survival_time": 15.10000000000008, "driven_lanedir": 0.44477401954845086, "get_state_dump": 0.009191347034064065, "get_robot_state": 0.013677682026778118, "sim_render-ego0": 0.003613608898502765, "sim_render-ego1": 0.0036117369585698194, "sim_render-ego2": 0.003583402916936591, "sim_render-ego3": 0.003612873971265535, "get_duckie_state": 1.4375932145826887e-06, "in-drivable-lane": 11.950000000000085, "deviation-heading": 0.9068102341402988, "agent_compute-ego0": 0.00968756927515414, "agent_compute-ego1": 0.0098761780427234, "agent_compute-ego2": 0.01022650935862324, "agent_compute-ego3": 0.00988753321934061, "complete-iteration": 0.6433698037276567, "set_robot_commands": 0.002162827910369772, "deviation-center-line": 0.24865738990220165, "driven_lanedir_consec": 0.44477401954845086, "sim_compute_sim_state": 0.026016064602943145, "sim_compute_performance-ego0": 0.001992292530072404, "sim_compute_performance-ego1": 0.001857552197900149, "sim_compute_performance-ego2": 0.0018408424390031167, "sim_compute_performance-ego3": 0.0018259487529792408}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.1779115194823089, "get_ui_image": 0.040637582835584586, "step_physics": 0.48358763326512705, "survival_time": 15.10000000000008, "driven_lanedir": 0.8739655144399272, "get_state_dump": 0.009191347034064065, "get_robot_state": 0.013677682026778118, "sim_render-ego0": 0.003613608898502765, "sim_render-ego1": 0.0036117369585698194, "sim_render-ego2": 0.003583402916936591, "sim_render-ego3": 0.003612873971265535, "get_duckie_state": 1.4375932145826887e-06, "in-drivable-lane": 9.000000000000092, "deviation-heading": 1.968896617771691, "agent_compute-ego0": 0.00968756927515414, "agent_compute-ego1": 0.0098761780427234, "agent_compute-ego2": 0.01022650935862324, "agent_compute-ego3": 0.00988753321934061, "complete-iteration": 0.6433698037276567, "set_robot_commands": 0.002162827910369772, "deviation-center-line": 0.456487134836235, "driven_lanedir_consec": 0.8739655144399272, "sim_compute_sim_state": 0.026016064602943145, "sim_compute_performance-ego0": 0.001992292530072404, "sim_compute_performance-ego1": 0.001857552197900149, "sim_compute_performance-ego2": 0.0018408424390031167, "sim_compute_performance-ego3": 0.0018259487529792408}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.3087345789536873, "get_ui_image": 0.04889120215000861, "step_physics": 0.933419856935879, "survival_time": 32.00000000000032, "driven_lanedir": 0.5568351699536372, "get_state_dump": 0.009606865750460096, "get_robot_state": 0.01474181203499971, "sim_render-ego0": 0.003873858176601844, "sim_render-ego1": 0.0038150435490838823, "sim_render-ego2": 0.0037311421541639496, "sim_render-ego3": 0.0037684373662177934, "get_duckie_state": 1.5227545442149718e-06, "in-drivable-lane": 27.550000000000328, "deviation-heading": 2.2820480631587916, "agent_compute-ego0": 0.010009248989420636, "agent_compute-ego1": 0.010176554484969926, "agent_compute-ego2": 0.010155587784027718, "agent_compute-ego3": 0.00993621405126896, "complete-iteration": 1.105459290993939, "set_robot_commands": 0.0023599585951211486, "deviation-center-line": 0.39832275630911695, "driven_lanedir_consec": 0.5568351699536372, "sim_compute_sim_state": 0.02570551568743963, "sim_compute_performance-ego0": 0.002138985858506606, "sim_compute_performance-ego1": 0.0020048811729538275, "sim_compute_performance-ego2": 0.00197337867689207, "sim_compute_performance-ego3": 0.0019868171531213057}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 5.114746336331455, "get_ui_image": 0.04889120215000861, "step_physics": 0.933419856935879, "survival_time": 32.00000000000032, "driven_lanedir": 0.977662661166671, "get_state_dump": 0.009606865750460096, "get_robot_state": 0.01474181203499971, "sim_render-ego0": 0.003873858176601844, "sim_render-ego1": 0.0038150435490838823, "sim_render-ego2": 0.0037311421541639496, "sim_render-ego3": 0.0037684373662177934, "get_duckie_state": 1.5227545442149718e-06, "in-drivable-lane": 24.600000000000232, "deviation-heading": 3.914823649869822, "agent_compute-ego0": 0.010009248989420636, "agent_compute-ego1": 0.010176554484969926, "agent_compute-ego2": 0.010155587784027718, "agent_compute-ego3": 0.00993621405126896, "complete-iteration": 1.105459290993939, "set_robot_commands": 0.0023599585951211486, "deviation-center-line": 0.5935504233433263, "driven_lanedir_consec": 0.977662661166671, "sim_compute_sim_state": 0.02570551568743963, "sim_compute_performance-ego0": 0.002138985858506606, "sim_compute_performance-ego1": 0.0020048811729538275, "sim_compute_performance-ego2": 0.00197337867689207, "sim_compute_performance-ego3": 0.0019868171531213057}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.87895973253482, "get_ui_image": 0.04889120215000861, "step_physics": 0.933419856935879, "survival_time": 32.00000000000032, "driven_lanedir": 0.7157696938306048, "get_state_dump": 0.009606865750460096, "get_robot_state": 0.01474181203499971, "sim_render-ego0": 0.003873858176601844, "sim_render-ego1": 0.0038150435490838823, "sim_render-ego2": 0.0037311421541639496, "sim_render-ego3": 0.0037684373662177934, "get_duckie_state": 1.5227545442149718e-06, "in-drivable-lane": 26.70000000000033, "deviation-heading": 2.165863847567469, "agent_compute-ego0": 0.010009248989420636, "agent_compute-ego1": 0.010176554484969926, "agent_compute-ego2": 0.010155587784027718, "agent_compute-ego3": 0.00993621405126896, "complete-iteration": 1.105459290993939, "set_robot_commands": 0.0023599585951211486, "deviation-center-line": 0.5082735897475552, "driven_lanedir_consec": 0.7157696938306048, "sim_compute_sim_state": 0.02570551568743963, "sim_compute_performance-ego0": 0.002138985858506606, "sim_compute_performance-ego1": 0.0020048811729538275, "sim_compute_performance-ego2": 0.00197337867689207, "sim_compute_performance-ego3": 0.0019868171531213057}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 1.308734578953583, "get_ui_image": 0.04889120215000861, "step_physics": 0.933419856935879, "survival_time": 32.00000000000032, "driven_lanedir": 0.640366633236193, "get_state_dump": 0.009606865750460096, "get_robot_state": 0.01474181203499971, "sim_render-ego0": 0.003873858176601844, "sim_render-ego1": 0.0038150435490838823, "sim_render-ego2": 0.0037311421541639496, "sim_render-ego3": 0.0037684373662177934, "get_duckie_state": 1.5227545442149718e-06, "in-drivable-lane": 27.15000000000033, "deviation-heading": 1.598635266728804, "agent_compute-ego0": 0.010009248989420636, "agent_compute-ego1": 0.010176554484969926, "agent_compute-ego2": 0.010155587784027718, "agent_compute-ego3": 0.00993621405126896, "complete-iteration": 1.105459290993939, "set_robot_commands": 0.0023599585951211486, "deviation-center-line": 0.41851362224089594, "driven_lanedir_consec": 0.640366633236193, "sim_compute_sim_state": 0.02570551568743963, "sim_compute_performance-ego0": 0.002138985858506606, "sim_compute_performance-ego1": 0.0020048811729538275, "sim_compute_performance-ego2": 0.00197337867689207, "sim_compute_performance-ego3": 0.0019868171531213057}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.8124423795237465, "get_ui_image": 0.04806008058435777, "step_physics": 0.656101904843188, "survival_time": 22.05000000000018, "driven_lanedir": 0.1964323403421724, "get_state_dump": 0.0096056261753065, "get_robot_state": 0.014353870806111469, "sim_render-ego0": 0.003799314952004549, "sim_render-ego1": 0.003776998002065253, "sim_render-ego2": 0.0036506172758421743, "sim_render-ego3": 0.0035894569768085737, "get_duckie_state": 1.521132111009969e-06, "in-drivable-lane": 20.250000000000178, "deviation-heading": 1.1184016962214265, "agent_compute-ego0": 0.010319224310137027, "agent_compute-ego1": 0.01042486100175262, "agent_compute-ego2": 0.010386249598334818, "agent_compute-ego3": 0.00941793519447292, "complete-iteration": 0.8243650224953215, "set_robot_commands": 0.0022534860205326683, "deviation-center-line": 0.13131467496691465, "driven_lanedir_consec": 0.1964323403421724, "sim_compute_sim_state": 0.024045677746043485, "sim_compute_performance-ego0": 0.0020265120726365307, "sim_compute_performance-ego1": 0.001910555956050821, "sim_compute_performance-ego2": 0.0019228188700266013, "sim_compute_performance-ego3": 0.0018876850335306711}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.9049025830341053, "get_ui_image": 0.04806008058435777, "step_physics": 0.656101904843188, "survival_time": 22.05000000000018, "driven_lanedir": 0.7138391578639616, "get_state_dump": 0.0096056261753065, "get_robot_state": 0.014353870806111469, "sim_render-ego0": 0.003799314952004549, "sim_render-ego1": 0.003776998002065253, "sim_render-ego2": 0.0036506172758421743, "sim_render-ego3": 0.0035894569768085737, "get_duckie_state": 1.521132111009969e-06, "in-drivable-lane": 17.30000000000019, "deviation-heading": 0.6949919463848312, "agent_compute-ego0": 0.010319224310137027, "agent_compute-ego1": 0.01042486100175262, "agent_compute-ego2": 0.010386249598334818, "agent_compute-ego3": 0.00941793519447292, "complete-iteration": 0.8243650224953215, "set_robot_commands": 0.0022534860205326683, "deviation-center-line": 0.203718891398521, "driven_lanedir_consec": 0.7138391578639616, "sim_compute_sim_state": 0.024045677746043485, "sim_compute_performance-ego0": 0.0020265120726365307, "sim_compute_performance-ego1": 0.001910555956050821, "sim_compute_performance-ego2": 0.0019228188700266013, "sim_compute_performance-ego3": 0.0018876850335306711}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 3.4749354803211023, "get_ui_image": 0.04806008058435777, "step_physics": 0.656101904843188, "survival_time": 22.05000000000018, "driven_lanedir": 0.4065491678439639, "get_state_dump": 0.0096056261753065, "get_robot_state": 0.014353870806111469, "sim_render-ego0": 0.003799314952004549, "sim_render-ego1": 0.003776998002065253, "sim_render-ego2": 0.0036506172758421743, "sim_render-ego3": 0.0035894569768085737, "get_duckie_state": 1.521132111009969e-06, "in-drivable-lane": 19.20000000000018, "deviation-heading": 0.5703639195063125, "agent_compute-ego0": 0.010319224310137027, "agent_compute-ego1": 0.01042486100175262, "agent_compute-ego2": 0.010386249598334818, "agent_compute-ego3": 0.00941793519447292, "complete-iteration": 0.8243650224953215, "set_robot_commands": 0.0022534860205326683, "deviation-center-line": 0.3154125566925224, "driven_lanedir_consec": 0.4065491678439639, "sim_compute_sim_state": 0.024045677746043485, "sim_compute_performance-ego0": 0.0020265120726365307, "sim_compute_performance-ego1": 0.001910555956050821, "sim_compute_performance-ego2": 0.0019228188700266013, "sim_compute_performance-ego3": 0.0018876850335306711}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 1.675648590788398, "get_ui_image": 0.04806008058435777, "step_physics": 0.656101904843188, "survival_time": 22.05000000000018, "driven_lanedir": 0.5989210039901636, "get_state_dump": 0.0096056261753065, "get_robot_state": 0.014353870806111469, "sim_render-ego0": 0.003799314952004549, "sim_render-ego1": 0.003776998002065253, "sim_render-ego2": 0.0036506172758421743, "sim_render-ego3": 0.0035894569768085737, "get_duckie_state": 1.521132111009969e-06, "in-drivable-lane": 18.000000000000185, "deviation-heading": 0.8842272187908944, "agent_compute-ego0": 0.010319224310137027, "agent_compute-ego1": 0.01042486100175262, "agent_compute-ego2": 0.010386249598334818, "agent_compute-ego3": 0.00941793519447292, "complete-iteration": 0.8243650224953215, "set_robot_commands": 0.0022534860205326683, "deviation-center-line": 0.26360175582853124, "driven_lanedir_consec": 0.5989210039901636, "sim_compute_sim_state": 0.024045677746043485, "sim_compute_performance-ego0": 0.0020265120726365307, "sim_compute_performance-ego1": 0.001910555956050821, "sim_compute_performance-ego2": 0.0019228188700266013, "sim_compute_performance-ego3": 0.0018876850335306711}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.668306262235915, "get_ui_image": 0.02755738581929888, "step_physics": 0.1641792846577508, "survival_time": 11.150000000000023, "driven_lanedir": 0.5700831528117538, "get_state_dump": 0.005879821521895272, "get_robot_state": 0.006530704242842538, "sim_render-ego0": 0.003562282238687788, "sim_render-ego1": 0.0033527538180351257, "get_duckie_state": 1.1292951447623118e-06, "in-drivable-lane": 7.300000000000029, "deviation-heading": 0.6911789472101965, "agent_compute-ego0": 0.009264598999704634, "agent_compute-ego1": 0.009359650313854218, "complete-iteration": 0.2446401459830148, "set_robot_commands": 0.0019747912883758545, "deviation-center-line": 0.3290553101948258, "driven_lanedir_consec": 0.5700831528117538, "sim_compute_sim_state": 0.007509690310273852, "sim_compute_performance-ego0": 0.001733526587486267, "sim_compute_performance-ego1": 0.0017053751008851187}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.313091713576913, "get_ui_image": 0.02755738581929888, "step_physics": 0.1641792846577508, "survival_time": 11.150000000000023, "driven_lanedir": 0.40509944935818054, "get_state_dump": 0.005879821521895272, "get_robot_state": 0.006530704242842538, "sim_render-ego0": 0.003562282238687788, "sim_render-ego1": 0.0033527538180351257, "get_duckie_state": 1.1292951447623118e-06, "in-drivable-lane": 7.300000000000029, "deviation-heading": 2.4645118488421347, "agent_compute-ego0": 0.009264598999704634, "agent_compute-ego1": 0.009359650313854218, "complete-iteration": 0.2446401459830148, "set_robot_commands": 0.0019747912883758545, "deviation-center-line": 0.36646520704229185, "driven_lanedir_consec": 0.40509944935818054, "sim_compute_sim_state": 0.007509690310273852, "sim_compute_performance-ego0": 0.001733526587486267, "sim_compute_performance-ego1": 0.0017053751008851187}}
set_robot_commands_max0.0023599585951211486
set_robot_commands_mean0.0022181909057747188
set_robot_commands_median0.0022534860205326683
set_robot_commands_min0.0019747912883758545
sim_compute_performance-ego0_max0.002138985858506606
sim_compute_performance-ego0_mean0.002007015358559621
sim_compute_performance-ego0_median0.0020265120726365307
sim_compute_performance-ego0_min0.001733526587486267
sim_compute_performance-ego1_max0.0020048811729538275
sim_compute_performance-ego1_mean0.001893050536384959
sim_compute_performance-ego1_median0.001910555956050821
sim_compute_performance-ego1_min0.0017053751008851187
sim_compute_sim_state_max0.026016064602943145
sim_compute_sim_state_mean0.022720600911875197
sim_compute_sim_state_median0.02570551568743963
sim_compute_sim_state_min0.007509690310273852
sim_render-ego0_max0.003873858176601844
sim_render-ego0_mean0.0037336923275580135
sim_render-ego0_median0.003799314952004549
sim_render-ego0_min0.003562282238687788
sim_render-ego1_max0.0038150435490838823
sim_render-ego1_mean0.0036800444053532904
sim_render-ego1_median0.003776998002065253
sim_render-ego1_min0.0033527538180351257
simulation-passed1
step_physics_max0.933419856935879
step_physics_mean0.6157711535351628
step_physics_median0.656101904843188
step_physics_min0.1641792846577508
survival_time_max32.00000000000032
survival_time_mean21.35000000000017
survival_time_min11.150000000000023
No reset possible
5340412567Bea Baselines 🐤straightaido5-LFP-sim-testingLFP-simabortednonogpu-prod-040:00:51
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5339311410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simabortednonogpu-prod-040:00:27
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5336012622Bea Baselines 🐤baseline-duckietownaido5-LFVI_multi-sim-validationLFVIv-simabortednonogpu-prod-040:48:26
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5335412602Bea Baselines 🐤template-randomaido5-LFI-full-sim-validationLFVIv-simabortednonogpu-prod-040:00:43
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5331111410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simabortednonogpu-prod-040:15:49
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5328712477Bea Baselines 🐤straightaido5-LFP-sim-testingLFP-simabortednonogpu-prod-040:19:49
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5327412543Bea Baselines 🐤template-rosaido5-LF-sim-testingLFt-simabortednonogpu-prod-040:00:54
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5326512473Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simabortednonogpu-prod-040:00:41
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5325012473Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simerrornonogpu-prod-040:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140419318522688
- M:video_aido:cmdline(in:/;out:/) 140419318525232
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5323912477Bea Baselines 🐤straightaido5-LFP-sim-testingLFP-simerrornonogpu-prod-040:04:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140250450570736
- M:video_aido:cmdline(in:/;out:/) 140250450560624
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5321912480Bea Baselines 🐤straightaido5-LFI-sim-validationLFVIv-simerrornonogpu-prod-040:01:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140547651775840
- M:video_aido:cmdline(in:/;out:/) 140547651775648
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5320912483Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simerrornonogpu-prod-040:01:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140266489831376
- M:video_aido:cmdline(in:/;out:/) 140266489830848
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5318411763Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-040:08:48
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139840099443088
- M:video_aido:cmdline(in:/;out:/) 139840098772736
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5314711771Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-040:10:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140669995898384
- M:video_aido:cmdline(in:/;out:/) 140669672289856
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5311711779Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-040:08:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139764169252768
- M:video_aido:cmdline(in:/;out:/) 139764168641216
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5309112340Bea Baselines 🐤template-rosaido5-LFI-full-sim-testingLFVIv-simhost-errornonogpu-prod-040:02:50
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1176, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 758, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5307412342Bea Baselines 🐤template-rosaido5-LFP-sim-testingLFP-simerrornonogpu-prod-040:02:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139675417722160
- M:video_aido:cmdline(in:/;out:/) 139675417269776
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5305812348Bea Baselines 🐤template-rosaido5-LF-sim-testingLFt-simerrornonogpu-prod-040:01:43
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140197739721872
- M:video_aido:cmdline(in:/;out:/) 140197739755168
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5302112389Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-testingLFVmultibodyv-simerrornonogpu-prod-040:30:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140592201672400
- M:video_aido:cmdline(in:/;out:/) 140592605780864
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5300812391Bea Baselines 🐤baseline-duckietownaido5-LFI-sim-testingLFVIv-simerrornonogpu-prod-040:05:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140537126180272
- M:video_aido:cmdline(in:/;out:/) 140537124204656
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5300212392Bea Baselines 🐤baseline-duckietownaido5-LFI-full-sim-validationLFVIv-simerrornonogpu-prod-040:03:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140377975840976
- M:video_aido:cmdline(in:/;out:/) 140377976919088
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5299312400Bea Baselines 🐤template-randomaido5-LFV-sim-validationLFVv-simerrornonogpu-prod-040:02:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139792229809456
- M:video_aido:cmdline(in:/;out:/) 139792229806576
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5297712403Bea Baselines 🐤template-randomaido5-LFP-sim-testingLFP-simerrornonogpu-prod-040:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139652914564544
- M:video_aido:cmdline(in:/;out:/) 139652914562432
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5296112408Bea Baselines 🐤template-randomaido5-LFI-full-sim-validationLFVIv-simerrornonogpu-prod-040:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140595803167520
- M:video_aido:cmdline(in:/;out:/) 140595803167568
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5293612405Bea Baselines 🐤template-randomaido5-LFV_multi-sim-testingLFVmultibodyv-simerrornonogpu-prod-040:03:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140152735386592
- M:video_aido:cmdline(in:/;out:/) 140152735384096
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
529149367Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-040:03:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140547549241984
- M:video_aido:cmdline(in:/;out:/) 140547549243760
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5289611122Olga (Ge Ya) Xu 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailednonogpu-prod-040:02:46
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5288012441Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-040:02:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140654997206208
- M:video_aido:cmdline(in:/;out:/) 140654997564528
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5287212432Bea Baselines 🐤straightaido5-LFP-sim-testingLFP-simerrornonogpu-prod-040:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139951165361072
- M:video_aido:cmdline(in:/;out:/) 139951165360304
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5284912430Bea Baselines 🐤straightaido5-LFI-full-sim-testingLFVIv-simabortednonogpu-prod-040:00:35
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5283412435Bea Baselines 🐤straightaido5-LFI-sim-validationLFVIv-simabortednonogpu-prod-040:00:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5282312435Bea Baselines 🐤straightaido5-LFI-sim-validationLFVIv-simerrornonogpu-prod-040:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140557418773760
- M:video_aido:cmdline(in:/;out:/) 140557418772320
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5280111410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simabortednonogpu-prod-040:02:44
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5278012225Bea Baselines 🐤straightaido5-LFI-full-sim-validationLFVIv-simabortednonogpu-prod-040:02:00
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5275712394Bea Baselines 🐤baseline-duckietownaido5-LFV-sim-testingLFVv-simabortednonogpu-prod-040:01:01
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5275212341Bea Baselines 🐤template-rosaido5-LFP-sim-validationLFP-simabortednonogpu-prod-040:01:38
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5265011772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednonogpu-prod-040:03:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525676805Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simfailednonogpu-prod-040:02:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525026836Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-040:13:15
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 59, in get_services_id
    raise ZValueError(container_ids=container_ids, services=services, res=res, names=names)
zuper_commons.types.exceptions.ZValueError: 

│ container_ids: [cdedc948e3b07fbb178cf69f3471a1710e92fce2659166e193d44664ee96b573]
│      services: dict[3]
│                │ evaluator:
│                │ dict[7]
│                │ │ image: docker.io/andreacensi/aido5-lf-sim-validation-lfv-sim-evaluator@sha256:2bc9fe8514d570141f87b0626353cbc6aebad89d220fecc8876a008efd430515
│                │ │ environment:
│                │ │ dict[10]
│                │ │ │ experiment_manager_parameters:
│                │ │ │ |episodes_per_scenario: 1
│                │ │ │ |episode_length_s: 60.0
│                │ │ │ |min_episode_length_s: 0.0
│                │ │ │ |seed: 888
│                │ │ │ |physics_dt: 0.05
│                │ │ │ |max_failures: 2
│                │ │ │ |fifo_dir: /fifos
│                │ │ │ |sim_in: /fifos/simulator-in
│                │ │ │ |sim_out: /fifos/simulator-out
│                │ │ │ |sm_in: /fifos/scenario_maker-in
│                │ │ │ |sm_out: /fifos/scenario_maker-out
│                │ │ │ |timeout_initialization: 120
│                │ │ │ |timeout_regular: 120
│                │ │ │ |port: 10123
│                │ │ │ |scenarios:
│                │ │ │ |- /scenarios
│                │ │ │ |
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 6836
│                │ │ │ submitter_name: melisande
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_10_18_16_39_07@sha256:d46a1e162a23be313d74622e5bd0705d845c591f0f11e830fb8d1ddd4f89054c
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ ports: [10123]
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-04_f1b0bf41b8f7}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission6836/LFv-sim-nogpu-prod-04_f1b0bf41b8f7-job52502-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission6836/LFv-sim-nogpu-prod-04_f1b0bf41b8f7-job52502-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_02_11_49_30-25453/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ simulator:
│                │ dict[6]
│                │ │ image: docker.io/duckietown/challenge-aido_lf-simulator-gym@sha256:4848042f4d088b99b480cb1fc276e32f956d6b9dee27d70fcbaba500d8a8768c
│                │ │ environment:
│                │ │ dict[12]
│                │ │ │ AIDONODE_CONFIG:
│                │ │ │ |env_constructor: Simulator
│                │ │ │ |env_parameters:
│                │ │ │ |  max_steps: 500001 # we don't want the gym to reset itself
│                │ │ │ |  domain_rand: 0
│                │ │ │ |  camera_width: 640
│                │ │ │ |  camera_height: 480
│                │ │ │ |  distortion: true
│                │ │ │ |  num_tris_distractors: 0
│                │ │ │ |  color_ground: [0, 0.3, 0] # green
│                │ │ │ |  enable_leds: true
│                │ │ │ |
│                │ │ │ AIDONODE_DATA_IN: /fifos/simulator-in
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/simulator-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 6836
│                │ │ │ submitter_name: melisande
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_10_18_16_39_07@sha256:d46a1e162a23be313d74622e5bd0705d845c591f0f11e830fb8d1ddd4f89054c
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-04_f1b0bf41b8f7}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission6836/LFv-sim-nogpu-prod-04_f1b0bf41b8f7-job52502-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission6836/LFv-sim-nogpu-prod-04_f1b0bf41b8f7-job52502-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_02_11_49_30-25453/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│                │ solution-ego0:
│                │ dict[6]
│                │ │ image: docker.io/melisande/aido-submissions@sha256:d46a1e162a23be313d74622e5bd0705d845c591f0f11e830fb8d1ddd4f89054c
│                │ │ environment:
│                │ │ dict[13]
│                │ │ │ AIDONODE_NAME: ego0
│                │ │ │ AIDONODE_DATA_IN: /fifos/ego0-in
│                │ │ │ AIDO_REQUIRE_GPU: 1
│                │ │ │ AIDONODE_DATA_OUT: fifo:/fifos/ego0-out
│                │ │ │ challenge_name: aido5-LF-sim-validation
│                │ │ │ challenge_step_name: LFv-sim
│                │ │ │ submission_id: 6836
│                │ │ │ submitter_name: melisande
│                │ │ │ SUBMISSION_CONTAINER: docker.io/melisande/aido-submissions:2020_10_18_16_39_07@sha256:d46a1e162a23be313d74622e5bd0705d845c591f0f11e830fb8d1ddd4f89054c
│                │ │ │ username: ubuntu
│                │ │ │ uid: 0
│                │ │ │ USER: ubuntu
│                │ │ │ HOME: /fake-home/ubuntu
│                │ │ labels: {org.duckietown.created_by_runner: true, org.duckietown.runner_name: nogpu-prod-04_f1b0bf41b8f7}
│                │ │ user: 0:0
│                │ │ volumes:
│                │ │ [
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission6836/LFv-sim-nogpu-prod-04_f1b0bf41b8f7-job52502-a-wd:/challenges:rw,
│                │ │  /tmp/duckietown/aido5-LF-sim-validation/submission6836/LFv-sim-nogpu-prod-04_f1b0bf41b8f7-job52502-a-fifos:/fifos:rw,
│                │ │  /tmp/duckietown/dt-challenges-runner/20_12_02_11_49_30-25453/fake-ubuntu-home:/fake-home/ubuntu:rw]
│                │ │ networks: {evaluation: {aliases: [evaluation]} }
│           res: {solution-ego0: cdedc948e3b07fbb178cf69f3471a1710e92fce2659166e193d44664ee96b573}
│         names: dict[1]
│                │ cdedc948e3b07fbb178cf69f3471a1710e92fce2659166e193d44664ee96b573: nogpu-prod-04_f1b0bf41b8f7-job52502-994434_solution-ego0_1

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: |cdedc948e3b07fbb178cf69f3471a1710e92fce2659166e193d44664ee96b573
│         |
│  names: dict[1]
│         │ cdedc948e3b07fbb178cf69f3471a1710e92fce2659166e193d44664ee96b573: nogpu-prod-04_f1b0bf41b8f7-job52502-994434_solution-ego0_1
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524576852Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-040:04:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139654283633952
- M:video_aido:cmdline(in:/;out:/) 139654283592080
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
523689296Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-040:10:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140130745433440
- M:video_aido:cmdline(in:/;out:/) 140130745431472
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
523269312Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-040:07:07
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
522859329Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-040:04:34
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
522499364Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-040:02:58
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
521339775Philippe Reddy 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-040:13:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139973441160576
- M:video_aido:cmdline(in:/;out:/) 139973441160336
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5208810018Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-040:07:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140629954145200
- M:video_aido:cmdline(in:/;out:/) 140629954223312
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5202510036Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-040:09:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139757962286704
- M:video_aido:cmdline(in:/;out:/) 139757962287376
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5194910051Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-040:09:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140043525802400
- M:video_aido:cmdline(in:/;out:/) 140043525802640
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5189710063Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-040:04:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140653694844016
- M:video_aido:cmdline(in:/;out:/) 140653696130592
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5186510365Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-040:02:48
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140625837946384
- M:video_aido:cmdline(in:/;out:/) 140625839138944
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5185410367Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-040:01:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140402557803200
- M:video_aido:cmdline(in:/;out:/) 140402557819440
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5181710763Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-040:04:19
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5180010763Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-040:02:31
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140688742180752
- M:video_aido:cmdline(in:/;out:/) 140688742181712
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5175310773Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-040:05:11
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5171210779Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-040:03:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139703220681984
- M:video_aido:cmdline(in:/;out:/) 139703220681840
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5162610812Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-040:03:14
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5152610845Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-040:09:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139940918577856
- M:video_aido:cmdline(in:/;out:/) 139940916823568
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5148010857Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-040:05:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139952711331952
- M:video_aido:cmdline(in:/;out:/) 139952712462400
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5145611010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednonogpu-prod-040:01:10
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5141610874Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-040:04:00
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5138410933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednonogpu-prod-040:01:12
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5137210933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednonogpu-prod-040:01:11
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5127710902Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-040:11:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140246456376144
- M:video_aido:cmdline(in:/;out:/) 140246456400816
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line