Duckietown Challenges Home Challenges Submissions

Evaluator 4770

ID4770
evaluatornogpu-prod-05
ownerI don't have one 😀
machinenogpu-prod_faa6cdf2edad
processnogpu-prod-05_faa6cdf2edad
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success52 53429
# timeout3 50085
# failed26 49818
# error73 47619
# aborted29 47288
# host-error51 49623
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5790410770Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:08:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7218534623998241
survival_time_median11.025000000000022
deviation-center-line_median0.13501655642758872
in-drivable-lane_median4.299999999999997


other stats
agent_compute-ego0_max0.015029573440551756
agent_compute-ego0_mean0.01398493191688076
agent_compute-ego0_median0.013889055935981848
agent_compute-ego0_min0.013132042355007596
complete-iteration_max0.23660275756671864
complete-iteration_mean0.19228993478308323
complete-iteration_median0.18731656840467076
complete-iteration_min0.15792384475627275
deviation-center-line_max0.5445074867097316
deviation-center-line_mean0.23218453433492311
deviation-center-line_min0.11419753777478348
deviation-heading_max1.1449371400588608
deviation-heading_mean0.8260042053380838
deviation-heading_median0.7764705343948259
deviation-heading_min0.6061386125038222
driven_any_max4.1735174553160155
driven_any_mean2.244681164688735
driven_any_median2.055639260284319
driven_any_min0.6939286828702865
driven_lanedir_consec_max2.016687275516219
driven_lanedir_consec_mean0.9213014138637848
driven_lanedir_consec_min0.22481145513927192
driven_lanedir_max2.016687275516219
driven_lanedir_mean0.9213014138637848
driven_lanedir_median0.7218534623998241
driven_lanedir_min0.22481145513927192
get_duckie_state_max1.6689300537109375e-06
get_duckie_state_mean1.5798172828618631e-06
get_duckie_state_median1.5821613743665623e-06
get_duckie_state_min1.4860163290033895e-06
get_robot_state_max0.004155679029576919
get_robot_state_mean0.004011795564956772
get_robot_state_median0.004014818465090981
get_robot_state_min0.003861866300068205
get_state_dump_max0.005122060214771944
get_state_dump_mean0.005031851145821592
get_state_dump_median0.005068810179295926
get_state_dump_min0.004867724009922573
get_ui_image_max0.037067039038545344
get_ui_image_mean0.0329554374173544
get_ui_image_median0.0338886040755586
get_ui_image_min0.02697750247975506
in-drivable-lane_max17.200000000000173
in-drivable-lane_mean7.137500000000053
in-drivable-lane_min2.750000000000039
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4247976372405367, "get_ui_image": 0.03117325080661323, "step_physics": 0.10618000894080935, "survival_time": 12.650000000000045, "driven_lanedir": 2.016687275516219, "get_state_dump": 0.005099658890971987, "get_robot_state": 0.004114875643272099, "sim_render-ego0": 0.004236498216944416, "get_duckie_state": 1.6689300537109375e-06, "in-drivable-lane": 2.750000000000039, "deviation-heading": 1.1449371400588608, "agent_compute-ego0": 0.013538741689967358, "complete-iteration": 0.17995738607691966, "set_robot_commands": 0.002520085319759339, "deviation-center-line": 0.5445074867097316, "driven_lanedir_consec": 2.016687275516219, "sim_compute_sim_state": 0.010687468558784543, "sim_compute_performance-ego0": 0.0022996232265562523}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6939286828702865, "get_ui_image": 0.037067039038545344, "step_physics": 0.15625111005639516, "survival_time": 4.599999999999992, "driven_lanedir": 0.22481145513927192, "get_state_dump": 0.005037961467619865, "get_robot_state": 0.003914761286909862, "sim_render-ego0": 0.004119157791137695, "get_duckie_state": 1.5279298187584005e-06, "in-drivable-lane": 2.949999999999991, "deviation-heading": 0.819452868700488, "agent_compute-ego0": 0.014239370181996336, "complete-iteration": 0.23660275756671864, "set_robot_commands": 0.0024110347993912236, "deviation-center-line": 0.11419753777478348, "driven_lanedir_consec": 0.22481145513927192, "sim_compute_sim_state": 0.011348275728123162, "sim_compute_performance-ego0": 0.0020990243522069785}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.1735174553160155, "get_ui_image": 0.036603957344503966, "step_physics": 0.11214012875276454, "survival_time": 21.200000000000166, "driven_lanedir": 0.7385345805346847, "get_state_dump": 0.005122060214771944, "get_robot_state": 0.004155679029576919, "sim_render-ego0": 0.004500681372249828, "get_duckie_state": 1.6363929299747242e-06, "in-drivable-lane": 17.200000000000173, "deviation-heading": 0.733488200089164, "agent_compute-ego0": 0.015029573440551756, "complete-iteration": 0.19467575073242188, "set_robot_commands": 0.0025637121761546413, "deviation-center-line": 0.1272307210466051, "driven_lanedir_consec": 0.7385345805346847, "sim_compute_sim_state": 0.012181094674503104, "sim_compute_performance-ego0": 0.002273408104391659}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.686480883328102, "get_ui_image": 0.02697750247975506, "step_physics": 0.09530297536698598, "survival_time": 9.4, "driven_lanedir": 0.7051723442649636, "get_state_dump": 0.004867724009922573, "get_robot_state": 0.003861866300068205, "sim_render-ego0": 0.003945079430070503, "get_duckie_state": 1.4860163290033895e-06, "in-drivable-lane": 5.650000000000004, "deviation-heading": 0.6061386125038222, "agent_compute-ego0": 0.013132042355007596, "complete-iteration": 0.15792384475627275, "set_robot_commands": 0.0023087004505137287, "deviation-center-line": 0.14280239180857235, "driven_lanedir_consec": 0.7051723442649636, "sim_compute_sim_state": 0.005380315124673188, "sim_compute_performance-ego0": 0.002055188335438885}}
set_robot_commands_max0.0025637121761546413
set_robot_commands_mean0.0024508831864547332
set_robot_commands_median0.0024655600595752812
set_robot_commands_min0.0023087004505137287
sim_compute_performance-ego0_max0.0022996232265562523
sim_compute_performance-ego0_mean0.0021818110046484436
sim_compute_performance-ego0_median0.002186216228299319
sim_compute_performance-ego0_min0.002055188335438885
sim_compute_sim_state_max0.012181094674503104
sim_compute_sim_state_mean0.009899288521521
sim_compute_sim_state_median0.011017872143453854
sim_compute_sim_state_min0.005380315124673188
sim_render-ego0_max0.004500681372249828
sim_render-ego0_mean0.004200354202600611
sim_render-ego0_median0.0041778280040410554
sim_render-ego0_min0.003945079430070503
simulation-passed1
step_physics_max0.15625111005639516
step_physics_mean0.11746855577923876
step_physics_median0.10916006884678696
step_physics_min0.09530297536698598
survival_time_max21.200000000000166
survival_time_mean11.96250000000005
survival_time_min4.599999999999992
No reset possible
5790210786Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:03:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 11 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5788810779Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:11:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.805899754011705
survival_time_median18.925000000000132
deviation-center-line_median0.5346957466346606
in-drivable-lane_median9.425000000000107


other stats
agent_compute-ego0_max0.014192666130504388
agent_compute-ego0_mean0.013511853308469275
agent_compute-ego0_median0.013559339068470158
agent_compute-ego0_min0.012736068966432404
complete-iteration_max0.23633239461087632
complete-iteration_mean0.19412987808785231
complete-iteration_median0.18725463194313113
complete-iteration_min0.16567785385427067
deviation-center-line_max0.569073059611885
deviation-center-line_mean0.433544362647576
deviation-center-line_min0.09571289770909765
deviation-heading_max2.4223526621881795
deviation-heading_mean1.5152995066447854
deviation-heading_median1.4122793223406334
deviation-heading_min0.8142867197096958
driven_any_max6.077324823962175
driven_any_mean3.4285358340544128
driven_any_median3.4994739982332104
driven_any_min0.6378705157890548
driven_lanedir_consec_max2.288640780462961
driven_lanedir_consec_mean1.5203127362272115
driven_lanedir_consec_min0.1808106564224765
driven_lanedir_max2.288640780462961
driven_lanedir_mean1.5203127362272115
driven_lanedir_median1.805899754011705
driven_lanedir_min0.1808106564224765
get_duckie_state_max2.77880964608028e-06
get_duckie_state_mean2.4971727494790743e-06
get_duckie_state_median2.439133058540958e-06
get_duckie_state_min2.331615234754101e-06
get_robot_state_max0.003935916210288432
get_robot_state_mean0.0038780842980712
get_robot_state_median0.003871245333649267
get_robot_state_min0.0038339303146978343
get_state_dump_max0.004929756050679221
get_state_dump_mean0.00482332028827329
get_state_dump_median0.004805526150330797
get_state_dump_min0.004752472801752343
get_ui_image_max0.039179645735642005
get_ui_image_mean0.03224805419516911
get_ui_image_median0.031294847204431694
get_ui_image_min0.02722287663617105
in-drivable-lane_max19.600000000000268
in-drivable-lane_mean10.20000000000013
in-drivable-lane_min2.3500000000000334
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4086568726149755, "get_ui_image": 0.02968252238942616, "step_physics": 0.1079741832035691, "survival_time": 13.350000000000056, "driven_lanedir": 2.062706375507745, "get_state_dump": 0.004929756050679221, "get_robot_state": 0.003935916210288432, "sim_render-ego0": 0.004152499917727798, "get_duckie_state": 2.5149601608959596e-06, "in-drivable-lane": 2.3500000000000334, "deviation-heading": 1.2194644853750125, "agent_compute-ego0": 0.013420176150193856, "complete-iteration": 0.17913230942256414, "set_robot_commands": 0.0024803209660658196, "deviation-center-line": 0.569073059611885, "driven_lanedir_consec": 2.062706375507745, "sim_compute_sim_state": 0.010218602507861692, "sim_compute_performance-ego0": 0.0022298168780198737}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6378705157890548, "get_ui_image": 0.039179645735642005, "step_physics": 0.15468480669218918, "survival_time": 4.299999999999993, "driven_lanedir": 0.1808106564224765, "get_state_dump": 0.004782164233854447, "get_robot_state": 0.003855877909167059, "sim_render-ego0": 0.004109253828552948, "get_duckie_state": 2.77880964608028e-06, "in-drivable-lane": 2.849999999999992, "deviation-heading": 0.8142867197096958, "agent_compute-ego0": 0.014192666130504388, "complete-iteration": 0.23633239461087632, "set_robot_commands": 0.002362711676235857, "deviation-center-line": 0.09571289770909765, "driven_lanedir_consec": 0.1808106564224765, "sim_compute_sim_state": 0.010882130984602304, "sim_compute_performance-ego0": 0.002180222807259395}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.077324823962175, "get_ui_image": 0.032907172019437235, "step_physics": 0.11800300112422207, "survival_time": 32.15000000000031, "driven_lanedir": 2.288640780462961, "get_state_dump": 0.004828888066807148, "get_robot_state": 0.0038339303146978343, "sim_render-ego0": 0.0040857795602786615, "get_duckie_state": 2.331615234754101e-06, "in-drivable-lane": 19.600000000000268, "deviation-heading": 2.4223526621881795, "agent_compute-ego0": 0.013698501986746462, "complete-iteration": 0.1953769544636981, "set_robot_commands": 0.002331617085830025, "deviation-center-line": 0.5194982059088225, "driven_lanedir_consec": 2.288640780462961, "sim_compute_sim_state": 0.01339483001957769, "sim_compute_performance-ego0": 0.0021844776520817915}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.590291123851445, "get_ui_image": 0.02722287663617105, "step_physics": 0.10178438174991648, "survival_time": 24.500000000000213, "driven_lanedir": 1.5490931325156652, "get_state_dump": 0.004752472801752343, "get_robot_state": 0.003886612758131474, "sim_render-ego0": 0.004113262394052416, "get_duckie_state": 2.3633059561859567e-06, "in-drivable-lane": 16.000000000000227, "deviation-heading": 1.6050941593062542, "agent_compute-ego0": 0.012736068966432404, "complete-iteration": 0.16567785385427067, "set_robot_commands": 0.0023838517136583505, "deviation-center-line": 0.5498932873604987, "driven_lanedir_consec": 1.5490931325156652, "sim_compute_sim_state": 0.006563163337785212, "sim_compute_performance-ego0": 0.002132859589368894}}
set_robot_commands_max0.0024803209660658196
set_robot_commands_mean0.0023896253604475132
set_robot_commands_median0.002373281694947104
set_robot_commands_min0.002331617085830025
sim_compute_performance-ego0_max0.0022298168780198737
sim_compute_performance-ego0_mean0.002181844231682489
sim_compute_performance-ego0_median0.0021823502296705933
sim_compute_performance-ego0_min0.002132859589368894
sim_compute_sim_state_max0.01339483001957769
sim_compute_sim_state_mean0.010264681712456723
sim_compute_sim_state_median0.010550366746231998
sim_compute_sim_state_min0.006563163337785212
sim_render-ego0_max0.004152499917727798
sim_render-ego0_mean0.004115198925152956
sim_render-ego0_median0.004111258111302682
sim_render-ego0_min0.0040857795602786615
simulation-passed1
step_physics_max0.15468480669218918
step_physics_mean0.1206115931924742
step_physics_median0.1129885921638956
step_physics_min0.10178438174991648
survival_time_max32.15000000000031
survival_time_mean18.575000000000145
survival_time_min4.299999999999993
No reset possible
5787610787Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:07:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8531017237711693
survival_time_median11.300000000000026
deviation-center-line_median0.2245119573588929
in-drivable-lane_median4.925000000000013


other stats
agent_compute-ego0_max0.013948503860646048
agent_compute-ego0_mean0.013273923850164389
agent_compute-ego0_median0.01314029186941472
agent_compute-ego0_min0.012866607801182064
complete-iteration_max0.253643071170345
complete-iteration_mean0.2020635958509028
complete-iteration_median0.19601639053767367
complete-iteration_min0.16257853115791882
deviation-center-line_max0.52890331527582
deviation-center-line_mean0.2807864409968281
deviation-center-line_min0.14521853399370657
deviation-heading_max2.7366504019016658
deviation-heading_mean1.6067006018974284
deviation-heading_median1.3709510684571122
deviation-heading_min0.9482498687738226
driven_any_max2.433934748853281
driven_any_mean2.087912368390664
driven_any_median2.1507302824860854
driven_any_min1.616254159737203
driven_lanedir_consec_max2.057447689563529
driven_lanedir_consec_mean0.9846904011185624
driven_lanedir_consec_min0.17511046736838232
driven_lanedir_max2.057447689563529
driven_lanedir_mean0.9998843195418984
driven_lanedir_median0.8534390277058852
driven_lanedir_min0.2352115331922946
get_duckie_state_max1.651095593069482e-06
get_duckie_state_mean1.5901009667762034e-06
get_duckie_state_median1.6041167265723882e-06
get_duckie_state_min1.501074820890555e-06
get_robot_state_max0.004183957805741305
get_robot_state_mean0.004032186099886733
get_robot_state_median0.0040785885939788845
get_robot_state_min0.003787609405847855
get_state_dump_max0.005328803412658347
get_state_dump_mean0.0051035808020828185
get_state_dump_median0.005051820851601101
get_state_dump_min0.004981878092470725
get_ui_image_max0.03735634885026735
get_ui_image_mean0.03164977827948822
get_ui_image_median0.031594624460059034
get_ui_image_min0.02605351534756747
in-drivable-lane_max9.200000000000024
in-drivable-lane_mean5.350000000000021
in-drivable-lane_min2.3500000000000334
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.433934748853281, "get_ui_image": 0.0283370459173608, "step_physics": 0.10641629489388052, "survival_time": 12.650000000000045, "driven_lanedir": 2.057447689563529, "get_state_dump": 0.005102530239135262, "get_robot_state": 0.004049410031536433, "sim_render-ego0": 0.004198969818475678, "get_duckie_state": 1.651095593069482e-06, "in-drivable-lane": 2.3500000000000334, "deviation-heading": 1.522923625169596, "agent_compute-ego0": 0.012866607801182064, "complete-iteration": 0.17564307516954075, "set_robot_commands": 0.0023760814366378183, "deviation-center-line": 0.52890331527582, "driven_lanedir_consec": 2.057447689563529, "sim_compute_sim_state": 0.009900884365472267, "sim_compute_performance-ego0": 0.0022825603410014956}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.108680989407429, "get_ui_image": 0.03735634885026735, "step_physics": 0.17354715030824122, "survival_time": 11.100000000000025, "driven_lanedir": 0.2352115331922946, "get_state_dump": 0.004981878092470725, "get_robot_state": 0.004107767156421336, "sim_render-ego0": 0.004287513382231708, "get_duckie_state": 1.501074820890555e-06, "in-drivable-lane": 9.200000000000024, "deviation-heading": 1.2189785117446283, "agent_compute-ego0": 0.013368009986364253, "complete-iteration": 0.253643071170345, "set_robot_commands": 0.0024674868904421684, "deviation-center-line": 0.14521853399370657, "driven_lanedir_consec": 0.17511046736838232, "sim_compute_sim_state": 0.011087437916229658, "sim_compute_performance-ego0": 0.0023302101768185738}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.616254159737203, "get_ui_image": 0.03485220300275727, "step_physics": 0.13887987163780774, "survival_time": 8.79999999999999, "driven_lanedir": 0.856086374116564, "get_state_dump": 0.005328803412658347, "get_robot_state": 0.004183957805741305, "sim_render-ego0": 0.004493644682027526, "get_duckie_state": 1.617744144073314e-06, "in-drivable-lane": 4.049999999999999, "deviation-heading": 0.9482498687738226, "agent_compute-ego0": 0.013948503860646048, "complete-iteration": 0.21638970590580656, "set_robot_commands": 0.0024404215947382867, "deviation-center-line": 0.15019940979599794, "driven_lanedir_consec": 0.856086374116564, "sim_compute_sim_state": 0.00988784078824318, "sim_compute_performance-ego0": 0.00225792496891345}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.192779575564742, "get_ui_image": 0.02605351534756747, "step_physics": 0.1003869240418141, "survival_time": 11.500000000000028, "driven_lanedir": 0.8507916812952063, "get_state_dump": 0.005001111464066939, "get_robot_state": 0.003787609405847855, "sim_render-ego0": 0.00400559004251059, "get_duckie_state": 1.5904893090714624e-06, "in-drivable-lane": 5.8000000000000265, "deviation-heading": 2.7366504019016658, "agent_compute-ego0": 0.012912573752465186, "complete-iteration": 0.16257853115791882, "set_robot_commands": 0.00230561706410858, "deviation-center-line": 0.29882450492178786, "driven_lanedir_consec": 0.8501170734257746, "sim_compute_sim_state": 0.005982789126309482, "sim_compute_performance-ego0": 0.0020388390594746645}}
set_robot_commands_max0.0024674868904421684
set_robot_commands_mean0.002397401746481713
set_robot_commands_median0.0024082515156880523
set_robot_commands_min0.00230561706410858
sim_compute_performance-ego0_max0.0023302101768185738
sim_compute_performance-ego0_mean0.0022273836365520458
sim_compute_performance-ego0_median0.002270242654957473
sim_compute_performance-ego0_min0.0020388390594746645
sim_compute_sim_state_max0.011087437916229658
sim_compute_sim_state_mean0.009214738049063647
sim_compute_sim_state_median0.009894362576857723
sim_compute_sim_state_min0.005982789126309482
sim_render-ego0_max0.004493644682027526
sim_render-ego0_mean0.004246429481311376
sim_render-ego0_median0.004243241600353693
sim_render-ego0_min0.00400559004251059
simulation-passed1
step_physics_max0.17354715030824122
step_physics_mean0.12980756022043588
step_physics_median0.12264808326584414
step_physics_min0.1003869240418141
survival_time_max12.650000000000045
survival_time_mean11.01250000000002
survival_time_min8.79999999999999
No reset possible
5785910791Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:08:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4317267292840056
survival_time_median13.65000000000006
deviation-center-line_median0.2168194698865736
in-drivable-lane_median10.62500000000004


other stats
agent_compute-ego0_max0.013463858195713588
agent_compute-ego0_mean0.012959120055240044
agent_compute-ego0_median0.01300301447091811
agent_compute-ego0_min0.01236659308341036
complete-iteration_max0.2368279755115509
complete-iteration_mean0.1999483228383488
complete-iteration_median0.1960619441453894
complete-iteration_min0.1708414275510654
deviation-center-line_max0.36000170230137746
deviation-center-line_mean0.21891194285517176
deviation-center-line_min0.08200712934616239
deviation-heading_max1.8268698226008515
deviation-heading_mean1.2010916267703629
deviation-heading_median1.1922768284062075
deviation-heading_min0.5929430276681849
driven_any_max3.062851498528514
driven_any_mean2.240016576349539
driven_any_median2.64357804563437
driven_any_min0.6100587156009034
driven_lanedir_consec_max0.5469360593776417
driven_lanedir_consec_mean0.395796440605685
driven_lanedir_consec_min0.17279624447708697
driven_lanedir_max0.5469360593776417
driven_lanedir_mean0.395796440605685
driven_lanedir_median0.4317267292840056
driven_lanedir_min0.17279624447708697
get_duckie_state_max1.83014642624628e-06
get_duckie_state_mean1.643820068689302e-06
get_duckie_state_median1.651350722473237e-06
get_duckie_state_min1.442432403564453e-06
get_robot_state_max0.004305196186852833
get_robot_state_mean0.00409102325018975
get_robot_state_median0.004049151139516103
get_robot_state_min0.003960594534873962
get_state_dump_max0.0052607407645573695
get_state_dump_mean0.005067562779199111
get_state_dump_median0.005040286912257413
get_state_dump_min0.00492893652772425
get_ui_image_max0.03711991012096405
get_ui_image_mean0.032384725358459994
get_ui_image_median0.032457109732344266
get_ui_image_min0.0275047718481874
in-drivable-lane_max12.850000000000076
in-drivable-lane_mean9.175000000000036
in-drivable-lane_min2.5999999999999934
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.381548265406412, "get_ui_image": 0.0301695291297024, "step_physics": 0.10588579484257832, "survival_time": 12.40000000000004, "driven_lanedir": 0.5469360593776417, "get_state_dump": 0.005112386611570795, "get_robot_state": 0.004100264315624313, "sim_render-ego0": 0.004199401441826878, "get_duckie_state": 1.7972356344322602e-06, "in-drivable-lane": 9.050000000000011, "deviation-heading": 1.6139611788317687, "agent_compute-ego0": 0.012742681196894512, "complete-iteration": 0.17750069893986345, "set_robot_commands": 0.0024214719672758416, "deviation-center-line": 0.36000170230137746, "driven_lanedir_consec": 0.5469360593776417, "sim_compute_sim_state": 0.010466163895695085, "sim_compute_performance-ego0": 0.002274236525876455}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6100587156009034, "get_ui_image": 0.03711991012096405, "step_physics": 0.1579052448272705, "survival_time": 3.949999999999994, "driven_lanedir": 0.17279624447708697, "get_state_dump": 0.004968187212944031, "get_robot_state": 0.003960594534873962, "sim_render-ego0": 0.004200902581214905, "get_duckie_state": 1.442432403564453e-06, "in-drivable-lane": 2.5999999999999934, "deviation-heading": 0.7705924779806463, "agent_compute-ego0": 0.01326334774494171, "complete-iteration": 0.2368279755115509, "set_robot_commands": 0.00241069495677948, "deviation-center-line": 0.08200712934616239, "driven_lanedir_consec": 0.17279624447708697, "sim_compute_sim_state": 0.010697764158248902, "sim_compute_performance-ego0": 0.0021919548511505128}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.062851498528514, "get_ui_image": 0.034744690334986124, "step_physics": 0.13607695594666497, "survival_time": 15.700000000000088, "driven_lanedir": 0.5319019203931561, "get_state_dump": 0.0052607407645573695, "get_robot_state": 0.004305196186852833, "sim_render-ego0": 0.0043994229937356615, "get_duckie_state": 1.83014642624628e-06, "in-drivable-lane": 12.200000000000069, "deviation-heading": 1.8268698226008515, "agent_compute-ego0": 0.013463858195713588, "complete-iteration": 0.21462318935091537, "set_robot_commands": 0.002559406038314577, "deviation-center-line": 0.2624651985509675, "driven_lanedir_consec": 0.5319019203931561, "sim_compute_sim_state": 0.011301317669096448, "sim_compute_performance-ego0": 0.002389810955713666}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.905607825862327, "get_ui_image": 0.0275047718481874, "step_physics": 0.10734937980422209, "survival_time": 14.900000000000077, "driven_lanedir": 0.33155153817485505, "get_state_dump": 0.00492893652772425, "get_robot_state": 0.003998037963407893, "sim_render-ego0": 0.003987292382230727, "get_duckie_state": 1.505465810514214e-06, "in-drivable-lane": 12.850000000000076, "deviation-heading": 0.5929430276681849, "agent_compute-ego0": 0.01236659308341036, "complete-iteration": 0.1708414275510654, "set_robot_commands": 0.0023914356295480377, "deviation-center-line": 0.17117374122217963, "driven_lanedir_consec": 0.33155153817485505, "sim_compute_sim_state": 0.006084518687780884, "sim_compute_performance-ego0": 0.002129053989780388}}
set_robot_commands_max0.002559406038314577
set_robot_commands_mean0.002445752147979484
set_robot_commands_median0.0024160834620276608
set_robot_commands_min0.0023914356295480377
sim_compute_performance-ego0_max0.002389810955713666
sim_compute_performance-ego0_mean0.0022462640806302555
sim_compute_performance-ego0_median0.002233095688513484
sim_compute_performance-ego0_min0.002129053989780388
sim_compute_sim_state_max0.011301317669096448
sim_compute_sim_state_mean0.00963744110270533
sim_compute_sim_state_median0.010581964026971992
sim_compute_sim_state_min0.006084518687780884
sim_render-ego0_max0.0043994229937356615
sim_render-ego0_mean0.004196754849752043
sim_render-ego0_median0.004200152011520891
sim_render-ego0_min0.003987292382230727
simulation-passed1
step_physics_max0.1579052448272705
step_physics_mean0.12680434385518397
step_physics_median0.12171316787544352
step_physics_min0.10588579484257832
survival_time_max15.700000000000088
survival_time_mean11.73750000000005
survival_time_min3.949999999999994
No reset possible
5784910796Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:04:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 39 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5782610807Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:11:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.577055664083586
survival_time_median20.325000000000152
deviation-center-line_median0.5277967972495952
in-drivable-lane_median8.12500000000011


other stats
agent_compute-ego0_max0.014026288063295426
agent_compute-ego0_mean0.013331702233767648
agent_compute-ego0_median0.013225099703978168
agent_compute-ego0_min0.01285032146381882
complete-iteration_max0.22164431951379265
complete-iteration_mean0.18316031752230305
complete-iteration_median0.17164190276765168
complete-iteration_min0.16771314504011622
deviation-center-line_max1.3950762569134432
deviation-center-line_mean0.6387298424498955
deviation-center-line_min0.10424951838694876
deviation-heading_max3.8313162972856336
deviation-heading_mean2.0182716274290753
deviation-heading_median1.6811621225260571
deviation-heading_min0.8794459673785541
driven_any_max4.616697307742068
driven_any_mean3.065551287946462
driven_any_median3.499345558881347
driven_any_min0.6468167262810862
driven_lanedir_consec_max2.3034704373581767
driven_lanedir_consec_mean1.4098699067596148
driven_lanedir_consec_min0.1818978615131104
driven_lanedir_max2.3034704373581767
driven_lanedir_mean1.4098699067596148
driven_lanedir_median1.577055664083586
driven_lanedir_min0.1818978615131104
get_duckie_state_max2.4786535299049234e-06
get_duckie_state_mean2.297550487673464e-06
get_duckie_state_median2.4055320232459164e-06
get_duckie_state_min1.9004843742971e-06
get_robot_state_max0.0041815312403552934
get_robot_state_mean0.0039862575331954635
get_robot_state_median0.0040599875918914275
get_robot_state_min0.003643523708643703
get_state_dump_max0.005159308833460654
get_state_dump_mean0.004990029298031384
get_state_dump_median0.005056911314456427
get_state_dump_min0.0046869857297520265
get_ui_image_max0.03618130376262049
get_ui_image_mean0.03067309589408228
get_ui_image_median0.030025156060859263
get_ui_image_min0.02646076769199011
in-drivable-lane_max17.750000000000195
in-drivable-lane_mean9.262500000000102
in-drivable-lane_min3.049999999999991
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4728100866640252, "get_ui_image": 0.02907927101161204, "step_physics": 0.09889921525708673, "survival_time": 14.650000000000071, "driven_lanedir": 2.0201042287423756, "get_state_dump": 0.005071567029369121, "get_robot_state": 0.004014543124607631, "sim_render-ego0": 0.004148093210596617, "get_duckie_state": 2.337150833233684e-06, "in-drivable-lane": 3.0500000000000433, "deviation-heading": 1.418133769525609, "agent_compute-ego0": 0.0134397858665103, "complete-iteration": 0.16968013721258465, "set_robot_commands": 0.002355513929509792, "deviation-center-line": 0.5991900707147363, "driven_lanedir_consec": 2.0201042287423756, "sim_compute_sim_state": 0.010373318276437771, "sim_compute_performance-ego0": 0.0022035780407133557}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6468167262810862, "get_ui_image": 0.03618130376262049, "step_physics": 0.14197192397168887, "survival_time": 4.599999999999992, "driven_lanedir": 0.1818978615131104, "get_state_dump": 0.005159308833460654, "get_robot_state": 0.004105432059175225, "sim_render-ego0": 0.004290560240386635, "get_duckie_state": 2.4739132132581487e-06, "in-drivable-lane": 3.049999999999991, "deviation-heading": 0.8794459673785541, "agent_compute-ego0": 0.014026288063295426, "complete-iteration": 0.22164431951379265, "set_robot_commands": 0.002472518592752436, "deviation-center-line": 0.10424951838694876, "driven_lanedir_consec": 0.1818978615131104, "sim_compute_sim_state": 0.01102852052257907, "sim_compute_performance-ego0": 0.0023020467450541836}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.525881031098669, "get_ui_image": 0.030971041110106484, "step_physics": 0.101482797721526, "survival_time": 26.00000000000023, "driven_lanedir": 1.1340070994247962, "get_state_dump": 0.0046869857297520265, "get_robot_state": 0.003643523708643703, "sim_render-ego0": 0.003895068580495647, "get_duckie_state": 1.9004843742971e-06, "in-drivable-lane": 17.750000000000195, "deviation-heading": 3.8313162972856336, "agent_compute-ego0": 0.013010413541446034, "complete-iteration": 0.17360366832271876, "set_robot_commands": 0.002169911097198897, "deviation-center-line": 0.456403523784454, "driven_lanedir_consec": 1.1340070994247962, "sim_compute_sim_state": 0.01166676010600436, "sim_compute_performance-ego0": 0.001991440833415729}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.616697307742068, "get_ui_image": 0.02646076769199011, "step_physics": 0.10313323893637028, "survival_time": 26.45000000000024, "driven_lanedir": 2.3034704373581767, "get_state_dump": 0.005042255599543733, "get_robot_state": 0.0041815312403552934, "sim_render-ego0": 0.004280218538248314, "get_duckie_state": 2.4786535299049234e-06, "in-drivable-lane": 13.200000000000175, "deviation-heading": 1.9441904755265051, "agent_compute-ego0": 0.01285032146381882, "complete-iteration": 0.16771314504011622, "set_robot_commands": 0.0024524954130064765, "deviation-center-line": 1.3950762569134432, "driven_lanedir_consec": 2.3034704373581767, "sim_compute_sim_state": 0.006836440428247992, "sim_compute_performance-ego0": 0.002374451565292646}}
set_robot_commands_max0.002472518592752436
set_robot_commands_mean0.0023626097581169003
set_robot_commands_median0.0024040046712581345
set_robot_commands_min0.002169911097198897
sim_compute_performance-ego0_max0.002374451565292646
sim_compute_performance-ego0_mean0.0022178792961189786
sim_compute_performance-ego0_median0.0022528123928837697
sim_compute_performance-ego0_min0.001991440833415729
sim_compute_sim_state_max0.01166676010600436
sim_compute_sim_state_mean0.009976259833317298
sim_compute_sim_state_median0.010700919399508424
sim_compute_sim_state_min0.006836440428247992
sim_render-ego0_max0.004290560240386635
sim_render-ego0_mean0.0041534851424318035
sim_render-ego0_median0.004214155874422466
sim_render-ego0_min0.003895068580495647
simulation-passed1
step_physics_max0.14197192397168887
step_physics_mean0.11137179397166797
step_physics_median0.10230801832894812
step_physics_min0.09889921525708673
survival_time_max26.45000000000024
survival_time_mean17.925000000000136
survival_time_min4.599999999999992
No reset possible
5775710844Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:44:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013547641252300126
agent_compute-ego0_mean0.012989762125166133
agent_compute-ego0_median0.01288164416320318
agent_compute-ego0_min0.01264811892195804
complete-iteration_max0.35103500236778035
complete-iteration_mean0.30356135753469604
complete-iteration_median0.30431858645589227
complete-iteration_min0.25457325485921917
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.3878303800991037e-06
get_duckie_state_mean1.3606832188233845e-06
get_duckie_state_median1.3611298814403524e-06
get_duckie_state_min1.3326427323137295e-06
get_robot_state_max0.0038330965891765815
get_robot_state_mean0.0037944591809669008
get_robot_state_median0.003806451079648897
get_robot_state_min0.003731837975393227
get_state_dump_max0.004837724787309506
get_state_dump_mean0.004788921784600251
get_state_dump_median0.004784428309044374
get_state_dump_min0.0047491057330027505
get_ui_image_max0.03565722143123986
get_ui_image_mean0.031228376864195863
get_ui_image_median0.03089054478495246
get_ui_image_min0.027475196455638673
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02833812163334703, "step_physics": 0.21542146759763744, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.0047491057330027505, "get_robot_state": 0.003731837975393227, "sim_render-ego0": 0.003902907574008049, "get_duckie_state": 1.3326427323137295e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.01264811892195804, "complete-iteration": 0.2818249087845852, "set_robot_commands": 0.0022816203416733817, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008634106900471632, "sim_compute_performance-ego0": 0.002034199426414369}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03565722143123986, "step_physics": 0.27301881771897596, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.0047928725154473325, "get_robot_state": 0.0038038971620634335, "sim_render-ego0": 0.0039990404861157975, "get_duckie_state": 1.3878303800991037e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013547641252300126, "complete-iteration": 0.35103500236778035, "set_robot_commands": 0.002295275909716045, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011704357140864262, "sim_compute_performance-ego0": 0.002132598406865535}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03344296793655789, "step_physics": 0.2541135040349905, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004837724787309506, "get_robot_state": 0.003809004997234361, "sim_render-ego0": 0.004039901380832745, "get_duckie_state": 1.357655838863935e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012719800132795932, "complete-iteration": 0.3268122641271993, "set_robot_commands": 0.0022944083916555335, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00931129527032425, "sim_compute_performance-ego0": 0.0021591772147757523}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.027475196455638673, "step_physics": 0.19051624892851793, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004775984102641415, "get_robot_state": 0.0038330965891765815, "sim_render-ego0": 0.003936791400131238, "get_duckie_state": 1.3646039240167698e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.013043488193610429, "complete-iteration": 0.25457325485921917, "set_robot_commands": 0.002303970941993021, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006348182319304429, "sim_compute_performance-ego0": 0.002256602669238647}}
set_robot_commands_max0.002303970941993021
set_robot_commands_mean0.002293818896259495
set_robot_commands_median0.0022948421506857894
set_robot_commands_min0.0022816203416733817
sim_compute_performance-ego0_max0.002256602669238647
sim_compute_performance-ego0_mean0.002145644429323576
sim_compute_performance-ego0_median0.0021458878108206437
sim_compute_performance-ego0_min0.002034199426414369
sim_compute_sim_state_max0.011704357140864262
sim_compute_sim_state_mean0.008999485407741144
sim_compute_sim_state_median0.008972701085397942
sim_compute_sim_state_min0.006348182319304429
sim_render-ego0_max0.004039901380832745
sim_render-ego0_mean0.003969660210271958
sim_render-ego0_median0.0039679159431235175
sim_render-ego0_min0.003902907574008049
simulation-passed1
step_physics_max0.27301881771897596
step_physics_mean0.23326750957003045
step_physics_median0.23476748581631396
step_physics_min0.19051624892851793
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5775010846Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:02:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 7 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5774110854Dishank Bansal 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:10:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.270460638711091
survival_time_median13.07500000000005
deviation-center-line_median0.48972904184805255
in-drivable-lane_median3.5750000000000153


other stats
agent_compute-ego0_max0.013489054480570792
agent_compute-ego0_mean0.013147415963406413
agent_compute-ego0_median0.01314462280394163
agent_compute-ego0_min0.012811363765171595
complete-iteration_max0.2278828852517264
complete-iteration_mean0.20351976873412145
complete-iteration_median0.2052802286866532
complete-iteration_min0.17563573231145302
deviation-center-line_max0.6263542457565078
deviation-center-line_mean0.4975088908943851
deviation-center-line_min0.38422323412492737
deviation-heading_max2.9248624357541675
deviation-heading_mean2.4131580847114456
deviation-heading_median2.380880922869556
deviation-heading_min1.9660080573525036
driven_any_max4.86710891842843
driven_any_mean2.6003851857958207
driven_any_median2.098124632274698
driven_any_min1.338182560205459
driven_lanedir_consec_max2.1267569970438367
driven_lanedir_consec_mean1.3284879043435849
driven_lanedir_consec_min0.6462733429083198
driven_lanedir_max2.1267569970438367
driven_lanedir_mean1.3284879043435849
driven_lanedir_median1.270460638711091
driven_lanedir_min0.6462733429083198
get_duckie_state_max2.3582438730822943e-06
get_duckie_state_mean2.074714656945915e-06
get_duckie_state_median2.0261922964272788e-06
get_duckie_state_min1.8882301618468087e-06
get_robot_state_max0.003890979785127
get_robot_state_mean0.003830237814321947
get_robot_state_median0.0038500776539357926
get_robot_state_min0.003729816164289202
get_state_dump_max0.004832371117125727
get_state_dump_mean0.004786523405300184
get_state_dump_median0.004804802705153785
get_state_dump_min0.004704117093767439
get_ui_image_max0.037030976159232
get_ui_image_mean0.032282669176455364
get_ui_image_median0.03248564946844763
get_ui_image_min0.02712840160969419
in-drivable-lane_max20.200000000000255
in-drivable-lane_mean7.512500000000081
in-drivable-lane_min2.7000000000000384
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.5436199970319273, "get_ui_image": 0.030553127630069232, "step_physics": 0.1223430938233202, "survival_time": 15.600000000000088, "driven_lanedir": 2.1267569970438367, "get_state_dump": 0.0048042935685227856, "get_robot_state": 0.003890979785127, "sim_render-ego0": 0.004076982839419819, "get_duckie_state": 2.1259624737139325e-06, "in-drivable-lane": 2.7000000000000384, "deviation-heading": 2.9248624357541675, "agent_compute-ego0": 0.013111256943724026, "complete-iteration": 0.1937219007327534, "set_robot_commands": 0.0023946602123613935, "deviation-center-line": 0.6263542457565078, "driven_lanedir_consec": 2.1267569970438367, "sim_compute_sim_state": 0.010313921462232692, "sim_compute_performance-ego0": 0.0021417597993113363}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.338182560205459, "get_ui_image": 0.037030976159232, "step_physics": 0.15091640199933734, "survival_time": 8.699999999999989, "driven_lanedir": 0.6462733429083198, "get_state_dump": 0.004704117093767439, "get_robot_state": 0.003729816164289202, "sim_render-ego0": 0.004025767190115792, "get_duckie_state": 1.926422119140625e-06, "in-drivable-lane": 4.199999999999997, "deviation-heading": 1.9660080573525036, "agent_compute-ego0": 0.012811363765171595, "complete-iteration": 0.2278828852517264, "set_robot_commands": 0.0022897325243268693, "deviation-center-line": 0.38422323412492737, "driven_lanedir_consec": 0.6462733429083198, "sim_compute_sim_state": 0.010203079496111187, "sim_compute_performance-ego0": 0.002078866958618164}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.6526292675174674, "get_ui_image": 0.034418171306826034, "step_physics": 0.14262158578296877, "survival_time": 10.550000000000017, "driven_lanedir": 1.1797383511470907, "get_state_dump": 0.004805311841784783, "get_robot_state": 0.003836143691584749, "sim_render-ego0": 0.004074033701194907, "get_duckie_state": 1.8882301618468087e-06, "in-drivable-lane": 2.950000000000034, "deviation-heading": 2.1973204219669413, "agent_compute-ego0": 0.013177988664159234, "complete-iteration": 0.21683855664055304, "set_robot_commands": 0.002378360280450785, "deviation-center-line": 0.4771790658617359, "driven_lanedir_consec": 1.1797383511470907, "sim_compute_sim_state": 0.009354535138831948, "sim_compute_performance-ego0": 0.002080608089015169}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.86710891842843, "get_ui_image": 0.02712840160969419, "step_physics": 0.11091213687508011, "survival_time": 28.900000000000276, "driven_lanedir": 1.3611829262750912, "get_state_dump": 0.004832371117125727, "get_robot_state": 0.003864011616286836, "sim_render-ego0": 0.004126795832974923, "get_duckie_state": 2.3582438730822943e-06, "in-drivable-lane": 20.200000000000255, "deviation-heading": 2.56444142377217, "agent_compute-ego0": 0.013489054480570792, "complete-iteration": 0.17563573231145302, "set_robot_commands": 0.0023840198450961465, "deviation-center-line": 0.5022790178343691, "driven_lanedir_consec": 1.3611829262750912, "sim_compute_sim_state": 0.006670628186952265, "sim_compute_performance-ego0": 0.002128728313149566}}
set_robot_commands_max0.0023946602123613935
set_robot_commands_mean0.0023616932155587985
set_robot_commands_median0.0023811900627734657
set_robot_commands_min0.0022897325243268693
sim_compute_performance-ego0_max0.0021417597993113363
sim_compute_performance-ego0_mean0.0021074907900235588
sim_compute_performance-ego0_median0.0021046682010823674
sim_compute_performance-ego0_min0.002078866958618164
sim_compute_sim_state_max0.010313921462232692
sim_compute_sim_state_mean0.009135541071032025
sim_compute_sim_state_median0.009778807317471569
sim_compute_sim_state_min0.006670628186952265
sim_render-ego0_max0.004126795832974923
sim_render-ego0_mean0.0040758948909263605
sim_render-ego0_median0.0040755082703073636
sim_render-ego0_min0.004025767190115792
simulation-passed1
step_physics_max0.15091640199933734
step_physics_mean0.13169830462017662
step_physics_median0.13248233980314447
step_physics_min0.11091213687508011
survival_time_max28.900000000000276
survival_time_mean15.937500000000092
survival_time_min8.699999999999989
No reset possible
5772410863Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:17:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8792480021423466
survival_time_median15.550000000000086
deviation-center-line_median0.40118849103420245
in-drivable-lane_median9.575000000000074


other stats
agent_compute-ego0_max0.03743808626014496
agent_compute-ego0_mean0.027040100536767968
agent_compute-ego0_median0.02848496237160297
agent_compute-ego0_min0.013752391143720975
complete-iteration_max0.257206796436775
complete-iteration_mean0.2137537850463206
complete-iteration_median0.20501088714658725
complete-iteration_min0.18778656945533292
deviation-center-line_max1.7751521432486046
deviation-center-line_mean0.6787130364676782
deviation-center-line_min0.13732302055370332
deviation-heading_max8.954789986293395
deviation-heading_mean3.635612366979073
deviation-heading_median2.426033041428631
deviation-heading_min0.7355933987656318
driven_any_max10.11861106536492
driven_any_mean4.190686205361065
driven_any_median2.5854406427912617
driven_any_min1.4732524704968182
driven_lanedir_consec_max6.270682763392273
driven_lanedir_consec_mean2.161087691677671
driven_lanedir_consec_min0.6151719990337172
driven_lanedir_max6.270682763392273
driven_lanedir_mean2.161087691677671
driven_lanedir_median0.8792480021423466
driven_lanedir_min0.6151719990337172
get_duckie_state_max1.64776204902435e-06
get_duckie_state_mean1.6105142140249163e-06
get_duckie_state_median1.6174213361697931e-06
get_duckie_state_min1.55945213473573e-06
get_robot_state_max0.0041327441610941075
get_robot_state_mean0.004054148819475018
get_robot_state_median0.0040727535283238605
get_robot_state_min0.003938344060158243
get_state_dump_max0.005278229713439941
get_state_dump_mean0.005188340704004725
get_state_dump_median0.005195812840756804
get_state_dump_min0.00508350742106535
get_ui_image_max0.03784558831191645
get_ui_image_mean0.03231490907411555
get_ui_image_median0.031299957450975475
get_ui_image_min0.028814133082594826
in-drivable-lane_max20.799999999999063
in-drivable-lane_mean11.412499999999808
in-drivable-lane_min5.70000000000001
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.11861106536492, "get_ui_image": 0.02965307771027191, "step_physics": 0.10914252912030524, "survival_time": 57.84999999999885, "driven_lanedir": 6.270682763392273, "get_state_dump": 0.005123799740753437, "get_robot_state": 0.004035705523581496, "sim_render-ego0": 0.004182490248342458, "get_duckie_state": 1.607781247153801e-06, "in-drivable-lane": 20.799999999999063, "deviation-heading": 8.954789986293395, "agent_compute-ego0": 0.02109444264920882, "complete-iteration": 0.18778656945533292, "set_robot_commands": 0.002403289337026435, "deviation-center-line": 1.7751521432486046, "driven_lanedir_consec": 6.270682763392273, "sim_compute_sim_state": 0.009800655030627737, "sim_compute_performance-ego0": 0.0022411626443549965}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.444843392109661, "get_ui_image": 0.03784558831191645, "step_physics": 0.15329746792956098, "survival_time": 20.450000000000156, "driven_lanedir": 1.1241635570432973, "get_state_dump": 0.005267825940760171, "get_robot_state": 0.0041327441610941075, "sim_render-ego0": 0.004239330640653284, "get_duckie_state": 1.627061425185785e-06, "in-drivable-lane": 12.450000000000127, "deviation-heading": 4.104159013759074, "agent_compute-ego0": 0.035875482093997116, "complete-iteration": 0.257206796436775, "set_robot_commands": 0.0023788742902802256, "deviation-center-line": 0.6534114977839266, "driven_lanedir_consec": 1.1241635570432973, "sim_compute_sim_state": 0.011726112482024402, "sim_compute_performance-ego0": 0.002324513109718881}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4732524704968182, "get_ui_image": 0.03294683719167904, "step_physics": 0.12850725042576694, "survival_time": 9.750000000000004, "driven_lanedir": 0.6343324472413957, "get_state_dump": 0.00508350742106535, "get_robot_state": 0.003938344060158243, "sim_render-ego0": 0.004220666934032829, "get_duckie_state": 1.55945213473573e-06, "in-drivable-lane": 5.70000000000001, "deviation-heading": 0.7355933987656318, "agent_compute-ego0": 0.013752391143720975, "complete-iteration": 0.20225294633787505, "set_robot_commands": 0.0023537047055302834, "deviation-center-line": 0.13732302055370332, "driven_lanedir_consec": 0.6343324472413957, "sim_compute_sim_state": 0.009190466939186563, "sim_compute_performance-ego0": 0.0021549767377425214}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7260378934728628, "get_ui_image": 0.028814133082594826, "step_physics": 0.11721747055231968, "survival_time": 10.650000000000016, "driven_lanedir": 0.6151719990337172, "get_state_dump": 0.005278229713439941, "get_robot_state": 0.004109801533066224, "sim_render-ego0": 0.0042324823753856055, "get_duckie_state": 1.64776204902435e-06, "in-drivable-lane": 6.700000000000022, "deviation-heading": 0.7479070690981882, "agent_compute-ego0": 0.03743808626014496, "complete-iteration": 0.20776882795529944, "set_robot_commands": 0.0024979448764123648, "deviation-center-line": 0.1489654842844783, "driven_lanedir_consec": 0.6151719990337172, "sim_compute_sim_state": 0.005848875669675453, "sim_compute_performance-ego0": 0.002213741017279224}}
set_robot_commands_max0.0024979448764123648
set_robot_commands_mean0.002408453302312327
set_robot_commands_median0.0023910818136533302
set_robot_commands_min0.0023537047055302834
sim_compute_performance-ego0_max0.002324513109718881
sim_compute_performance-ego0_mean0.0022335983772739055
sim_compute_performance-ego0_median0.0022274518308171105
sim_compute_performance-ego0_min0.0021549767377425214
sim_compute_sim_state_max0.011726112482024402
sim_compute_sim_state_mean0.009141527530378538
sim_compute_sim_state_median0.009495560984907147
sim_compute_sim_state_min0.005848875669675453
sim_render-ego0_max0.004239330640653284
sim_render-ego0_mean0.004218742549603544
sim_render-ego0_median0.004226574654709218
sim_render-ego0_min0.004182490248342458
simulation-passed1
step_physics_max0.15329746792956098
step_physics_mean0.1270411795069882
step_physics_median0.12286236048904332
step_physics_min0.10914252912030524
survival_time_max57.84999999999885
survival_time_mean24.67499999999976
survival_time_min9.750000000000004
No reset possible
5767110882Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:24:51
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8954387354252447
survival_time_median56.69999999999891
deviation-center-line_median0.9599870481892496
in-drivable-lane_median14.87499999999988


other stats
agent_compute-ego0_max0.0130418393137453
agent_compute-ego0_mean0.01265329313947776
agent_compute-ego0_median0.012684398107079654
agent_compute-ego0_min0.012202537030006427
complete-iteration_max0.21338908937242296
complete-iteration_mean0.1776067400280104
complete-iteration_median0.17413799522550313
complete-iteration_min0.14876188028861242
deviation-center-line_max4.171897291135004
deviation-center-line_mean1.5671301949733722
deviation-center-line_min0.17664939237998664
deviation-heading_max14.172035289548935
deviation-heading_mean6.224757768240901
deviation-heading_median4.3946427188170345
deviation-heading_min1.9377103457805989
driven_any_max7.110816944681776
driven_any_mean5.269417279136013
driven_any_median6.833386688506324
driven_any_min0.3000787948496251
driven_lanedir_consec_max6.865902515974668
driven_lanedir_consec_mean3.197924503903862
driven_lanedir_consec_min0.1349180287902918
driven_lanedir_max6.865902515974668
driven_lanedir_mean3.1992304121717696
driven_lanedir_median2.898050551961059
driven_lanedir_min0.1349180287902918
get_duckie_state_max1.5716891739276996e-06
get_duckie_state_mean1.4169128859408526e-06
get_duckie_state_median1.4259290470204817e-06
get_duckie_state_min1.244104275794748e-06
get_robot_state_max0.00383478620545233
get_robot_state_mean0.003699007458771089
get_robot_state_median0.00374496767264818
get_robot_state_min0.0034713082843356663
get_state_dump_max0.004747262108236626
get_state_dump_mean0.004692063423968338
get_state_dump_median0.004721325464301193
get_state_dump_min0.004578340659034341
get_ui_image_max0.034367156028747556
get_ui_image_mean0.03024623961058559
get_ui_image_median0.03044376986276845
get_ui_image_min0.025730262688057903
in-drivable-lane_max43.8499999999988
in-drivable-lane_mean18.39999999999964
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.933106907135774, "get_ui_image": 0.028367767833570548, "step_physics": 0.09980539967792965, "survival_time": 53.3999999999991, "driven_lanedir": 3.980580025569117, "get_state_dump": 0.004734612492560448, "get_robot_state": 0.00383478620545233, "sim_render-ego0": 0.003998346257365898, "get_duckie_state": 1.5716891739276996e-06, "in-drivable-lane": 28.099999999999763, "deviation-heading": 3.4614734851760613, "agent_compute-ego0": 0.01289363148281572, "complete-iteration": 0.16939204245443318, "set_robot_commands": 0.0022886867719459354, "deviation-center-line": 0.9437307854181364, "driven_lanedir_consec": 3.980580025569117, "sim_compute_sim_state": 0.011232050029444182, "sim_compute_performance-ego0": 0.0021362645922697403}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.3000787948496251, "get_ui_image": 0.034367156028747556, "step_physics": 0.14002392556932236, "survival_time": 4.449999999999992, "driven_lanedir": 0.1349180287902918, "get_state_dump": 0.004708038436041938, "get_robot_state": 0.0034713082843356663, "sim_render-ego0": 0.003774645593431261, "get_duckie_state": 1.3907750447591143e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 1.9377103457805989, "agent_compute-ego0": 0.012475164731343589, "complete-iteration": 0.21338908937242296, "set_robot_commands": 0.0021242353651258683, "deviation-center-line": 0.17664939237998664, "driven_lanedir_consec": 0.1349180287902918, "sim_compute_sim_state": 0.010459793938530816, "sim_compute_performance-ego0": 0.0018971946504380969}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.733666469876874, "get_ui_image": 0.03251977189196635, "step_physics": 0.1063185635454748, "survival_time": 59.99999999999873, "driven_lanedir": 1.8155210783530011, "get_state_dump": 0.004747262108236626, "get_robot_state": 0.0037334525118660274, "sim_render-ego0": 0.003961169054665038, "get_duckie_state": 1.244104275794748e-06, "in-drivable-lane": 43.8499999999988, "deviation-heading": 5.327811952458007, "agent_compute-ego0": 0.0130418393137453, "complete-iteration": 0.1788839479965731, "set_robot_commands": 0.0022083752161259455, "deviation-center-line": 0.9762433109603628, "driven_lanedir_consec": 1.8102974452813727, "sim_compute_sim_state": 0.01026017143764067, "sim_compute_performance-ego0": 0.002004568820988308}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.110816944681776, "get_ui_image": 0.025730262688057903, "step_physics": 0.08801983714997023, "survival_time": 59.99999999999873, "driven_lanedir": 6.865902515974668, "get_state_dump": 0.004578340659034341, "get_robot_state": 0.003756482833430332, "sim_render-ego0": 0.003882608246942246, "get_duckie_state": 1.4610830492818484e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.172035289548935, "agent_compute-ego0": 0.012202537030006427, "complete-iteration": 0.14876188028861242, "set_robot_commands": 0.0022779027190831776, "deviation-center-line": 4.171897291135004, "driven_lanedir_consec": 6.865902515974668, "sim_compute_sim_state": 0.006185217761278748, "sim_compute_performance-ego0": 0.002037032855539695}}
set_robot_commands_max0.0022886867719459354
set_robot_commands_mean0.002224800018070232
set_robot_commands_median0.0022431389676045616
set_robot_commands_min0.0021242353651258683
sim_compute_performance-ego0_max0.0021362645922697403
sim_compute_performance-ego0_mean0.00201876522980896
sim_compute_performance-ego0_median0.0020208008382640013
sim_compute_performance-ego0_min0.0018971946504380969
sim_compute_sim_state_max0.011232050029444182
sim_compute_sim_state_mean0.009534308291723604
sim_compute_sim_state_median0.010359982688085745
sim_compute_sim_state_min0.006185217761278748
sim_render-ego0_max0.003998346257365898
sim_render-ego0_mean0.0039041922881011106
sim_render-ego0_median0.003921888650803642
sim_render-ego0_min0.003774645593431261
simulation-passed1
step_physics_max0.14002392556932236
step_physics_mean0.10854193148567426
step_physics_median0.1030619816117022
step_physics_min0.08801983714997023
survival_time_max59.99999999999873
survival_time_mean44.46249999999914
survival_time_min4.449999999999992
No reset possible
5765010892Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:10:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24121804806902336
survival_time_median15.80000000000009
deviation-center-line_median0.10017809771254636
in-drivable-lane_median14.125000000000089


other stats
agent_compute-ego0_max0.014184947283762806
agent_compute-ego0_mean0.013289378286659851
agent_compute-ego0_median0.01313689958810391
agent_compute-ego0_min0.012698766686668776
complete-iteration_max0.2637462705936072
complete-iteration_mean0.19550034847777376
complete-iteration_median0.17417804620614866
complete-iteration_min0.16989903090519043
deviation-center-line_max1.2590346156913892
deviation-center-line_mean0.3860016453650855
deviation-center-line_min0.08461577034386047
deviation-heading_max3.7063772206438808
deviation-heading_mean1.4384429180471296
deviation-heading_median0.7362118432018805
deviation-heading_min0.574970765140877
driven_any_max7.140372271572013
driven_any_mean3.411382873028588
driven_any_median3.0890562061012465
driven_any_min0.32704680833984573
driven_lanedir_consec_max2.483080034204625
driven_lanedir_consec_mean0.7840031091886928
driven_lanedir_consec_min0.17049630641209923
driven_lanedir_max2.483080034204625
driven_lanedir_mean0.7840031091886928
driven_lanedir_median0.24121804806902336
driven_lanedir_min0.17049630641209923
get_duckie_state_max1.7274703298296248e-06
get_duckie_state_mean1.5650468108323268e-06
get_duckie_state_median1.58366720829805e-06
get_duckie_state_min1.3653824969035825e-06
get_robot_state_max0.004252680710383824
get_robot_state_mean0.003996543230476111
get_robot_state_median0.004042880319928953
get_robot_state_min0.0036477315716627167
get_state_dump_max0.005443213120946345
get_state_dump_mean0.005002514504657455
get_state_dump_median0.00495996186992328
get_state_dump_min0.004646921157836914
get_ui_image_max0.03897807733067926
get_ui_image_mean0.031531446522491145
get_ui_image_median0.029657131481670273
get_ui_image_min0.02783344579594476
in-drivable-lane_max22.19999999999998
in-drivable-lane_mean12.925000000000038
in-drivable-lane_min1.2499999999999982
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.140372271572013, "get_ui_image": 0.02854299816603681, "step_physics": 0.10154899458797016, "survival_time": 35.10000000000014, "driven_lanedir": 2.483080034204625, "get_state_dump": 0.004664742929667531, "get_robot_state": 0.0038870025325465846, "sim_render-ego0": 0.004057664450676648, "get_duckie_state": 1.5973705655310943e-06, "in-drivable-lane": 22.19999999999998, "deviation-heading": 3.7063772206438808, "agent_compute-ego0": 0.012698766686668776, "complete-iteration": 0.16989903090519043, "set_robot_commands": 0.002332230889441109, "deviation-center-line": 1.2590346156913892, "driven_lanedir_consec": 2.483080034204625, "sim_compute_sim_state": 0.009886874921969636, "sim_compute_performance-ego0": 0.002181463865603017}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.32704680833984573, "get_ui_image": 0.03897807733067926, "step_physics": 0.1816310297768071, "survival_time": 2.5999999999999988, "driven_lanedir": 0.17049630641209923, "get_state_dump": 0.005443213120946345, "get_robot_state": 0.004198758107311321, "sim_render-ego0": 0.0043337345123291016, "get_duckie_state": 1.5699638510650058e-06, "in-drivable-lane": 1.2499999999999982, "deviation-heading": 0.790575840626918, "agent_compute-ego0": 0.014184947283762806, "complete-iteration": 0.2637462705936072, "set_robot_commands": 0.0024732913611070165, "deviation-center-line": 0.08461577034386047, "driven_lanedir_consec": 0.17049630641209923, "sim_compute_sim_state": 0.010159861366703824, "sim_compute_performance-ego0": 0.0022341890155144458}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.0586490311235, "get_ui_image": 0.030771264797303736, "step_physics": 0.10246220042065876, "survival_time": 20.450000000000156, "driven_lanedir": 0.23412191887813935, "get_state_dump": 0.004646921157836914, "get_robot_state": 0.0036477315716627167, "sim_render-ego0": 0.003879956501286204, "get_duckie_state": 1.3653824969035825e-06, "in-drivable-lane": 18.750000000000153, "deviation-heading": 0.6818478457768429, "agent_compute-ego0": 0.01280680982077994, "complete-iteration": 0.17252987070781428, "set_robot_commands": 0.002189796145369367, "deviation-center-line": 0.09511041642275618, "driven_lanedir_consec": 0.23412191887813935, "sim_compute_sim_state": 0.01006028826643781, "sim_compute_performance-ego0": 0.0019701533201264172}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.1194633810789933, "get_ui_image": 0.02783344579594476, "step_physics": 0.11011629125901631, "survival_time": 11.150000000000023, "driven_lanedir": 0.24831417725990737, "get_state_dump": 0.005255180810179029, "get_robot_state": 0.004252680710383824, "sim_render-ego0": 0.004242131752627236, "get_duckie_state": 1.7274703298296248e-06, "in-drivable-lane": 9.50000000000002, "deviation-heading": 0.574970765140877, "agent_compute-ego0": 0.013466989355427878, "complete-iteration": 0.17582622170448303, "set_robot_commands": 0.002386378390448434, "deviation-center-line": 0.10524577900233652, "driven_lanedir_consec": 0.24831417725990737, "sim_compute_sim_state": 0.005874510322298322, "sim_compute_performance-ego0": 0.002285133515085493}}
set_robot_commands_max0.0024732913611070165
set_robot_commands_mean0.002345424196591482
set_robot_commands_median0.0023593046399447717
set_robot_commands_min0.002189796145369367
sim_compute_performance-ego0_max0.002285133515085493
sim_compute_performance-ego0_mean0.0021677349290823433
sim_compute_performance-ego0_median0.0022078264405587314
sim_compute_performance-ego0_min0.0019701533201264172
sim_compute_sim_state_max0.010159861366703824
sim_compute_sim_state_mean0.008995383719352398
sim_compute_sim_state_median0.009973581594203723
sim_compute_sim_state_min0.005874510322298322
sim_render-ego0_max0.0043337345123291016
sim_render-ego0_mean0.004128371804229798
sim_render-ego0_median0.004149898101651942
sim_render-ego0_min0.003879956501286204
simulation-passed1
step_physics_max0.1816310297768071
step_physics_mean0.12393962901111308
step_physics_median0.10628924583983754
step_physics_min0.10154899458797016
survival_time_max35.10000000000014
survival_time_mean17.32500000000008
survival_time_min2.5999999999999988
No reset possible
5764811426Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-testingLFP-simhost-erroryesnogpu-prod-050:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5764711428Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-erroryesnogpu-prod-050:00:54
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5760210912Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:26:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.511477146122779
survival_time_median59.99999999999873
deviation-center-line_median2.3651790830642776
in-drivable-lane_median3.549999999999903


other stats
agent_compute-ego0_max0.01253155003423276
agent_compute-ego0_mean0.012155724537172778
agent_compute-ego0_median0.012261216686131258
agent_compute-ego0_min0.011568914742195834
complete-iteration_max0.2322816606880962
complete-iteration_mean0.1909916946909519
complete-iteration_median0.18605027429070897
complete-iteration_min0.1595845694942935
deviation-center-line_max2.807884199077578
deviation-center-line_mean1.9157242786085869
deviation-center-line_min0.1246547492282144
deviation-heading_max10.88509441185965
deviation-heading_mean7.206331231975094
deviation-heading_median8.357222961991486
deviation-heading_min1.2257845920577546
driven_any_max9.564349245044754
driven_any_mean7.078871850090232
driven_any_median9.224792562690164
driven_any_min0.30155302993584826
driven_lanedir_consec_max8.566499040682404
driven_lanedir_consec_mean6.434609858851831
driven_lanedir_consec_min0.14898610247935773
driven_lanedir_max8.566499040682404
driven_lanedir_mean6.434609858851831
driven_lanedir_median8.511477146122779
driven_lanedir_min0.14898610247935773
get_duckie_state_max1.3822719119768356e-06
get_duckie_state_mean1.332550666589137e-06
get_duckie_state_median1.33472715785958e-06
get_duckie_state_min1.2784764386605525e-06
get_robot_state_max0.0038432265002959778
get_robot_state_mean0.003749922088920235
get_robot_state_median0.003790361101085399
get_robot_state_min0.0035757396532141643
get_state_dump_max0.006562896396802819
get_state_dump_mean0.005298855645821527
get_state_dump_median0.004968475044815864
get_state_dump_min0.004695576096851561
get_ui_image_max0.03470436040905939
get_ui_image_mean0.030798934423907236
get_ui_image_median0.03118307534899938
get_ui_image_min0.026125226588570805
in-drivable-lane_max6.4999999999996305
in-drivable-lane_mean3.774999999999858
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.564349245044754, "get_ui_image": 0.028947870896122635, "step_physics": 0.10331444637066715, "survival_time": 59.99999999999873, "driven_lanedir": 8.463680429460776, "get_state_dump": 0.004695576096851561, "get_robot_state": 0.0038089009744737864, "sim_render-ego0": 0.00391108328654903, "get_duckie_state": 1.3342308660629488e-06, "in-drivable-lane": 6.4999999999996305, "deviation-heading": 8.004229433280724, "agent_compute-ego0": 0.012128157976962048, "complete-iteration": 0.1702526685697252, "set_robot_commands": 0.0022533315107486924, "deviation-center-line": 2.372810591800842, "driven_lanedir_consec": 8.463680429460776, "sim_compute_sim_state": 0.009059484951899111, "sim_compute_performance-ego0": 0.0020436335364348883}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.30155302993584826, "get_ui_image": 0.03470436040905939, "step_physics": 0.15749658017918683, "survival_time": 3.399999999999996, "driven_lanedir": 0.14898610247935773, "get_state_dump": 0.006562896396802819, "get_robot_state": 0.0035757396532141643, "sim_render-ego0": 0.003917348557624264, "get_duckie_state": 1.2784764386605525e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 1.2257845920577546, "agent_compute-ego0": 0.01253155003423276, "complete-iteration": 0.2322816606880962, "set_robot_commands": 0.0020682327989218893, "deviation-center-line": 0.1246547492282144, "driven_lanedir_consec": 0.14898610247935773, "sim_compute_sim_state": 0.00941192931023197, "sim_compute_performance-ego0": 0.0019265015920003257}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.284907395496566, "get_ui_image": 0.03341827980187612, "step_physics": 0.1254331207990051, "survival_time": 59.99999999999873, "driven_lanedir": 8.55927386278478, "get_state_dump": 0.004791634763706534, "get_robot_state": 0.0038432265002959778, "sim_render-ego0": 0.0039297795911117156, "get_duckie_state": 1.3822719119768356e-06, "in-drivable-lane": 3.499999999999801, "deviation-heading": 10.88509441185965, "agent_compute-ego0": 0.012394275395300466, "complete-iteration": 0.2018478800116927, "set_robot_commands": 0.0022741156156414455, "deviation-center-line": 2.807884199077578, "driven_lanedir_consec": 8.55927386278478, "sim_compute_sim_state": 0.01357384486361209, "sim_compute_performance-ego0": 0.0020978389234963704}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.164677729883762, "get_ui_image": 0.026125226588570805, "step_physics": 0.09857963801025849, "survival_time": 59.99999999999873, "driven_lanedir": 8.566499040682404, "get_state_dump": 0.005145315325925193, "get_robot_state": 0.003771821227697012, "sim_render-ego0": 0.003857790679359912, "get_duckie_state": 1.335223449656211e-06, "in-drivable-lane": 3.600000000000005, "deviation-heading": 8.71021649070225, "agent_compute-ego0": 0.011568914742195834, "complete-iteration": 0.1595845694942935, "set_robot_commands": 0.002323918298916654, "deviation-center-line": 2.3575475743277132, "driven_lanedir_consec": 8.566499040682404, "sim_compute_sim_state": 0.006032365247867784, "sim_compute_performance-ego0": 0.002092424975545281}}
set_robot_commands_max0.002323918298916654
set_robot_commands_mean0.0022298995560571704
set_robot_commands_median0.002263723563195069
set_robot_commands_min0.0020682327989218893
sim_compute_performance-ego0_max0.0020978389234963704
sim_compute_performance-ego0_mean0.0020400997568692163
sim_compute_performance-ego0_median0.002068029255990085
sim_compute_performance-ego0_min0.0019265015920003257
sim_compute_sim_state_max0.01357384486361209
sim_compute_sim_state_mean0.00951940609340274
sim_compute_sim_state_median0.00923570713106554
sim_compute_sim_state_min0.006032365247867784
sim_render-ego0_max0.0039297795911117156
sim_render-ego0_mean0.0039040005286612306
sim_render-ego0_median0.003914215922086647
sim_render-ego0_min0.003857790679359912
simulation-passed1
step_physics_max0.15749658017918683
step_physics_mean0.1212059463397794
step_physics_median0.11437378358483612
step_physics_min0.09857963801025849
survival_time_max59.99999999999873
survival_time_mean45.84999999999904
survival_time_min3.399999999999996
No reset possible
5758810888Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:07:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3578341030471408
survival_time_median11.100000000000028
deviation-center-line_median0.20904698245588135
in-drivable-lane_median8.600000000000016


other stats
agent_compute-ego0_max0.01559531224946954
agent_compute-ego0_mean0.01332515081856636
agent_compute-ego0_median0.012801785624003276
agent_compute-ego0_min0.012101719776789348
complete-iteration_max0.2758563955624898
complete-iteration_mean0.2133255747436119
complete-iteration_median0.20368335132724252
complete-iteration_min0.170079200757473
deviation-center-line_max0.38217093006663067
deviation-center-line_mean0.21545350503037097
deviation-center-line_min0.06154912514309048
deviation-heading_max1.7300324940030365
deviation-heading_mean1.0019789993007329
deviation-heading_median0.8074959969869204
deviation-heading_min0.6628915092260542
driven_any_max4.35204216123572
driven_any_mean2.208542419528322
driven_any_median2.103745668285376
driven_any_min0.27463618030681675
driven_lanedir_consec_max0.5040127973385946
driven_lanedir_consec_mean0.32821353766161043
driven_lanedir_consec_min0.09317314721356552
driven_lanedir_max0.5040127973385946
driven_lanedir_mean0.32821353766161043
driven_lanedir_median0.3578341030471408
driven_lanedir_min0.09317314721356552
get_duckie_state_max1.9265501291159814e-06
get_duckie_state_mean1.6230185003514852e-06
get_duckie_state_median1.6420120048095302e-06
get_duckie_state_min1.2814998626708984e-06
get_robot_state_max0.004208545556804478
get_robot_state_mean0.0039615363478743846
get_robot_state_median0.00392849941707403
get_robot_state_min0.003780601000545001
get_state_dump_max0.005001712965485234
get_state_dump_mean0.004844768776422717
get_state_dump_median0.004844455226355361
get_state_dump_min0.004688451687494914
get_ui_image_max0.03495450814565023
get_ui_image_mean0.03126101225753845
get_ui_image_median0.03171800988177306
get_ui_image_min0.026653521120957435
in-drivable-lane_max18.950000000000166
in-drivable-lane_mean9.35000000000005
in-drivable-lane_min1.2499999999999991
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.8846683424998423, "get_ui_image": 0.02851737227905479, "step_physics": 0.10232058839765865, "survival_time": 14.800000000000075, "driven_lanedir": 0.5040127973385946, "get_state_dump": 0.004709676459983543, "get_robot_state": 0.003780601000545001, "sim_render-ego0": 0.0039238985941466254, "get_duckie_state": 1.5196174082129893e-06, "in-drivable-lane": 11.450000000000053, "deviation-heading": 1.7300324940030365, "agent_compute-ego0": 0.012241856417672, "complete-iteration": 0.170079200757473, "set_robot_commands": 0.002223992588544133, "deviation-center-line": 0.38217093006663067, "driven_lanedir_consec": 0.5040127973385946, "sim_compute_sim_state": 0.010129633977356984, "sim_compute_performance-ego0": 0.0021275703353111192}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.27463618030681675, "get_ui_image": 0.03495450814565023, "step_physics": 0.203489288687706, "survival_time": 2.3499999999999996, "driven_lanedir": 0.09317314721356552, "get_state_dump": 0.004688451687494914, "get_robot_state": 0.0037852476040522256, "sim_render-ego0": 0.00386357307434082, "get_duckie_state": 1.2814998626708984e-06, "in-drivable-lane": 1.2499999999999991, "deviation-heading": 0.8608878667156767, "agent_compute-ego0": 0.012101719776789348, "complete-iteration": 0.2758563955624898, "set_robot_commands": 0.002230296532313029, "deviation-center-line": 0.06154912514309048, "driven_lanedir_consec": 0.09317314721356552, "sim_compute_sim_state": 0.00869243343671163, "sim_compute_performance-ego0": 0.0019571532805760703}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3228229940709095, "get_ui_image": 0.03491864748449133, "step_physics": 0.14938373853696274, "survival_time": 7.399999999999982, "driven_lanedir": 0.22558730680632344, "get_state_dump": 0.005001712965485234, "get_robot_state": 0.004208545556804478, "sim_render-ego0": 0.004357563569241722, "get_duckie_state": 1.9265501291159814e-06, "in-drivable-lane": 5.7499999999999805, "deviation-heading": 0.6628915092260542, "agent_compute-ego0": 0.013361714830334557, "complete-iteration": 0.22532888866911, "set_robot_commands": 0.0024527847366845046, "deviation-center-line": 0.09073899326637166, "driven_lanedir_consec": 0.22558730680632344, "sim_compute_sim_state": 0.009130596314500642, "sim_compute_performance-ego0": 0.0023955418759544424}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.35204216123572, "get_ui_image": 0.026653521120957435, "step_physics": 0.11499616046792036, "survival_time": 21.800000000000175, "driven_lanedir": 0.49008089928795817, "get_state_dump": 0.0049792339927271796, "get_robot_state": 0.004071751230095835, "sim_render-ego0": 0.004152622048314704, "get_duckie_state": 1.764406601406071e-06, "in-drivable-lane": 18.950000000000166, "deviation-heading": 0.7541041272581642, "agent_compute-ego0": 0.01559531224946954, "complete-iteration": 0.18203781398537505, "set_robot_commands": 0.002407859064621565, "deviation-center-line": 0.32735497164539107, "driven_lanedir_consec": 0.49008089928795817, "sim_compute_sim_state": 0.006820166411061581, "sim_compute_performance-ego0": 0.002248960446984053}}
set_robot_commands_max0.0024527847366845046
set_robot_commands_mean0.0023287332305408077
set_robot_commands_median0.0023190777984672967
set_robot_commands_min0.002223992588544133
sim_compute_performance-ego0_max0.0023955418759544424
sim_compute_performance-ego0_mean0.0021823064847064214
sim_compute_performance-ego0_median0.002188265391147586
sim_compute_performance-ego0_min0.0019571532805760703
sim_compute_sim_state_max0.010129633977356984
sim_compute_sim_state_mean0.00869320753490771
sim_compute_sim_state_median0.008911514875606135
sim_compute_sim_state_min0.006820166411061581
sim_render-ego0_max0.004357563569241722
sim_render-ego0_mean0.004074414321510968
sim_render-ego0_median0.004038260321230665
sim_render-ego0_min0.00386357307434082
simulation-passed1
step_physics_max0.203489288687706
step_physics_mean0.14254744402256192
step_physics_median0.13218994950244156
step_physics_min0.10232058839765865
survival_time_max21.800000000000175
survival_time_mean11.587500000000055
survival_time_min2.3499999999999996
No reset possible
5753210899Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:17:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.936391622378068
survival_time_median28.000000000000263
deviation-center-line_median0.38613376599843746
in-drivable-lane_median20.099999999999604


other stats
agent_compute-ego0_max0.012899230390587107
agent_compute-ego0_mean0.01185299842072216
agent_compute-ego0_median0.01162677938906446
agent_compute-ego0_min0.011259204514172613
complete-iteration_max0.18689892243365852
complete-iteration_mean0.16819236725200568
complete-iteration_median0.16835658738163856
complete-iteration_min0.14915737181108715
deviation-center-line_max1.7282128132641248
deviation-center-line_mean0.657581111060152
deviation-center-line_min0.12984409897960827
deviation-heading_max9.70092899596419
deviation-heading_mean3.7364303716213954
deviation-heading_median2.210404682282282
deviation-heading_min0.823983125956828
driven_any_max9.711720919425904
driven_any_mean4.962845283185484
driven_any_median4.1893734303317025
driven_any_min1.7609133526526246
driven_lanedir_consec_max5.586591620622148
driven_lanedir_consec_mean2.0181371794545813
driven_lanedir_consec_min0.613173852440041
driven_lanedir_max5.739454630421866
driven_lanedir_mean2.056352931904511
driven_lanedir_median0.936391622378068
driven_lanedir_min0.613173852440041
get_duckie_state_max2.3009793070338717e-06
get_duckie_state_mean2.127583018911772e-06
get_duckie_state_median2.0974795297347016e-06
get_duckie_state_min2.0143937091438136e-06
get_robot_state_max0.003729806250373789
get_robot_state_mean0.0034863947516759726
get_robot_state_median0.0034298495685026516
get_robot_state_min0.003356073619324798
get_state_dump_max0.0047212959135938815
get_state_dump_mean0.004457284385200422
get_state_dump_median0.00437218396040377
get_state_dump_min0.004363473706400265
get_ui_image_max0.03367646178420709
get_ui_image_mean0.02904292786877337
get_ui_image_median0.02907547160461563
get_ui_image_min0.024344306481655108
in-drivable-lane_max25.450000000000298
in-drivable-lane_mean18.374999999999886
in-drivable-lane_min7.850000000000046
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.711720919425904, "get_ui_image": 0.025936773674970465, "step_physics": 0.09164007120982098, "survival_time": 59.99999999999873, "driven_lanedir": 5.739454630421866, "get_state_dump": 0.004363473706400265, "get_robot_state": 0.003356073619324798, "sim_render-ego0": 0.0035537712579960627, "get_duckie_state": 2.0387667005604052e-06, "in-drivable-lane": 22.59999999999899, "deviation-heading": 9.70092899596419, "agent_compute-ego0": 0.011329611969629394, "complete-iteration": 0.15273805224428963, "set_robot_commands": 0.001982168988522443, "deviation-center-line": 1.7282128132641248, "driven_lanedir_consec": 5.586591620622148, "sim_compute_sim_state": 0.008720251046846947, "sim_compute_performance-ego0": 0.0017799719684229206}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.7609133526526246, "get_ui_image": 0.03367646178420709, "step_physics": 0.11761877780057946, "survival_time": 12.200000000000038, "driven_lanedir": 0.613173852440041, "get_state_dump": 0.004370468489977779, "get_robot_state": 0.0033935177082918128, "sim_render-ego0": 0.003565871958829918, "get_duckie_state": 2.0143937091438136e-06, "in-drivable-lane": 7.850000000000046, "deviation-heading": 1.56305989270145, "agent_compute-ego0": 0.011259204514172613, "complete-iteration": 0.18689892243365852, "set_robot_commands": 0.00201784542628697, "deviation-center-line": 0.2535117714575482, "driven_lanedir_consec": 0.613173852440041, "sim_compute_sim_state": 0.009114517484392438, "sim_compute_performance-ego0": 0.0018028882085060589}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.341909539481093, "get_ui_image": 0.032214169534260796, "step_physics": 0.1114542784306827, "survival_time": 29.750000000000288, "driven_lanedir": 0.6176491334619838, "get_state_dump": 0.0047212959135938815, "get_robot_state": 0.003729806250373789, "sim_render-ego0": 0.003996618642102952, "get_duckie_state": 2.3009793070338717e-06, "in-drivable-lane": 25.450000000000298, "deviation-heading": 0.823983125956828, "agent_compute-ego0": 0.012899230390587107, "complete-iteration": 0.18397512251898743, "set_robot_commands": 0.002242974386919265, "deviation-center-line": 0.12984409897960827, "driven_lanedir_consec": 0.6176491334619838, "sim_compute_sim_state": 0.010609012722168992, "sim_compute_performance-ego0": 0.0020213251145894096}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.036837321182311, "get_ui_image": 0.024344306481655108, "step_physics": 0.09158442138265747, "survival_time": 26.25000000000024, "driven_lanedir": 1.255134111294152, "get_state_dump": 0.004373899430829762, "get_robot_state": 0.00346618142871349, "sim_render-ego0": 0.003670497538925577, "get_duckie_state": 2.156192358908998e-06, "in-drivable-lane": 17.600000000000215, "deviation-heading": 2.8577494718631136, "agent_compute-ego0": 0.011923946808499527, "complete-iteration": 0.14915737181108715, "set_robot_commands": 0.0020503975139371344, "deviation-center-line": 0.5187557605393267, "driven_lanedir_consec": 1.255134111294152, "sim_compute_sim_state": 0.005840143776665169, "sim_compute_performance-ego0": 0.0018209703974850732}}
set_robot_commands_max0.002242974386919265
set_robot_commands_mean0.002073346578916453
set_robot_commands_median0.0020341214701120524
set_robot_commands_min0.001982168988522443
sim_compute_performance-ego0_max0.0020213251145894096
sim_compute_performance-ego0_mean0.0018562889222508655
sim_compute_performance-ego0_median0.001811929302995566
sim_compute_performance-ego0_min0.0017799719684229206
sim_compute_sim_state_max0.010609012722168992
sim_compute_sim_state_mean0.008570981257518387
sim_compute_sim_state_median0.008917384265619693
sim_compute_sim_state_min0.005840143776665169
sim_render-ego0_max0.003996618642102952
sim_render-ego0_mean0.003696689849463627
sim_render-ego0_median0.003618184748877748
sim_render-ego0_min0.0035537712579960627
simulation-passed1
step_physics_max0.11761877780057946
step_physics_mean0.10307438720593516
step_physics_median0.10154717482025184
step_physics_min0.09158442138265747
survival_time_max59.99999999999873
survival_time_mean32.04999999999982
survival_time_min12.200000000000038
No reset possible
5751911313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-050:02:51
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5742010932Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:22:58
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1961238150146727
survival_time_median47.724999999999426
deviation-center-line_median1.4124082550402657
in-drivable-lane_median7.724999999999973


other stats
agent_compute-ego0_max0.04943670877596227
agent_compute-ego0_mean0.035716461580399
agent_compute-ego0_median0.04023906442148302
agent_compute-ego0_min0.012951008702667664
complete-iteration_max0.2563426843503626
complete-iteration_mean0.19683126898494377
complete-iteration_median0.18236566208647845
complete-iteration_min0.16625106741645554
deviation-center-line_max3.3597453895648584
deviation-center-line_mean1.5848459360821807
deviation-center-line_min0.15482184468333365
deviation-heading_max10.058269649583549
deviation-heading_mean5.334613486878761
deviation-heading_median4.717565742768647
deviation-heading_min1.845052812394204
driven_any_max6.972747754361618
driven_any_mean4.316837702152087
driven_any_median5.008481350675872
driven_any_min0.27764035289498584
driven_lanedir_consec_max6.233145004203759
driven_lanedir_consec_mean3.184173868043511
driven_lanedir_consec_min0.11130283794093998
driven_lanedir_max6.233145004203759
driven_lanedir_mean3.184173868043511
driven_lanedir_median3.1961238150146727
driven_lanedir_min0.11130283794093998
get_duckie_state_max1.2137312178409269e-06
get_duckie_state_mean1.1995506302251473e-06
get_duckie_state_median1.197642975599715e-06
get_duckie_state_min1.1891853518602326e-06
get_robot_state_max0.0036226625173864232
get_robot_state_mean0.0035969681897503464
get_robot_state_median0.0035974281432798534
get_robot_state_min0.003570353955055256
get_state_dump_max0.00458612350698911
get_state_dump_mean0.00455472491800549
get_state_dump_median0.004575978871101808
get_state_dump_min0.004480818422829233
get_ui_image_max0.036617377909218395
get_ui_image_mean0.03033009542626068
get_ui_image_median0.029797332303415056
get_ui_image_min0.025108339188994216
in-drivable-lane_max29.39999999999959
in-drivable-lane_mean11.212499999999883
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.972747754361618, "get_ui_image": 0.027722698365718897, "step_physics": 0.091705250998123, "survival_time": 59.99999999999873, "driven_lanedir": 4.07071548609704, "get_state_dump": 0.00458612350698911, "get_robot_state": 0.003618789850722542, "sim_render-ego0": 0.0038372082674533103, "get_duckie_state": 1.1998350475352572e-06, "in-drivable-lane": 29.39999999999959, "deviation-heading": 4.608436004850047, "agent_compute-ego0": 0.04351359700084626, "complete-iteration": 0.1900084951735853, "set_robot_commands": 0.002236387513261552, "deviation-center-line": 1.2046228552594251, "driven_lanedir_consec": 4.07071548609704, "sim_compute_sim_state": 0.010749433558747532, "sim_compute_performance-ego0": 0.001953042814078478}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.27764035289498584, "get_ui_image": 0.036617377909218395, "step_physics": 0.14436047542385938, "survival_time": 4.049999999999994, "driven_lanedir": 0.11130283794093998, "get_state_dump": 0.004480818422829233, "get_robot_state": 0.003576066435837164, "sim_render-ego0": 0.0038564757602970777, "get_duckie_state": 1.1891853518602326e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 1.845052812394204, "agent_compute-ego0": 0.04943670877596227, "complete-iteration": 0.2563426843503626, "set_robot_commands": 0.00235184809056724, "deviation-center-line": 0.15482184468333365, "driven_lanedir_consec": 0.11130283794093998, "sim_compute_sim_state": 0.00961403439684612, "sim_compute_performance-ego0": 0.001961347533435356}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.673833653051254, "get_ui_image": 0.031871966241111216, "step_physics": 0.10321330755529268, "survival_time": 35.450000000000124, "driven_lanedir": 2.3215321439323056, "get_state_dump": 0.004577416097614127, "get_robot_state": 0.0036226625173864232, "sim_render-ego0": 0.0038382006363129953, "get_duckie_state": 1.1954509036641726e-06, "in-drivable-lane": 13.799999999999953, "deviation-heading": 4.826695480687248, "agent_compute-ego0": 0.012951008702667664, "complete-iteration": 0.17472282899937158, "set_robot_commands": 0.002145933769118618, "deviation-center-line": 1.6201936548211056, "driven_lanedir_consec": 2.3215321439323056, "sim_compute_sim_state": 0.010484976164052183, "sim_compute_performance-ego0": 0.0019337227646733673}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.34312904830049, "get_ui_image": 0.025108339188994216, "step_physics": 0.08214366862815584, "survival_time": 59.99999999999873, "driven_lanedir": 6.233145004203759, "get_state_dump": 0.00457454164458949, "get_robot_state": 0.003570353955055256, "sim_render-ego0": 0.003761489822108184, "get_duckie_state": 1.2137312178409269e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.058269649583549, "agent_compute-ego0": 0.036964531842119785, "complete-iteration": 0.16625106741645554, "set_robot_commands": 0.0022085935845164635, "deviation-center-line": 3.3597453895648584, "driven_lanedir_consec": 6.233145004203759, "sim_compute_sim_state": 0.005930734018203519, "sim_compute_performance-ego0": 0.001905580245882744}}
set_robot_commands_max0.00235184809056724
set_robot_commands_mean0.002235690739365968
set_robot_commands_median0.0022224905488890077
set_robot_commands_min0.002145933769118618
sim_compute_performance-ego0_max0.001961347533435356
sim_compute_performance-ego0_mean0.0019384233395174865
sim_compute_performance-ego0_median0.0019433827893759227
sim_compute_performance-ego0_min0.001905580245882744
sim_compute_sim_state_max0.010749433558747532
sim_compute_sim_state_mean0.00919479453446234
sim_compute_sim_state_median0.010049505280449154
sim_compute_sim_state_min0.005930734018203519
sim_render-ego0_max0.0038564757602970777
sim_render-ego0_mean0.003823343621542892
sim_render-ego0_median0.003837704451883153
sim_render-ego0_min0.003761489822108184
simulation-passed1
step_physics_max0.14436047542385938
step_physics_mean0.10535567565135771
step_physics_median0.09745927927670783
step_physics_min0.08214366862815584
survival_time_max59.99999999999873
survival_time_mean39.87499999999939
survival_time_min4.049999999999994
No reset possible
5729610969Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:24:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.428168733856523
survival_time_median45.47499999999952
deviation-center-line_median1.1176584102386735
in-drivable-lane_median10.050000000000129


other stats
agent_compute-ego0_max0.013044263855103525
agent_compute-ego0_mean0.01262208797492716
agent_compute-ego0_median0.01271716530004103
agent_compute-ego0_min0.012009757444523058
complete-iteration_max0.222433778974745
complete-iteration_mean0.18197502251647485
complete-iteration_median0.18062892572968356
complete-iteration_min0.14420845963178724
deviation-center-line_max3.2502631810016505
deviation-center-line_mean1.4080003367697649
deviation-center-line_min0.1464213456000624
deviation-heading_max10.778495644266656
deviation-heading_mean5.170975440130948
deviation-heading_median4.141841858272862
deviation-heading_min1.621722399711412
driven_any_max7.74318465746717
driven_any_mean4.7300961783116175
driven_any_median5.4528977110028585
driven_any_min0.2714046337735838
driven_lanedir_consec_max7.585493299016857
driven_lanedir_consec_mean3.1338120200775084
driven_lanedir_consec_min0.0934173135801295
driven_lanedir_max7.585493299016857
driven_lanedir_mean3.1338120200775084
driven_lanedir_median2.428168733856523
driven_lanedir_min0.0934173135801295
get_duckie_state_max2.370289620709955e-06
get_duckie_state_mean2.1455138006977613e-06
get_duckie_state_median2.143374480654262e-06
get_duckie_state_min1.925016620772566e-06
get_robot_state_max0.0038189878074652342
get_robot_state_mean0.0036443473593312974
get_robot_state_median0.003649477795365796
get_robot_state_min0.003459446039128363
get_state_dump_max0.004854611043007143
get_state_dump_mean0.004579135899757638
get_state_dump_median0.004530840424129361
get_state_dump_min0.004400251707764688
get_ui_image_max0.03331545547202781
get_ui_image_mean0.029717849931722592
get_ui_image_median0.03034354632874992
get_ui_image_min0.024868851597362712
in-drivable-lane_max37.29999999999906
in-drivable-lane_mean14.349999999999827
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.00891121984825, "get_ui_image": 0.028581553889859106, "step_physics": 0.10434583848522556, "survival_time": 30.950000000000305, "driven_lanedir": 2.001588770331863, "get_state_dump": 0.004854611043007143, "get_robot_state": 0.003813582081948557, "sim_render-ego0": 0.004069747078803278, "get_duckie_state": 2.273436515561996e-06, "in-drivable-lane": 18.450000000000266, "deviation-heading": 1.621722399711412, "agent_compute-ego0": 0.013044263855103525, "complete-iteration": 0.17411267488233506, "set_robot_commands": 0.0023054119079343733, "deviation-center-line": 0.4733726651313423, "driven_lanedir_consec": 2.001588770331863, "sim_compute_sim_state": 0.010892398511209796, "sim_compute_performance-ego0": 0.002108822330351798}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2714046337735838, "get_ui_image": 0.03331545547202781, "step_physics": 0.1511813122549175, "survival_time": 3.999999999999994, "driven_lanedir": 0.0934173135801295, "get_state_dump": 0.004406681767216435, "get_robot_state": 0.0034853735087830343, "sim_render-ego0": 0.0037290902785312983, "get_duckie_state": 2.013312445746528e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 1.9810192868015977, "agent_compute-ego0": 0.012483293627515253, "complete-iteration": 0.222433778974745, "set_robot_commands": 0.00203539412698628, "deviation-center-line": 0.1464213456000624, "driven_lanedir_consec": 0.0934173135801295, "sim_compute_sim_state": 0.009840179372716832, "sim_compute_performance-ego0": 0.0018719508324140384}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.896884202157468, "get_ui_image": 0.03210553876764074, "step_physics": 0.11338025306682604, "survival_time": 59.99999999999873, "driven_lanedir": 2.854748697381183, "get_state_dump": 0.004654999081042287, "get_robot_state": 0.0038189878074652342, "sim_render-ego0": 0.004058530388227807, "get_duckie_state": 2.370289620709955e-06, "in-drivable-lane": 37.29999999999906, "deviation-heading": 6.302664429744126, "agent_compute-ego0": 0.012951036972566806, "complete-iteration": 0.18714517657703209, "set_robot_commands": 0.0023084369726125444, "deviation-center-line": 1.761944155346005, "driven_lanedir_consec": 2.854748697381183, "sim_compute_sim_state": 0.011621756517916894, "sim_compute_performance-ego0": 0.002149650198930904}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.74318465746717, "get_ui_image": 0.024868851597362712, "step_physics": 0.0859638040607716, "survival_time": 59.99999999999873, "driven_lanedir": 7.585493299016857, "get_state_dump": 0.004400251707764688, "get_robot_state": 0.003459446039128363, "sim_render-ego0": 0.0036404269819553447, "get_duckie_state": 1.925016620772566e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.778495644266656, "agent_compute-ego0": 0.012009757444523058, "complete-iteration": 0.14420845963178724, "set_robot_commands": 0.002059234568320345, "deviation-center-line": 3.2502631810016505, "driven_lanedir_consec": 7.585493299016857, "sim_compute_sim_state": 0.005886008201491128, "sim_compute_performance-ego0": 0.001835405776939424}}
set_robot_commands_max0.0023084369726125444
set_robot_commands_mean0.0021771193939633853
set_robot_commands_median0.002182323238127359
set_robot_commands_min0.00203539412698628
sim_compute_performance-ego0_max0.002149650198930904
sim_compute_performance-ego0_mean0.001991457284659041
sim_compute_performance-ego0_median0.0019903865813829186
sim_compute_performance-ego0_min0.001835405776939424
sim_compute_sim_state_max0.011621756517916894
sim_compute_sim_state_mean0.009560085650833662
sim_compute_sim_state_median0.010366288941963314
sim_compute_sim_state_min0.005886008201491128
sim_render-ego0_max0.004069747078803278
sim_render-ego0_mean0.0038744486818794313
sim_render-ego0_median0.003893810333379552
sim_render-ego0_min0.0036404269819553447
simulation-passed1
step_physics_max0.1511813122549175
step_physics_mean0.11371780196693516
step_physics_median0.1088630457760258
step_physics_min0.0859638040607716
survival_time_max59.99999999999873
survival_time_mean38.73749999999944
survival_time_min3.999999999999994
No reset possible
5723110987Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:10:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4315937045278263
survival_time_median15.12500000000008
deviation-center-line_median0.2892287548131988
in-drivable-lane_median11.725000000000051


other stats
agent_compute-ego0_max0.05324472387138726
agent_compute-ego0_mean0.04930328506015899
agent_compute-ego0_median0.05065354580042272
agent_compute-ego0_min0.04266132476840325
complete-iteration_max0.2546663469481237
complete-iteration_mean0.22441456663402673
complete-iteration_median0.22006935370920536
complete-iteration_min0.2028532121695724
deviation-center-line_max0.4650172818614281
deviation-center-line_mean0.28833952935600876
deviation-center-line_min0.10988332593620936
deviation-heading_max4.3998128468080635
deviation-heading_mean2.1647244556219265
deviation-heading_median1.841594550293163
deviation-heading_min0.5758958750933162
driven_any_max4.083116986554166
driven_any_mean2.542341258284345
driven_any_median2.7332035457861767
driven_any_min0.6198409550108618
driven_lanedir_consec_max0.6293576320105188
driven_lanedir_consec_mean0.41901518714311253
driven_lanedir_consec_min0.18351570750627877
driven_lanedir_max0.6293576320105188
driven_lanedir_mean0.41901518714311253
driven_lanedir_median0.4315937045278263
driven_lanedir_min0.18351570750627877
get_duckie_state_max1.6899669871610753e-06
get_duckie_state_mean1.6187042451392697e-06
get_duckie_state_median1.6392749156950529e-06
get_duckie_state_min1.506300162005898e-06
get_robot_state_max0.004140770464913721
get_robot_state_mean0.003968941634120858
get_robot_state_median0.003934329488958624
get_robot_state_min0.003866337093652463
get_state_dump_max0.00538481198824369
get_state_dump_mean0.005046448403451323
get_state_dump_median0.005008349554765449
get_state_dump_min0.004784282516030704
get_ui_image_max0.0350712271570002
get_ui_image_mean0.030786078988013343
get_ui_image_median0.031226543211230542
get_ui_image_min0.025620002372592102
in-drivable-lane_max16.60000000000013
in-drivable-lane_mean10.662500000000056
in-drivable-lane_min2.5999999999999908
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.6952933835903865, "get_ui_image": 0.02926252497632805, "step_physics": 0.10518715990979974, "survival_time": 20.10000000000015, "driven_lanedir": 0.6293576320105188, "get_state_dump": 0.00538481198824369, "get_robot_state": 0.004140770464913721, "sim_render-ego0": 0.0043802645898634385, "get_duckie_state": 1.6559146474076263e-06, "in-drivable-lane": 15.000000000000098, "deviation-heading": 2.320819216174226, "agent_compute-ego0": 0.05324472387138726, "complete-iteration": 0.2177095513781602, "set_robot_commands": 0.002453220689267142, "deviation-center-line": 0.4650172818614281, "driven_lanedir_consec": 0.6293576320105188, "sim_compute_sim_state": 0.01129511568149917, "sim_compute_performance-ego0": 0.002252950266040584}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6198409550108618, "get_ui_image": 0.0350712271570002, "step_physics": 0.13812647513972903, "survival_time": 5.09999999999999, "driven_lanedir": 0.18351570750627877, "get_state_dump": 0.0050123247128088496, "get_robot_state": 0.0039637505429462325, "sim_render-ego0": 0.004209817034526936, "get_duckie_state": 1.6226351839824788e-06, "in-drivable-lane": 2.5999999999999908, "deviation-heading": 1.3623698844121002, "agent_compute-ego0": 0.052217499723712216, "complete-iteration": 0.2546663469481237, "set_robot_commands": 0.0023536936750689756, "deviation-center-line": 0.1276569231371329, "driven_lanedir_consec": 0.18351570750627877, "sim_compute_sim_state": 0.011099613985969025, "sim_compute_performance-ego0": 0.0025003419339078145}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.083116986554166, "get_ui_image": 0.03319056144613304, "step_physics": 0.11678290735543696, "survival_time": 22.600000000000183, "driven_lanedir": 0.6034426534229125, "get_state_dump": 0.005004374396722048, "get_robot_state": 0.003904908434971016, "sim_render-ego0": 0.004211647357898569, "get_duckie_state": 1.506300162005898e-06, "in-drivable-lane": 16.60000000000013, "deviation-heading": 4.3998128468080635, "agent_compute-ego0": 0.04266132476840325, "complete-iteration": 0.2224291560402506, "set_robot_commands": 0.0023830579079802726, "deviation-center-line": 0.4508005864892648, "driven_lanedir_consec": 0.6034426534229125, "sim_compute_sim_state": 0.011993451886882318, "sim_compute_performance-ego0": 0.0021895209685066676}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7711137079819668, "get_ui_image": 0.025620002372592102, "step_physics": 0.10576394843120202, "survival_time": 10.15000000000001, "driven_lanedir": 0.25974475563274013, "get_state_dump": 0.004784282516030704, "get_robot_state": 0.003866337093652463, "sim_render-ego0": 0.003833949565887451, "get_duckie_state": 1.6899669871610753e-06, "in-drivable-lane": 8.450000000000008, "deviation-heading": 0.5758958750933162, "agent_compute-ego0": 0.04908959187713323, "complete-iteration": 0.2028532121695724, "set_robot_commands": 0.0022865977941774855, "deviation-center-line": 0.10988332593620936, "driven_lanedir_consec": 0.25974475563274013, "sim_compute_sim_state": 0.005400928796506396, "sim_compute_performance-ego0": 0.0020943447655322506}}
set_robot_commands_max0.002453220689267142
set_robot_commands_mean0.0023691425166234687
set_robot_commands_median0.0023683757915246243
set_robot_commands_min0.0022865977941774855
sim_compute_performance-ego0_max0.0025003419339078145
sim_compute_performance-ego0_mean0.002259289483496829
sim_compute_performance-ego0_median0.0022212356172736257
sim_compute_performance-ego0_min0.0020943447655322506
sim_compute_sim_state_max0.011993451886882318
sim_compute_sim_state_mean0.009947277587714227
sim_compute_sim_state_median0.011197364833734095
sim_compute_sim_state_min0.005400928796506396
sim_render-ego0_max0.0043802645898634385
sim_render-ego0_mean0.0041589196370440985
sim_render-ego0_median0.004210732196212753
sim_render-ego0_min0.003833949565887451
simulation-passed1
step_physics_max0.13812647513972903
step_physics_mean0.11646512270904193
step_physics_median0.11127342789331948
step_physics_min0.10518715990979974
survival_time_max22.600000000000183
survival_time_mean14.487500000000082
survival_time_min5.09999999999999
No reset possible
5714811003Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:24:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.899984276601852
survival_time_median56.199999999998944
deviation-center-line_median0.6377443223208161
in-drivable-lane_median20.499999999999552


other stats
agent_compute-ego0_max0.013301128427452765
agent_compute-ego0_mean0.012789154544187446
agent_compute-ego0_median0.012894448285595163
agent_compute-ego0_min0.012066593178106684
complete-iteration_max0.23895910680294036
complete-iteration_mean0.1858435607640029
complete-iteration_median0.1769294407047905
complete-iteration_min0.1505562548434903
deviation-center-line_max3.266032124079493
deviation-center-line_mean1.1714515367762628
deviation-center-line_min0.14428537838392566
deviation-heading_max10.967165439583836
deviation-heading_mean4.310307159007528
deviation-heading_median2.270738830356514
deviation-heading_min1.7325855357332487
driven_any_max8.535375240815826
driven_any_mean5.695626220723407
driven_any_median6.994741754874882
driven_any_min0.25764613232803946
driven_lanedir_consec_max7.573223521619112
driven_lanedir_consec_mean2.865413315545683
driven_lanedir_consec_min0.08846118735991526
driven_lanedir_max7.573223521619112
driven_lanedir_mean2.865413315545683
driven_lanedir_median1.899984276601852
driven_lanedir_min0.08846118735991526
get_duckie_state_max1.4991982592631142e-06
get_duckie_state_mean1.3784146791451624e-06
get_duckie_state_median1.363500065084549e-06
get_duckie_state_min1.2874603271484376e-06
get_robot_state_max0.003768739300301463
get_robot_state_mean0.00367481942900294
get_robot_state_median0.003669263044066671
get_robot_state_min0.003592012327576954
get_state_dump_max0.004798296093940735
get_state_dump_mean0.004679358341157567
get_state_dump_median0.0046962607661585574
get_state_dump_min0.004526615738372422
get_ui_image_max0.035384070873260495
get_ui_image_mean0.030599133042299748
get_ui_image_median0.03075218638120577
get_ui_image_min0.025508088533526953
in-drivable-lane_max46.799999999998676
in-drivable-lane_mean21.949999999999445
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.535375240815826, "get_ui_image": 0.02876269112617944, "step_physics": 0.0953805416847248, "survival_time": 59.99999999999873, "driven_lanedir": 2.035591220153016, "get_state_dump": 0.00468621901131788, "get_robot_state": 0.003737642604246624, "sim_render-ego0": 0.004011607785506808, "get_duckie_state": 1.4991982592631142e-06, "in-drivable-lane": 46.799999999998676, "deviation-heading": 1.7325855357332487, "agent_compute-ego0": 0.012811314354927512, "complete-iteration": 0.16325183276034314, "set_robot_commands": 0.002255810190497787, "deviation-center-line": 0.5560012830039653, "driven_lanedir_consec": 2.035591220153016, "sim_compute_sim_state": 0.009493631089756037, "sim_compute_performance-ego0": 0.002023943854212066}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.25764613232803946, "get_ui_image": 0.035384070873260495, "step_physics": 0.16460329294204712, "survival_time": 3.949999999999994, "driven_lanedir": 0.08846118735991526, "get_state_dump": 0.004798296093940735, "get_robot_state": 0.003600883483886719, "sim_render-ego0": 0.0036840349435806274, "get_duckie_state": 1.2874603271484376e-06, "in-drivable-lane": 1.649999999999994, "deviation-heading": 1.967986461393192, "agent_compute-ego0": 0.012977582216262818, "complete-iteration": 0.23895910680294036, "set_robot_commands": 0.002318769693374634, "deviation-center-line": 0.14428537838392566, "driven_lanedir_consec": 0.08846118735991526, "sim_compute_sim_state": 0.009635597467422484, "sim_compute_performance-ego0": 0.001872238516807556}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.252363800808376, "get_ui_image": 0.032741681636232096, "step_physics": 0.11571978477208926, "survival_time": 52.39999999999916, "driven_lanedir": 1.7643773330506884, "get_state_dump": 0.004706302520999236, "get_robot_state": 0.003768739300301463, "sim_render-ego0": 0.00403043744220861, "get_duckie_state": 1.3534629538129691e-06, "in-drivable-lane": 39.34999999999911, "deviation-heading": 2.5734911993198355, "agent_compute-ego0": 0.013301128427452765, "complete-iteration": 0.1906070486492379, "set_robot_commands": 0.0022425362902442196, "deviation-center-line": 0.7194873616376668, "driven_lanedir_consec": 1.7643773330506884, "sim_compute_sim_state": 0.011978634433364504, "sim_compute_performance-ego0": 0.002028155940504047}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.737119708941387, "get_ui_image": 0.025508088533526953, "step_physics": 0.0907875217069297, "survival_time": 59.99999999999873, "driven_lanedir": 7.573223521619112, "get_state_dump": 0.004526615738372422, "get_robot_state": 0.003592012327576954, "sim_render-ego0": 0.003796644353747467, "get_duckie_state": 1.373537176356129e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.967165439583836, "agent_compute-ego0": 0.012066593178106684, "complete-iteration": 0.1505562548434903, "set_robot_commands": 0.0021379944883119454, "deviation-center-line": 3.266032124079493, "driven_lanedir_consec": 7.573223521619112, "sim_compute_sim_state": 0.006133182956019011, "sim_compute_performance-ego0": 0.001921570172020041}}
set_robot_commands_max0.002318769693374634
set_robot_commands_mean0.0022387776656071466
set_robot_commands_median0.002249173240371003
set_robot_commands_min0.0021379944883119454
sim_compute_performance-ego0_max0.002028155940504047
sim_compute_performance-ego0_mean0.0019614771208859272
sim_compute_performance-ego0_median0.0019727570131160537
sim_compute_performance-ego0_min0.001872238516807556
sim_compute_sim_state_max0.011978634433364504
sim_compute_sim_state_mean0.00931026148664051
sim_compute_sim_state_median0.00956461427858926
sim_compute_sim_state_min0.006133182956019011
sim_render-ego0_max0.00403043744220861
sim_render-ego0_mean0.003880681131260878
sim_render-ego0_median0.0039041260696271378
sim_render-ego0_min0.0036840349435806274
simulation-passed1
step_physics_max0.16460329294204712
step_physics_mean0.11662278527644772
step_physics_median0.10555016322840705
step_physics_min0.0907875217069297
survival_time_max59.99999999999873
survival_time_mean44.08749999999915
survival_time_min3.949999999999994
No reset possible
5694011053Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:40:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013420617947669747
agent_compute-ego0_mean0.011893005891207554
agent_compute-ego0_median0.011582621626810268
agent_compute-ego0_min0.010986162363539925
complete-iteration_max0.33774327318634617
complete-iteration_mean0.27996282871319395
complete-iteration_median0.2782182740132874
complete-iteration_min0.22567149363985467
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max2.0778744941349333e-06
get_duckie_state_mean1.937572803227332e-06
get_duckie_state_median1.91310561765342e-06
get_duckie_state_min1.8462054834675532e-06
get_robot_state_max0.0035961770098175633
get_robot_state_mean0.0035369773391482236
get_robot_state_median0.0035370820567173127
get_robot_state_min0.0034775682333407056
get_state_dump_max0.004563110257862608
get_state_dump_mean0.004481189306530726
get_state_dump_median0.0044938262356608045
get_state_dump_min0.004373994496938688
get_ui_image_max0.03439386381296988
get_ui_image_mean0.029318712384972745
get_ui_image_median0.028921123547518284
get_ui_image_min0.02503873863188452
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.026401687720534604, "step_physics": 0.1932413383487063, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004373994496938688, "get_robot_state": 0.0035206197600479825, "sim_render-ego0": 0.003709916965252752, "get_duckie_state": 1.9023857148461891e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.010986162363539925, "complete-iteration": 0.2542664978923051, "set_robot_commands": 0.0020911872238044836, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.007964504648505599, "sim_compute_performance-ego0": 0.0018977507464990925}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03439386381296988, "step_physics": 0.2624150239657006, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004563110257862608, "get_robot_state": 0.0035961770098175633, "sim_render-ego0": 0.00389589675757212, "get_duckie_state": 2.0778744941349333e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013420617947669747, "complete-iteration": 0.33774327318634617, "set_robot_commands": 0.0021203282870023476, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011283952925822618, "sim_compute_performance-ego0": 0.001970629608700615}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.031440559374501964, "step_physics": 0.2346960751837636, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004561497905073714, "get_robot_state": 0.003553544353386643, "sim_render-ego0": 0.003823859010707528, "get_duckie_state": 1.8462054834675532e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.0112505828609673, "complete-iteration": 0.30217005013426973, "set_robot_commands": 0.00221039571928839, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008634781063248177, "sim_compute_performance-ego0": 0.0019175170561753145}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02503873863188452, "step_physics": 0.16734664962254, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004426154566247894, "get_robot_state": 0.0034775682333407056, "sim_render-ego0": 0.003641877742135257, "get_duckie_state": 1.923825520460651e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.011914660392653237, "complete-iteration": 0.22567149363985467, "set_robot_commands": 0.0020793850078471596, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00582975451892659, "sim_compute_performance-ego0": 0.0018358315953009331}}
set_robot_commands_max0.00221039571928839
set_robot_commands_mean0.0021253240594855953
set_robot_commands_median0.002105757755403416
set_robot_commands_min0.0020793850078471596
sim_compute_performance-ego0_max0.001970629608700615
sim_compute_performance-ego0_mean0.001905432251668989
sim_compute_performance-ego0_median0.0019076339013372032
sim_compute_performance-ego0_min0.0018358315953009331
sim_compute_sim_state_max0.011283952925822618
sim_compute_sim_state_mean0.008428248289125745
sim_compute_sim_state_median0.008299642855876888
sim_compute_sim_state_min0.00582975451892659
sim_render-ego0_max0.00389589675757212
sim_render-ego0_mean0.0037678876189169144
sim_render-ego0_median0.003766887987980139
sim_render-ego0_min0.003641877742135257
simulation-passed1
step_physics_max0.2624150239657006
step_physics_mean0.2144247717801776
step_physics_median0.21396870676623497
step_physics_min0.16734664962254
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5676611084Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:31:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.1214480620572544
survival_time_median54.624999999999034
deviation-center-line_median2.275961459343408
in-drivable-lane_median8.524999999999887


other stats
agent_compute-ego0_max0.02557894589998244
agent_compute-ego0_mean0.015939148499220394
agent_compute-ego0_median0.012857024961466791
agent_compute-ego0_min0.012463598173965546
complete-iteration_max0.21454199654715403
complete-iteration_mean0.1884624011143371
complete-iteration_median0.1851321593374019
complete-iteration_min0.16904328923539058
deviation-center-line_max3.1944171987390133
deviation-center-line_mean2.198706507816876
deviation-center-line_min1.048485913841675
deviation-heading_max14.061927977230786
deviation-heading_mean11.049122462604585
deviation-heading_median11.989262428695165
deviation-heading_min6.156037015797228
driven_any_max10.575839010826076
driven_any_mean8.493027912749048
driven_any_median9.560095770219087
driven_any_min4.276081099731934
driven_lanedir_consec_max5.916060571304909
driven_lanedir_consec_mean4.754736770787124
driven_lanedir_consec_min2.8599903877290784
driven_lanedir_max9.100802773528
driven_lanedir_mean6.792895378610789
driven_lanedir_median7.605394176593038
driven_lanedir_min2.8599903877290784
get_duckie_state_max1.4866917059880114e-06
get_duckie_state_mean1.3478102127553304e-06
get_duckie_state_median1.3507875385256442e-06
get_duckie_state_min1.2029740679820216e-06
get_robot_state_max0.003769815414771748
get_robot_state_mean0.003608577994766402
get_robot_state_median0.0035680608175392738
get_robot_state_min0.003528374929215313
get_state_dump_max0.004578297024681454
get_state_dump_mean0.0044889943923505605
get_state_dump_median0.004490698108466638
get_state_dump_min0.004396284327787512
get_ui_image_max0.034858019692557196
get_ui_image_mean0.02994202781737428
get_ui_image_median0.029846653238181767
get_ui_image_min0.025216785100576383
in-drivable-lane_max9.549999999999676
in-drivable-lane_mean8.012499999999852
in-drivable-lane_min5.449999999999959
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.575839010826076, "get_ui_image": 0.028052792561044305, "step_physics": 0.11515782258591982, "survival_time": 59.99999999999873, "driven_lanedir": 8.484828688709982, "get_state_dump": 0.004569035187847509, "get_robot_state": 0.003769815414771748, "sim_render-ego0": 0.00392663826255576, "get_duckie_state": 1.4866917059880114e-06, "in-drivable-lane": 9.349999999999664, "deviation-heading": 13.818261955060484, "agent_compute-ego0": 0.01268483697127343, "complete-iteration": 0.18279868359371187, "set_robot_commands": 0.0022443359241596764, "deviation-center-line": 2.640477032141753, "driven_lanedir_consec": 5.916060571304909, "sim_compute_sim_state": 0.010206178661984866, "sim_compute_performance-ego0": 0.0020888907824031123}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.276081099731934, "get_ui_image": 0.034858019692557196, "step_physics": 0.1393324820200602, "survival_time": 26.200000000000237, "driven_lanedir": 2.8599903877290784, "get_state_dump": 0.004578297024681454, "get_robot_state": 0.003573553902762277, "sim_render-ego0": 0.003835717155819848, "get_duckie_state": 1.3496762230282738e-06, "in-drivable-lane": 7.700000000000109, "deviation-heading": 6.156037015797228, "agent_compute-ego0": 0.013029212951660155, "complete-iteration": 0.21454199654715403, "set_robot_commands": 0.002188509986514137, "deviation-center-line": 1.048485913841675, "driven_lanedir_consec": 2.8599903877290784, "sim_compute_sim_state": 0.011096986134847005, "sim_compute_performance-ego0": 0.0019614051637195404}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.611998030737983, "get_ui_image": 0.03164051391531923, "step_physics": 0.11628232717997646, "survival_time": 49.24999999999934, "driven_lanedir": 6.725959664476095, "get_state_dump": 0.004396284327787512, "get_robot_state": 0.003528374929215313, "sim_render-ego0": 0.003743607422401165, "get_duckie_state": 1.2029740679820216e-06, "in-drivable-lane": 9.549999999999676, "deviation-heading": 10.160262902329842, "agent_compute-ego0": 0.012463598173965546, "complete-iteration": 0.18746563508109196, "set_robot_commands": 0.0021065323638142243, "deviation-center-line": 1.9114458865450632, "driven_lanedir_consec": 5.783414745917128, "sim_compute_sim_state": 0.011298809767253016, "sim_compute_performance-ego0": 0.0019176922753664832}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.508193509700195, "get_ui_image": 0.025216785100576383, "step_physics": 0.09648059230362942, "survival_time": 59.99999999999873, "driven_lanedir": 9.100802773528, "get_state_dump": 0.004412361029085768, "get_robot_state": 0.0035625677323162705, "sim_render-ego0": 0.003756533653710307, "get_duckie_state": 1.3518988540230147e-06, "in-drivable-lane": 5.449999999999959, "deviation-heading": 14.061927977230786, "agent_compute-ego0": 0.02557894589998244, "complete-iteration": 0.16904328923539058, "set_robot_commands": 0.0021452274449560464, "deviation-center-line": 3.1944171987390133, "driven_lanedir_consec": 4.459481378197382, "sim_compute_sim_state": 0.005840479384651788, "sim_compute_performance-ego0": 0.001957229333158139}}
set_robot_commands_max0.0022443359241596764
set_robot_commands_mean0.002171151429861021
set_robot_commands_median0.0021668687157350916
set_robot_commands_min0.0021065323638142243
sim_compute_performance-ego0_max0.0020888907824031123
sim_compute_performance-ego0_mean0.001981304388661819
sim_compute_performance-ego0_median0.0019593172484388397
sim_compute_performance-ego0_min0.0019176922753664832
sim_compute_sim_state_max0.011298809767253016
sim_compute_sim_state_mean0.009610613487184168
sim_compute_sim_state_median0.010651582398415935
sim_compute_sim_state_min0.005840479384651788
sim_render-ego0_max0.00392663826255576
sim_render-ego0_mean0.00381562412362177
sim_render-ego0_median0.003796125404765078
sim_render-ego0_min0.003743607422401165
simulation-passed1
step_physics_max0.1393324820200602
step_physics_mean0.11681330602239648
step_physics_median0.11572007488294814
step_physics_min0.09648059230362942
survival_time_max59.99999999999873
survival_time_mean48.86249999999926
survival_time_min26.200000000000237
No reset possible
5673811090Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:04:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6604555779228618
survival_time_median5.474999999999989
deviation-center-line_median0.06928450525579605
in-drivable-lane_median3.124999999999989


other stats
agent_compute-ego0_max0.013321824300856818
agent_compute-ego0_mean0.012291167101296642
agent_compute-ego0_median0.012273635319787196
agent_compute-ego0_min0.011295573464755354
complete-iteration_max0.21629902063790013
complete-iteration_mean0.1772211994599816
complete-iteration_median0.17486080167287574
complete-iteration_min0.14286417385627484
deviation-center-line_max0.2634381591689133
deviation-center-line_mean0.11612874425297866
deviation-center-line_min0.06250780733140925
deviation-heading_max0.9959151468096028
deviation-heading_mean0.5801456122891651
deviation-heading_median0.467619225848023
deviation-heading_min0.38942885065101135
driven_any_max1.9426795632958231
driven_any_mean1.41858050417213
driven_any_median1.5408765902052446
driven_any_min0.6498892729822074
driven_lanedir_consec_max0.7080420806580163
driven_lanedir_consec_mean0.560362357853305
driven_lanedir_consec_min0.2124961949094799
driven_lanedir_max0.7080420806580163
driven_lanedir_mean0.560362357853305
driven_lanedir_median0.6604555779228618
driven_lanedir_min0.2124961949094799
get_duckie_state_max1.846040998186384e-06
get_duckie_state_mean1.7179652155282502e-06
get_duckie_state_median1.7288005532801524e-06
get_duckie_state_min1.568218757366312e-06
get_robot_state_max0.0036030315217517673
get_robot_state_mean0.00344138193070582
get_robot_state_median0.0033948266092037826
get_robot_state_min0.0033728429826639468
get_state_dump_max0.004542845771426246
get_state_dump_mean0.0043570146673546795
get_state_dump_median0.004312974625489386
get_state_dump_min0.004259263647013697
get_ui_image_max0.03247180227505959
get_ui_image_mean0.029178092600816857
get_ui_image_median0.02958767169101495
get_ui_image_min0.025065224746177936
in-drivable-lane_max4.04999999999999
in-drivable-lane_mean3.037499999999991
in-drivable-lane_min1.8499999999999976
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.9426795632958231, "get_ui_image": 0.027185466952789995, "step_physics": 0.1041435478325177, "survival_time": 6.5999999999999845, "driven_lanedir": 0.7080420806580163, "get_state_dump": 0.004324154746263547, "get_robot_state": 0.003405250104746424, "sim_render-ego0": 0.0035614716379266035, "get_duckie_state": 1.7442201313219573e-06, "in-drivable-lane": 4.04999999999999, "deviation-heading": 0.9959151468096028, "agent_compute-ego0": 0.0118961585195441, "complete-iteration": 0.16660316008374207, "set_robot_commands": 0.0020389485179929806, "deviation-center-line": 0.2634381591689133, "driven_lanedir_consec": 0.7080420806580163, "sim_compute_sim_state": 0.008138337529691538, "sim_compute_performance-ego0": 0.0018290541225806215}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6498892729822074, "get_ui_image": 0.03247180227505959, "step_physics": 0.1471518338736841, "survival_time": 2.8999999999999977, "driven_lanedir": 0.2124961949094799, "get_state_dump": 0.004301794504715225, "get_robot_state": 0.0033728429826639468, "sim_render-ego0": 0.0035510911779888608, "get_duckie_state": 1.7133809752383476e-06, "in-drivable-lane": 1.8499999999999976, "deviation-heading": 0.5394685557426923, "agent_compute-ego0": 0.01265111212003029, "complete-iteration": 0.21629902063790013, "set_robot_commands": 0.0020483227099402476, "deviation-center-line": 0.06395439398344449, "driven_lanedir_consec": 0.2124961949094799, "sim_compute_sim_state": 0.00884148630045228, "sim_compute_performance-ego0": 0.0018300080703476727}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4360562336261316, "get_ui_image": 0.03198987642923991, "step_physics": 0.1132960001627604, "survival_time": 5.1999999999999895, "driven_lanedir": 0.6512741600468508, "get_state_dump": 0.004542845771426246, "get_robot_state": 0.0036030315217517673, "sim_render-ego0": 0.00399975095476423, "get_duckie_state": 1.846040998186384e-06, "in-drivable-lane": 2.84999999999999, "deviation-heading": 0.38942885065101135, "agent_compute-ego0": 0.013321824300856818, "complete-iteration": 0.1831184432620094, "set_robot_commands": 0.0021056697482154485, "deviation-center-line": 0.06250780733140925, "driven_lanedir_consec": 0.6512741600468508, "sim_compute_sim_state": 0.008188933417910622, "sim_compute_performance-ego0": 0.0019826026189894903}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6456969467843576, "get_ui_image": 0.025065224746177936, "step_physics": 0.08667418463476773, "survival_time": 5.749999999999988, "driven_lanedir": 0.6696369957988728, "get_state_dump": 0.004259263647013697, "get_robot_state": 0.003384403113661141, "sim_render-ego0": 0.0035161663746011667, "get_duckie_state": 1.568218757366312e-06, "in-drivable-lane": 3.399999999999988, "deviation-heading": 0.39576989595335377, "agent_compute-ego0": 0.011295573464755354, "complete-iteration": 0.14286417385627484, "set_robot_commands": 0.002066854772896602, "deviation-center-line": 0.07461461652814759, "driven_lanedir_consec": 0.6696369957988728, "sim_compute_sim_state": 0.004739144752765524, "sim_compute_performance-ego0": 0.001788207169236808}}
set_robot_commands_max0.0021056697482154485
set_robot_commands_mean0.00206494893726132
set_robot_commands_median0.002057588741418425
set_robot_commands_min0.0020389485179929806
sim_compute_performance-ego0_max0.0019826026189894903
sim_compute_performance-ego0_mean0.001857467995288648
sim_compute_performance-ego0_median0.0018295310964641471
sim_compute_performance-ego0_min0.001788207169236808
sim_compute_sim_state_max0.00884148630045228
sim_compute_sim_state_mean0.007476975500204991
sim_compute_sim_state_median0.00816363547380108
sim_compute_sim_state_min0.004739144752765524
sim_render-ego0_max0.00399975095476423
sim_render-ego0_mean0.0036571200363202153
sim_render-ego0_median0.0035562814079577324
sim_render-ego0_min0.0035161663746011667
simulation-passed1
step_physics_max0.1471518338736841
step_physics_mean0.11281639162593247
step_physics_median0.10871977399763905
step_physics_min0.08667418463476773
survival_time_max6.5999999999999845
survival_time_mean5.11249999999999
survival_time_min2.8999999999999977
No reset possible
5671611425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-050:03:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5669711427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-050:02:22
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5663311097Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:09:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6884305688663147
survival_time_median6.124999999999986
deviation-center-line_median0.13143608314350158
in-drivable-lane_median3.599999999999987


other stats
agent_compute-ego0_max0.10807748454989809
agent_compute-ego0_mean0.07381525597103926
agent_compute-ego0_median0.08682231523341169
agent_compute-ego0_min0.0135389088674356
complete-iteration_max0.28842552340760524
complete-iteration_mean0.2512591917384622
complete-iteration_median0.26100918795123246
complete-iteration_min0.19459286764377856
deviation-center-line_max0.2912653696119943
deviation-center-line_mean0.16299004177806586
deviation-center-line_min0.09782263121326595
deviation-heading_max1.2926692480906172
deviation-heading_mean0.7664401243863481
deviation-heading_median0.692874376321682
deviation-heading_min0.38734249681141103
driven_any_max8.755843247468091
driven_any_mean3.4101167192632076
driven_any_median1.7766965597968931
driven_any_min1.3312305099909536
driven_lanedir_consec_max0.7431020823055867
driven_lanedir_consec_mean0.6243804031537795
driven_lanedir_consec_min0.37755839257690194
driven_lanedir_max0.7431020823055867
driven_lanedir_mean0.6243804031537795
driven_lanedir_median0.6884305688663147
driven_lanedir_min0.37755839257690194
get_duckie_state_max1.474302642199458e-06
get_duckie_state_mean1.366581489763707e-06
get_duckie_state_median1.34295207219297e-06
get_duckie_state_min1.3061191724694294e-06
get_robot_state_max0.0038056427782232113
get_robot_state_mean0.0037704050560853374
get_robot_state_median0.00378575231929532
get_robot_state_min0.0037044728075274983
get_state_dump_max0.004884237592870539
get_state_dump_mean0.004805547761598188
get_state_dump_median0.004850858797219557
get_state_dump_min0.004636235859083093
get_ui_image_max0.037602298113764546
get_ui_image_mean0.03135385478503772
get_ui_image_median0.02997845417631056
get_ui_image_min0.02785621267376524
in-drivable-lane_max23.75000000000024
in-drivable-lane_mean8.487500000000052
in-drivable-lane_min2.9999999999999933
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.6281974260903993, "get_ui_image": 0.028393388831097148, "step_physics": 0.12034270659736963, "survival_time": 5.699999999999988, "driven_lanedir": 0.7431020823055867, "get_state_dump": 0.004636235859083093, "get_robot_state": 0.003775725157364555, "sim_render-ego0": 0.0037803255993386978, "get_duckie_state": 1.3061191724694294e-06, "in-drivable-lane": 3.049999999999989, "deviation-heading": 0.9512895962369032, "agent_compute-ego0": 0.08358958078467328, "complete-iteration": 0.25741286277770997, "set_robot_commands": 0.002274320436560589, "deviation-center-line": 0.2912653696119943, "driven_lanedir_consec": 0.7431020823055867, "sim_compute_sim_state": 0.008562179233716882, "sim_compute_performance-ego0": 0.0019646043362824815}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3312305099909536, "get_ui_image": 0.037602298113764546, "step_physics": 0.133239568496237, "survival_time": 4.849999999999991, "driven_lanedir": 0.37755839257690194, "get_state_dump": 0.004859029030313297, "get_robot_state": 0.003795779481226084, "sim_render-ego0": 0.0040808161910699334, "get_duckie_state": 1.474302642199458e-06, "in-drivable-lane": 2.9999999999999933, "deviation-heading": 1.2926692480906172, "agent_compute-ego0": 0.09005504968215008, "complete-iteration": 0.28842552340760524, "set_robot_commands": 0.002426196117790378, "deviation-center-line": 0.1431055204176302, "driven_lanedir_consec": 0.37755839257690194, "sim_compute_sim_state": 0.010154376224595672, "sim_compute_performance-ego0": 0.0021155269778504663}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.755843247468091, "get_ui_image": 0.031563519521523975, "step_physics": 0.11981593789035128, "survival_time": 26.150000000000237, "driven_lanedir": 0.6853799955596598, "get_state_dump": 0.0048426885641258185, "get_robot_state": 0.0037044728075274983, "sim_render-ego0": 0.004030408295056292, "get_duckie_state": 1.322222119979276e-06, "in-drivable-lane": 23.75000000000024, "deviation-heading": 0.38734249681141103, "agent_compute-ego0": 0.0135389088674356, "complete-iteration": 0.19459286764377856, "set_robot_commands": 0.0022147252359463057, "deviation-center-line": 0.11976664586937294, "driven_lanedir_consec": 0.6853799955596598, "sim_compute_sim_state": 0.01273914238878789, "sim_compute_performance-ego0": 0.002051400319310545}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.9251956935033872, "get_ui_image": 0.02785621267376524, "step_physics": 0.1063318613803748, "survival_time": 6.549999999999985, "driven_lanedir": 0.6914811421729696, "get_state_dump": 0.004884237592870539, "get_robot_state": 0.0038056427782232113, "sim_render-ego0": 0.003996796680219246, "get_duckie_state": 1.3636820244066643e-06, "in-drivable-lane": 4.149999999999985, "deviation-heading": 0.4344591564064608, "agent_compute-ego0": 0.10807748454989809, "complete-iteration": 0.26460551312475494, "set_robot_commands": 0.0023678721803607364, "deviation-center-line": 0.09782263121326595, "driven_lanedir_consec": 0.6914811421729696, "sim_compute_sim_state": 0.005216311324726452, "sim_compute_performance-ego0": 0.001971952842943596}}
set_robot_commands_max0.002426196117790378
set_robot_commands_mean0.0023207784926645024
set_robot_commands_median0.0023210963084606628
set_robot_commands_min0.0022147252359463057
sim_compute_performance-ego0_max0.0021155269778504663
sim_compute_performance-ego0_mean0.002025871119096772
sim_compute_performance-ego0_median0.0020116765811270705
sim_compute_performance-ego0_min0.0019646043362824815
sim_compute_sim_state_max0.01273914238878789
sim_compute_sim_state_mean0.009168002292956725
sim_compute_sim_state_median0.00935827772915628
sim_compute_sim_state_min0.005216311324726452
sim_render-ego0_max0.0040808161910699334
sim_render-ego0_mean0.003972086691421042
sim_render-ego0_median0.0040136024876377685
sim_render-ego0_min0.0037803255993386978
simulation-passed1
step_physics_max0.133239568496237
step_physics_mean0.11993251859108316
step_physics_median0.12007932224386046
step_physics_min0.1063318613803748
survival_time_max26.150000000000237
survival_time_mean10.81250000000005
survival_time_min4.849999999999991
No reset possible
5650511113Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:13:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3126232228136825
survival_time_median21.675000000000175
deviation-center-line_median0.445561761522451
in-drivable-lane_median10.40000000000012


other stats
agent_compute-ego0_max0.012447191669094948
agent_compute-ego0_mean0.0123151438887592
agent_compute-ego0_median0.01229063947435317
agent_compute-ego0_min0.012232104937235514
complete-iteration_max0.2161628658540787
complete-iteration_mean0.1788995289199919
complete-iteration_median0.17047382703101394
complete-iteration_min0.15848759576386096
deviation-center-line_max1.5252602476136146
deviation-center-line_mean0.647955873421467
deviation-center-line_min0.17543972302735109
deviation-heading_max11.601543808417254
deviation-heading_mean4.349081911010298
deviation-heading_median2.499936936997687
deviation-heading_min0.7949099616285642
driven_any_max6.429530273683535
driven_any_mean3.8440133214583665
driven_any_median3.698184109166198
driven_any_min1.5501547938175355
driven_lanedir_consec_max2.031886000883549
driven_lanedir_consec_mean1.3329622753326924
driven_lanedir_consec_min0.6747166548198549
driven_lanedir_max2.9419154479676344
driven_lanedir_mean1.8738197276751225
driven_lanedir_median1.9393234039565
driven_lanedir_min0.6747166548198549
get_duckie_state_max2.0524132961046217e-06
get_duckie_state_mean1.9774011511728955e-06
get_duckie_state_median1.9649872304246653e-06
get_duckie_state_min1.9272168477376303e-06
get_robot_state_max0.003630324905993892
get_robot_state_mean0.003563836284225148
get_robot_state_median0.0035712549636389224
get_robot_state_min0.003482510303628856
get_state_dump_max0.00487841913777013
get_state_dump_mean0.004686105364307727
get_state_dump_median0.0046532035800877095
get_state_dump_min0.004559595159285357
get_ui_image_max0.03443005838701802
get_ui_image_mean0.028821717670601956
get_ui_image_median0.02789944728946671
get_ui_image_min0.025057917716456393
in-drivable-lane_max17.399999999999853
in-drivable-lane_mean11.000000000000028
in-drivable-lane_min5.800000000000017
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.4625461775145805, "get_ui_image": 0.026159036640013476, "step_physics": 0.09791418412367808, "survival_time": 26.00000000000023, "driven_lanedir": 2.031886000883549, "get_state_dump": 0.004559595159285357, "get_robot_state": 0.003527736023154231, "sim_render-ego0": 0.00385810683647639, "get_duckie_state": 2.0524132961046217e-06, "in-drivable-lane": 14.700000000000207, "deviation-heading": 1.647458195724934, "agent_compute-ego0": 0.012274540774881723, "complete-iteration": 0.16238749370465122, "set_robot_commands": 0.002114040151438649, "deviation-center-line": 0.4094681491369721, "driven_lanedir_consec": 2.031886000883549, "sim_compute_sim_state": 0.009922707149483649, "sim_compute_performance-ego0": 0.0019664087130790023}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.429530273683535, "get_ui_image": 0.03443005838701802, "step_physics": 0.14110185377059445, "survival_time": 38.69999999999994, "driven_lanedir": 2.9419154479676344, "get_state_dump": 0.00487841913777013, "get_robot_state": 0.003614773904123614, "sim_render-ego0": 0.003831316424954322, "get_duckie_state": 1.9993320588142643e-06, "in-drivable-lane": 17.399999999999853, "deviation-heading": 11.601543808417254, "agent_compute-ego0": 0.012447191669094948, "complete-iteration": 0.2161628658540787, "set_robot_commands": 0.00214744383288968, "deviation-center-line": 1.5252602476136146, "driven_lanedir_consec": 1.6387514500371043, "sim_compute_sim_state": 0.0116329586890436, "sim_compute_performance-ego0": 0.0019876818503102947}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.933822040817816, "get_ui_image": 0.029639857938919944, "step_physics": 0.11272792158455684, "survival_time": 17.35000000000011, "driven_lanedir": 1.8467608070294512, "get_state_dump": 0.004587473540470518, "get_robot_state": 0.003482510303628856, "sim_render-ego0": 0.003720215682325692, "get_duckie_state": 1.9306424020350664e-06, "in-drivable-lane": 6.100000000000032, "deviation-heading": 3.3524156782704395, "agent_compute-ego0": 0.012306738173824616, "complete-iteration": 0.17856016035737662, "set_robot_commands": 0.002050046263069942, "deviation-center-line": 0.48165537390793, "driven_lanedir_consec": 0.9864949955902604, "sim_compute_sim_state": 0.008049901874586084, "sim_compute_performance-ego0": 0.0019044663714266371}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.5501547938175355, "get_ui_image": 0.025057917716456393, "step_physics": 0.09963746865590412, "survival_time": 10.15000000000001, "driven_lanedir": 0.6747166548198549, "get_state_dump": 0.004718933619704901, "get_robot_state": 0.003630324905993892, "sim_render-ego0": 0.00386128822962443, "get_duckie_state": 1.9272168477376303e-06, "in-drivable-lane": 5.800000000000017, "deviation-heading": 0.7949099616285642, "agent_compute-ego0": 0.012232104937235514, "complete-iteration": 0.15848759576386096, "set_robot_commands": 0.002102405417199228, "deviation-center-line": 0.17543972302735109, "driven_lanedir_consec": 0.6747166548198549, "sim_compute_sim_state": 0.005234787277146882, "sim_compute_performance-ego0": 0.0019257606244554707}}
set_robot_commands_max0.00214744383288968
set_robot_commands_mean0.002103483916149375
set_robot_commands_median0.0021082227843189387
set_robot_commands_min0.002050046263069942
sim_compute_performance-ego0_max0.0019876818503102947
sim_compute_performance-ego0_mean0.001946079389817851
sim_compute_performance-ego0_median0.0019460846687672363
sim_compute_performance-ego0_min0.0019044663714266371
sim_compute_sim_state_max0.0116329586890436
sim_compute_sim_state_mean0.008710088747565053
sim_compute_sim_state_median0.008986304512034866
sim_compute_sim_state_min0.005234787277146882
sim_render-ego0_max0.00386128822962443
sim_render-ego0_mean0.003817731793345208
sim_render-ego0_median0.003844711630715356
sim_render-ego0_min0.003720215682325692
simulation-passed1
step_physics_max0.14110185377059445
step_physics_mean0.11284535703368338
step_physics_median0.10618269512023049
step_physics_min0.09791418412367808
survival_time_max38.69999999999994
survival_time_mean23.050000000000075
survival_time_min10.15000000000001
No reset possible
5642811132Philippe Reddy 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:02:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5631211138Mo Kleit 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:06:29
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5626011135Bhavya Patwa 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:02:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5618011138Mo Kleit 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:04:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5614711282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:01:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5613111282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:49
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5612611282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5608011145Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:04:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5603911291Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5602311291Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5600611291Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:49
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5597711301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:01
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5594711153Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:02:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5593311283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5590211309Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5589511308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5583511450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-050:02:25
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5577511154Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:02:48
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5576311302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5571211296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:57
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5568411302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:47
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5566411287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5562811281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5557611303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:55
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5553911285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:13
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5550311289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5547111280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:49
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5539511274Andrea Censi 🇨🇭template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:03:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.011355155044131808
agent_compute-ego0_mean0.010961083622394969
agent_compute-ego0_median0.010887838664311398
agent_compute-ego0_min0.01071350211682527
complete-iteration_max0.1813184152478757
complete-iteration_mean0.16044323407145444
complete-iteration_median0.1596031288096338
complete-iteration_min0.14124826341867447
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.1951108522053006e-06
get_duckie_state_mean1.149952556535402e-06
get_duckie_state_median1.1510067227957903e-06
get_duckie_state_min1.1026859283447266e-06
get_robot_state_max0.003390217820803324
get_robot_state_mean0.003336560512803887
get_robot_state_median0.0033332666461127897
get_robot_state_min0.0032894909381866455
get_state_dump_max0.004296821852525075
get_state_dump_mean0.004197572755756556
get_state_dump_median0.004207250733393919
get_state_dump_min0.004078967703713311
get_ui_image_max0.03172251452570376
get_ui_image_mean0.027193987981375223
get_ui_image_median0.02647424477732802
get_ui_image_min0.024104947845141098
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02547940423217001, "step_physics": 0.08880186382728288, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004209544085249116, "get_robot_state": 0.003360647189466259, "sim_render-ego0": 0.0034925620767134653, "get_duckie_state": 1.1951108522053006e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.01092632812789724, "complete-iteration": 0.1486793590497367, "set_robot_commands": 0.0019535294061974635, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.008624325824689262, "sim_compute_performance-ego0": 0.00175700761094878}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03172251452570376, "step_physics": 0.11592295377150826, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.004204957381538723, "get_robot_state": 0.00330588610275932, "sim_render-ego0": 0.0035201311111450195, "get_duckie_state": 1.1273052381432576e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.01071350211682527, "complete-iteration": 0.1813184152478757, "set_robot_commands": 0.001955040123151696, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.00814183639443439, "sim_compute_performance-ego0": 0.001759674238122028}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.027469085322486028, "step_physics": 0.11032919420136346, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004078967703713311, "get_robot_state": 0.0032894909381866455, "sim_render-ego0": 0.003486974371804131, "get_duckie_state": 1.1026859283447266e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.011355155044131808, "complete-iteration": 0.1705268985695309, "set_robot_commands": 0.0019227001402113172, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.006817854113048977, "sim_compute_performance-ego0": 0.0017085042264726427}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.024104947845141098, "step_physics": 0.08641247202952702, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004296821852525075, "get_robot_state": 0.003390217820803324, "sim_render-ego0": 0.003575121363004049, "get_duckie_state": 1.1747082074483235e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.010849349200725555, "complete-iteration": 0.14124826341867447, "set_robot_commands": 0.0020770529905954995, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.004663939277331035, "sim_compute_performance-ego0": 0.001805412272612254}}
set_robot_commands_max0.0020770529905954995
set_robot_commands_mean0.001977080665038994
set_robot_commands_median0.00195428476467458
set_robot_commands_min0.0019227001402113172
sim_compute_performance-ego0_max0.001805412272612254
sim_compute_performance-ego0_mean0.0017576495870389262
sim_compute_performance-ego0_median0.001758340924535404
sim_compute_performance-ego0_min0.0017085042264726427
sim_compute_sim_state_max0.008624325824689262
sim_compute_sim_state_mean0.007061988902375916
sim_compute_sim_state_median0.007479845253741683
sim_compute_sim_state_min0.004663939277331035
sim_render-ego0_max0.003575121363004049
sim_render-ego0_mean0.003518697230666666
sim_render-ego0_median0.003506346593929242
sim_render-ego0_min0.003486974371804131
simulation-passed1
step_physics_max0.11592295377150826
step_physics_mean0.1003666209574204
step_physics_median0.09956552901432315
step_physics_min0.08641247202952702
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5534111299Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5526811310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:08
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5524711284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5522811311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5517411293Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:02:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5516411307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:33
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5513811290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5510011299Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:01:14
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5506211300Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:56
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5483711358Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:23:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.8107512046725125
survival_time_median45.54999999999955
deviation-center-line_median0.7554076047106516
in-drivable-lane_median30.049999999999734


other stats
agent_compute-ego0_max0.04500235566290888
agent_compute-ego0_mean0.028750059683775593
agent_compute-ego0_median0.028838287670579655
agent_compute-ego0_min0.012321307731034167
complete-iteration_max0.2372333094164416
complete-iteration_mean0.19935608272736785
complete-iteration_median0.19129378862815205
complete-iteration_min0.1776034442367257
deviation-center-line_max1.0675641614658975
deviation-center-line_mean0.7277784827329631
deviation-center-line_min0.33273456004465185
deviation-heading_max5.878099861190968
deviation-heading_mean3.45293643909658
deviation-heading_median3.2079271389894064
deviation-heading_min1.5177916172165389
driven_any_max13.513596698533265
driven_any_mean9.022473828372506
driven_any_median9.677740321795648
driven_any_min3.2208179713654683
driven_lanedir_consec_max3.869842675774638
driven_lanedir_consec_mean2.7520801841651013
driven_lanedir_consec_min1.5169756515407422
driven_lanedir_max3.869842675774638
driven_lanedir_mean2.7520801841651013
driven_lanedir_median2.8107512046725125
driven_lanedir_min1.5169756515407422
get_duckie_state_max1.828591744820993e-06
get_duckie_state_mean1.783158997164202e-06
get_duckie_state_median1.7902610462477304e-06
get_duckie_state_min1.7235221513403544e-06
get_robot_state_max0.003679818219250745
get_robot_state_mean0.0036445765298269263
get_robot_state_median0.00366241293120104
get_robot_state_min0.00357366203765488
get_state_dump_max0.004719066248793547
get_state_dump_mean0.004627923378611382
get_state_dump_median0.004618027379442377
get_state_dump_min0.004556572506767228
get_ui_image_max0.034988936003264005
get_ui_image_mean0.030108950951814553
get_ui_image_median0.030195731747531054
get_ui_image_min0.025055404308932112
in-drivable-lane_max49.99999999999915
in-drivable-lane_mean29.89999999999968
in-drivable-lane_min9.500000000000115
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.21475962048098, "get_ui_image": 0.02825848717633852, "step_physics": 0.10839556905546076, "survival_time": 51.34999999999922, "driven_lanedir": 3.2847320997069205, "get_state_dump": 0.004719066248793547, "get_robot_state": 0.003676433043721121, "sim_render-ego0": 0.003986986462708114, "get_duckie_state": 1.799271728278134e-06, "in-drivable-lane": 35.69999999999931, "deviation-heading": 5.878099861190968, "agent_compute-ego0": 0.015492089295665578, "complete-iteration": 0.1776034442367257, "set_robot_commands": 0.002241579938955344, "deviation-center-line": 1.0675641614658975, "driven_lanedir_consec": 3.2847320997069205, "sim_compute_sim_state": 0.008609726735126184, "sim_compute_performance-ego0": 0.002144340875083834}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.2208179713654683, "get_ui_image": 0.034988936003264005, "step_physics": 0.13328727301176604, "survival_time": 16.6000000000001, "driven_lanedir": 1.5169756515407422, "get_state_dump": 0.004619579773407441, "get_robot_state": 0.003679818219250745, "sim_render-ego0": 0.00379095993958436, "get_duckie_state": 1.828591744820993e-06, "in-drivable-lane": 9.500000000000115, "deviation-heading": 1.5177916172165389, "agent_compute-ego0": 0.042184486045493734, "complete-iteration": 0.2372333094164416, "set_robot_commands": 0.0021683783144564243, "deviation-center-line": 0.33273456004465185, "driven_lanedir_consec": 1.5169756515407422, "sim_compute_sim_state": 0.010470267888661976, "sim_compute_performance-ego0": 0.001959354669840128}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.140721023110316, "get_ui_image": 0.03213297631872359, "step_physics": 0.12483883952375632, "survival_time": 39.74999999999988, "driven_lanedir": 3.869842675774638, "get_state_dump": 0.004616474985477313, "get_robot_state": 0.00364839281868096, "sim_render-ego0": 0.003869245699302635, "get_duckie_state": 1.7812503642173268e-06, "in-drivable-lane": 24.40000000000016, "deviation-heading": 3.3666169263764165, "agent_compute-ego0": 0.012321307731034167, "complete-iteration": 0.19652463263602712, "set_robot_commands": 0.0021598000622274887, "deviation-center-line": 0.8823853288591403, "driven_lanedir_consec": 3.869842675774638, "sim_compute_sim_state": 0.010878139704316106, "sim_compute_performance-ego0": 0.0019772244458222507}, "LF-norm-small_loop-000-ego0": {"driven_any": 13.513596698533265, "get_ui_image": 0.025055404308932112, "step_physics": 0.0939786868925198, "survival_time": 59.99999999999873, "driven_lanedir": 2.336770309638105, "get_state_dump": 0.004556572506767228, "get_robot_state": 0.00357366203765488, "sim_render-ego0": 0.0037671810979152303, "get_duckie_state": 1.7235221513403544e-06, "in-drivable-lane": 49.99999999999915, "deviation-heading": 3.049237351602396, "agent_compute-ego0": 0.04500235566290888, "complete-iteration": 0.18606294462027695, "set_robot_commands": 0.0022358765312277405, "deviation-center-line": 0.6284298805621629, "driven_lanedir_consec": 2.336770309638105, "sim_compute_sim_state": 0.00580492920919223, "sim_compute_performance-ego0": 0.0020075038906735843}}
set_robot_commands_max0.002241579938955344
set_robot_commands_mean0.0022014087117167495
set_robot_commands_median0.0022021274228420824
set_robot_commands_min0.0021598000622274887
sim_compute_performance-ego0_max0.002144340875083834
sim_compute_performance-ego0_mean0.0020221059703549493
sim_compute_performance-ego0_median0.0019923641682479173
sim_compute_performance-ego0_min0.001959354669840128
sim_compute_sim_state_max0.010878139704316106
sim_compute_sim_state_mean0.008940765884324124
sim_compute_sim_state_median0.00953999731189408
sim_compute_sim_state_min0.00580492920919223
sim_render-ego0_max0.003986986462708114
sim_render-ego0_mean0.003853593299877584
sim_render-ego0_median0.0038301028194434976
sim_render-ego0_min0.0037671810979152303
simulation-passed1
step_physics_max0.13328727301176604
step_physics_mean0.11512509212087574
step_physics_median0.11661720428960856
step_physics_min0.0939786868925198
survival_time_max59.99999999999873
survival_time_mean41.92499999999948
survival_time_min16.6000000000001
No reset possible
5466311389Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:26:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.455652571845207
survival_time_median42.74999999999971
deviation-center-line_median0.7483907243323539
in-drivable-lane_median36.824999999999235


other stats
agent_compute-ego0_max0.0473117026789435
agent_compute-ego0_mean0.04391529052292016
agent_compute-ego0_median0.04358614044437937
agent_compute-ego0_min0.04117717852397841
complete-iteration_max0.24349947873003577
complete-iteration_mean0.21973989228057456
complete-iteration_median0.21658940811694172
complete-iteration_min0.20228127415837913
deviation-center-line_max1.534932108999386
deviation-center-line_mean0.7921230569879002
deviation-center-line_min0.136778670287507
deviation-heading_max5.739890927152421
deviation-heading_mean2.9177632997218432
deviation-heading_median2.7071488197624256
deviation-heading_min0.5168646322100988
driven_any_max12.070292701642332
driven_any_mean8.766417452662967
driven_any_median8.733435175631042
driven_any_min5.528506757747453
driven_lanedir_consec_max3.9240977501500582
driven_lanedir_consec_mean2.380693767124897
driven_lanedir_consec_min0.6873721746591153
driven_lanedir_max3.9240977501500582
driven_lanedir_mean2.4564801890801946
driven_lanedir_median2.607225415755802
driven_lanedir_min0.6873721746591153
get_duckie_state_max1.2504568107916255e-06
get_duckie_state_mean1.1746643870853824e-06
get_duckie_state_median1.1631557003533982e-06
get_duckie_state_min1.1218893368431077e-06
get_robot_state_max0.003648318502367759
get_robot_state_mean0.0035891045084515704
get_robot_state_median0.0036297619266648833
get_robot_state_min0.003448575678108755
get_state_dump_max0.00461483515542129
get_state_dump_mean0.004512140583728778
get_state_dump_median0.004539833684664749
get_state_dump_min0.004354059810164326
get_ui_image_max0.03459685073109293
get_ui_image_mean0.028898691272652065
get_ui_image_median0.027850225581191344
get_ui_image_min0.025297463197132636
in-drivable-lane_max43.449999999999505
in-drivable-lane_mean31.449999999999523
in-drivable-lane_min8.700000000000124
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.528506757747453, "get_ui_image": 0.026105838797516396, "step_physics": 0.11471270876678408, "survival_time": 26.100000000000236, "driven_lanedir": 3.9240977501500582, "get_state_dump": 0.004354059810164326, "get_robot_state": 0.003448575678108755, "sim_render-ego0": 0.003580991442299254, "get_duckie_state": 1.1218893368431077e-06, "in-drivable-lane": 8.700000000000124, "deviation-heading": 3.597863018165482, "agent_compute-ego0": 0.04251033990834457, "complete-iteration": 0.20858094705906244, "set_robot_commands": 0.00207266342571543, "deviation-center-line": 1.073759752752216, "driven_lanedir_consec": 3.9240977501500582, "sim_compute_sim_state": 0.009887383499291386, "sim_compute_performance-ego0": 0.0018307045814412045}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.070292701642332, "get_ui_image": 0.03459685073109293, "step_physics": 0.1337887045743563, "survival_time": 59.99999999999873, "driven_lanedir": 3.4528683350912934, "get_state_dump": 0.004608593415856659, "get_robot_state": 0.0036465893379357536, "sim_render-ego0": 0.00387665016466533, "get_duckie_state": 1.2504568107916255e-06, "in-drivable-lane": 42.09999999999861, "deviation-heading": 5.739890927152421, "agent_compute-ego0": 0.04466194098041417, "complete-iteration": 0.24349947873003577, "set_robot_commands": 0.0022442672373750227, "deviation-center-line": 1.534932108999386, "driven_lanedir_consec": 3.149722647270103, "sim_compute_sim_state": 0.013963959794755183, "sim_compute_performance-ego0": 0.002026805671228159}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.961416145605953, "get_ui_image": 0.029594612364866296, "step_physics": 0.12547994450647004, "survival_time": 39.14999999999991, "driven_lanedir": 1.7615824964203104, "get_state_dump": 0.004471073953472838, "get_robot_state": 0.003648318502367759, "sim_render-ego0": 0.003847422040238672, "get_duckie_state": 1.1784081556359115e-06, "in-drivable-lane": 31.549999999999855, "deviation-heading": 1.8164346213593696, "agent_compute-ego0": 0.04117717852397841, "complete-iteration": 0.22459786917482105, "set_robot_commands": 0.002261235701794527, "deviation-center-line": 0.4230216959124918, "driven_lanedir_consec": 1.7615824964203104, "sim_compute_sim_state": 0.011971652811887314, "sim_compute_performance-ego0": 0.002062621469400367}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.505454205656132, "get_ui_image": 0.025297463197132636, "step_physics": 0.10773558092528376, "survival_time": 46.349999999999504, "driven_lanedir": 0.6873721746591153, "get_state_dump": 0.00461483515542129, "get_robot_state": 0.0036129345153940134, "sim_render-ego0": 0.003774544031455599, "get_duckie_state": 1.1479032450708849e-06, "in-drivable-lane": 43.449999999999505, "deviation-heading": 0.5168646322100988, "agent_compute-ego0": 0.0473117026789435, "complete-iteration": 0.20228127415837913, "set_robot_commands": 0.0021969891827681967, "deviation-center-line": 0.136778670287507, "driven_lanedir_consec": 0.6873721746591153, "sim_compute_sim_state": 0.005774930119514465, "sim_compute_performance-ego0": 0.0018804548629399005}}
set_robot_commands_max0.002261235701794527
set_robot_commands_mean0.002193788886913294
set_robot_commands_median0.00222062821007161
set_robot_commands_min0.00207266342571543
sim_compute_performance-ego0_max0.002062621469400367
sim_compute_performance-ego0_mean0.0019501466462524075
sim_compute_performance-ego0_median0.00195363026708403
sim_compute_performance-ego0_min0.0018307045814412045
sim_compute_sim_state_max0.013963959794755183
sim_compute_sim_state_mean0.010399481556362089
sim_compute_sim_state_median0.01092951815558935
sim_compute_sim_state_min0.005774930119514465
sim_render-ego0_max0.00387665016466533
sim_render-ego0_mean0.003769901919664714
sim_render-ego0_median0.003810983035847136
sim_render-ego0_min0.003580991442299254
simulation-passed1
step_physics_max0.1337887045743563
step_physics_mean0.12042923469322352
step_physics_median0.12009632663662706
step_physics_min0.10773558092528376
survival_time_max59.99999999999873
survival_time_mean42.899999999999594
survival_time_min26.100000000000236
No reset possible
5462711435Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:02:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5460411424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:01:58
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5459911436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5458311439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:45
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5457511449Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:14
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5452511466Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:19:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6283417682797845
survival_time_median27.15000000000025
deviation-center-line_median0.4897349295844574
in-drivable-lane_median21.12500000000024


other stats
agent_compute-ego0_max0.012849558704638084
agent_compute-ego0_mean0.012731309882752876
agent_compute-ego0_median0.012727406941259276
agent_compute-ego0_min0.012620866943854872
complete-iteration_max0.2143304325875192
complete-iteration_mean0.19901228221565168
complete-iteration_median0.20378314968830177
complete-iteration_min0.17415239689848405
deviation-center-line_max0.535242626568972
deviation-center-line_mean0.4623282121413273
deviation-center-line_min0.3346003628274223
deviation-heading_max3.6480701058896017
deviation-heading_mean2.7423628050632707
deviation-heading_median2.8638434316142867
deviation-heading_min1.5936942511349084
driven_any_max12.84070045709854
driven_any_mean6.367773870015817
driven_any_median4.830645205357478
driven_any_min2.9691046122497715
driven_lanedir_consec_max2.095389323729317
driven_lanedir_consec_mean1.5259048675599969
driven_lanedir_consec_min0.7515466099511011
driven_lanedir_max2.095389323729317
driven_lanedir_mean1.530061525979891
driven_lanedir_median1.6312870931128387
driven_lanedir_min0.76228259396457
get_duckie_state_max1.5956352961779482e-06
get_duckie_state_mean1.4365396567651943e-06
get_duckie_state_median1.4079936385023423e-06
get_duckie_state_min1.334536053878145e-06
get_robot_state_max0.00389279136054224
get_robot_state_mean0.003820893079030638
get_robot_state_median0.003830478140382604
get_robot_state_min0.0037298246748151058
get_state_dump_max0.004859687582764103
get_state_dump_mean0.004789312563783436
get_state_dump_median0.004802275234781524
get_state_dump_min0.004693012202806594
get_ui_image_max0.03611227267306014
get_ui_image_mean0.031603825965693416
get_ui_image_median0.031484384945915836
get_ui_image_min0.02733426129788185
in-drivable-lane_max51.54999999999905
in-drivable-lane_mean24.862499999999905
in-drivable-lane_min5.65000000000008
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.9691046122497715, "get_ui_image": 0.030605979184801083, "step_physics": 0.13137773321711133, "survival_time": 14.100000000000064, "driven_lanedir": 2.095389323729317, "get_state_dump": 0.004859687582764103, "get_robot_state": 0.0038894991992640417, "sim_render-ego0": 0.004053697147975962, "get_duckie_state": 1.5956352961779482e-06, "in-drivable-lane": 5.65000000000008, "deviation-heading": 1.5936942511349084, "agent_compute-ego0": 0.012690067291259766, "complete-iteration": 0.20270422069428248, "set_robot_commands": 0.002428316817266781, "deviation-center-line": 0.4512518469436445, "driven_lanedir_consec": 2.095389323729317, "sim_compute_sim_state": 0.010512504476540502, "sim_compute_performance-ego0": 0.0021928451928991313}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.7198751124408425, "get_ui_image": 0.03611227267306014, "step_physics": 0.1368882532243605, "survival_time": 26.900000000000247, "driven_lanedir": 0.76228259396457, "get_state_dump": 0.004828311074421446, "get_robot_state": 0.0037298246748151058, "sim_render-ego0": 0.00389004372931146, "get_duckie_state": 1.3668152308419816e-06, "in-drivable-lane": 21.80000000000023, "deviation-heading": 2.7867973962043857, "agent_compute-ego0": 0.012849558704638084, "complete-iteration": 0.2143304325875192, "set_robot_commands": 0.0022544967000250027, "deviation-center-line": 0.3346003628274223, "driven_lanedir_consec": 0.7515466099511011, "sim_compute_sim_state": 0.011605880698379206, "sim_compute_performance-ego0": 0.00208067274712897}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.941415298274114, "get_ui_image": 0.03236279070703058, "step_physics": 0.13274828896930743, "survival_time": 27.400000000000254, "driven_lanedir": 1.500612832545341, "get_state_dump": 0.004693012202806594, "get_robot_state": 0.0037714570815011663, "sim_render-ego0": 0.003862687147380224, "get_duckie_state": 1.334536053878145e-06, "in-drivable-lane": 20.450000000000248, "deviation-heading": 2.940889467024187, "agent_compute-ego0": 0.012764746591258787, "complete-iteration": 0.204862078682321, "set_robot_commands": 0.00225269251616709, "deviation-center-line": 0.5282180122252704, "driven_lanedir_consec": 1.500612832545341, "sim_compute_sim_state": 0.010300691444799982, "sim_compute_performance-ego0": 0.0020169886083550794}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.84070045709854, "get_ui_image": 0.02733426129788185, "step_physics": 0.1104618754613211, "survival_time": 59.99999999999873, "driven_lanedir": 1.7619613536803362, "get_state_dump": 0.0047762393951416016, "get_robot_state": 0.00389279136054224, "sim_render-ego0": 0.003959064380413884, "get_duckie_state": 1.449172046162703e-06, "in-drivable-lane": 51.54999999999905, "deviation-heading": 3.6480701058896017, "agent_compute-ego0": 0.012620866943854872, "complete-iteration": 0.17415239689848405, "set_robot_commands": 0.002372220394315569, "deviation-center-line": 0.535242626568972, "driven_lanedir_consec": 1.756070704014228, "sim_compute_sim_state": 0.006523173615696229, "sim_compute_performance-ego0": 0.0021229105924785783}}
set_robot_commands_max0.002428316817266781
set_robot_commands_mean0.002326931606943611
set_robot_commands_median0.002313358547170286
set_robot_commands_min0.00225269251616709
sim_compute_performance-ego0_max0.0021928451928991313
sim_compute_performance-ego0_mean0.00210335428521544
sim_compute_performance-ego0_median0.002101791669803774
sim_compute_performance-ego0_min0.0020169886083550794
sim_compute_sim_state_max0.011605880698379206
sim_compute_sim_state_mean0.00973556255885398
sim_compute_sim_state_median0.01040659796067024
sim_compute_sim_state_min0.006523173615696229
sim_render-ego0_max0.004053697147975962
sim_render-ego0_mean0.0039413731012703825
sim_render-ego0_median0.003924554054862672
sim_render-ego0_min0.003862687147380224
simulation-passed1
step_physics_max0.1368882532243605
step_physics_mean0.1278690377180251
step_physics_median0.1320630110932094
step_physics_min0.1104618754613211
survival_time_max59.99999999999873
survival_time_mean32.099999999999824
survival_time_min14.100000000000064
No reset possible
5443311543Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:36:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.64457073050376
survival_time_median59.99999999999873
deviation-center-line_median3.9155251617843305
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012830561741901178
agent_compute-ego0_mean0.012718883134443295
agent_compute-ego0_median0.012740859878152534
agent_compute-ego0_min0.012563251039566944
complete-iteration_max0.221064263438305
complete-iteration_mean0.1942527053457414
complete-iteration_median0.19300880777547996
complete-iteration_min0.16992894239370074
deviation-center-line_max4.152582859268457
deviation-center-line_mean3.8586983409403097
deviation-center-line_min3.4511601809241186
deviation-heading_max13.538493184266892
deviation-heading_mean12.953370630110356
deviation-heading_median12.878025309139057
deviation-heading_min12.518938717896416
driven_any_max12.145415519981798
driven_any_mean11.23819715917347
driven_any_median11.032586431565328
driven_any_min10.742200253581434
driven_lanedir_consec_max11.75178378149511
driven_lanedir_consec_mean10.849551751077502
driven_lanedir_consec_min10.357281761807378
driven_lanedir_max11.75178378149511
driven_lanedir_mean10.849551751077502
driven_lanedir_median10.64457073050376
driven_lanedir_min10.357281761807378
get_duckie_state_max2.1255185066115152e-06
get_duckie_state_mean2.061893898283413e-06
get_duckie_state_median2.0953439653763463e-06
get_duckie_state_min1.9313691557694433e-06
get_robot_state_max0.0037646454438678826
get_robot_state_mean0.003747666457809079
get_robot_state_median0.003746313616000643
get_robot_state_min0.00373339315536715
get_state_dump_max0.004757941315116533
get_state_dump_mean0.004713409796642522
get_state_dump_median0.004707537026925448
get_state_dump_min0.004680623817602661
get_ui_image_max0.036071247304111195
get_ui_image_mean0.03071645197522928
get_ui_image_median0.030203536090803187
get_ui_image_min0.026387488415199552
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.145415519981798, "get_ui_image": 0.028295853056578116, "step_physics": 0.11388792602545415, "survival_time": 59.99999999999873, "driven_lanedir": 11.75178378149511, "get_state_dump": 0.004680623817602661, "get_robot_state": 0.0037646454438678826, "sim_render-ego0": 0.0038239187642398424, "get_duckie_state": 2.1056668347462726e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.853563847298998, "agent_compute-ego0": 0.012803151943006682, "complete-iteration": 0.18115816306909055, "set_robot_commands": 0.002339526080370545, "deviation-center-line": 3.4511601809241186, "driven_lanedir_consec": 11.75178378149511, "sim_compute_sim_state": 0.00939821938888715, "sim_compute_performance-ego0": 0.002074618422915596}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.825432486021109, "get_ui_image": 0.036071247304111195, "step_physics": 0.1420811558643249, "survival_time": 59.99999999999873, "driven_lanedir": 10.41627392911696, "get_state_dump": 0.0046970995141505005, "get_robot_state": 0.00373339315536715, "sim_render-ego0": 0.0038090905579401, "get_duckie_state": 2.1255185066115152e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.538493184266892, "agent_compute-ego0": 0.012563251039566944, "complete-iteration": 0.221064263438305, "set_robot_commands": 0.00225326858094888, "deviation-center-line": 4.152582859268457, "driven_lanedir_consec": 10.41627392911696, "sim_compute_sim_state": 0.01371132126457983, "sim_compute_performance-ego0": 0.0020544419776986384}, "LF-norm-techtrack-000-ego0": {"driven_any": 11.239740377109548, "get_ui_image": 0.032111219125028255, "step_physics": 0.13038378075497237, "survival_time": 59.99999999999873, "driven_lanedir": 10.87286753189056, "get_state_dump": 0.004757941315116533, "get_robot_state": 0.0037396905027162423, "sim_render-ego0": 0.003782110547741486, "get_duckie_state": 1.9313691557694433e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.518938717896416, "agent_compute-ego0": 0.012678567813298389, "complete-iteration": 0.20485945248186935, "set_robot_commands": 0.002290876977747426, "deviation-center-line": 3.803761566140649, "driven_lanedir_consec": 10.87286753189056, "sim_compute_sim_state": 0.013007349217563347, "sim_compute_performance-ego0": 0.002018936667017496}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.742200253581434, "get_ui_image": 0.026387488415199552, "step_physics": 0.10780417551903006, "survival_time": 59.99999999999873, "driven_lanedir": 10.357281761807378, "get_state_dump": 0.004717974539700396, "get_robot_state": 0.003752936729285044, "sim_render-ego0": 0.0037970646136408544, "get_duckie_state": 2.0850210960064203e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.902486770979117, "agent_compute-ego0": 0.012830561741901178, "complete-iteration": 0.16992894239370074, "set_robot_commands": 0.002279469214510064, "deviation-center-line": 4.027288757428011, "driven_lanedir_consec": 10.357281761807378, "sim_compute_sim_state": 0.006257897709728181, "sim_compute_performance-ego0": 0.0020112290568990968}}
set_robot_commands_max0.002339526080370545
set_robot_commands_mean0.0022907852133942285
set_robot_commands_median0.002285173096128745
set_robot_commands_min0.00225326858094888
sim_compute_performance-ego0_max0.002074618422915596
sim_compute_performance-ego0_mean0.0020398065311327067
sim_compute_performance-ego0_median0.0020366893223580673
sim_compute_performance-ego0_min0.0020112290568990968
sim_compute_sim_state_max0.01371132126457983
sim_compute_sim_state_mean0.010593696895189629
sim_compute_sim_state_median0.011202784303225247
sim_compute_sim_state_min0.006257897709728181
sim_render-ego0_max0.0038239187642398424
sim_render-ego0_mean0.0038030461208905706
sim_render-ego0_median0.003803077585790477
sim_render-ego0_min0.003782110547741486
simulation-passed1
step_physics_max0.1420811558643249
step_physics_mean0.12353925954094536
step_physics_median0.12213585339021328
step_physics_min0.10780417551903006
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5438011555Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:17:15
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2045 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5435411564Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:05:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47469644768734554
survival_time_median5.799999999999987
deviation-center-line_median0.1652944732306097
in-drivable-lane_median3.424999999999989


other stats
agent_compute-ego0_max0.012881281399967694
agent_compute-ego0_mean0.012299593680659774
agent_compute-ego0_median0.012527866309132584
agent_compute-ego0_min0.011261360704406236
complete-iteration_max0.20316455821798304
complete-iteration_mean0.17254504600100448
complete-iteration_median0.1731541462800928
complete-iteration_min0.14070733322584925
deviation-center-line_max0.207379547721231
deviation-center-line_mean0.1575691113149522
deviation-center-line_min0.09230795107735856
deviation-heading_max1.6028043324994483
deviation-heading_mean0.9725201313494434
deviation-heading_median0.9222809147569432
deviation-heading_min0.4427143633844387
driven_any_max2.742138185962727
driven_any_mean1.6170509091491772
driven_any_median1.3305380001207268
driven_any_min1.064989450392528
driven_lanedir_consec_max0.6308086958038511
driven_lanedir_consec_mean0.476292081256212
driven_lanedir_consec_min0.3249667338463058
driven_lanedir_max0.6308086958038511
driven_lanedir_mean0.476292081256212
driven_lanedir_median0.47469644768734554
driven_lanedir_min0.3249667338463058
get_duckie_state_max1.4353280115609216e-06
get_duckie_state_mean1.274842427749085e-06
get_duckie_state_median1.2428708071444264e-06
get_duckie_state_min1.178300085146565e-06
get_robot_state_max0.003895364626489505
get_robot_state_mean0.0036701155756508064
get_robot_state_median0.0036916421239248506
get_robot_state_min0.003401813428264019
get_state_dump_max0.005207107524679165
get_state_dump_mean0.00483996141841796
get_state_dump_median0.0049538604816543
get_state_dump_min0.004245017185684078
get_ui_image_max0.034469515386253896
get_ui_image_mean0.03019577475843204
get_ui_image_median0.030965326745430545
get_ui_image_min0.024382930156613185
in-drivable-lane_max8.850000000000005
in-drivable-lane_mean4.462499999999994
in-drivable-lane_min2.1499999999999924
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.742138185962727, "get_ui_image": 0.027732766002690028, "step_physics": 0.09598147103545862, "survival_time": 10.85000000000002, "driven_lanedir": 0.3249667338463058, "get_state_dump": 0.005000190997342451, "get_robot_state": 0.0037017743521874104, "sim_render-ego0": 0.003762797478142135, "get_duckie_state": 1.2894289209208355e-06, "in-drivable-lane": 8.850000000000005, "deviation-heading": 1.3647347330347204, "agent_compute-ego0": 0.012860544230959833, "complete-iteration": 0.16312974746074152, "set_robot_commands": 0.0022988319396972656, "deviation-center-line": 0.207379547721231, "driven_lanedir_consec": 0.3249667338463058, "sim_compute_sim_state": 0.00958677169379838, "sim_compute_performance-ego0": 0.0021179028607289725}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2746330422663896, "get_ui_image": 0.03419788748817106, "step_physics": 0.11071438493981824, "survival_time": 5.599999999999988, "driven_lanedir": 0.3485414367201807, "get_state_dump": 0.004907529965966149, "get_robot_state": 0.003681509895662291, "sim_render-ego0": 0.0035784476626235825, "get_duckie_state": 1.196312693368017e-06, "in-drivable-lane": 3.3999999999999906, "deviation-heading": 1.6028043324994483, "agent_compute-ego0": 0.012195188387305336, "complete-iteration": 0.1831785450994441, "set_robot_commands": 0.0021000140536147935, "deviation-center-line": 0.17269441294522414, "driven_lanedir_consec": 0.3485414367201807, "sim_compute_sim_state": 0.00982499333609522, "sim_compute_performance-ego0": 0.0018970924141132727}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.064989450392528, "get_ui_image": 0.034469515386253896, "step_physics": 0.1288475315980237, "survival_time": 4.899999999999991, "driven_lanedir": 0.6308086958038511, "get_state_dump": 0.005207107524679165, "get_robot_state": 0.003895364626489505, "sim_render-ego0": 0.0042624618067885894, "get_duckie_state": 1.4353280115609216e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 0.4798270964791663, "agent_compute-ego0": 0.012881281399967694, "complete-iteration": 0.20316455821798304, "set_robot_commands": 0.002334363532788826, "deviation-center-line": 0.09230795107735856, "driven_lanedir_consec": 0.6308086958038511, "sim_compute_sim_state": 0.008926923828895646, "sim_compute_performance-ego0": 0.002243942684597439}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3864429579750637, "get_ui_image": 0.024382930156613185, "step_physics": 0.08534794011391884, "survival_time": 5.999999999999987, "driven_lanedir": 0.6008514586545104, "get_state_dump": 0.004245017185684078, "get_robot_state": 0.003401813428264019, "sim_render-ego0": 0.0034312985160134053, "get_duckie_state": 1.178300085146565e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.4427143633844387, "agent_compute-ego0": 0.011261360704406236, "complete-iteration": 0.14070733322584925, "set_robot_commands": 0.001955597853857624, "deviation-center-line": 0.15789453351599525, "driven_lanedir_consec": 0.6008514586545104, "sim_compute_sim_state": 0.004843650770581459, "sim_compute_performance-ego0": 0.0017620453164597187}}
set_robot_commands_max0.002334363532788826
set_robot_commands_mean0.0021722018449896272
set_robot_commands_median0.0021994229966560298
set_robot_commands_min0.001955597853857624
sim_compute_performance-ego0_max0.002243942684597439
sim_compute_performance-ego0_mean0.0020052458189748507
sim_compute_performance-ego0_median0.0020074976374211224
sim_compute_performance-ego0_min0.0017620453164597187
sim_compute_sim_state_max0.00982499333609522
sim_compute_sim_state_mean0.008295584907342677
sim_compute_sim_state_median0.009256847761347014
sim_compute_sim_state_min0.004843650770581459
sim_render-ego0_max0.0042624618067885894
sim_render-ego0_mean0.003758751365891928
sim_render-ego0_median0.0036706225703828583
sim_render-ego0_min0.0034312985160134053
simulation-passed1
step_physics_max0.1288475315980237
step_physics_mean0.10522283192180486
step_physics_median0.10334792798763844
step_physics_min0.08534794011391884
survival_time_max10.85000000000002
survival_time_mean6.837499999999996
survival_time_min4.899999999999991
No reset possible
5422812728Raphael Jeansim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:37:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median12.567241595519958
survival_time_median59.99999999999873
deviation-center-line_median3.1921568490417624
in-drivable-lane_median0.2499999999999858


other stats
agent_compute-ego0_max0.012512441876528163
agent_compute-ego0_mean0.012090378657268743
agent_compute-ego0_median0.012139440376891582
agent_compute-ego0_min0.011570191998763643
complete-iteration_max0.2446154894975699
complete-iteration_mean0.20497162202117244
complete-iteration_median0.20053424068930545
complete-iteration_min0.1742025172085091
deviation-center-line_max3.731913183126803
deviation-center-line_mean3.2995060659720417
deviation-center-line_min3.08179738267784
deviation-heading_max13.758938754909476
deviation-heading_mean12.322412469485364
deviation-heading_median12.02906187016605
deviation-heading_min11.47258738269988
driven_any_max16.162063786366733
driven_any_mean14.17636261333023
driven_any_median13.82874321128172
driven_any_min12.885900244390752
driven_lanedir_consec_max15.71854266377385
driven_lanedir_consec_mean13.321569738106982
driven_lanedir_consec_min12.433253097614164
driven_lanedir_max15.71854266377385
driven_lanedir_mean13.321569738106982
driven_lanedir_median12.567241595519958
driven_lanedir_min12.433253097614164
get_duckie_state_max1.4311070247653322e-06
get_duckie_state_mean1.3663905744846416e-06
get_duckie_state_median1.3641076322201387e-06
get_duckie_state_min1.3062400087329568e-06
get_robot_state_max0.003759593391894897
get_robot_state_mean0.003672346534776648
get_robot_state_median0.0036917909992227544
get_robot_state_min0.003546210748766185
get_state_dump_max0.004730969444103384
get_state_dump_mean0.004652908650365698
get_state_dump_median0.004664587438553199
get_state_dump_min0.0045514902802530075
get_ui_image_max0.035863721698249605
get_ui_image_mean0.03043661705163198
get_ui_image_median0.030331737095866968
get_ui_image_min0.02521927231654438
in-drivable-lane_max6.249999999999763
in-drivable-lane_mean1.6874999999999336
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 16.162063786366733, "get_ui_image": 0.028340694211504043, "step_physics": 0.1155787860225579, "survival_time": 59.99999999999873, "driven_lanedir": 15.71854266377385, "get_state_dump": 0.004730969444103384, "get_robot_state": 0.0036757484661550143, "sim_render-ego0": 0.003759081020244055, "get_duckie_state": 1.4021235838420782e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.53880450524235, "agent_compute-ego0": 0.012023019155395914, "complete-iteration": 0.18203330020126351, "set_robot_commands": 0.0022138852461688623, "deviation-center-line": 3.133353302143299, "driven_lanedir_consec": 15.71854266377385, "sim_compute_sim_state": 0.00963034339987368, "sim_compute_performance-ego0": 0.001997499839153814}, "LF-norm-zigzag-000-ego0": {"driven_any": 13.215834177134097, "get_ui_image": 0.035863721698249605, "step_physics": 0.16556791719250835, "survival_time": 59.99999999999873, "driven_lanedir": 12.61047019950863, "get_state_dump": 0.004665497836224939, "get_robot_state": 0.003759593391894897, "sim_render-ego0": 0.0038450228780830633, "get_duckie_state": 1.4311070247653322e-06, "in-drivable-lane": 0.4999999999999716, "deviation-heading": 13.758938754909476, "agent_compute-ego0": 0.01225586159838725, "complete-iteration": 0.2446154894975699, "set_robot_commands": 0.002296544630064952, "deviation-center-line": 3.731913183126803, "driven_lanedir_consec": 12.61047019950863, "sim_compute_sim_state": 0.014167163691651712, "sim_compute_performance-ego0": 0.0021086670179152668}, "LF-norm-techtrack-000-ego0": {"driven_any": 14.441652245429342, "get_ui_image": 0.03232277998022989, "step_physics": 0.14497490350054662, "survival_time": 59.99999999999873, "driven_lanedir": 12.433253097614164, "get_state_dump": 0.004663677040881459, "get_robot_state": 0.0037078335322904945, "sim_render-ego0": 0.0038191106893140808, "get_duckie_state": 1.3260916805981994e-06, "in-drivable-lane": 6.249999999999763, "deviation-heading": 12.519319235089748, "agent_compute-ego0": 0.012512441876528163, "complete-iteration": 0.21903518117734733, "set_robot_commands": 0.002242798610690432, "deviation-center-line": 3.250960395940226, "driven_lanedir_consec": 12.433253097614164, "sim_compute_sim_state": 0.012684415321763011, "sim_compute_performance-ego0": 0.002024275178615497}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.885900244390752, "get_ui_image": 0.02521927231654438, "step_physics": 0.11572423009054549, "survival_time": 59.99999999999873, "driven_lanedir": 12.524012991531286, "get_state_dump": 0.0045514902802530075, "get_robot_state": 0.003546210748766185, "sim_render-ego0": 0.0035808022869913705, "get_duckie_state": 1.3062400087329568e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.47258738269988, "agent_compute-ego0": 0.011570191998763643, "complete-iteration": 0.1742025172085091, "set_robot_commands": 0.0020948589890326785, "deviation-center-line": 3.08179738267784, "driven_lanedir_consec": 12.524012991531286, "sim_compute_sim_state": 0.0059565894311909675, "sim_compute_performance-ego0": 0.0018805562209130127}}
set_robot_commands_max0.002296544630064952
set_robot_commands_mean0.0022120218689892315
set_robot_commands_median0.0022283419284296474
set_robot_commands_min0.0020948589890326785
sim_compute_performance-ego0_max0.0021086670179152668
sim_compute_performance-ego0_mean0.002002749564149397
sim_compute_performance-ego0_median0.002010887508884655
sim_compute_performance-ego0_min0.0018805562209130127
sim_compute_sim_state_max0.014167163691651712
sim_compute_sim_state_mean0.010609627961119843
sim_compute_sim_state_median0.011157379360818346
sim_compute_sim_state_min0.0059565894311909675
sim_render-ego0_max0.0038450228780830633
sim_render-ego0_mean0.0037510042186581424
sim_render-ego0_median0.003789095854779068
sim_render-ego0_min0.0035808022869913705
simulation-passed1
step_physics_max0.16556791719250835
step_physics_mean0.1354614592015396
step_physics_median0.13034956679554605
step_physics_min0.1155787860225579
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5410511458Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-050:46:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.724390041272839
survival_time_median59.99999999999873
deviation-center-line_median9.040440443034507
in-drivable-lane_median1.0249999999999977


other stats
agent_compute-ego0_max0.06771863608634243
agent_compute-ego0_mean0.06368033589173316
agent_compute-ego0_median0.0626997706495058
agent_compute-ego0_min0.06160316618157862
complete-iteration_max0.39161656976837994
complete-iteration_mean0.3135797614658206
complete-iteration_median0.3211519764821595
complete-iteration_min0.2203985231305836
deviation-center-line_max10.427592717870484
deviation-center-line_mean8.446372209688825
deviation-center-line_min5.277015234815799
deviation-heading_max18.827466858824813
deviation-heading_mean11.423604390409842
deviation-heading_median9.253417465251555
deviation-heading_min8.360115772311445
driven_any_max22.46543435213386
driven_any_mean8.488824500229782
driven_any_median5.101580845553132
driven_any_min1.2867019576790024
driven_lanedir_consec_max21.740796798462902
driven_lanedir_consec_mean8.1143374663006
driven_lanedir_consec_min1.2677729841938197
driven_lanedir_max21.740796798462902
driven_lanedir_mean8.1143374663006
driven_lanedir_median4.724390041272839
driven_lanedir_min1.2677729841938197
get_duckie_state_max2.109041618963364e-06
get_duckie_state_mean2.078767819368869e-06
get_duckie_state_median2.09683284076624e-06
get_duckie_state_min2.0123639769796328e-06
get_robot_state_max0.003796387473113531
get_robot_state_mean0.0037486270305814593
get_robot_state_median0.00375296531569253
get_robot_state_min0.003692190017827246
get_state_dump_max0.004689093930437404
get_state_dump_mean0.0046648960824215244
get_state_dump_median0.004680592352702755
get_state_dump_min0.0046093056938431845
get_ui_image_max0.03574325143050194
get_ui_image_mean0.03080976649585314
get_ui_image_median0.030572967565029883
get_ui_image_min0.02634987942285085
in-drivable-lane_max1.500000000000005
in-drivable-lane_mean0.8875000000000002
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.2867019576790024, "get_ui_image": 0.02832228377101622, "step_physics": 0.2035428790823804, "survival_time": 59.99999999999873, "driven_lanedir": 1.2677729841938197, "get_state_dump": 0.0046093056938431845, "get_robot_state": 0.0037397887684919753, "sim_render-ego0": 0.0037952644640361142, "get_duckie_state": 2.0123639769796328e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.462205844220204, "agent_compute-ego0": 0.0625791791873014, "complete-iteration": 0.31801911615312944, "set_robot_commands": 0.0022421210731296713, "deviation-center-line": 9.5806868266877, "driven_lanedir_consec": 1.2677729841938197, "sim_compute_sim_state": 0.007082631447035308, "sim_compute_performance-ego0": 0.0020110174380770134}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.577452539219929, "get_ui_image": 0.03574325143050194, "step_physics": 0.25914498332338864, "survival_time": 59.99999999999873, "driven_lanedir": 1.37346864838672, "get_state_dump": 0.004676716413029425, "get_robot_state": 0.003796387473113531, "sim_render-ego0": 0.003991550053287604, "get_duckie_state": 2.0991157830307428e-06, "in-drivable-lane": 0.6499999999999977, "deviation-heading": 18.827466858824813, "agent_compute-ego0": 0.06771863608634243, "complete-iteration": 0.39161656976837994, "set_robot_commands": 0.0023091327737114215, "deviation-center-line": 10.427592717870484, "driven_lanedir_consec": 1.37346864838672, "sim_compute_sim_state": 0.012034396347058603, "sim_compute_performance-ego0": 0.0021055509009825796}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.625709151886335, "get_ui_image": 0.03282365135904355, "step_physics": 0.19970601305775004, "survival_time": 59.99999999999873, "driven_lanedir": 8.075311434158959, "get_state_dump": 0.004689093930437404, "get_robot_state": 0.003766141862893085, "sim_render-ego0": 0.003853632945204456, "get_duckie_state": 2.109041618963364e-06, "in-drivable-lane": 1.500000000000005, "deviation-heading": 10.044629086282908, "agent_compute-ego0": 0.06282036211171019, "complete-iteration": 0.3242848368111895, "set_robot_commands": 0.002286730162011495, "deviation-center-line": 8.50019405938132, "driven_lanedir_consec": 8.075311434158959, "sim_compute_sim_state": 0.012187549811815045, "sim_compute_performance-ego0": 0.0020490071854920907}, "LF-norm-small_loop-000-ego0": {"driven_any": 22.46543435213386, "get_ui_image": 0.02634987942285085, "step_physics": 0.10971309699980444, "survival_time": 59.99999999999873, "driven_lanedir": 21.740796798462902, "get_state_dump": 0.004684468292376084, "get_robot_state": 0.003692190017827246, "sim_render-ego0": 0.003760955812135009, "get_duckie_state": 2.094549898501737e-06, "in-drivable-lane": 1.3999999999999977, "deviation-heading": 8.360115772311445, "agent_compute-ego0": 0.06160316618157862, "complete-iteration": 0.2203985231305836, "set_robot_commands": 0.002192841481408112, "deviation-center-line": 5.277015234815799, "driven_lanedir_consec": 21.740796798462902, "sim_compute_sim_state": 0.00633190692612571, "sim_compute_performance-ego0": 0.0019729131465152736}}
set_robot_commands_max0.0023091327737114215
set_robot_commands_mean0.002257706372565175
set_robot_commands_median0.0022644256175705832
set_robot_commands_min0.002192841481408112
sim_compute_performance-ego0_max0.0021055509009825796
sim_compute_performance-ego0_mean0.0020346221677667396
sim_compute_performance-ego0_median0.002030012311784552
sim_compute_performance-ego0_min0.0019729131465152736
sim_compute_sim_state_max0.012187549811815045
sim_compute_sim_state_mean0.009409121133008666
sim_compute_sim_state_median0.009558513897046955
sim_compute_sim_state_min0.00633190692612571
sim_render-ego0_max0.003991550053287604
sim_render-ego0_mean0.003850350818665795
sim_render-ego0_median0.003824448704620285
sim_render-ego0_min0.003760955812135009
simulation-passed1
step_physics_max0.25914498332338864
step_physics_mean0.19302674311583087
step_physics_median0.2016244460700652
step_physics_min0.10971309699980444
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5400911696Bhavya Patwa 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:30:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.8202441515454877
survival_time_median59.99999999999873
deviation-center-line_median1.4480729913745771
in-drivable-lane_median19.44999999999943


other stats
agent_compute-ego0_max0.013094432745051324
agent_compute-ego0_mean0.012626100215457473
agent_compute-ego0_median0.012632143534530536
agent_compute-ego0_min0.0121456810477175
complete-iteration_max0.2728772721392043
complete-iteration_mean0.2362909190504431
complete-iteration_median0.2383994926123893
complete-iteration_min0.1954874188377895
deviation-center-line_max3.4192241640646572
deviation-center-line_mean1.6188428319768922
deviation-center-line_min0.16000118109375724
deviation-heading_max13.745423630961865
deviation-heading_mean7.5248850957505535
deviation-heading_median7.2249532889261
deviation-heading_min1.9042101741881512
driven_any_max6.729154799046956
driven_any_mean5.1177019907952
driven_any_median6.419604636699908
driven_any_min0.9024438907340288
driven_lanedir_consec_max5.0454645320952425
driven_lanedir_consec_mean2.285895435744173
driven_lanedir_consec_min0.4576289077904745
driven_lanedir_max5.0454645320952425
driven_lanedir_mean2.285895435744173
driven_lanedir_median1.8202441515454877
driven_lanedir_min0.4576289077904745
get_duckie_state_max1.3442749672747672e-06
get_duckie_state_mean1.3244834839891165e-06
get_duckie_state_median1.3368115834054305e-06
get_duckie_state_min1.2800358018708369e-06
get_robot_state_max0.0038772830359643943
get_robot_state_mean0.003795760909736
get_robot_state_median0.003770743887496315
get_robot_state_min0.003764272827986972
get_state_dump_max0.004828467754202024
get_state_dump_mean0.00475668663824156
get_state_dump_median0.00477589337733317
get_state_dump_min0.004646492044097875
get_ui_image_max0.03687123034862762
get_ui_image_mean0.031574410506447215
get_ui_image_median0.0313927691544621
get_ui_image_min0.02664087336823704
in-drivable-lane_max53.79999999999872
in-drivable-lane_mean24.224999999999397
in-drivable-lane_min4.200000000000008
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.729154799046956, "get_ui_image": 0.028732000441475773, "step_physics": 0.12787326785745867, "survival_time": 59.99999999999873, "driven_lanedir": 5.0454645320952425, "get_state_dump": 0.004646492044097875, "get_robot_state": 0.003764272827986972, "sim_render-ego0": 0.003799834318899493, "get_duckie_state": 1.3346278995002536e-06, "in-drivable-lane": 12.149999999999489, "deviation-heading": 12.030593524457483, "agent_compute-ego0": 0.0121456810477175, "complete-iteration": 0.1954874188377895, "set_robot_commands": 0.0022680014992236693, "deviation-center-line": 3.4192241640646572, "driven_lanedir_consec": 5.0454645320952425, "sim_compute_sim_state": 0.010129164299500375, "sim_compute_performance-ego0": 0.002043666291693466}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.9024438907340288, "get_ui_image": 0.03687123034862762, "step_physics": 0.1950295313875726, "survival_time": 9.349999999999998, "driven_lanedir": 0.4576289077904745, "get_state_dump": 0.004805633362303389, "get_robot_state": 0.0037762142242269313, "sim_render-ego0": 0.0037559067949335624, "get_duckie_state": 1.3442749672747672e-06, "in-drivable-lane": 4.200000000000008, "deviation-heading": 1.9042101741881512, "agent_compute-ego0": 0.0128613088993316, "complete-iteration": 0.2728772721392043, "set_robot_commands": 0.0022001824480422, "deviation-center-line": 0.16000118109375724, "driven_lanedir_consec": 0.4576289077904745, "sim_compute_sim_state": 0.011436305147536258, "sim_compute_performance-ego0": 0.002054390755105526}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.53086593985545, "get_ui_image": 0.034053537867448413, "step_physics": 0.16801052724789026, "survival_time": 59.99999999999873, "driven_lanedir": 3.073582890941533, "get_state_dump": 0.004828467754202024, "get_robot_state": 0.0038772830359643943, "sim_render-ego0": 0.0040534461765464, "get_duckie_state": 1.2800358018708369e-06, "in-drivable-lane": 26.749999999999385, "deviation-heading": 13.745423630961865, "agent_compute-ego0": 0.012402978169729469, "complete-iteration": 0.24545066223652737, "set_robot_commands": 0.002351057519523627, "deviation-center-line": 2.567945671016543, "driven_lanedir_consec": 3.073582890941533, "sim_compute_sim_state": 0.013566432646371043, "sim_compute_performance-ego0": 0.0022206767016306806}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.308343333544366, "get_ui_image": 0.02664087336823704, "step_physics": 0.16862039959103142, "survival_time": 59.99999999999873, "driven_lanedir": 0.5669054121494419, "get_state_dump": 0.0047461533923629515, "get_robot_state": 0.003765273550765699, "sim_render-ego0": 0.0037997374427407903, "get_duckie_state": 1.338995267310607e-06, "in-drivable-lane": 53.79999999999872, "deviation-heading": 2.419313053394718, "agent_compute-ego0": 0.013094432745051324, "complete-iteration": 0.23134832298825125, "set_robot_commands": 0.002238303398113267, "deviation-center-line": 0.328200311732611, "driven_lanedir_consec": 0.5669054121494419, "sim_compute_sim_state": 0.006338528054242924, "sim_compute_performance-ego0": 0.002018433824169149}}
set_robot_commands_max0.002351057519523627
set_robot_commands_mean0.0022643862162256907
set_robot_commands_median0.0022531524486684683
set_robot_commands_min0.0022001824480422
sim_compute_performance-ego0_max0.0022206767016306806
sim_compute_performance-ego0_mean0.0020842918931497055
sim_compute_performance-ego0_median0.002049028523399496
sim_compute_performance-ego0_min0.002018433824169149
sim_compute_sim_state_max0.013566432646371043
sim_compute_sim_state_mean0.01036760753691265
sim_compute_sim_state_median0.010782734723518317
sim_compute_sim_state_min0.006338528054242924
sim_render-ego0_max0.0040534461765464
sim_render-ego0_mean0.003852231183280062
sim_render-ego0_median0.0037997858808201416
sim_render-ego0_min0.0037559067949335624
simulation-passed1
step_physics_max0.1950295313875726
step_physics_mean0.16488343152098822
step_physics_median0.16831546341946085
step_physics_min0.12787326785745867
survival_time_max59.99999999999873
survival_time_mean47.33749999999905
survival_time_min9.349999999999998
No reset possible
5390011381Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:37:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.889910309868486
survival_time_median42.37499999999973
deviation-center-line_median1.9429518723902952
in-drivable-lane_median15.775000000000029


other stats
agent_compute-ego0_max0.17267567743519266
agent_compute-ego0_mean0.1438149103071639
agent_compute-ego0_median0.1388291254987311
agent_compute-ego0_min0.12492571279600068
complete-iteration_max0.44823410754691145
complete-iteration_mean0.3843909808120019
complete-iteration_median0.372781868518993
complete-iteration_min0.34376607866311054
deviation-center-line_max3.791642116573936
deviation-center-line_mean2.0961879729038473
deviation-center-line_min0.7072060302608635
deviation-heading_max10.861771989194777
deviation-heading_mean7.088482646487947
deviation-heading_median7.438914232530456
deviation-heading_min2.6143301316961045
driven_any_max23.208184101912817
driven_any_mean14.610464528795564
driven_any_median13.648293172745856
driven_any_min7.937087667777726
driven_lanedir_consec_max17.727708952992003
driven_lanedir_consec_mean8.698525863904727
driven_lanedir_consec_min3.286573882889934
driven_lanedir_max17.727708952992003
driven_lanedir_mean8.698525863904727
driven_lanedir_median6.889910309868486
driven_lanedir_min3.286573882889934
get_duckie_state_max1.519380924935809e-06
get_duckie_state_mean1.4247507631345411e-06
get_duckie_state_median1.4142917563467506e-06
get_duckie_state_min1.3510386149088542e-06
get_robot_state_max0.004275081630699142
get_robot_state_mean0.0041228798827768805
get_robot_state_median0.00407646654012229
get_robot_state_min0.0040635048201638
get_state_dump_max0.005253693861569575
get_state_dump_mean0.005064534453127868
get_state_dump_median0.005020370645419775
get_state_dump_min0.004963702660102349
get_ui_image_max0.04205938593133703
get_ui_image_mean0.036548513232792165
get_ui_image_median0.03676899357283504
get_ui_image_min0.03059667985416153
in-drivable-lane_max25.19999999999959
in-drivable-lane_mean17.58749999999982
in-drivable-lane_min13.599999999999644
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 23.208184101912817, "get_ui_image": 0.03393731764413038, "step_physics": 0.1445125993542826, "survival_time": 59.99999999999873, "driven_lanedir": 17.727708952992003, "get_state_dump": 0.005026784169485329, "get_robot_state": 0.0040635048201638, "sim_render-ego0": 0.004084901746167033, "get_duckie_state": 1.3872348299431465e-06, "in-drivable-lane": 13.599999999999644, "deviation-heading": 10.861771989194777, "agent_compute-ego0": 0.13663998610967404, "complete-iteration": 0.34376607866311054, "set_robot_commands": 0.0025814433181216376, "deviation-center-line": 3.791642116573936, "driven_lanedir_consec": 17.727708952992003, "sim_compute_sim_state": 0.010477002911722532, "sim_compute_performance-ego0": 0.002341037983699802}, "LF-norm-zigzag-000-ego0": {"driven_any": 12.665215633400871, "get_ui_image": 0.04205938593133703, "step_physics": 0.19483722123232755, "survival_time": 38.44999999999995, "driven_lanedir": 6.96637888548171, "get_state_dump": 0.004963702660102349, "get_robot_state": 0.004080311663739093, "sim_render-ego0": 0.004144084918034541, "get_duckie_state": 1.4413486827503552e-06, "in-drivable-lane": 17.149999999999906, "deviation-heading": 6.710619663840967, "agent_compute-ego0": 0.12492571279600068, "complete-iteration": 0.3946699383970979, "set_robot_commands": 0.002633513103831898, "deviation-center-line": 1.808943869663848, "driven_lanedir_consec": 6.96637888548171, "sim_compute_sim_state": 0.014619083218760305, "sim_compute_performance-ego0": 0.002306110518319266}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.937087667777726, "get_ui_image": 0.039600669501539704, "step_physics": 0.20179328077541803, "survival_time": 24.90000000000022, "driven_lanedir": 3.286573882889934, "get_state_dump": 0.005253693861569575, "get_robot_state": 0.004275081630699142, "sim_render-ego0": 0.00433732703596891, "get_duckie_state": 1.519380924935809e-06, "in-drivable-lane": 14.400000000000146, "deviation-heading": 2.6143301316961045, "agent_compute-ego0": 0.17267567743519266, "complete-iteration": 0.44823410754691145, "set_robot_commands": 0.002701809506616994, "deviation-center-line": 0.7072060302608635, "driven_lanedir_consec": 3.286573882889934, "sim_compute_sim_state": 0.015024444622123889, "sim_compute_performance-ego0": 0.002463145819837918}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.63137071209084, "get_ui_image": 0.03059667985416153, "step_physics": 0.15462547212742678, "survival_time": 46.29999999999951, "driven_lanedir": 6.813441734255262, "get_state_dump": 0.0050139571213542195, "get_robot_state": 0.004072621416505487, "sim_render-ego0": 0.004061705600610957, "get_duckie_state": 1.3510386149088542e-06, "in-drivable-lane": 25.19999999999959, "deviation-heading": 8.167208801219944, "agent_compute-ego0": 0.14101826488778815, "complete-iteration": 0.350893798640888, "set_robot_commands": 0.0025190193419060403, "deviation-center-line": 2.076959875116742, "driven_lanedir_consec": 6.813441734255262, "sim_compute_sim_state": 0.006619129108893961, "sim_compute_performance-ego0": 0.002268507256862801}}
set_robot_commands_max0.002701809506616994
set_robot_commands_mean0.002608946317619143
set_robot_commands_median0.002607478210976768
set_robot_commands_min0.0025190193419060403
sim_compute_performance-ego0_max0.002463145819837918
sim_compute_performance-ego0_mean0.002344700394679946
sim_compute_performance-ego0_median0.002323574251009534
sim_compute_performance-ego0_min0.002268507256862801
sim_compute_sim_state_max0.015024444622123889
sim_compute_sim_state_mean0.01168491496537517
sim_compute_sim_state_median0.012548043065241418
sim_compute_sim_state_min0.006619129108893961
sim_render-ego0_max0.00433732703596891
sim_render-ego0_mean0.0041570048251953606
sim_render-ego0_median0.004114493332100786
sim_render-ego0_min0.004061705600610957
simulation-passed1
step_physics_max0.20179328077541803
step_physics_mean0.17394214337236374
step_physics_median0.17473134667987716
step_physics_min0.1445125993542826
survival_time_max59.99999999999873
survival_time_mean42.4124999999996
survival_time_min24.90000000000022
No reset possible
5386811740Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:35:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.989606520851506
survival_time_median59.99999999999873
deviation-center-line_median3.860938753803662
in-drivable-lane_median7.924999999999825


other stats
agent_compute-ego0_max0.013397012523171506
agent_compute-ego0_mean0.013000270106115965
agent_compute-ego0_median0.012980967923267715
agent_compute-ego0_min0.01264213205475692
complete-iteration_max0.23073222252630415
complete-iteration_mean0.20000592143256857
complete-iteration_median0.19618633565656549
complete-iteration_min0.17691879189083914
deviation-center-line_max4.161528049839962
deviation-center-line_mean3.8680612641866823
deviation-center-line_min3.5888394992994432
deviation-heading_max20.5110504705209
deviation-heading_mean17.655295898386825
deviation-heading_median17.403542922843236
deviation-heading_min15.303047277339926
driven_any_max10.375424969146316
driven_any_mean9.062766252486895
driven_any_median9.104594248793656
driven_any_min7.666451543213955
driven_lanedir_consec_max9.475944855027258
driven_lanedir_consec_mean6.430247004229403
driven_lanedir_consec_min4.265830120187342
driven_lanedir_max9.475944855027258
driven_lanedir_mean7.350593376107524
driven_lanedir_median7.276708991754702
driven_lanedir_min5.373010665893433
get_duckie_state_max1.345911333637853e-06
get_duckie_state_mean1.2897054871987455e-06
get_duckie_state_median1.2804328353081415e-06
get_duckie_state_min1.252044944540845e-06
get_robot_state_max0.003952841278317568
get_robot_state_mean0.003767225832194061
get_robot_state_median0.003730250374711712
get_robot_state_min0.0036555613010352496
get_state_dump_max0.004959555887163529
get_state_dump_mean0.004801317173910367
get_state_dump_median0.004809591008737003
get_state_dump_min0.004626530791003936
get_ui_image_max0.034874058881469015
get_ui_image_mean0.031728387955531685
get_ui_image_median0.03170893171369244
get_ui_image_min0.028621629513272833
in-drivable-lane_max17.149999999999327
in-drivable-lane_mean8.912499999999707
in-drivable-lane_min2.64999999999985
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.375424969146316, "get_ui_image": 0.028621629513272833, "step_physics": 0.11000151141894848, "survival_time": 59.99999999999873, "driven_lanedir": 9.475944855027258, "get_state_dump": 0.004626530791003936, "get_robot_state": 0.003673200305554392, "sim_render-ego0": 0.003768464508501318, "get_duckie_state": 1.252044944540845e-06, "in-drivable-lane": 2.64999999999985, "deviation-heading": 15.303047277339926, "agent_compute-ego0": 0.01264213205475692, "complete-iteration": 0.17691879189083914, "set_robot_commands": 0.0021772358836381262, "deviation-center-line": 4.104869005109379, "driven_lanedir_consec": 9.475944855027258, "sim_compute_sim_state": 0.00933636813040677, "sim_compute_performance-ego0": 0.0019895937123167624}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.624950978142971, "get_ui_image": 0.034874058881469015, "step_physics": 0.13045704235740743, "survival_time": 59.99999999999873, "driven_lanedir": 5.842794553607332, "get_state_dump": 0.004959555887163529, "get_robot_state": 0.0036555613010352496, "sim_render-ego0": 0.003765073247396579, "get_duckie_state": 1.2846016863998429e-06, "in-drivable-lane": 17.149999999999327, "deviation-heading": 18.966439051573055, "agent_compute-ego0": 0.013220643719268977, "complete-iteration": 0.21060298642548397, "set_robot_commands": 0.002177861012785163, "deviation-center-line": 3.5888394992994432, "driven_lanedir_consec": 5.519665250348812, "sim_compute_sim_state": 0.015349595374012866, "sim_compute_performance-ego0": 0.002059810266804437}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.666451543213955, "get_ui_image": 0.03340886726906772, "step_physics": 0.15466880820313905, "survival_time": 54.19999999999906, "driven_lanedir": 5.373010665893433, "get_state_dump": 0.004670311888242098, "get_robot_state": 0.0037873004438690326, "sim_render-ego0": 0.003890678520026844, "get_duckie_state": 1.345911333637853e-06, "in-drivable-lane": 11.099999999999792, "deviation-heading": 20.5110504705209, "agent_compute-ego0": 0.012741292127266456, "complete-iteration": 0.23073222252630415, "set_robot_commands": 0.0023132330810968775, "deviation-center-line": 3.617008502497946, "driven_lanedir_consec": 4.265830120187342, "sim_compute_sim_state": 0.013089659466721497, "sim_compute_performance-ego0": 0.002075742686399117}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.584237519444342, "get_ui_image": 0.030008996158317165, "step_physics": 0.11399491998575607, "survival_time": 59.99999999999873, "driven_lanedir": 8.710623429902071, "get_state_dump": 0.004948870129231907, "get_robot_state": 0.003952841278317568, "sim_render-ego0": 0.004031351067243666, "get_duckie_state": 1.2762639842164408e-06, "in-drivable-lane": 4.749999999999858, "deviation-heading": 15.840646794113418, "agent_compute-ego0": 0.013397012523171506, "complete-iteration": 0.18176968488764703, "set_robot_commands": 0.002447775261884526, "deviation-center-line": 4.161528049839962, "driven_lanedir_consec": 6.4595477913542005, "sim_compute_sim_state": 0.006733127478060377, "sim_compute_performance-ego0": 0.002168997241297332}}
set_robot_commands_max0.002447775261884526
set_robot_commands_mean0.002279026309851173
set_robot_commands_median0.00224554704694102
set_robot_commands_min0.0021772358836381262
sim_compute_performance-ego0_max0.002168997241297332
sim_compute_performance-ego0_mean0.002073535976704412
sim_compute_performance-ego0_median0.002067776476601777
sim_compute_performance-ego0_min0.0019895937123167624
sim_compute_sim_state_max0.015349595374012866
sim_compute_sim_state_mean0.011127187612300376
sim_compute_sim_state_median0.011213013798564132
sim_compute_sim_state_min0.006733127478060377
sim_render-ego0_max0.004031351067243666
sim_render-ego0_mean0.003863891835792102
sim_render-ego0_median0.0038295715142640818
sim_render-ego0_min0.003765073247396579
simulation-passed1
step_physics_max0.15466880820313905
step_physics_mean0.12728057049131275
step_physics_median0.12222598117158176
step_physics_min0.11000151141894848
survival_time_max59.99999999999873
survival_time_mean58.54999999999881
survival_time_min54.19999999999906
No reset possible
5384811749Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:13:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6223515861488093
survival_time_median10.45000000000002
deviation-center-line_median0.18676419605948447
in-drivable-lane_median4.6499999999999835


other stats
agent_compute-ego0_max0.012868275513520112
agent_compute-ego0_mean0.01256246858876903
agent_compute-ego0_median0.01252589716567763
agent_compute-ego0_min0.012329804510200748
complete-iteration_max0.19865310542723713
complete-iteration_mean0.1783681409692791
complete-iteration_median0.1753289069203164
complete-iteration_min0.16416164460924643
deviation-center-line_max4.660667107572782
deviation-center-line_mean1.281497568352201
deviation-center-line_min0.09179477371705326
deviation-heading_max5.824854208870358
deviation-heading_mean2.131242390302324
deviation-heading_median1.17211598664893
deviation-heading_min0.3558833790410807
driven_any_max14.231561834177606
driven_any_mean4.924935468110286
driven_any_median2.0388600626444826
driven_any_min1.3904599129745725
driven_lanedir_consec_max13.453571661453744
driven_lanedir_consec_mean3.797271119645762
driven_lanedir_consec_min0.4908096448316867
driven_lanedir_max13.453571661453744
driven_lanedir_mean3.797271119645762
driven_lanedir_median0.6223515861488093
driven_lanedir_min0.4908096448316867
get_duckie_state_max1.6706452952872075e-06
get_duckie_state_mean1.433804165812283e-06
get_duckie_state_median1.3744432442172757e-06
get_duckie_state_min1.3156848795273723e-06
get_robot_state_max0.0038515345470325367
get_robot_state_mean0.003781390639793405
get_robot_state_median0.0037830677044936385
get_robot_state_min0.003707892603153805
get_state_dump_max0.0048430686374362425
get_state_dump_mean0.004760505745605937
get_state_dump_median0.004755842700319951
get_state_dump_min0.004687268944347606
get_ui_image_max0.03645957305150874
get_ui_image_mean0.030702329821667665
get_ui_image_median0.030107953530082013
get_ui_image_min0.026133839174997897
in-drivable-lane_max10.500000000000064
in-drivable-lane_mean5.725000000000019
in-drivable-lane_min3.100000000000044
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.231561834177606, "get_ui_image": 0.02909519114561819, "step_physics": 0.09566768877313694, "survival_time": 59.99999999999873, "driven_lanedir": 13.453571661453744, "get_state_dump": 0.004784110781552889, "get_robot_state": 0.0038431109635657214, "sim_render-ego0": 0.0039075026404946965, "get_duckie_state": 1.3586484224571972e-06, "in-drivable-lane": 3.100000000000044, "deviation-heading": 5.824854208870358, "agent_compute-ego0": 0.012329804510200748, "complete-iteration": 0.16416164460924643, "set_robot_commands": 0.0023228492863867104, "deviation-center-line": 4.660667107572782, "driven_lanedir_consec": 13.453571661453744, "sim_compute_sim_state": 0.00997058160100551, "sim_compute_performance-ego0": 0.002148971073236394}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.601013881395489, "get_ui_image": 0.03645957305150874, "step_physics": 0.1223282665014267, "survival_time": 13.550000000000058, "driven_lanedir": 0.4908096448316867, "get_state_dump": 0.004687268944347606, "get_robot_state": 0.003723024445421556, "sim_render-ego0": 0.0038139311706318576, "get_duckie_state": 1.3156848795273723e-06, "in-drivable-lane": 10.500000000000064, "deviation-heading": 1.8309049108712825, "agent_compute-ego0": 0.012614363256622765, "complete-iteration": 0.19865310542723713, "set_robot_commands": 0.0022586838287465714, "deviation-center-line": 0.2594602323854797, "driven_lanedir_consec": 0.4908096448316867, "sim_compute_sim_state": 0.01066423864925609, "sim_compute_performance-ego0": 0.002013348481234382}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4767062438934762, "get_ui_image": 0.03112071591454583, "step_physics": 0.11664826322246244, "survival_time": 7.349999999999982, "driven_lanedir": 0.638497142376496, "get_state_dump": 0.0047275746190870134, "get_robot_state": 0.0038515345470325367, "sim_render-ego0": 0.0038825160748249777, "get_duckie_state": 1.3902380659773542e-06, "in-drivable-lane": 4.799999999999983, "deviation-heading": 0.5133270624265774, "agent_compute-ego0": 0.012868275513520112, "complete-iteration": 0.1862846612930298, "set_robot_commands": 0.00223624545174676, "deviation-center-line": 0.09179477371705326, "driven_lanedir_consec": 0.638497142376496, "sim_compute_sim_state": 0.00880124601157936, "sim_compute_performance-ego0": 0.002052988554980304}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3904599129745725, "get_ui_image": 0.026133839174997897, "step_physics": 0.10384510060866102, "survival_time": 6.8999999999999835, "driven_lanedir": 0.6062060299211225, "get_state_dump": 0.0048430686374362425, "get_robot_state": 0.003707892603153805, "sim_render-ego0": 0.0038488288577512015, "get_duckie_state": 1.6706452952872075e-06, "in-drivable-lane": 4.499999999999984, "deviation-heading": 0.3558833790410807, "agent_compute-ego0": 0.012437431074732498, "complete-iteration": 0.16437315254760304, "set_robot_commands": 0.0022274693139165427, "deviation-center-line": 0.1140681597334892, "driven_lanedir_consec": 0.6062060299211225, "sim_compute_sim_state": 0.005174489330044754, "sim_compute_performance-ego0": 0.002062322424470092}}
set_robot_commands_max0.0023228492863867104
set_robot_commands_mean0.002261311970199146
set_robot_commands_median0.002247464640246666
set_robot_commands_min0.0022274693139165427
sim_compute_performance-ego0_max0.002148971073236394
sim_compute_performance-ego0_mean0.002069407633480293
sim_compute_performance-ego0_median0.002057655489725198
sim_compute_performance-ego0_min0.002013348481234382
sim_compute_sim_state_max0.01066423864925609
sim_compute_sim_state_mean0.008652638897971429
sim_compute_sim_state_median0.009385913806292437
sim_compute_sim_state_min0.005174489330044754
sim_render-ego0_max0.0039075026404946965
sim_render-ego0_mean0.0038631946859256834
sim_render-ego0_median0.0038656724662880894
sim_render-ego0_min0.0038139311706318576
simulation-passed1
step_physics_max0.1223282665014267
step_physics_mean0.10962232977642178
step_physics_median0.11024668191556172
step_physics_min0.09566768877313694
survival_time_max59.99999999999873
survival_time_mean21.949999999999687
survival_time_min6.8999999999999835
No reset possible
5383411752Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:18:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2351481379485048
survival_time_median25.80000000000023
deviation-center-line_median0.5628345156930862
in-drivable-lane_median19.8250000000002


other stats
agent_compute-ego0_max0.013183946211494948
agent_compute-ego0_mean0.012890681395713598
agent_compute-ego0_median0.01286897151761258
agent_compute-ego0_min0.012640836336134276
complete-iteration_max0.2029172359011759
complete-iteration_mean0.18635012660726377
complete-iteration_median0.18627647273261644
complete-iteration_min0.16993032506264616
deviation-center-line_max1.7988678531600326
deviation-center-line_mean0.7640269682645451
deviation-center-line_min0.13157098851197505
deviation-heading_max2.654920305501262
deviation-heading_mean1.4955168292218246
deviation-heading_median1.4492290682901978
deviation-heading_min0.4286888748056415
driven_any_max14.53185115125254
driven_any_mean7.112299907380602
driven_any_median5.861834858143974
driven_any_min2.193678761981918
driven_lanedir_consec_max4.368085381879093
driven_lanedir_consec_mean1.8663997522820668
driven_lanedir_consec_min0.627217351352165
driven_lanedir_max4.368085381879093
driven_lanedir_mean1.8663997522820668
driven_lanedir_median1.2351481379485048
driven_lanedir_min0.627217351352165
get_duckie_state_max1.907928726678927e-06
get_duckie_state_mean1.7669484783430126e-06
get_duckie_state_median1.8221977833608576e-06
get_duckie_state_min1.5154696199714085e-06
get_robot_state_max0.004255084900194378
get_robot_state_mean0.004035753145849832
get_robot_state_median0.0039904835098999135
get_robot_state_min0.003906960663405123
get_state_dump_max0.005093352075969203
get_state_dump_mean0.004944083207350643
get_state_dump_median0.004923979561835627
get_state_dump_min0.004835021629762114
get_ui_image_max0.0374386821059995
get_ui_image_mean0.032006473141496294
get_ui_image_median0.03146428555898255
get_ui_image_min0.027658639342020577
in-drivable-lane_max42.8499999999991
in-drivable-lane_mean22.499999999999883
in-drivable-lane_min7.500000000000015
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.53185115125254, "get_ui_image": 0.02932588107182918, "step_physics": 0.10020973342939976, "survival_time": 59.99999999999873, "driven_lanedir": 4.368085381879093, "get_state_dump": 0.004860581803778427, "get_robot_state": 0.003942460839099233, "sim_render-ego0": 0.004015550526055964, "get_duckie_state": 1.7781142489697712e-06, "in-drivable-lane": 42.8499999999991, "deviation-heading": 2.1825706840949017, "agent_compute-ego0": 0.012640836336134276, "complete-iteration": 0.16993032506264616, "set_robot_commands": 0.002383194200005956, "deviation-center-line": 1.7988678531600326, "driven_lanedir_consec": 4.368085381879093, "sim_compute_sim_state": 0.01025997867790686, "sim_compute_performance-ego0": 0.0021970954961721147}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.502477667469712, "get_ui_image": 0.0374386821059995, "step_physics": 0.12333740747177978, "survival_time": 20.500000000000156, "driven_lanedir": 1.7784944221566328, "get_state_dump": 0.004987377319892828, "get_robot_state": 0.004038506180700594, "sim_render-ego0": 0.004106421830300287, "get_duckie_state": 1.907928726678927e-06, "in-drivable-lane": 11.950000000000095, "deviation-heading": 2.654920305501262, "agent_compute-ego0": 0.012701702233938695, "complete-iteration": 0.2029172359011759, "set_robot_commands": 0.002336876235739158, "deviation-center-line": 0.9828462156870512, "driven_lanedir_consec": 1.7784944221566328, "sim_compute_sim_state": 0.01166163917875638, "sim_compute_performance-ego0": 0.0022062739026517475}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.221192048818235, "get_ui_image": 0.03360269004613592, "step_physics": 0.11279111229971552, "survival_time": 31.100000000000307, "driven_lanedir": 0.6918018537403766, "get_state_dump": 0.004835021629762114, "get_robot_state": 0.003906960663405123, "sim_render-ego0": 0.004037562381015734, "get_duckie_state": 1.5154696199714085e-06, "in-drivable-lane": 27.700000000000312, "deviation-heading": 0.7158874524854939, "agent_compute-ego0": 0.013183946211494948, "complete-iteration": 0.19109600658018747, "set_robot_commands": 0.0023493108550388586, "deviation-center-line": 0.13157098851197505, "driven_lanedir_consec": 0.6918018537403766, "sim_compute_sim_state": 0.01413302704763642, "sim_compute_performance-ego0": 0.0021628522184074976}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.193678761981918, "get_ui_image": 0.027658639342020577, "step_physics": 0.11680941034161874, "survival_time": 10.400000000000013, "driven_lanedir": 0.627217351352165, "get_state_dump": 0.005093352075969203, "get_robot_state": 0.004255084900194378, "sim_render-ego0": 0.004128264468252374, "get_duckie_state": 1.866281317751944e-06, "in-drivable-lane": 7.500000000000015, "deviation-heading": 0.4286888748056415, "agent_compute-ego0": 0.013036240801286469, "complete-iteration": 0.18145693888504535, "set_robot_commands": 0.002446888736560584, "deviation-center-line": 0.1428228156991213, "driven_lanedir_consec": 0.627217351352165, "sim_compute_sim_state": 0.005667809664347525, "sim_compute_performance-ego0": 0.002255868683591414}}
set_robot_commands_max0.002446888736560584
set_robot_commands_mean0.0023790675068361394
set_robot_commands_median0.0023662525275224074
set_robot_commands_min0.002336876235739158
sim_compute_performance-ego0_max0.002255868683591414
sim_compute_performance-ego0_mean0.0022055225752056935
sim_compute_performance-ego0_median0.002201684699411931
sim_compute_performance-ego0_min0.0021628522184074976
sim_compute_sim_state_max0.01413302704763642
sim_compute_sim_state_mean0.010430613642161796
sim_compute_sim_state_median0.01096080892833162
sim_compute_sim_state_min0.005667809664347525
sim_render-ego0_max0.004128264468252374
sim_render-ego0_mean0.00407194980140609
sim_render-ego0_median0.00407199210565801
sim_render-ego0_min0.004015550526055964
simulation-passed1
step_physics_max0.12333740747177978
step_physics_mean0.11328691588562843
step_physics_median0.11480026132066712
step_physics_min0.10020973342939976
survival_time_max59.99999999999873
survival_time_mean30.4999999999998
survival_time_min10.400000000000013
No reset possible
5381611759Ayman Shams 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:11:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4813896869804931
survival_time_median12.025000000000036
deviation-center-line_median0.3334567582915222
in-drivable-lane_median7.375000000000044


other stats
agent_compute-ego0_max0.012819826928644232
agent_compute-ego0_mean0.01214440113312392
agent_compute-ego0_median0.012043934356574826
agent_compute-ego0_min0.011669908890701797
complete-iteration_max0.3472194705210941
complete-iteration_mean0.30888435460801333
complete-iteration_median0.3173300902015971
complete-iteration_min0.25365776750776503
deviation-center-line_max0.3802917791055106
deviation-center-line_mean0.3065027497415179
deviation-center-line_min0.17880570327751663
deviation-heading_max3.161354731862355
deviation-heading_mean1.9743526954486716
deviation-heading_median1.93732530413052
deviation-heading_min0.8614054416712923
driven_any_max3.0219426594608327
driven_any_mean1.7506289086494378
driven_any_median1.4585254889299129
driven_any_min1.0635219972770928
driven_lanedir_consec_max0.6434143025977583
driven_lanedir_consec_mean0.4686311707286781
driven_lanedir_consec_min0.2683310063559676
driven_lanedir_max0.6434143025977583
driven_lanedir_mean0.4686311707286781
driven_lanedir_median0.4813896869804931
driven_lanedir_min0.2683310063559676
get_duckie_state_max1.8513267808924607e-06
get_duckie_state_mean1.7017621753206467e-06
get_duckie_state_median1.7049594162061946e-06
get_duckie_state_min1.5458030879777362e-06
get_robot_state_max0.0040007705896929965
get_robot_state_mean0.0038257365098404144
get_robot_state_median0.003821863151779548
get_robot_state_min0.0036584491461095674
get_state_dump_max0.005043150948696449
get_state_dump_mean0.0048269473696531985
get_state_dump_median0.004827356721703445
get_state_dump_min0.004609925086509454
get_ui_image_max0.03532393101795179
get_ui_image_mean0.03143775287563007
get_ui_image_median0.03161088742763106
get_ui_image_min0.02720530562930637
in-drivable-lane_max20.200000000000177
in-drivable-lane_mean9.637500000000069
in-drivable-lane_min3.600000000000006
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0219426594608327, "get_ui_image": 0.02949931686529323, "step_physics": 0.2234855148027528, "survival_time": 23.800000000000203, "driven_lanedir": 0.2683310063559676, "get_state_dump": 0.0048516051574323165, "get_robot_state": 0.003819924980339514, "sim_render-ego0": 0.003871906728364637, "get_duckie_state": 1.6129491714061682e-06, "in-drivable-lane": 20.200000000000177, "deviation-heading": 2.8274313997987712, "agent_compute-ego0": 0.011993774578006511, "complete-iteration": 0.292570529993725, "set_robot_commands": 0.002291310508296174, "deviation-center-line": 0.3802917791055106, "driven_lanedir_consec": 0.2683310063559676, "sim_compute_sim_state": 0.01055866267446202, "sim_compute_performance-ego0": 0.002103639098833192}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2693221363997798, "get_ui_image": 0.03532393101795179, "step_physics": 0.27341275259922365, "survival_time": 10.600000000000016, "driven_lanedir": 0.35456522652489086, "get_state_dump": 0.004609925086509454, "get_robot_state": 0.0036584491461095674, "sim_render-ego0": 0.0037485019701747266, "get_duckie_state": 1.5458030879777362e-06, "in-drivable-lane": 6.350000000000023, "deviation-heading": 3.161354731862355, "agent_compute-ego0": 0.011669908890701797, "complete-iteration": 0.3472194705210941, "set_robot_commands": 0.002228596960434891, "deviation-center-line": 0.35733130213015035, "driven_lanedir_consec": 0.35456522652489086, "sim_compute_sim_state": 0.01041380116637324, "sim_compute_performance-ego0": 0.0020574605520902105}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0635219972770928, "get_ui_image": 0.03372245798996889, "step_physics": 0.2681635090562164, "survival_time": 9.099999999999994, "driven_lanedir": 0.6434143025977583, "get_state_dump": 0.005043150948696449, "get_robot_state": 0.0040007705896929965, "sim_render-ego0": 0.004107154783655385, "get_duckie_state": 1.8513267808924607e-06, "in-drivable-lane": 3.600000000000006, "deviation-heading": 1.0472192084622685, "agent_compute-ego0": 0.012819826928644232, "complete-iteration": 0.3420896504094692, "set_robot_commands": 0.0025935615998148266, "deviation-center-line": 0.17880570327751663, "driven_lanedir_consec": 0.6434143025977583, "sim_compute_sim_state": 0.00921535882793489, "sim_compute_performance-ego0": 0.0023164241040339235}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6477288414600455, "get_ui_image": 0.02720530562930637, "step_physics": 0.19178446310537833, "survival_time": 13.450000000000056, "driven_lanedir": 0.6082141474360954, "get_state_dump": 0.004803108285974573, "get_robot_state": 0.0038238013232195817, "sim_render-ego0": 0.003904759442364728, "get_duckie_state": 1.796969661006221e-06, "in-drivable-lane": 8.400000000000066, "deviation-heading": 0.8614054416712923, "agent_compute-ego0": 0.01209409413514314, "complete-iteration": 0.25365776750776503, "set_robot_commands": 0.002286041224444354, "deviation-center-line": 0.30958221445289413, "driven_lanedir_consec": 0.6082141474360954, "sim_compute_sim_state": 0.005581313592416269, "sim_compute_performance-ego0": 0.00207705056225812}}
set_robot_commands_max0.0025935615998148266
set_robot_commands_mean0.0023498775732475616
set_robot_commands_median0.002288675866370264
set_robot_commands_min0.002228596960434891
sim_compute_performance-ego0_max0.0023164241040339235
sim_compute_performance-ego0_mean0.002138643579303862
sim_compute_performance-ego0_median0.0020903448305456557
sim_compute_performance-ego0_min0.0020574605520902105
sim_compute_sim_state_max0.01055866267446202
sim_compute_sim_state_mean0.008942284065296605
sim_compute_sim_state_median0.009814579997154065
sim_compute_sim_state_min0.005581313592416269
sim_render-ego0_max0.004107154783655385
sim_render-ego0_mean0.0039080807311398695
sim_render-ego0_median0.0038883330853646822
sim_render-ego0_min0.0037485019701747266
simulation-passed1
step_physics_max0.27341275259922365
step_physics_mean0.2392115598908928
step_physics_median0.2458245119294846
step_physics_min0.19178446310537833
survival_time_max23.800000000000203
survival_time_mean14.237500000000068
survival_time_min9.099999999999994
No reset possible
5377711775Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:26:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.709197270682787
survival_time_median46.92499999999947
deviation-center-line_median1.5806176397853753
in-drivable-lane_median14.57499999999986


other stats
agent_compute-ego0_max0.01348540784913634
agent_compute-ego0_mean0.012957727300800775
agent_compute-ego0_median0.012940219805006304
agent_compute-ego0_min0.012465061744054158
complete-iteration_max0.23255851562905577
complete-iteration_mean0.19780037029559464
complete-iteration_median0.1925766249488391
complete-iteration_min0.17348971565564472
deviation-center-line_max3.129740250798717
deviation-center-line_mean1.6108224052742903
deviation-center-line_min0.15231409072769392
deviation-heading_max11.90748317076164
deviation-heading_mean6.000260549927818
deviation-heading_median5.617932233256624
deviation-heading_min0.857694562436385
driven_any_max12.681077611401372
driven_any_mean8.058970802663016
driven_any_median8.530362853389999
driven_any_min2.494079892470692
driven_lanedir_consec_max7.549807569125805
driven_lanedir_consec_mean4.418173413286542
driven_lanedir_consec_min0.7044915426547895
driven_lanedir_max8.868154552570894
driven_lanedir_mean4.7477601591478145
driven_lanedir_median4.709197270682787
driven_lanedir_min0.7044915426547895
get_duckie_state_max2.6575433126000144e-06
get_duckie_state_mean2.5069669207242485e-06
get_duckie_state_median2.4776714230737014e-06
get_duckie_state_min2.4149815241495768e-06
get_robot_state_max0.004120590883329647
get_robot_state_mean0.003949806462895415
get_robot_state_median0.003986525976087167
get_robot_state_min0.0037055830160776775
get_state_dump_max0.005100685789821349
get_state_dump_mean0.005032403288521893
get_state_dump_median0.005059714932400141
get_state_dump_min0.004909497499465942
get_ui_image_max0.03689126552287172
get_ui_image_mean0.03165709952573429
get_ui_image_median0.03126103592322596
get_ui_image_min0.027215060733613513
in-drivable-lane_max40.59999999999964
in-drivable-lane_mean18.31249999999985
in-drivable-lane_min3.5000000000000497
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.494079892470692, "get_ui_image": 0.027741626898447672, "step_physics": 0.10694147149721782, "survival_time": 11.950000000000037, "driven_lanedir": 1.9798634116992249, "get_state_dump": 0.004909497499465942, "get_robot_state": 0.0037055830160776775, "sim_render-ego0": 0.0038844833771387735, "get_duckie_state": 2.4149815241495768e-06, "in-drivable-lane": 3.5000000000000497, "deviation-heading": 1.967494489700616, "agent_compute-ego0": 0.012465061744054158, "complete-iteration": 0.17348971565564472, "set_robot_commands": 0.0022656371196111045, "deviation-center-line": 0.5216637434956013, "driven_lanedir_consec": 1.9798634116992249, "sim_compute_sim_state": 0.009391304850578309, "sim_compute_performance-ego0": 0.002087780833244324}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.947005385466966, "get_ui_image": 0.03689126552287172, "step_physics": 0.15175957474091586, "survival_time": 49.79999999999931, "driven_lanedir": 7.43853112966635, "get_state_dump": 0.005053053170053985, "get_robot_state": 0.003997692731820951, "sim_render-ego0": 0.003993127147555949, "get_duckie_state": 2.5279065192403384e-06, "in-drivable-lane": 8.349999999999657, "deviation-heading": 11.90748317076164, "agent_compute-ego0": 0.013103571196377218, "complete-iteration": 0.23255851562905577, "set_robot_commands": 0.0024058830773938025, "deviation-center-line": 3.129740250798717, "driven_lanedir_consec": 7.43853112966635, "sim_compute_sim_state": 0.013061024838966977, "sim_compute_performance-ego0": 0.0021882561766874108}, "LF-norm-techtrack-000-ego0": {"driven_any": 12.681077611401372, "get_ui_image": 0.034780444948004245, "step_physics": 0.1301851703364287, "survival_time": 59.99999999999873, "driven_lanedir": 8.868154552570894, "get_state_dump": 0.005100685789821349, "get_robot_state": 0.004120590883329647, "sim_render-ego0": 0.0041996446080648535, "get_duckie_state": 2.6575433126000144e-06, "in-drivable-lane": 20.80000000000006, "deviation-heading": 9.268369976812632, "agent_compute-ego0": 0.01348540784913634, "complete-iteration": 0.20957154219196203, "set_robot_commands": 0.002525943205021105, "deviation-center-line": 2.6395715360751493, "driven_lanedir_consec": 7.549807569125805, "sim_compute_sim_state": 0.012730984366208092, "sim_compute_performance-ego0": 0.002335806274096436}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.11372032131303, "get_ui_image": 0.027215060733613513, "step_physics": 0.11177093101466865, "survival_time": 44.049999999999635, "driven_lanedir": 0.7044915426547895, "get_state_dump": 0.005066376694746299, "get_robot_state": 0.0039753592203533835, "sim_render-ego0": 0.003897172253148086, "get_duckie_state": 2.427436326907065e-06, "in-drivable-lane": 40.59999999999964, "deviation-heading": 0.857694562436385, "agent_compute-ego0": 0.012776868413635392, "complete-iteration": 0.17558170770571616, "set_robot_commands": 0.002359149677683166, "deviation-center-line": 0.15231409072769392, "driven_lanedir_consec": 0.7044915426547895, "sim_compute_sim_state": 0.006323537588660139, "sim_compute_performance-ego0": 0.0020990525784135676}}
set_robot_commands_max0.002525943205021105
set_robot_commands_mean0.0023891532699272947
set_robot_commands_median0.0023825163775384843
set_robot_commands_min0.0022656371196111045
sim_compute_performance-ego0_max0.002335806274096436
sim_compute_performance-ego0_mean0.0021777239656104344
sim_compute_performance-ego0_median0.002143654377550489
sim_compute_performance-ego0_min0.002087780833244324
sim_compute_sim_state_max0.013061024838966977
sim_compute_sim_state_mean0.010376712911103378
sim_compute_sim_state_median0.0110611446083932
sim_compute_sim_state_min0.006323537588660139
sim_render-ego0_max0.0041996446080648535
sim_render-ego0_mean0.003993606846476916
sim_render-ego0_median0.003945149700352017
sim_render-ego0_min0.0038844833771387735
simulation-passed1
step_physics_max0.15175957474091586
step_physics_mean0.12516428689730777
step_physics_median0.12097805067554868
step_physics_min0.10694147149721782
survival_time_max59.99999999999873
survival_time_mean41.44999999999943
survival_time_min11.950000000000037
No reset possible
5376511774Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-050:10:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5372711779Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:16:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.624848654773162
survival_time_median23.900000000000205
deviation-center-line_median0.9845835057581952
in-drivable-lane_median9.625000000000089


other stats
agent_compute-ego0_max0.012103968367134172
agent_compute-ego0_mean0.011943097760336148
agent_compute-ego0_median0.011993850218788555
agent_compute-ego0_min0.0116807222366333
complete-iteration_max0.22258580525716143
complete-iteration_mean0.19178818996392083
complete-iteration_median0.18663730467867437
complete-iteration_min0.17129234524117304
deviation-center-line_max1.632525425908523
deviation-center-line_mean1.0041797612166414
deviation-center-line_min0.415026607441652
deviation-heading_max5.678589866570235
deviation-heading_mean4.014705909338042
deviation-heading_median3.741187741133389
deviation-heading_min2.897858288515157
driven_any_max8.186549569988731
driven_any_mean5.459102474216087
driven_any_median5.0071294141550275
driven_any_min3.6356014985655625
driven_lanedir_consec_max3.7963287412574
driven_lanedir_consec_mean2.5499860800919905
driven_lanedir_consec_min1.1539182695642374
driven_lanedir_max3.7963287412574
driven_lanedir_mean2.5500843940823756
driven_lanedir_median2.6250452827539323
driven_lanedir_min1.1539182695642374
get_duckie_state_max2.0856303828103203e-06
get_duckie_state_mean1.949265975055694e-06
get_duckie_state_median2.0196407955054783e-06
get_duckie_state_min1.672151926401499e-06
get_robot_state_max0.003725883272505298
get_robot_state_mean0.003638264025781519
get_robot_state_median0.003660011966647554
get_robot_state_min0.0035071488973256702
get_state_dump_max0.004661272174304293
get_state_dump_mean0.004566003716285454
get_state_dump_median0.004586133147989
get_state_dump_min0.00443047639485952
get_ui_image_max0.03556232966628729
get_ui_image_mean0.030370120810150943
get_ui_image_median0.029578692618484205
get_ui_image_min0.02676076833734807
in-drivable-lane_max30.19999999999995
in-drivable-lane_mean13.825000000000053
in-drivable-lane_min5.850000000000083
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.94781390262217, "get_ui_image": 0.02833383423941476, "step_physics": 0.11931308891092028, "survival_time": 22.350000000000183, "driven_lanedir": 3.7963287412574, "get_state_dump": 0.004545920661517552, "get_robot_state": 0.0036524837570531023, "sim_render-ego0": 0.0036599981997694287, "get_duckie_state": 2.0856303828103203e-06, "in-drivable-lane": 5.850000000000083, "deviation-heading": 4.339774797314768, "agent_compute-ego0": 0.0116807222366333, "complete-iteration": 0.18583244777151517, "set_robot_commands": 0.0021594390273094177, "deviation-center-line": 1.1941091544581866, "driven_lanedir_consec": 3.7963287412574, "sim_compute_sim_state": 0.0104180175278868, "sim_compute_performance-ego0": 0.001980131758110864}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.066444925687886, "get_ui_image": 0.03556232966628729, "step_physics": 0.14765386160682228, "survival_time": 25.450000000000227, "driven_lanedir": 3.749146453053896, "get_state_dump": 0.004626345634460449, "get_robot_state": 0.0036675401762420057, "sim_render-ego0": 0.003775318463643392, "get_duckie_state": 1.9826141058229934e-06, "in-drivable-lane": 6.750000000000096, "deviation-heading": 5.678589866570235, "agent_compute-ego0": 0.012070104187610104, "complete-iteration": 0.22258580525716143, "set_robot_commands": 0.0021777835546755325, "deviation-center-line": 1.632525425908523, "driven_lanedir_consec": 3.748753197092355, "sim_compute_sim_state": 0.010970876731124578, "sim_compute_performance-ego0": 0.001992528111326928}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.6356014985655625, "get_ui_image": 0.030823550997553645, "step_physics": 0.11905806902292612, "survival_time": 18.450000000000127, "driven_lanedir": 1.1539182695642374, "get_state_dump": 0.00443047639485952, "get_robot_state": 0.0035071488973256702, "sim_render-ego0": 0.0036341473862931536, "get_duckie_state": 1.672151926401499e-06, "in-drivable-lane": 12.500000000000082, "deviation-heading": 2.897858288515157, "agent_compute-ego0": 0.011917596249967008, "complete-iteration": 0.18744216158583357, "set_robot_commands": 0.002067346830625792, "deviation-center-line": 0.415026607441652, "driven_lanedir_consec": 1.1539182695642374, "sim_compute_sim_state": 0.010048274091772133, "sim_compute_performance-ego0": 0.0018727895375844595}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.186549569988731, "get_ui_image": 0.02676076833734807, "step_physics": 0.10979763840891651, "survival_time": 38.749999999999936, "driven_lanedir": 1.5009441124539684, "get_state_dump": 0.004661272174304293, "get_robot_state": 0.003725883272505298, "sim_render-ego0": 0.003767239064285436, "get_duckie_state": 2.0566674851879632e-06, "in-drivable-lane": 30.19999999999995, "deviation-heading": 3.1426006849520083, "agent_compute-ego0": 0.012103968367134172, "complete-iteration": 0.17129234524117304, "set_robot_commands": 0.0022362676477923837, "deviation-center-line": 0.7750578570582041, "driven_lanedir_consec": 1.5009441124539684, "sim_compute_sim_state": 0.006158223778931136, "sim_compute_performance-ego0": 0.0019911675109076745}}
set_robot_commands_max0.0022362676477923837
set_robot_commands_mean0.0021602092651007813
set_robot_commands_median0.002168611290992475
set_robot_commands_min0.002067346830625792
sim_compute_performance-ego0_max0.001992528111326928
sim_compute_performance-ego0_mean0.0019591542294824815
sim_compute_performance-ego0_median0.0019856496345092693
sim_compute_performance-ego0_min0.0018727895375844595
sim_compute_sim_state_max0.010970876731124578
sim_compute_sim_state_mean0.009398848032428662
sim_compute_sim_state_median0.010233145809829466
sim_compute_sim_state_min0.006158223778931136
sim_render-ego0_max0.003775318463643392
sim_render-ego0_mean0.003709175778497853
sim_render-ego0_median0.003713618632027432
sim_render-ego0_min0.0036341473862931536
simulation-passed1
step_physics_max0.14765386160682228
step_physics_mean0.12395566448739632
step_physics_median0.1191855789669232
step_physics_min0.10979763840891651
survival_time_max38.749999999999936
survival_time_mean26.25000000000012
survival_time_min18.450000000000127
No reset possible
5371612322Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-050:02:17
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5370612578Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-050:04:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.324087517573334
survival_time_median5.749999999999988
deviation-center-line_median0.1284500503584474
in-drivable-lane_median3.9499999999999895


other stats
agent_compute-ego0_max0.013338469323657808
agent_compute-ego0_mean0.012777919693252648
agent_compute-ego0_median0.012979669139503837
agent_compute-ego0_min0.011813871170345106
complete-iteration_max0.21391555739612111
complete-iteration_mean0.18999726923717591
complete-iteration_median0.20271930474805852
complete-iteration_min0.14063491005646556
deviation-center-line_max0.22527359023878377
deviation-center-line_mean0.13802201186892482
deviation-center-line_min0.06991435652002079
deviation-heading_max2.3653838274780417
deviation-heading_mean0.9134252203999522
deviation-heading_median0.4448576790028647
deviation-heading_min0.3986016961160378
driven_any_max1.8389364418925875
driven_any_mean1.388022649028059
driven_any_median1.4026006212246838
driven_any_min0.9079529117702806
driven_lanedir_consec_max0.5896059559673335
driven_lanedir_consec_mean0.3506678138767172
driven_lanedir_consec_min0.16489026439286736
driven_lanedir_max0.5896059559673335
driven_lanedir_mean0.35371235580662497
driven_lanedir_median0.33017660143314953
driven_lanedir_min0.16489026439286736
get_duckie_state_max1.475924537295387e-06
get_duckie_state_mean1.344907981309974e-06
get_duckie_state_median1.3738454939793211e-06
get_duckie_state_min1.1560163999858656e-06
get_robot_state_max0.004224152792067755
get_robot_state_mean0.0037336703067678513
get_robot_state_median0.0036891693057759262
get_robot_state_min0.003332189823451795
get_state_dump_max0.0052832989465622674
get_state_dump_mean0.004836735808756795
get_state_dump_median0.004823229283910208
get_state_dump_min0.0044171857206444995
get_ui_image_max0.03317454966103158
get_ui_image_mean0.029529918275883797
get_ui_image_median0.030689319495604828
get_ui_image_min0.023566484451293945
in-drivable-lane_max4.899999999999983
in-drivable-lane_mean3.874999999999989
in-drivable-lane_min2.699999999999992
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.9079529117702806, "get_ui_image": 0.028924533299037387, "step_physics": 0.14382471357073104, "survival_time": 4.149999999999993, "driven_lanedir": 0.16489026439286736, "get_state_dump": 0.0052832989465622674, "get_robot_state": 0.004224152792067755, "sim_render-ego0": 0.00413924739474342, "get_duckie_state": 1.475924537295387e-06, "in-drivable-lane": 3.1499999999999932, "deviation-heading": 0.3986016961160378, "agent_compute-ego0": 0.013338469323657808, "complete-iteration": 0.21265674772716703, "set_robot_commands": 0.0025975448744637625, "deviation-center-line": 0.10455426457099896, "driven_lanedir_consec": 0.16489026439286736, "sim_compute_sim_state": 0.008030059791746594, "sim_compute_performance-ego0": 0.0022003139768327984}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2864573089184093, "get_ui_image": 0.03245410569217227, "step_physics": 0.1220574357094021, "survival_time": 5.399999999999989, "driven_lanedir": 0.3616452319942034, "get_state_dump": 0.00455934848260442, "get_robot_state": 0.0035125596807637346, "sim_render-ego0": 0.003640824501667548, "get_duckie_state": 1.3714536614374284e-06, "in-drivable-lane": 2.699999999999992, "deviation-heading": 2.3653838274780417, "agent_compute-ego0": 0.013285293491608506, "complete-iteration": 0.19278186176895, "set_robot_commands": 0.002074913147392623, "deviation-center-line": 0.22527359023878377, "driven_lanedir_consec": 0.3494670642745723, "sim_compute_sim_state": 0.009190983728531305, "sim_compute_performance-ego0": 0.0019217543645736277}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.5187439335309585, "get_ui_image": 0.03317454966103158, "step_physics": 0.1424315072656647, "survival_time": 6.099999999999986, "driven_lanedir": 0.29870797087209566, "get_state_dump": 0.005087110085215995, "get_robot_state": 0.003865778930788118, "sim_render-ego0": 0.003897984822591146, "get_duckie_state": 1.3762373265212145e-06, "in-drivable-lane": 4.749999999999986, "deviation-heading": 0.430509061939736, "agent_compute-ego0": 0.012674044787399167, "complete-iteration": 0.21391555739612111, "set_robot_commands": 0.002303854236757852, "deviation-center-line": 0.06991435652002079, "driven_lanedir_consec": 0.29870797087209566, "sim_compute_sim_state": 0.008308057862568677, "sim_compute_performance-ego0": 0.0020792348598077043}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8389364418925875, "get_ui_image": 0.023566484451293945, "step_physics": 0.08565766246695268, "survival_time": 7.549999999999981, "driven_lanedir": 0.5896059559673335, "get_state_dump": 0.0044171857206444995, "get_robot_state": 0.003332189823451795, "sim_render-ego0": 0.003405538044477764, "get_duckie_state": 1.1560163999858656e-06, "in-drivable-lane": 4.899999999999983, "deviation-heading": 0.45920629606599345, "agent_compute-ego0": 0.011813871170345106, "complete-iteration": 0.14063491005646556, "set_robot_commands": 0.0019653941455640292, "deviation-center-line": 0.15234583614589584, "driven_lanedir_consec": 0.5896059559673335, "sim_compute_sim_state": 0.004636959025734349, "sim_compute_performance-ego0": 0.0017633077345396344}}
set_robot_commands_max0.0025975448744637625
set_robot_commands_mean0.002235426601044567
set_robot_commands_median0.002189383692075238
set_robot_commands_min0.0019653941455640292
sim_compute_performance-ego0_max0.0022003139768327984
sim_compute_performance-ego0_mean0.001991152733938441
sim_compute_performance-ego0_median0.002000494612190666
sim_compute_performance-ego0_min0.0017633077345396344
sim_compute_sim_state_max0.009190983728531305
sim_compute_sim_state_mean0.007541515102145231
sim_compute_sim_state_median0.008169058827157636
sim_compute_sim_state_min0.004636959025734349
sim_render-ego0_max0.00413924739474342
sim_render-ego0_mean0.0037708986908699697
sim_render-ego0_median0.003769404662129346
sim_render-ego0_min0.003405538044477764
simulation-passed1
step_physics_max0.14382471357073104
step_physics_mean0.12349282975318762
step_physics_median0.1322444714875334
step_physics_min0.08565766246695268
survival_time_max7.549999999999981
survival_time_mean5.7999999999999865
survival_time_min4.149999999999993
No reset possible
5369112717Bea Baselines 🐤template-randomaido5-LFP-sim-testingLFP-simsuccessyesnogpu-prod-050:04:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4012977349482021
survival_time_median4.499999999999992
deviation-center-line_median0.1385293223550657
in-drivable-lane_median2.7749999999999937


other stats
agent_compute-ego0_max0.012331831104615157
agent_compute-ego0_mean0.011466170941692637
agent_compute-ego0_median0.0113657932882192
agent_compute-ego0_min0.010801266085716986
complete-iteration_max0.26006864890074116
complete-iteration_mean0.2263180969737027
complete-iteration_median0.22454783105533535
complete-iteration_min0.19610807688339896
deviation-center-line_max0.18027339903737324
deviation-center-line_mean0.1285451587987956
deviation-center-line_min0.056848591447677815
deviation-heading_max1.7649200470050517
deviation-heading_mean0.7368137764399135
deviation-heading_median0.48008699517634235
deviation-heading_min0.22216106840191804
driven_any_max3.0249186308586435
driven_any_mean1.6335412217500125
driven_any_median1.5621944647828574
driven_any_min0.38485732657569066
driven_lanedir_consec_max0.7467792340807347
driven_lanedir_consec_mean0.4327941126790024
driven_lanedir_consec_min0.18180174673887084
driven_lanedir_max0.7467792340807347
driven_lanedir_mean0.4327941126790024
driven_lanedir_median0.4012977349482021
driven_lanedir_min0.18180174673887084
get_duckie_state_max0.025975624720255535
get_duckie_state_mean0.018378566548208183
get_duckie_state_median0.02153799235255261
get_duckie_state_min0.004462656767471977
get_robot_state_max0.0039920806884765625
get_robot_state_mean0.0038552387273997103
get_robot_state_median0.003894099722737851
get_robot_state_min0.003640674775646579
get_state_dump_max0.009587391828879332
get_state_dump_mean0.008053935261160695
get_state_dump_median0.008347350822680363
get_state_dump_min0.005933647570402726
get_ui_image_max0.03872532003066119
get_ui_image_mean0.033994956530418584
get_ui_image_median0.03419949785552802
get_ui_image_min0.028855510379957115
in-drivable-lane_max6.349999999999983
in-drivable-lane_mean2.9749999999999925
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.38485732657569066, "get_ui_image": 0.03339550434014736, "step_physics": 0.16128114553598258, "survival_time": 1.900000000000001, "driven_lanedir": 0.3799549493870889, "get_state_dump": 0.009587391828879332, "get_robot_state": 0.0039920806884765625, "sim_render-ego0": 0.0040174203041272285, "get_duckie_state": 0.025975624720255535, "in-drivable-lane": 0.0, "deviation-heading": 0.22216106840191804, "agent_compute-ego0": 0.011568937546167618, "complete-iteration": 0.26006864890074116, "set_robot_commands": 0.002282998500726162, "deviation-center-line": 0.13386765529050942, "driven_lanedir_consec": 0.3799549493870889, "sim_compute_sim_state": 0.005786229402591021, "sim_compute_performance-ego0": 0.0020735569489307893}, "LFP-norm-zigzag-000-ego0": {"driven_any": 2.5553912208152347, "get_ui_image": 0.03872532003066119, "step_physics": 0.12748276486116297, "survival_time": 6.749999999999984, "driven_lanedir": 0.7467792340807347, "get_state_dump": 0.008718532674452838, "get_robot_state": 0.003950059413909912, "sim_render-ego0": 0.004128317622577443, "get_duckie_state": 0.022096647935755113, "in-drivable-lane": 4.049999999999987, "deviation-heading": 1.7649200470050517, "agent_compute-ego0": 0.012331831104615157, "complete-iteration": 0.23600759576348695, "set_robot_commands": 0.002373427152633667, "deviation-center-line": 0.18027339903737324, "driven_lanedir_consec": 0.7467792340807347, "sim_compute_sim_state": 0.01393511365441715, "sim_compute_performance-ego0": 0.002155168968088487}, "LFP-norm-techtrack-000-ego0": {"driven_any": 3.0249186308586435, "get_ui_image": 0.035003491370908676, "step_physics": 0.11572364837892594, "survival_time": 7.699999999999981, "driven_lanedir": 0.4226405205093153, "get_state_dump": 0.007976168970907888, "get_robot_state": 0.003640674775646579, "sim_render-ego0": 0.0038939214521838774, "get_duckie_state": 0.020979336769350113, "in-drivable-lane": 6.349999999999983, "deviation-heading": 0.5966178261082585, "agent_compute-ego0": 0.010801266085716986, "complete-iteration": 0.21308806634718372, "set_robot_commands": 0.0021523106482721145, "deviation-center-line": 0.14319098941962197, "driven_lanedir_consec": 0.4226405205093153, "sim_compute_sim_state": 0.010770302434121408, "sim_compute_performance-ego0": 0.0020461128604027535}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.5689977087504798, "get_ui_image": 0.028855510379957115, "step_physics": 0.12752306461334229, "survival_time": 2.25, "driven_lanedir": 0.18180174673887084, "get_state_dump": 0.005933647570402726, "get_robot_state": 0.00383814003156579, "sim_render-ego0": 0.004156978234000828, "get_duckie_state": 0.004462656767471977, "in-drivable-lane": 1.5, "deviation-heading": 0.3635561642444261, "agent_compute-ego0": 0.011162649030270784, "complete-iteration": 0.19610807688339896, "set_robot_commands": 0.0023659726847773013, "deviation-center-line": 0.056848591447677815, "driven_lanedir_consec": 0.18180174673887084, "sim_compute_sim_state": 0.005658911622088888, "sim_compute_performance-ego0": 0.0020550022954526153}}
set_robot_commands_max0.002373427152633667
set_robot_commands_mean0.002293677246602311
set_robot_commands_median0.0023244855927517316
set_robot_commands_min0.0021523106482721145
sim_compute_performance-ego0_max0.002155168968088487
sim_compute_performance-ego0_mean0.002082460268218661
sim_compute_performance-ego0_median0.0020642796221917023
sim_compute_performance-ego0_min0.0020461128604027535
sim_compute_sim_state_max0.01393511365441715
sim_compute_sim_state_mean0.009037639278304616
sim_compute_sim_state_median0.008278265918356214
sim_compute_sim_state_min0.005658911622088888
sim_render-ego0_max0.004156978234000828
sim_render-ego0_mean0.0040491594032223445
sim_render-ego0_median0.004072868963352336
sim_render-ego0_min0.0038939214521838774
simulation-passed1
step_physics_max0.16128114553598258
step_physics_mean0.13300265584735343
step_physics_median0.12750291473725262
step_physics_min0.11572364837892594
survival_time_max7.699999999999981
survival_time_mean4.6499999999999915
survival_time_min1.900000000000001
No reset possible
5368212720Bea Baselines 🐤template-randomaido5-LFI-sim-validationLFVIv-simsuccessyesnogpu-prod-050:02:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19295142106760688
survival_time_median2.6749999999999985
deviation-center-line_median0.1430668550637951
in-drivable-lane_median1.1250000000000004


other stats
agent_compute-ego0_max0.011116882732936314
agent_compute-ego0_mean0.01103220182460743
agent_compute-ego0_median0.01103220182460743
agent_compute-ego0_min0.010947520916278543
complete-iteration_max0.2507884380144951
complete-iteration_mean0.2350400114234114
complete-iteration_median0.2350400114234114
complete-iteration_min0.21929158483232772
deviation-center-line_max0.22596774648423773
deviation-center-line_mean0.1430668550637951
deviation-center-line_min0.06016596364335245
deviation-heading_max1.9892082549741996
deviation-heading_mean1.1948036666590705
deviation-heading_median1.1948036666590705
deviation-heading_min0.4003990783439415
driven_any_max1.0672360153840748
driven_any_mean0.7318093849558207
driven_any_median0.7318093849558207
driven_any_min0.39638275452756666
driven_lanedir_consec_max0.26738221859900735
driven_lanedir_consec_mean0.19295142106760688
driven_lanedir_consec_min0.1185206235362064
driven_lanedir_max0.40392741637882246
driven_lanedir_mean0.26122401995751443
driven_lanedir_median0.26122401995751443
driven_lanedir_min0.1185206235362064
get_duckie_state_max1.93180182041266e-06
get_duckie_state_mean1.8821094498966204e-06
get_duckie_state_median1.8821094498966204e-06
get_duckie_state_min1.8324170793805804e-06
get_robot_state_max0.003675375665937151
get_robot_state_mean0.0036144289341601696
get_robot_state_median0.0036144289341601696
get_robot_state_min0.003553482202383188
get_state_dump_max0.004649441582815988
get_state_dump_mean0.004521656298375392
get_state_dump_median0.004521656298375392
get_state_dump_min0.004393871013934796
get_ui_image_max0.035629529219407305
get_ui_image_mean0.035248469258402734
get_ui_image_median0.035248469258402734
get_ui_image_min0.03486740929739816
in-drivable-lane_max1.250000000000001
in-drivable-lane_mean1.1250000000000004
in-drivable-lane_min0.9999999999999996
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.39638275452756666, "get_ui_image": 0.035629529219407305, "step_physics": 0.18091933543865496, "survival_time": 1.900000000000001, "driven_lanedir": 0.1185206235362064, "get_state_dump": 0.004393871013934796, "get_robot_state": 0.003553482202383188, "sim_render-ego0": 0.0035093075189834987, "get_duckie_state": 1.93180182041266e-06, "in-drivable-lane": 1.250000000000001, "deviation-heading": 0.4003990783439415, "agent_compute-ego0": 0.010947520916278543, "complete-iteration": 0.2507884380144951, "set_robot_commands": 0.0021384801620092145, "deviation-center-line": 0.06016596364335245, "driven_lanedir_consec": 0.1185206235362064, "sim_compute_sim_state": 0.007779848881256886, "sim_compute_performance-ego0": 0.0018357619261130309}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.0672360153840748, "get_ui_image": 0.03486740929739816, "step_physics": 0.14751310348510743, "survival_time": 3.4499999999999957, "driven_lanedir": 0.40392741637882246, "get_state_dump": 0.004649441582815988, "get_robot_state": 0.003675375665937151, "sim_render-ego0": 0.00370833192552839, "get_duckie_state": 1.8324170793805804e-06, "in-drivable-lane": 0.9999999999999996, "deviation-heading": 1.9892082549741996, "agent_compute-ego0": 0.011116882732936314, "complete-iteration": 0.21929158483232772, "set_robot_commands": 0.0020369904381888253, "deviation-center-line": 0.22596774648423773, "driven_lanedir_consec": 0.26738221859900735, "sim_compute_sim_state": 0.009635819707598005, "sim_compute_performance-ego0": 0.002003676550728934}}
set_robot_commands_max0.0021384801620092145
set_robot_commands_mean0.0020877353000990197
set_robot_commands_median0.0020877353000990197
set_robot_commands_min0.0020369904381888253
sim_compute_performance-ego0_max0.002003676550728934
sim_compute_performance-ego0_mean0.0019197192384209825
sim_compute_performance-ego0_median0.0019197192384209825
sim_compute_performance-ego0_min0.0018357619261130309
sim_compute_sim_state_max0.009635819707598005
sim_compute_sim_state_mean0.008707834294427445
sim_compute_sim_state_median0.008707834294427445
sim_compute_sim_state_min0.007779848881256886
sim_render-ego0_max0.00370833192552839
sim_render-ego0_mean0.003608819722255944
sim_render-ego0_median0.003608819722255944
sim_render-ego0_min0.0035093075189834987
simulation-passed1
step_physics_max0.18091933543865496
step_physics_mean0.1642162194618812
step_physics_median0.1642162194618812
step_physics_min0.14751310348510743
survival_time_max3.4499999999999957
survival_time_mean2.6749999999999985
survival_time_min1.900000000000001
No reset possible
5367212722Bea Baselines 🐤template-randomaido5-LFI-full-sim-validationLFVIv-simsuccessyesnogpu-prod-050:02:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6587966891077274
survival_time_median4.82499999999999
deviation-center-line_median0.18372681341530445
in-drivable-lane_median2.6749999999999927


other stats
agent_compute-ego0_max0.01144008586804072
agent_compute-ego0_mean0.011394393075295169
agent_compute-ego0_median0.011394393075295169
agent_compute-ego0_min0.011348700282549615
complete-iteration_max0.2096879988005667
complete-iteration_mean0.2092637945756768
complete-iteration_median0.2092637945756768
complete-iteration_min0.20883959035078684
deviation-center-line_max0.22270545771576217
deviation-center-line_mean0.18372681341530445
deviation-center-line_min0.14474816911484673
deviation-heading_max0.9254423888501632
deviation-heading_mean0.9131948861321344
deviation-heading_median0.9131948861321344
deviation-heading_min0.9009473834141052
driven_any_max1.7167609354270057
driven_any_mean1.6960945672591825
driven_any_median1.6960945672591825
driven_any_min1.6754281990913595
driven_lanedir_consec_max0.8731138199226813
driven_lanedir_consec_mean0.6587966891077274
driven_lanedir_consec_min0.4444795582927734
driven_lanedir_max0.8919331054681621
driven_lanedir_mean0.6682063318804677
driven_lanedir_median0.6682063318804677
driven_lanedir_min0.4444795582927734
get_duckie_state_max1.4503796895345051e-06
get_duckie_state_mean1.4235877027415266e-06
get_duckie_state_median1.4235877027415266e-06
get_duckie_state_min1.396795715948548e-06
get_robot_state_max0.003784097731113434
get_robot_state_mean0.003759933202856719
get_robot_state_median0.003759933202856719
get_robot_state_min0.003735768674600004
get_state_dump_max0.005141829450925191
get_state_dump_mean0.005004904712691452
get_state_dump_median0.005004904712691452
get_state_dump_min0.004867979974457712
get_ui_image_max0.03610643744468689
get_ui_image_mean0.035494562501859186
get_ui_image_median0.035494562501859186
get_ui_image_min0.034882687559031476
in-drivable-lane_max3.249999999999993
in-drivable-lane_mean2.6749999999999927
in-drivable-lane_min2.0999999999999925
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 1.6754281990913595, "get_ui_image": 0.03610643744468689, "step_physics": 0.13370227068662643, "survival_time": 4.749999999999991, "driven_lanedir": 0.8919331054681621, "get_state_dump": 0.005141829450925191, "get_robot_state": 0.003784097731113434, "sim_render-ego0": 0.003744455675284067, "get_duckie_state": 1.4503796895345051e-06, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 0.9009473834141052, "agent_compute-ego0": 0.01144008586804072, "complete-iteration": 0.20883959035078684, "set_robot_commands": 0.002278486887613932, "deviation-center-line": 0.22270545771576217, "driven_lanedir_consec": 0.8731138199226813, "sim_compute_sim_state": 0.010487178961435951, "sim_compute_performance-ego0": 0.002065670986970266}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7167609354270057, "get_ui_image": 0.034882687559031476, "step_physics": 0.13763139946292144, "survival_time": 4.899999999999991, "driven_lanedir": 0.4444795582927734, "get_state_dump": 0.004867979974457712, "get_robot_state": 0.003735768674600004, "sim_render-ego0": 0.0036287115077779752, "get_duckie_state": 1.396795715948548e-06, "in-drivable-lane": 3.249999999999993, "deviation-heading": 0.9254423888501632, "agent_compute-ego0": 0.011348700282549615, "complete-iteration": 0.2096879988005667, "set_robot_commands": 0.0021154808275627365, "deviation-center-line": 0.14474816911484673, "driven_lanedir_consec": 0.4444795582927734, "sim_compute_sim_state": 0.009468651781178485, "sim_compute_performance-ego0": 0.001925401013306897}}
set_robot_commands_max0.002278486887613932
set_robot_commands_mean0.002196983857588334
set_robot_commands_median0.002196983857588334
set_robot_commands_min0.0021154808275627365
sim_compute_performance-ego0_max0.002065670986970266
sim_compute_performance-ego0_mean0.0019955360001385814
sim_compute_performance-ego0_median0.0019955360001385814
sim_compute_performance-ego0_min0.001925401013306897
sim_compute_sim_state_max0.010487178961435951
sim_compute_sim_state_mean0.009977915371307218
sim_compute_sim_state_median0.009977915371307218
sim_compute_sim_state_min0.009468651781178485
sim_render-ego0_max0.003744455675284067
sim_render-ego0_mean0.0036865835915310214
sim_render-ego0_median0.0036865835915310214
sim_render-ego0_min0.0036287115077779752
simulation-passed1
step_physics_max0.13763139946292144
step_physics_mean0.13566683507477395
step_physics_median0.13566683507477395
step_physics_min0.13370227068662643
survival_time_max4.899999999999991
survival_time_mean4.82499999999999
survival_time_min4.749999999999991
No reset possible
5366012723Bea Baselines 🐤template-randomaido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-050:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.34594080188194565
survival_time_median3.649999999999995
deviation-center-line_median0.09488940232508568
in-drivable-lane_median2.449999999999993


other stats
agent_compute-ego0_max0.01365426778793335
agent_compute-ego0_mean0.012570982925687663
agent_compute-ego0_median0.012637530952095384
agent_compute-ego0_min0.01135460201062654
complete-iteration_max0.2547794461250305
complete-iteration_mean0.20571326883385993
complete-iteration_median0.20526632892798743
complete-iteration_min0.15754097135443437
deviation-center-line_max0.25831223976637174
deviation-center-line_mean0.13066585301948935
deviation-center-line_min0.07457236766141423
deviation-heading_max1.4169556658180873
deviation-heading_mean0.6148969366642039
deviation-heading_median0.388641682360125
deviation-heading_min0.26534871611847816
driven_any_max2.4199481648528267
driven_any_mean1.3020780256656512
driven_any_median1.2008709458648514
driven_any_min0.3866220460800752
driven_lanedir_consec_max0.918768019317286
driven_lanedir_consec_mean0.4760575018003668
driven_lanedir_consec_min0.29358038412028975
driven_lanedir_max0.918768019317286
driven_lanedir_mean0.4760575018003668
driven_lanedir_median0.34594080188194565
driven_lanedir_min0.29358038412028975
get_duckie_state_max2.0063148354584315e-06
get_duckie_state_mean1.6054937285685535e-06
get_duckie_state_median1.5001033098643064e-06
get_duckie_state_min1.415453459087171e-06
get_robot_state_max0.003912525356940503
get_robot_state_mean0.0038353143526084015
get_robot_state_median0.0038787399767009354
get_robot_state_min0.003671252100091232
get_state_dump_max0.0055306077003479
get_state_dump_mean0.00519323122939472
get_state_dump_median0.005209040198806176
get_state_dump_min0.004824236819618626
get_ui_image_max0.03745607019380759
get_ui_image_mean0.031969514508614065
get_ui_image_median0.03262229342505617
get_ui_image_min0.02517740099053634
in-drivable-lane_max3.6999999999999913
in-drivable-lane_mean2.3624999999999945
in-drivable-lane_min0.8500000000000008
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.7195926723959571, "get_ui_image": 0.030927671576445957, "step_physics": 0.13452213215378095, "survival_time": 2.5999999999999988, "driven_lanedir": 0.3934042908794564, "get_state_dump": 0.005300265438151809, "get_robot_state": 0.003912525356940503, "sim_render-ego0": 0.00411273848335698, "get_duckie_state": 2.0063148354584315e-06, "in-drivable-lane": 1.3499999999999983, "deviation-heading": 0.396385773337009, "agent_compute-ego0": 0.0126695767888483, "complete-iteration": 0.20303690658425383, "set_robot_commands": 0.0024154096279504164, "deviation-center-line": 0.08121507017171659, "driven_lanedir_consec": 0.3934042908794564, "sim_compute_sim_state": 0.006945403117053914, "sim_compute_performance-ego0": 0.002124984309358417}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.4199481648528267, "get_ui_image": 0.03745607019380759, "step_physics": 0.12775822268187545, "survival_time": 6.499999999999985, "driven_lanedir": 0.918768019317286, "get_state_dump": 0.005117814959460542, "get_robot_state": 0.0038974175926383215, "sim_render-ego0": 0.004107559000262777, "get_duckie_state": 1.516050964821386e-06, "in-drivable-lane": 3.5499999999999874, "deviation-heading": 1.4169556658180873, "agent_compute-ego0": 0.012605485115342468, "complete-iteration": 0.20749575127172107, "set_robot_commands": 0.0023600254350036156, "deviation-center-line": 0.25831223976637174, "driven_lanedir_consec": 0.918768019317286, "sim_compute_sim_state": 0.011876293721089837, "sim_compute_performance-ego0": 0.0022149759394521932}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.3866220460800752, "get_ui_image": 0.034316915273666385, "step_physics": 0.1788218915462494, "survival_time": 1.950000000000001, "driven_lanedir": 0.2984773128844349, "get_state_dump": 0.0055306077003479, "get_robot_state": 0.0038600623607635497, "sim_render-ego0": 0.0042376935482025145, "get_duckie_state": 1.4841556549072265e-06, "in-drivable-lane": 0.8500000000000008, "deviation-heading": 0.3808975913832409, "agent_compute-ego0": 0.01365426778793335, "complete-iteration": 0.2547794461250305, "set_robot_commands": 0.002382409572601318, "deviation-center-line": 0.07457236766141423, "driven_lanedir_consec": 0.2984773128844349, "sim_compute_sim_state": 0.009515362977981568, "sim_compute_performance-ego0": 0.0023544669151306153}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6821492193337455, "get_ui_image": 0.02517740099053634, "step_physics": 0.098311017688952, "survival_time": 4.699999999999991, "driven_lanedir": 0.29358038412028975, "get_state_dump": 0.004824236819618626, "get_robot_state": 0.003671252100091232, "sim_render-ego0": 0.003824336905228464, "get_duckie_state": 1.415453459087171e-06, "in-drivable-lane": 3.6999999999999913, "deviation-heading": 0.26534871611847816, "agent_compute-ego0": 0.01135460201062654, "complete-iteration": 0.15754097135443437, "set_robot_commands": 0.002206983064350329, "deviation-center-line": 0.1085637344784548, "driven_lanedir_consec": 0.29358038412028975, "sim_compute_sim_state": 0.006048528771651418, "sim_compute_performance-ego0": 0.0020272355330617805}}
set_robot_commands_max0.0024154096279504164
set_robot_commands_mean0.00234120692497642
set_robot_commands_median0.002371217503802467
set_robot_commands_min0.002206983064350329
sim_compute_performance-ego0_max0.0023544669151306153
sim_compute_performance-ego0_mean0.0021804156742507514
sim_compute_performance-ego0_median0.002169980124405305
sim_compute_performance-ego0_min0.0020272355330617805
sim_compute_sim_state_max0.011876293721089837
sim_compute_sim_state_mean0.008596397146944185
sim_compute_sim_state_median0.00823038304751774
sim_compute_sim_state_min0.006048528771651418
sim_render-ego0_max0.0042376935482025145
sim_render-ego0_mean0.004070581984262684
sim_render-ego0_median0.004110148741809878
sim_render-ego0_min0.003824336905228464
simulation-passed1
step_physics_max0.1788218915462494
step_physics_mean0.13485331601771444
step_physics_median0.1311401774178282
step_physics_min0.098311017688952
survival_time_max6.499999999999985
survival_time_mean3.937499999999994
survival_time_min1.950000000000001
No reset possible
5365112726Bea Baselines 🐤template-randomaido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-050:04:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8346371424253776
survival_time_median4.124999999999993
deviation-center-line_median0.2788935993045573
in-drivable-lane_median1.549999999999997


other stats
agent_compute-ego0_max0.011945973271908968
agent_compute-ego0_mean0.01121732248833314
agent_compute-ego0_median0.01121732248833314
agent_compute-ego0_min0.010488671704757311
agent_compute-npc0_max0.04749542215596075
agent_compute-npc0_mean0.04543272122349878
agent_compute-npc0_median0.04543272122349878
agent_compute-npc0_min0.04337002029103681
agent_compute-npc1_max0.048500346100848656
agent_compute-npc1_mean0.040698865892387665
agent_compute-npc1_median0.040698865892387665
agent_compute-npc1_min0.032897385683926667
agent_compute-npc2_max0.04710426019585651
agent_compute-npc2_mean0.039013700073158575
agent_compute-npc2_median0.039013700073158575
agent_compute-npc2_min0.03092313995046064
complete-iteration_max0.9385118622425174
complete-iteration_mean0.890034747282207
complete-iteration_median0.890034747282207
complete-iteration_min0.8415576323218967
deviation-center-line_max0.5131197357490916
deviation-center-line_mean0.2788935993045573
deviation-center-line_min0.044667462860022975
deviation-heading_max0.7729298921344514
deviation-heading_mean0.6302487746425269
deviation-heading_median0.6302487746425269
deviation-heading_min0.4875676571506023
driven_any_max2.2544111376152616
driven_any_mean1.3911351901097644
driven_any_median1.3911351901097644
driven_any_min0.5278592426042671
driven_lanedir_consec_max1.4955475701369614
driven_lanedir_consec_mean0.8346371424253776
driven_lanedir_consec_min0.17372671471379375
driven_lanedir_max1.7595402874633888
driven_lanedir_mean0.9666335010885913
driven_lanedir_median0.9666335010885913
driven_lanedir_min0.17372671471379375
get_duckie_state_max1.4699195042129391e-06
get_duckie_state_mean1.424300426465335e-06
get_duckie_state_median1.424300426465335e-06
get_duckie_state_min1.378681348717731e-06
get_robot_state_max0.014405685922373896
get_robot_state_mean0.014218282065629702
get_robot_state_median0.014218282065629702
get_robot_state_min0.014030878208885508
get_state_dump_max0.009729307630787724
get_state_dump_mean0.009683917912055896
get_state_dump_median0.009683917912055896
get_state_dump_min0.009638528193324064
get_ui_image_max0.054278095891653014
get_ui_image_mean0.05314604457744882
get_ui_image_median0.05314604457744882
get_ui_image_min0.05201399326324463
in-drivable-lane_max1.699999999999994
in-drivable-lane_mean1.549999999999997
in-drivable-lane_min1.4
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 2.2544111376152616, "get_ui_image": 0.054278095891653014, "step_physics": 0.6725004093706115, "survival_time": 5.999999999999987, "driven_lanedir": 1.7595402874633888, "get_state_dump": 0.009638528193324064, "get_robot_state": 0.014030878208885508, "sim_render-ego0": 0.003807357520111336, "sim_render-npc0": 0.0036331425028399, "sim_render-npc1": 0.003718990924929784, "sim_render-npc2": 0.0036970682380613215, "get_duckie_state": 1.4699195042129391e-06, "in-drivable-lane": 1.699999999999994, "deviation-heading": 0.7729298921344514, "agent_compute-ego0": 0.010488671704757311, "agent_compute-npc0": 0.04337002029103681, "agent_compute-npc1": 0.032897385683926667, "agent_compute-npc2": 0.03092313995046064, "complete-iteration": 0.9385118622425174, "set_robot_commands": 0.0022537393018233873, "deviation-center-line": 0.5131197357490916, "driven_lanedir_consec": 1.4955475701369614, "sim_compute_sim_state": 0.0385801634512657, "sim_compute_performance-ego0": 0.002068493977065914, "sim_compute_performance-npc0": 0.001861152570109722, "sim_compute_performance-npc1": 0.001997074805015375, "sim_compute_performance-npc2": 0.0019429360539459984}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.5278592426042671, "get_ui_image": 0.05201399326324463, "step_physics": 0.5351034195526786, "survival_time": 2.25, "driven_lanedir": 0.17372671471379375, "get_state_dump": 0.009729307630787724, "get_robot_state": 0.014405685922373896, "sim_render-ego0": 0.00400543212890625, "sim_render-npc0": 0.00378660015437914, "sim_render-npc1": 0.0037501480268395462, "sim_render-npc2": 0.003771476123643958, "get_duckie_state": 1.378681348717731e-06, "in-drivable-lane": 1.4, "deviation-heading": 0.4875676571506023, "agent_compute-ego0": 0.011945973271908968, "agent_compute-npc0": 0.04749542215596075, "agent_compute-npc1": 0.048500346100848656, "agent_compute-npc2": 0.04710426019585651, "complete-iteration": 0.8415576323218967, "set_robot_commands": 0.0022057605826336403, "deviation-center-line": 0.044667462860022975, "driven_lanedir_consec": 0.17372671471379375, "sim_compute_sim_state": 0.042915147283802864, "sim_compute_performance-ego0": 0.0022043456201967988, "sim_compute_performance-npc0": 0.0019389857416567595, "sim_compute_performance-npc1": 0.001961697702822478, "sim_compute_performance-npc2": 0.0019316984259563944}}
set_robot_commands_max0.0022537393018233873
set_robot_commands_mean0.0022297499422285136
set_robot_commands_median0.0022297499422285136
set_robot_commands_min0.0022057605826336403
sim_compute_performance-ego0_max0.0022043456201967988
sim_compute_performance-ego0_mean0.0021364197986313564
sim_compute_performance-ego0_median0.0021364197986313564
sim_compute_performance-ego0_min0.002068493977065914
sim_compute_performance-npc0_max0.0019389857416567595
sim_compute_performance-npc0_mean0.0019000691558832409
sim_compute_performance-npc0_median0.0019000691558832409
sim_compute_performance-npc0_min0.001861152570109722
sim_compute_performance-npc1_max0.001997074805015375
sim_compute_performance-npc1_mean0.0019793862539189263
sim_compute_performance-npc1_median0.0019793862539189263
sim_compute_performance-npc1_min0.001961697702822478
sim_compute_performance-npc2_max0.0019429360539459984
sim_compute_performance-npc2_mean0.0019373172399511963
sim_compute_performance-npc2_median0.0019373172399511963
sim_compute_performance-npc2_min0.0019316984259563944
sim_compute_sim_state_max0.042915147283802864
sim_compute_sim_state_mean0.04074765536753428
sim_compute_sim_state_median0.04074765536753428
sim_compute_sim_state_min0.0385801634512657
sim_render-ego0_max0.00400543212890625
sim_render-ego0_mean0.003906394824508793
sim_render-ego0_median0.003906394824508793
sim_render-ego0_min0.003807357520111336
sim_render-npc0_max0.00378660015437914
sim_render-npc0_mean0.00370987132860952
sim_render-npc0_median0.00370987132860952
sim_render-npc0_min0.0036331425028399
sim_render-npc1_max0.0037501480268395462
sim_render-npc1_mean0.0037345694758846655
sim_render-npc1_median0.0037345694758846655
sim_render-npc1_min0.003718990924929784
sim_render-npc2_max0.003771476123643958
sim_render-npc2_mean0.00373427218085264
sim_render-npc2_median0.00373427218085264
sim_render-npc2_min0.0036970682380613215
simulation-passed1
step_physics_max0.6725004093706115
step_physics_mean0.6038019144616451
step_physics_median0.6038019144616451
step_physics_min0.5351034195526786
survival_time_max5.999999999999987
survival_time_mean4.124999999999993
survival_time_min2.25
No reset possible
5363812582Bea Baselines 🐤template-rosaido5-LFP-sim-testingLFP-simsuccessyesnogpu-prod-050:05:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3122339065060067
survival_time_median5.899999999999987
deviation-center-line_median0.19536109613263747
in-drivable-lane_median3.4499999999999904


other stats
agent_compute-ego0_max0.013637325593403408
agent_compute-ego0_mean0.013088015307344172
agent_compute-ego0_median0.01324972113260644
agent_compute-ego0_min0.012215293370760404
complete-iteration_max0.2696227625012398
complete-iteration_mean0.23533645031456327
complete-iteration_median0.25346386128718157
complete-iteration_min0.16479531618265006
deviation-center-line_max0.3360680036175146
deviation-center-line_mean0.19890105053620763
deviation-center-line_min0.06881400626204089
deviation-heading_max1.6308320037467952
deviation-heading_mean1.0322531016855176
deviation-heading_median1.0064047298398602
deviation-heading_min0.48537094331555497
driven_any_max2.201123951106202
driven_any_mean1.387305808067794
driven_any_median1.439586502328154
driven_any_min0.4689262765086653
driven_lanedir_consec_max0.9355489089049208
driven_lanedir_consec_mean0.4253472730641655
driven_lanedir_consec_min0.14137237033972783
driven_lanedir_max0.9355489089049208
driven_lanedir_mean0.4253472730641655
driven_lanedir_median0.3122339065060067
driven_lanedir_min0.14137237033972783
get_duckie_state_max0.025816598108836585
get_duckie_state_mean0.017899285765786085
get_duckie_state_median0.020920824974430777
get_duckie_state_min0.003938895005446214
get_robot_state_max0.00397365540266037
get_robot_state_mean0.003742527267035976
get_robot_state_median0.0037792181791499262
get_robot_state_min0.0034380173071836815
get_state_dump_max0.008827669279915946
get_state_dump_mean0.007553359758056874
get_state_dump_median0.008218612013696936
get_state_dump_min0.004948545724917681
get_ui_image_max0.039990094304084775
get_ui_image_mean0.03398250645084658
get_ui_image_median0.03568202807182719
get_ui_image_min0.02457587535564716
in-drivable-lane_max7.099999999999989
in-drivable-lane_mean3.4999999999999925
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.4689262765086653, "get_ui_image": 0.0349823704787663, "step_physics": 0.1644636264869145, "survival_time": 2.7499999999999982, "driven_lanedir": 0.4504499128069439, "get_state_dump": 0.008827669279915946, "get_robot_state": 0.0037761075156075618, "sim_render-ego0": 0.0038352268082754953, "get_duckie_state": 0.025816598108836585, "in-drivable-lane": 0.0, "deviation-heading": 0.7068940976804999, "agent_compute-ego0": 0.013637325593403408, "complete-iteration": 0.26607168146542143, "set_robot_commands": 0.0023768416472843717, "deviation-center-line": 0.3360680036175146, "driven_lanedir_consec": 0.4504499128069439, "sim_compute_sim_state": 0.006194238151822772, "sim_compute_performance-ego0": 0.00205675618989127}, "LFP-norm-zigzag-000-ego0": {"driven_any": 1.9611031072281129, "get_ui_image": 0.039990094304084775, "step_physics": 0.16031662076711656, "survival_time": 7.94999999999998, "driven_lanedir": 0.9355489089049208, "get_state_dump": 0.00834546834230423, "get_robot_state": 0.00397365540266037, "sim_render-ego0": 0.003948788344860077, "get_duckie_state": 0.021366353332996368, "in-drivable-lane": 3.899999999999986, "deviation-heading": 1.6308320037467952, "agent_compute-ego0": 0.013377079367637634, "complete-iteration": 0.2696227625012398, "set_robot_commands": 0.002338211238384247, "deviation-center-line": 0.2634457329190508, "driven_lanedir_consec": 0.9355489089049208, "sim_compute_sim_state": 0.013759377598762512, "sim_compute_performance-ego0": 0.0020965680480003355}, "LFP-norm-techtrack-000-ego0": {"driven_any": 2.201123951106202, "get_ui_image": 0.036381685664888065, "step_physics": 0.139536594379844, "survival_time": 8.599999999999987, "driven_lanedir": 0.17401790020506946, "get_state_dump": 0.00809175568508964, "get_robot_state": 0.003782328842692293, "sim_render-ego0": 0.0037839398907788223, "get_duckie_state": 0.02047529661586519, "in-drivable-lane": 7.099999999999989, "deviation-heading": 1.3059153619992203, "agent_compute-ego0": 0.013122362897575244, "complete-iteration": 0.24085604110894177, "set_robot_commands": 0.00226001518999221, "deviation-center-line": 0.12727645934622414, "driven_lanedir_consec": 0.17401790020506946, "sim_compute_sim_state": 0.011350897695287803, "sim_compute_performance-ego0": 0.0019713591978040043}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.9180698974281952, "get_ui_image": 0.02457587535564716, "step_physics": 0.1026398738225301, "survival_time": 3.8499999999999943, "driven_lanedir": 0.14137237033972783, "get_state_dump": 0.004948545724917681, "get_robot_state": 0.0034380173071836815, "sim_render-ego0": 0.0035211764849149263, "get_duckie_state": 0.003938895005446214, "in-drivable-lane": 2.9999999999999942, "deviation-heading": 0.48537094331555497, "agent_compute-ego0": 0.012215293370760404, "complete-iteration": 0.16479531618265006, "set_robot_commands": 0.0019758053314991486, "deviation-center-line": 0.06881400626204089, "driven_lanedir_consec": 0.14137237033972783, "sim_compute_sim_state": 0.005678629263853416, "sim_compute_performance-ego0": 0.0017804824388944183}}
set_robot_commands_max0.0023768416472843717
set_robot_commands_mean0.0022377183517899944
set_robot_commands_median0.0022991132141882285
set_robot_commands_min0.0019758053314991486
sim_compute_performance-ego0_max0.0020965680480003355
sim_compute_performance-ego0_mean0.0019762914686475073
sim_compute_performance-ego0_median0.002014057693847637
sim_compute_performance-ego0_min0.0017804824388944183
sim_compute_sim_state_max0.013759377598762512
sim_compute_sim_state_mean0.009245785677431626
sim_compute_sim_state_median0.008772567923555288
sim_compute_sim_state_min0.005678629263853416
sim_render-ego0_max0.003948788344860077
sim_render-ego0_mean0.0037722828822073303
sim_render-ego0_median0.003809583349527159
sim_render-ego0_min0.0035211764849149263
simulation-passed1
step_physics_max0.1644636264869145
step_physics_mean0.1417391788641013
step_physics_median0.14992660757348028
step_physics_min0.1026398738225301
survival_time_max8.599999999999987
survival_time_mean5.78749999999999
survival_time_min2.7499999999999982
No reset possible
5363012691Bea Baselines 🐤template-randomaido5-LFI-sim-testingLFVIv-simabortedyesnogpu-prod-050:00:35
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5361912689Bea Baselines 🐤template-randomaido5-LFV_multi-sim-testingLFVmultibodyv-simabortedyesnogpu-prod-050:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5360612696Bea Baselines 🐤template-randomaido5-LFVI-sim-testingLFVIt-simabortedyesnogpu-prod-050:05:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5359412586Bea Baselines 🐤template-rosaido5-LFI-sim-testingLFVIv-simsuccessyesnogpu-prod-050:03:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3564871372563728
survival_time_median4.149999999999993
deviation-center-line_median0.19507018589103495
in-drivable-lane_median2.0249999999999964


other stats
agent_compute-ego0_max0.013530164434198747
agent_compute-ego0_mean0.013148026624385842
agent_compute-ego0_median0.013148026624385842
agent_compute-ego0_min0.012765888814572936
complete-iteration_max0.26027198632558185
complete-iteration_mean0.2497236927350362
complete-iteration_median0.2497236927350362
complete-iteration_min0.23917539914449057
deviation-center-line_max0.3042376089852991
deviation-center-line_mean0.19507018589103495
deviation-center-line_min0.08590276279677081
deviation-heading_max1.707521393766303
deviation-heading_mean1.1166484948919913
deviation-heading_median1.1166484948919913
deviation-heading_min0.5257755960176795
driven_any_max1.399695936074464
driven_any_mean0.9091890234666632
driven_any_median0.9091890234666632
driven_any_min0.4186821108588621
driven_lanedir_consec_max0.5943688385539103
driven_lanedir_consec_mean0.3564871372563728
driven_lanedir_consec_min0.11860543595883533
driven_lanedir_max0.5943688385539103
driven_lanedir_mean0.3564871372563728
driven_lanedir_median0.3564871372563728
driven_lanedir_min0.11860543595883533
get_duckie_state_max1.885272838451244e-06
get_duckie_state_mean1.6924001087686937e-06
get_duckie_state_median1.6924001087686937e-06
get_duckie_state_min1.4995273790861431e-06
get_robot_state_max0.004197618417572557
get_robot_state_mean0.004029262367977269
get_robot_state_median0.004029262367977269
get_robot_state_min0.003860906318381981
get_state_dump_max0.005335723912274396
get_state_dump_mean0.005305851644475093
get_state_dump_median0.005305851644475093
get_state_dump_min0.00527597937667579
get_ui_image_max0.03945233110795941
get_ui_image_mean0.03881345146115993
get_ui_image_median0.03881345146115993
get_ui_image_min0.038174571814360445
in-drivable-lane_max2.2999999999999945
in-drivable-lane_mean2.0249999999999964
in-drivable-lane_min1.7499999999999984
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.4186821108588621, "get_ui_image": 0.038174571814360445, "step_physics": 0.1815621190600925, "survival_time": 2.6499999999999986, "driven_lanedir": 0.11860543595883533, "get_state_dump": 0.005335723912274396, "get_robot_state": 0.003860906318381981, "sim_render-ego0": 0.004042841770030834, "get_duckie_state": 1.885272838451244e-06, "in-drivable-lane": 1.7499999999999984, "deviation-heading": 0.5257755960176795, "agent_compute-ego0": 0.012765888814572936, "complete-iteration": 0.26027198632558185, "set_robot_commands": 0.002338877430668584, "deviation-center-line": 0.08590276279677081, "driven_lanedir_consec": 0.11860543595883533, "sim_compute_sim_state": 0.00978725927847403, "sim_compute_performance-ego0": 0.0022995648560700595}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.399695936074464, "get_ui_image": 0.03945233110795941, "step_physics": 0.1558927799526014, "survival_time": 5.649999999999988, "driven_lanedir": 0.5943688385539103, "get_state_dump": 0.00527597937667579, "get_robot_state": 0.004197618417572557, "sim_render-ego0": 0.004138317024498655, "get_duckie_state": 1.4995273790861431e-06, "in-drivable-lane": 2.2999999999999945, "deviation-heading": 1.707521393766303, "agent_compute-ego0": 0.013530164434198747, "complete-iteration": 0.23917539914449057, "set_robot_commands": 0.0024610548688654313, "deviation-center-line": 0.3042376089852991, "driven_lanedir_consec": 0.5943688385539103, "sim_compute_sim_state": 0.011835232115628426, "sim_compute_performance-ego0": 0.0022848907269929584}}
set_robot_commands_max0.0024610548688654313
set_robot_commands_mean0.0023999661497670077
set_robot_commands_median0.0023999661497670077
set_robot_commands_min0.002338877430668584
sim_compute_performance-ego0_max0.0022995648560700595
sim_compute_performance-ego0_mean0.0022922277915315087
sim_compute_performance-ego0_median0.0022922277915315087
sim_compute_performance-ego0_min0.0022848907269929584
sim_compute_sim_state_max0.011835232115628426
sim_compute_sim_state_mean0.010811245697051228
sim_compute_sim_state_median0.010811245697051228
sim_compute_sim_state_min0.00978725927847403
sim_render-ego0_max0.004138317024498655
sim_render-ego0_mean0.004090579397264744
sim_render-ego0_median0.004090579397264744
sim_render-ego0_min0.004042841770030834
simulation-passed1
step_physics_max0.1815621190600925
step_physics_mean0.16872744950634694
step_physics_median0.16872744950634694
step_physics_min0.1558927799526014
survival_time_max5.649999999999988
survival_time_mean4.149999999999993
survival_time_min2.6499999999999986
No reset possible
5358112593Bea Baselines 🐤template-randomaido5-LF-sim-validationLFv-simabortedyesnogpu-prod-050:02:25
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5354812599Bea Baselines 🐤template-randomaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-050:13:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3386162956066159
survival_time_median7.199999999999982
deviation-center-line_median0.13150150834523444
in-drivable-lane_median5.1749999999999865


other stats
agent_compute-ego0_max0.012604035583196902
agent_compute-ego0_mean0.0117433566332929
agent_compute-ego0_median0.011404474850358634
agent_compute-ego0_min0.011276843150456746
agent_compute-ego1_max0.012042849671606924
agent_compute-ego1_mean0.011484653326511725
agent_compute-ego1_median0.01172230654749377
agent_compute-ego1_min0.010483077078154593
complete-iteration_max0.8198810979431751
complete-iteration_mean0.664440265871441
complete-iteration_median0.7499845389662118
complete-iteration_min0.25076692032091547
deviation-center-line_max1.1793353551209578
deviation-center-line_mean0.19682735223382447
deviation-center-line_min0.03781627258124975
deviation-heading_max4.13206271019058
deviation-heading_mean1.0463262829209203
deviation-heading_median0.9402685921450354
deviation-heading_min0.291348286294811
driven_any_max2.951704478527868
driven_any_mean1.9134596982041032
driven_any_median1.760372794839244
driven_any_min0.18489783262536005
driven_lanedir_consec_max0.7960762545928977
driven_lanedir_consec_mean0.3518580104312197
driven_lanedir_consec_min0.10162466951715476
driven_lanedir_max0.7960762545928977
driven_lanedir_mean0.3521650626338418
driven_lanedir_median0.3407656610249702
driven_lanedir_min0.10162466951715476
get_duckie_state_max1.650843127020474e-06
get_duckie_state_mean1.5369265500209042e-06
get_duckie_state_median1.5676411148769403e-06
get_duckie_state_min1.249891338926373e-06
get_robot_state_max0.014924858356344288
get_robot_state_mean0.013419308148911136
get_robot_state_median0.014296782562156128
get_robot_state_min0.007043778294264668
get_state_dump_max0.0099742303486743
get_state_dump_mean0.009222698999329332
get_state_dump_median0.009958913408476731
get_state_dump_min0.006053859537298029
get_ui_image_max0.04926578587499158
get_ui_image_mean0.04359793625718026
get_ui_image_median0.04597233946806465
get_ui_image_min0.030385626686943903
in-drivable-lane_max6.599999999999981
in-drivable-lane_mean4.764285714285701
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.274124355035624, "get_ui_image": 0.042161838213602705, "step_physics": 0.4685957054297129, "survival_time": 5.949999999999987, "driven_lanedir": 0.7960762545928977, "get_state_dump": 0.00931937297185262, "get_robot_state": 0.014224048455556231, "sim_render-ego0": 0.0036505738894144694, "sim_render-ego1": 0.003629879156748454, "sim_render-ego2": 0.003673805793126424, "sim_render-ego3": 0.003565746545791626, "get_duckie_state": 1.535813013712565e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.9316977066482196, "agent_compute-ego0": 0.011276843150456746, "agent_compute-ego1": 0.011189591884613038, "agent_compute-ego2": 0.012191355228424072, "agent_compute-ego3": 0.011084375778834026, "complete-iteration": 0.6302918334801991, "set_robot_commands": 0.0021649698416392007, "deviation-center-line": 0.23307611918600285, "driven_lanedir_consec": 0.7960762545928977, "sim_compute_sim_state": 0.01899580359458923, "sim_compute_performance-ego0": 0.0020599027474721273, "sim_compute_performance-ego1": 0.0018911381562550865, "sim_compute_performance-ego2": 0.001911256710688273, "sim_compute_performance-ego3": 0.0018784046173095704}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.7771107787938447, "get_ui_image": 0.042161838213602705, "step_physics": 0.4685957054297129, "survival_time": 5.949999999999987, "driven_lanedir": 0.4079052940890945, "get_state_dump": 0.00931937297185262, "get_robot_state": 0.014224048455556231, "sim_render-ego0": 0.0036505738894144694, "sim_render-ego1": 0.003629879156748454, "sim_render-ego2": 0.003673805793126424, "sim_render-ego3": 0.003565746545791626, "get_duckie_state": 1.535813013712565e-06, "in-drivable-lane": 4.64999999999999, "deviation-heading": 0.5815629454748248, "agent_compute-ego0": 0.011276843150456746, "agent_compute-ego1": 0.011189591884613038, "agent_compute-ego2": 0.012191355228424072, "agent_compute-ego3": 0.011084375778834026, "complete-iteration": 0.6302918334801991, "set_robot_commands": 0.0021649698416392007, "deviation-center-line": 0.15345155549638095, "driven_lanedir_consec": 0.4079052940890945, "sim_compute_sim_state": 0.01899580359458923, "sim_compute_performance-ego0": 0.0020599027474721273, "sim_compute_performance-ego1": 0.0018911381562550865, "sim_compute_performance-ego2": 0.001911256710688273, "sim_compute_performance-ego3": 0.0018784046173095704}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.615892599054939, "get_ui_image": 0.042161838213602705, "step_physics": 0.4685957054297129, "survival_time": 5.949999999999987, "driven_lanedir": 0.3409414151275487, "get_state_dump": 0.00931937297185262, "get_robot_state": 0.014224048455556231, "sim_render-ego0": 0.0036505738894144694, "sim_render-ego1": 0.003629879156748454, "sim_render-ego2": 0.003673805793126424, "sim_render-ego3": 0.003565746545791626, "get_duckie_state": 1.535813013712565e-06, "in-drivable-lane": 4.599999999999988, "deviation-heading": 0.9488394776418512, "agent_compute-ego0": 0.011276843150456746, "agent_compute-ego1": 0.011189591884613038, "agent_compute-ego2": 0.012191355228424072, "agent_compute-ego3": 0.011084375778834026, "complete-iteration": 0.6302918334801991, "set_robot_commands": 0.0021649698416392007, "deviation-center-line": 0.09422141413744677, "driven_lanedir_consec": 0.3409414151275487, "sim_compute_sim_state": 0.01899580359458923, "sim_compute_performance-ego0": 0.0020599027474721273, "sim_compute_performance-ego1": 0.0018911381562550865, "sim_compute_performance-ego2": 0.001911256710688273, "sim_compute_performance-ego3": 0.0018784046173095704}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.6398074009825068, "get_ui_image": 0.042161838213602705, "step_physics": 0.4685957054297129, "survival_time": 5.949999999999987, "driven_lanedir": 0.21369386022737347, "get_state_dump": 0.00931937297185262, "get_robot_state": 0.014224048455556231, "sim_render-ego0": 0.0036505738894144694, "sim_render-ego1": 0.003629879156748454, "sim_render-ego2": 0.003673805793126424, "sim_render-ego3": 0.003565746545791626, "get_duckie_state": 1.535813013712565e-06, "in-drivable-lane": 5.099999999999986, "deviation-heading": 0.36485645822221113, "agent_compute-ego0": 0.011276843150456746, "agent_compute-ego1": 0.011189591884613038, "agent_compute-ego2": 0.012191355228424072, "agent_compute-ego3": 0.011084375778834026, "complete-iteration": 0.6302918334801991, "set_robot_commands": 0.0021649698416392007, "deviation-center-line": 0.06914054888435704, "driven_lanedir_consec": 0.21369386022737347, "sim_compute_sim_state": 0.01899580359458923, "sim_compute_performance-ego0": 0.0020599027474721273, "sim_compute_performance-ego1": 0.0018911381562550865, "sim_compute_performance-ego2": 0.001911256710688273, "sim_compute_performance-ego3": 0.0018784046173095704}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.5559095507228855, "get_ui_image": 0.04926578587499158, "step_physics": 0.5648182819629538, "survival_time": 7.199999999999982, "driven_lanedir": 0.16582071872096904, "get_state_dump": 0.009958913408476731, "get_robot_state": 0.014924858356344288, "sim_render-ego0": 0.003809560578444908, "sim_render-ego1": 0.0037619426332671066, "sim_render-ego2": 0.0037946240655307114, "sim_render-ego3": 0.003677026156721444, "get_duckie_state": 1.650843127020474e-06, "in-drivable-lane": 6.449999999999982, "deviation-heading": 0.3586823355775982, "agent_compute-ego0": 0.011404474850358634, "agent_compute-ego1": 0.01172230654749377, "agent_compute-ego2": 0.011959768163746802, "agent_compute-ego3": 0.01169229375905004, "complete-iteration": 0.7499845389662118, "set_robot_commands": 0.0022007399591906316, "deviation-center-line": 0.059631431224197985, "driven_lanedir_consec": 0.16582071872096904, "sim_compute_sim_state": 0.03202137782655913, "sim_compute_performance-ego0": 0.00218798538734173, "sim_compute_performance-ego1": 0.0019600605142527615, "sim_compute_performance-ego2": 0.0019308616375101023, "sim_compute_performance-ego3": 0.0019301463817727976}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.8734985354242055, "get_ui_image": 0.04926578587499158, "step_physics": 0.5648182819629538, "survival_time": 7.199999999999982, "driven_lanedir": 0.19265203980442447, "get_state_dump": 0.009958913408476731, "get_robot_state": 0.014924858356344288, "sim_render-ego0": 0.003809560578444908, "sim_render-ego1": 0.0037619426332671066, "sim_render-ego2": 0.0037946240655307114, "sim_render-ego3": 0.003677026156721444, "get_duckie_state": 1.650843127020474e-06, "in-drivable-lane": 5.949999999999984, "deviation-heading": 1.2444813548952531, "agent_compute-ego0": 0.011404474850358634, "agent_compute-ego1": 0.01172230654749377, "agent_compute-ego2": 0.011959768163746802, "agent_compute-ego3": 0.01169229375905004, "complete-iteration": 0.7499845389662118, "set_robot_commands": 0.0022007399591906316, "deviation-center-line": 0.09612169677476312, "driven_lanedir_consec": 0.19265203980442447, "sim_compute_sim_state": 0.03202137782655913, "sim_compute_performance-ego0": 0.00218798538734173, "sim_compute_performance-ego1": 0.0019600605142527615, "sim_compute_performance-ego2": 0.0019308616375101023, "sim_compute_performance-ego3": 0.0019301463817727976}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 2.3178974013322633, "get_ui_image": 0.04926578587499158, "step_physics": 0.5648182819629538, "survival_time": 7.199999999999982, "driven_lanedir": 0.10162466951715476, "get_state_dump": 0.009958913408476731, "get_robot_state": 0.014924858356344288, "sim_render-ego0": 0.003809560578444908, "sim_render-ego1": 0.0037619426332671066, "sim_render-ego2": 0.0037946240655307114, "sim_render-ego3": 0.003677026156721444, "get_duckie_state": 1.650843127020474e-06, "in-drivable-lane": 6.499999999999982, "deviation-heading": 0.5541987636288823, "agent_compute-ego0": 0.011404474850358634, "agent_compute-ego1": 0.01172230654749377, "agent_compute-ego2": 0.011959768163746802, "agent_compute-ego3": 0.01169229375905004, "complete-iteration": 0.7499845389662118, "set_robot_commands": 0.0022007399591906316, "deviation-center-line": 0.03781627258124975, "driven_lanedir_consec": 0.10162466951715476, "sim_compute_sim_state": 0.03202137782655913, "sim_compute_performance-ego0": 0.00218798538734173, "sim_compute_performance-ego1": 0.0019600605142527615, "sim_compute_performance-ego2": 0.0019308616375101023, "sim_compute_performance-ego3": 0.0019301463817727976}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.7765427252108315, "get_ui_image": 0.04926578587499158, "step_physics": 0.5648182819629538, "survival_time": 7.199999999999982, "driven_lanedir": 0.6452515830462522, "get_state_dump": 0.009958913408476731, "get_robot_state": 0.014924858356344288, "sim_render-ego0": 0.003809560578444908, "sim_render-ego1": 0.0037619426332671066, "sim_render-ego2": 0.0037946240655307114, "sim_render-ego3": 0.003677026156721444, "get_duckie_state": 1.650843127020474e-06, "in-drivable-lane": 5.249999999999986, "deviation-heading": 0.9734465477255804, "agent_compute-ego0": 0.011404474850358634, "agent_compute-ego1": 0.01172230654749377, "agent_compute-ego2": 0.011959768163746802, "agent_compute-ego3": 0.01169229375905004, "complete-iteration": 0.7499845389662118, "set_robot_commands": 0.0022007399591906316, "deviation-center-line": 0.1436614022182105, "driven_lanedir_consec": 0.6452515830462522, "sim_compute_sim_state": 0.03202137782655913, "sim_compute_performance-ego0": 0.00218798538734173, "sim_compute_performance-ego1": 0.0019600605142527615, "sim_compute_performance-ego2": 0.0019308616375101023, "sim_compute_performance-ego3": 0.0019301463817727976}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.18489783262536005, "get_ui_image": 0.04597233946806465, "step_physics": 0.6448979689404856, "survival_time": 7.599999999999981, "driven_lanedir": 0.16126759294861004, "get_state_dump": 0.0099742303486743, "get_robot_state": 0.014296782562156128, "sim_render-ego0": 0.003921779931760302, "sim_render-ego1": 0.00373030955495398, "sim_render-ego2": 0.0037050839343102143, "sim_render-ego3": 0.003774127149893568, "get_duckie_state": 1.5676411148769403e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.13206271019058, "agent_compute-ego0": 0.012604035583196902, "agent_compute-ego1": 0.012042849671606924, "agent_compute-ego2": 0.01154499427945006, "agent_compute-ego3": 0.011953057806476267, "complete-iteration": 0.8198810979431751, "set_robot_commands": 0.0022116829367244944, "deviation-center-line": 1.1793353551209578, "driven_lanedir_consec": 0.16126759294861004, "sim_compute_sim_state": 0.0238954927407059, "sim_compute_performance-ego0": 0.00222316910238827, "sim_compute_performance-ego1": 0.0019883221270991305, "sim_compute_performance-ego2": 0.002008135801826427, "sim_compute_performance-ego3": 0.0019922147389330896}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.7205864887254294, "get_ui_image": 0.04597233946806465, "step_physics": 0.6448979689404856, "survival_time": 7.599999999999981, "driven_lanedir": 0.34433052196676683, "get_state_dump": 0.0099742303486743, "get_robot_state": 0.014296782562156128, "sim_render-ego0": 0.003921779931760302, "sim_render-ego1": 0.00373030955495398, "sim_render-ego2": 0.0037050839343102143, "sim_render-ego3": 0.003774127149893568, "get_duckie_state": 1.5676411148769403e-06, "in-drivable-lane": 6.049999999999983, "deviation-heading": 1.1722790788608328, "agent_compute-ego0": 0.012604035583196902, "agent_compute-ego1": 0.012042849671606924, "agent_compute-ego2": 0.01154499427945006, "agent_compute-ego3": 0.011953057806476267, "complete-iteration": 0.8198810979431751, "set_robot_commands": 0.0022116829367244944, "deviation-center-line": 0.1193416144722584, "driven_lanedir_consec": 0.34433052196676683, "sim_compute_sim_state": 0.0238954927407059, "sim_compute_performance-ego0": 0.00222316910238827, "sim_compute_performance-ego1": 0.0019883221270991305, "sim_compute_performance-ego2": 0.002008135801826427, "sim_compute_performance-ego3": 0.0019922147389330896}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.7436348108846431, "get_ui_image": 0.04597233946806465, "step_physics": 0.6448979689404856, "survival_time": 7.599999999999981, "driven_lanedir": 0.3484125379459806, "get_state_dump": 0.0099742303486743, "get_robot_state": 0.014296782562156128, "sim_render-ego0": 0.003921779931760302, "sim_render-ego1": 0.00373030955495398, "sim_render-ego2": 0.0037050839343102143, "sim_render-ego3": 0.003774127149893568, "get_duckie_state": 1.5676411148769403e-06, "in-drivable-lane": 6.049999999999981, "deviation-heading": 0.9782946667514604, "agent_compute-ego0": 0.012604035583196902, "agent_compute-ego1": 0.012042849671606924, "agent_compute-ego2": 0.01154499427945006, "agent_compute-ego3": 0.011953057806476267, "complete-iteration": 0.8198810979431751, "set_robot_commands": 0.0022116829367244944, "deviation-center-line": 0.14721758995799067, "driven_lanedir_consec": 0.3484125379459806, "sim_compute_sim_state": 0.0238954927407059, "sim_compute_performance-ego0": 0.00222316910238827, "sim_compute_performance-ego1": 0.0019883221270991305, "sim_compute_performance-ego2": 0.002008135801826427, "sim_compute_performance-ego3": 0.0019922147389330896}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.951704478527868, "get_ui_image": 0.04597233946806465, "step_physics": 0.6448979689404856, "survival_time": 7.599999999999981, "driven_lanedir": 0.2576470504888566, "get_state_dump": 0.0099742303486743, "get_robot_state": 0.014296782562156128, "sim_render-ego0": 0.003921779931760302, "sim_render-ego1": 0.00373030955495398, "sim_render-ego2": 0.0037050839343102143, "sim_render-ego3": 0.003774127149893568, "get_duckie_state": 1.5676411148769403e-06, "in-drivable-lane": 6.599999999999981, "deviation-heading": 0.3481560818464254, "agent_compute-ego0": 0.012604035583196902, "agent_compute-ego1": 0.012042849671606924, "agent_compute-ego2": 0.01154499427945006, "agent_compute-ego3": 0.011953057806476267, "complete-iteration": 0.8198810979431751, "set_robot_commands": 0.0022116829367244944, "deviation-center-line": 0.086677958791832, "driven_lanedir_consec": 0.2576470504888566, "sim_compute_sim_state": 0.0238954927407059, "sim_compute_performance-ego0": 0.00222316910238827, "sim_compute_performance-ego1": 0.0019883221270991305, "sim_compute_performance-ego2": 0.002008135801826427, "sim_compute_performance-ego3": 0.0019922147389330896}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.678414408768526, "get_ui_image": 0.030385626686943903, "step_physics": 0.16099706563082608, "survival_time": 4.899999999999991, "driven_lanedir": 0.6140974314754637, "get_state_dump": 0.006053859537298029, "get_robot_state": 0.007043778294264668, "sim_render-ego0": 0.00360772344801161, "sim_render-ego1": 0.0036642936745075265, "get_duckie_state": 1.249891338926373e-06, "in-drivable-lane": 3.1499999999999897, "deviation-heading": 0.291348286294811, "agent_compute-ego0": 0.011632789265025744, "agent_compute-ego1": 0.010483077078154593, "complete-iteration": 0.25076692032091547, "set_robot_commands": 0.0021619628174136384, "deviation-center-line": 0.16192487225063373, "driven_lanedir_consec": 0.6140974314754637, "sim_compute_sim_state": 0.00869640437039462, "sim_compute_performance-ego0": 0.0019578596558233706, "sim_compute_performance-ego1": 0.0018488156675088288}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6784144087685244, "get_ui_image": 0.030385626686943903, "step_physics": 0.16099706563082608, "survival_time": 4.899999999999991, "driven_lanedir": 0.34058990692239166, "get_state_dump": 0.006053859537298029, "get_robot_state": 0.007043778294264668, "sim_render-ego0": 0.00360772344801161, "sim_render-ego1": 0.0036642936745075265, "get_duckie_state": 1.249891338926373e-06, "in-drivable-lane": 2.8999999999999924, "deviation-heading": 1.768661547134351, "agent_compute-ego0": 0.011632789265025744, "agent_compute-ego1": 0.010483077078154593, "complete-iteration": 0.25076692032091547, "set_robot_commands": 0.0021619628174136384, "deviation-center-line": 0.17396510017726105, "driven_lanedir_consec": 0.33629117608568304, "sim_compute_sim_state": 0.00869640437039462, "sim_compute_performance-ego0": 0.0019578596558233706, "sim_compute_performance-ego1": 0.0018488156675088288}}
set_robot_commands_max0.0022116829367244944
set_robot_commands_mean0.0021881068989317567
set_robot_commands_median0.0022007399591906316
set_robot_commands_min0.0021619628174136384
sim_compute_performance-ego0_max0.00222316910238827
sim_compute_performance-ego0_mean0.002128567732889661
sim_compute_performance-ego0_median0.00218798538734173
sim_compute_performance-ego0_min0.0019578596558233706
sim_compute_performance-ego1_max0.0019883221270991305
sim_compute_performance-ego1_mean0.0019325510375318264
sim_compute_performance-ego1_median0.0019600605142527615
sim_compute_performance-ego1_min0.0018488156675088288
sim_compute_sim_state_max0.03202137782655913
sim_compute_sim_state_mean0.022645964670586164
sim_compute_sim_state_median0.0238954927407059
sim_compute_sim_state_min0.00869640437039462
sim_render-ego0_max0.003921779931760302
sim_render-ego0_mean0.003767364606750138
sim_render-ego0_median0.003809560578444908
sim_render-ego0_min0.00360772344801161
sim_render-ego1_max0.0037619426332671066
sim_render-ego1_mean0.0037012223377780873
sim_render-ego1_median0.00373030955495398
sim_render-ego1_min0.003629879156748454
simulation-passed1
step_physics_max0.6448979689404856
step_physics_mean0.5025172826138757
step_physics_median0.5648182819629538
step_physics_min0.16099706563082608
survival_time_max7.599999999999981
survival_time_mean6.628571428571413
survival_time_min4.899999999999991
No reset possible
5353612600Bea Baselines 🐤template-randomaido5-LFI-sim-validationLFVIv-simsuccessyesnogpu-prod-050:02:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.19295142106760688
survival_time_median2.6749999999999985
deviation-center-line_median0.1430668550637951
in-drivable-lane_median1.1250000000000004


other stats
agent_compute-ego0_max0.012156040327889578
agent_compute-ego0_mean0.012143257380405188
agent_compute-ego0_median0.012143257380405188
agent_compute-ego0_min0.0121304744329208
complete-iteration_max0.2636454227643135
complete-iteration_mean0.24063764059499945
complete-iteration_median0.24063764059499945
complete-iteration_min0.21762985842568533
deviation-center-line_max0.22596774648423773
deviation-center-line_mean0.1430668550637951
deviation-center-line_min0.06016596364335245
deviation-heading_max1.9892082549741996
deviation-heading_mean1.1948036666590705
deviation-heading_median1.1948036666590705
deviation-heading_min0.4003990783439415
driven_any_max1.0672360153840748
driven_any_mean0.7318093849558207
driven_any_median0.7318093849558207
driven_any_min0.39638275452756666
driven_lanedir_consec_max0.26738221859900735
driven_lanedir_consec_mean0.19295142106760688
driven_lanedir_consec_min0.1185206235362064
driven_lanedir_max0.40392741637882246
driven_lanedir_mean0.26122401995751443
driven_lanedir_median0.26122401995751443
driven_lanedir_min0.1185206235362064
get_duckie_state_max1.6750433506109775e-06
get_duckie_state_mean1.5698073111174309e-06
get_duckie_state_median1.5698073111174309e-06
get_duckie_state_min1.464571271623884e-06
get_robot_state_max0.0036965574537004744
get_robot_state_mean0.003645441296336415
get_robot_state_median0.003645441296336415
get_robot_state_min0.003594325138972356
get_state_dump_max0.004887250753549429
get_state_dump_mean0.00478395917913416
get_state_dump_median0.00478395917913416
get_state_dump_min0.00468066760471889
get_ui_image_max0.03676160176595052
get_ui_image_mean0.0357003064382644
get_ui_image_median0.0357003064382644
get_ui_image_min0.034639011110578266
in-drivable-lane_max1.250000000000001
in-drivable-lane_mean1.1250000000000004
in-drivable-lane_min0.9999999999999996
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.39638275452756666, "get_ui_image": 0.03676160176595052, "step_physics": 0.19018061344440168, "survival_time": 1.900000000000001, "driven_lanedir": 0.1185206235362064, "get_state_dump": 0.004887250753549429, "get_robot_state": 0.003594325138972356, "sim_render-ego0": 0.0038961019271459337, "get_duckie_state": 1.6750433506109775e-06, "in-drivable-lane": 1.250000000000001, "deviation-heading": 0.4003990783439415, "agent_compute-ego0": 0.0121304744329208, "complete-iteration": 0.2636454227643135, "set_robot_commands": 0.0021817684173583984, "deviation-center-line": 0.06016596364335245, "driven_lanedir_consec": 0.1185206235362064, "sim_compute_sim_state": 0.007840174895066481, "sim_compute_performance-ego0": 0.002079162842188126}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.0672360153840748, "get_ui_image": 0.034639011110578266, "step_physics": 0.14482628617967877, "survival_time": 3.4499999999999957, "driven_lanedir": 0.40392741637882246, "get_state_dump": 0.00468066760471889, "get_robot_state": 0.0036965574537004744, "sim_render-ego0": 0.003764561244419643, "get_duckie_state": 1.464571271623884e-06, "in-drivable-lane": 0.9999999999999996, "deviation-heading": 1.9892082549741996, "agent_compute-ego0": 0.012156040327889578, "complete-iteration": 0.21762985842568533, "set_robot_commands": 0.0021410226821899415, "deviation-center-line": 0.22596774648423773, "driven_lanedir_consec": 0.26738221859900735, "sim_compute_sim_state": 0.009637471607753209, "sim_compute_performance-ego0": 0.0019939422607421877}}
set_robot_commands_max0.0021817684173583984
set_robot_commands_mean0.0021613955497741697
set_robot_commands_median0.0021613955497741697
set_robot_commands_min0.0021410226821899415
sim_compute_performance-ego0_max0.002079162842188126
sim_compute_performance-ego0_mean0.002036552551465157
sim_compute_performance-ego0_median0.002036552551465157
sim_compute_performance-ego0_min0.0019939422607421877
sim_compute_sim_state_max0.009637471607753209
sim_compute_sim_state_mean0.008738823251409844
sim_compute_sim_state_median0.008738823251409844
sim_compute_sim_state_min0.007840174895066481
sim_render-ego0_max0.0038961019271459337
sim_render-ego0_mean0.003830331585782788
sim_render-ego0_median0.003830331585782788
sim_render-ego0_min0.003764561244419643
simulation-passed1
step_physics_max0.19018061344440168
step_physics_mean0.16750344981204024
step_physics_median0.16750344981204024
step_physics_min0.14482628617967877
survival_time_max3.4499999999999957
survival_time_mean2.6749999999999985
survival_time_min1.900000000000001
No reset possible
5348812681Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-050:37:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.7150719765159763
survival_time_median32.34999999999936
deviation-center-line_median2.0396577925927257
in-drivable-lane_median4.5999999999999


other stats
agent_compute-ego0_max0.012753752844220494
agent_compute-ego0_mean0.012177339446048875
agent_compute-ego0_median0.012177339446048875
agent_compute-ego0_min0.011600926047877262
agent_compute-npc0_max0.045092432822514135
agent_compute-npc0_mean0.04215952506684532
agent_compute-npc0_median0.04215952506684532
agent_compute-npc0_min0.0392266173111765
agent_compute-npc1_max0.04601981915800299
agent_compute-npc1_mean0.03729160911095822
agent_compute-npc1_median0.03729160911095822
agent_compute-npc1_min0.028563399063913447
agent_compute-npc2_max0.03829424446766621
agent_compute-npc2_mean0.03533151370730209
agent_compute-npc2_median0.03533151370730209
agent_compute-npc2_min0.032368782946937964
complete-iteration_max1.341726911951362
complete-iteration_mean1.0995556274238365
complete-iteration_median1.0995556274238365
complete-iteration_min0.8573843428963109
deviation-center-line_max3.904995113492974
deviation-center-line_mean2.0396577925927257
deviation-center-line_min0.17432047169247747
deviation-heading_max19.712407507421744
deviation-heading_mean10.56149547393942
deviation-heading_median10.56149547393942
deviation-heading_min1.410583440457094
driven_any_max7.913577150773276
driven_any_mean4.199756923767261
driven_any_median4.199756923767261
driven_any_min0.4859366967612459
driven_lanedir_consec_max2.9672832628497665
driven_lanedir_consec_mean1.7150719765159763
driven_lanedir_consec_min0.46286069018218656
driven_lanedir_max5.983456930364021
driven_lanedir_mean3.2231588102731035
driven_lanedir_median3.2231588102731035
driven_lanedir_min0.46286069018218656
get_duckie_state_max1.4106598027441324e-06
get_duckie_state_mean1.3176891992750267e-06
get_duckie_state_median1.3176891992750267e-06
get_duckie_state_min1.224718595805921e-06
get_robot_state_max0.014883699266241552
get_robot_state_mean0.014196355894845952
get_robot_state_median0.014196355894845952
get_robot_state_min0.01350901252345035
get_state_dump_max0.010014027977466186
get_state_dump_mean0.009523634373752496
get_state_dump_median0.009523634373752496
get_state_dump_min0.009033240770038803
get_ui_image_max0.05481659959099077
get_ui_image_mean0.05213763698582227
get_ui_image_median0.05213763698582227
get_ui_image_min0.04945867438065378
in-drivable-lane_max9.1999999999998
in-drivable-lane_mean4.5999999999999
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 0.4859366967612459, "get_ui_image": 0.04945867438065378, "step_physics": 0.6074784830996864, "survival_time": 4.699999999999991, "driven_lanedir": 0.46286069018218656, "get_state_dump": 0.009033240770038803, "get_robot_state": 0.01350901252345035, "sim_render-ego0": 0.0034769459774619655, "sim_render-npc0": 0.0036020931444670024, "sim_render-npc1": 0.003480037889982525, "sim_render-npc2": 0.003617387068899054, "get_duckie_state": 1.224718595805921e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.410583440457094, "agent_compute-ego0": 0.011600926047877262, "agent_compute-npc0": 0.0392266173111765, "agent_compute-npc1": 0.028563399063913447, "agent_compute-npc2": 0.032368782946937964, "complete-iteration": 0.8573843428963109, "set_robot_commands": 0.0021839869649786696, "deviation-center-line": 0.17432047169247747, "driven_lanedir_consec": 0.46286069018218656, "sim_compute_sim_state": 0.035887457195081206, "sim_compute_performance-ego0": 0.001940333215813888, "sim_compute_performance-npc0": 0.0018049491079230055, "sim_compute_performance-npc1": 0.0017967525281404194, "sim_compute_performance-npc2": 0.001800112975271125}, "LFVI-norm-udem1-000-ego0": {"driven_any": 7.913577150773276, "get_ui_image": 0.05481659959099077, "step_physics": 1.046765713568631, "survival_time": 59.99999999999873, "driven_lanedir": 5.983456930364021, "get_state_dump": 0.010014027977466186, "get_robot_state": 0.014883699266241552, "sim_render-ego0": 0.003893373610078048, "sim_render-npc0": 0.004077746409559925, "sim_render-npc1": 0.003913234612229067, "sim_render-npc2": 0.003952953440263607, "get_duckie_state": 1.4106598027441324e-06, "in-drivable-lane": 9.1999999999998, "deviation-heading": 19.712407507421744, "agent_compute-ego0": 0.012753752844220494, "agent_compute-npc0": 0.045092432822514135, "agent_compute-npc1": 0.04601981915800299, "agent_compute-npc2": 0.03829424446766621, "complete-iteration": 1.341726911951362, "set_robot_commands": 0.002551500048863699, "deviation-center-line": 3.904995113492974, "driven_lanedir_consec": 2.9672832628497665, "sim_compute_sim_state": 0.03889703393280258, "sim_compute_performance-ego0": 0.0021860561799645723, "sim_compute_performance-npc0": 0.002097850437466052, "sim_compute_performance-npc1": 0.0021103413079203814, "sim_compute_performance-npc2": 0.002097186796075597}}
set_robot_commands_max0.002551500048863699
set_robot_commands_mean0.002367743506921184
set_robot_commands_median0.002367743506921184
set_robot_commands_min0.0021839869649786696
sim_compute_performance-ego0_max0.0021860561799645723
sim_compute_performance-ego0_mean0.00206319469788923
sim_compute_performance-ego0_median0.00206319469788923
sim_compute_performance-ego0_min0.001940333215813888
sim_compute_performance-npc0_max0.002097850437466052
sim_compute_performance-npc0_mean0.001951399772694529
sim_compute_performance-npc0_median0.001951399772694529
sim_compute_performance-npc0_min0.0018049491079230055
sim_compute_performance-npc1_max0.0021103413079203814
sim_compute_performance-npc1_mean0.0019535469180304004
sim_compute_performance-npc1_median0.0019535469180304004
sim_compute_performance-npc1_min0.0017967525281404194
sim_compute_performance-npc2_max0.002097186796075597
sim_compute_performance-npc2_mean0.0019486498856733608
sim_compute_performance-npc2_median0.0019486498856733608
sim_compute_performance-npc2_min0.001800112975271125
sim_compute_sim_state_max0.03889703393280258
sim_compute_sim_state_mean0.0373922455639419
sim_compute_sim_state_median0.0373922455639419
sim_compute_sim_state_min0.035887457195081206
sim_render-ego0_max0.003893373610078048
sim_render-ego0_mean0.0036851597937700062
sim_render-ego0_median0.0036851597937700062
sim_render-ego0_min0.0034769459774619655
sim_render-npc0_max0.004077746409559925
sim_render-npc0_mean0.003839919777013464
sim_render-npc0_median0.003839919777013464
sim_render-npc0_min0.0036020931444670024
sim_render-npc1_max0.003913234612229067
sim_render-npc1_mean0.003696636251105795
sim_render-npc1_median0.003696636251105795
sim_render-npc1_min0.003480037889982525
sim_render-npc2_max0.003952953440263607
sim_render-npc2_mean0.003785170254581331
sim_render-npc2_median0.003785170254581331
sim_render-npc2_min0.003617387068899054
simulation-passed1
step_physics_max1.046765713568631
step_physics_mean0.8271220983341587
step_physics_median0.8271220983341587
step_physics_min0.6074784830996864
survival_time_max59.99999999999873
survival_time_mean32.34999999999936
survival_time_min4.699999999999991
No reset possible
5347911122Olga (Ge Ya) Xu 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-050:02:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5346012567Bea Baselines 🐤straightaido5-LFP-sim-testingLFP-simsuccessyesnogpu-prod-050:09:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6382528029058884
survival_time_median14.200000000000069
deviation-center-line_median0.422465273716786
in-drivable-lane_median8.05000000000004


other stats
agent_compute-ego0_max0.01055606023980937
agent_compute-ego0_mean0.01009667247422329
agent_compute-ego0_median0.01009518654663068
agent_compute-ego0_min0.009640256563822428
complete-iteration_max0.2304456151953531
complete-iteration_mean0.21111489487983248
complete-iteration_median0.21806783463662496
complete-iteration_min0.177878295050727
deviation-center-line_max0.9563302962992344
deviation-center-line_mean0.48749115060445447
deviation-center-line_min0.14870375868501146
deviation-heading_max4.607866908517961
deviation-heading_mean2.837149012104016
deviation-heading_median2.982304193530481
deviation-heading_min0.7761207528371414
driven_any_max3.4256999573235083
driven_any_mean2.084045847059827
driven_any_median2.172624142301436
driven_any_min0.5652351463129267
driven_lanedir_consec_max1.1386511383098072
driven_lanedir_consec_mean0.6496872686094345
driven_lanedir_consec_min0.18359233031615396
driven_lanedir_max1.1386511383098072
driven_lanedir_mean0.6496872686094345
driven_lanedir_median0.6382528029058884
driven_lanedir_min0.18359233031615396
get_duckie_state_max0.02548590340839435
get_duckie_state_mean0.01780799897264576
get_duckie_state_median0.02080237160976364
get_duckie_state_min0.004141349262661404
get_robot_state_max0.00385741716802376
get_robot_state_mean0.003719623351624552
get_robot_state_median0.003716989323325224
get_robot_state_min0.0035870975918240017
get_state_dump_max0.009000838570328741
get_state_dump_mean0.007597192620927866
get_state_dump_median0.008027329648657102
get_state_dump_min0.005333272616068522
get_ui_image_max0.037574435592791354
get_ui_image_mean0.03280104692627771
get_ui_image_median0.03399174470680806
get_ui_image_min0.02564626269870334
in-drivable-lane_max14.750000000000169
in-drivable-lane_mean8.42500000000006
in-drivable-lane_min2.8499999999999917
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 1.7360642795923185, "get_ui_image": 0.033372143307468925, "step_physics": 0.11534215247682236, "survival_time": 11.60000000000003, "driven_lanedir": 0.4877264050993597, "get_state_dump": 0.009000838570328741, "get_robot_state": 0.00385741716802376, "sim_render-ego0": 0.003754921737146991, "get_duckie_state": 0.02548590340839435, "in-drivable-lane": 7.500000000000036, "deviation-heading": 2.3299097290399096, "agent_compute-ego0": 0.010028865715976438, "complete-iteration": 0.21216730703100117, "set_robot_commands": 0.002169404418683359, "deviation-center-line": 0.36820632481597826, "driven_lanedir_consec": 0.4877264050993597, "sim_compute_sim_state": 0.007106575331462811, "sim_compute_performance-ego0": 0.0019506067677117216}, "LFP-norm-zigzag-000-ego0": {"driven_any": 3.4256999573235083, "get_ui_image": 0.037574435592791354, "step_physics": 0.12682311031796517, "survival_time": 21.750000000000178, "driven_lanedir": 0.788779200712417, "get_state_dump": 0.007959050322891376, "get_robot_state": 0.0036788336727597297, "sim_render-ego0": 0.003920071168777046, "get_duckie_state": 0.020791157123145707, "in-drivable-lane": 14.750000000000169, "deviation-heading": 4.607866908517961, "agent_compute-ego0": 0.01055606023980937, "complete-iteration": 0.2304456151953531, "set_robot_commands": 0.002129240320363176, "deviation-center-line": 0.4767242226175938, "driven_lanedir_consec": 0.788779200712417, "sim_compute_sim_state": 0.014874450110514229, "sim_compute_performance-ego0": 0.0020410347422328565}, "LFP-norm-techtrack-000-ego0": {"driven_any": 2.6091840050105533, "get_ui_image": 0.0346113461061472, "step_physics": 0.12673835867590297, "survival_time": 16.800000000000104, "driven_lanedir": 1.1386511383098072, "get_state_dump": 0.008095608974422828, "get_robot_state": 0.003755144973890718, "sim_render-ego0": 0.0037647998651340383, "get_duckie_state": 0.020813586096381575, "in-drivable-lane": 8.600000000000044, "deviation-heading": 3.634698658021053, "agent_compute-ego0": 0.010161507377284924, "complete-iteration": 0.22396836224224873, "set_robot_commands": 0.0021701509945470433, "deviation-center-line": 0.9563302962992344, "driven_lanedir_consec": 1.1386511383098072, "sim_compute_sim_state": 0.0117838227076771, "sim_compute_performance-ego0": 0.0019798186837035048}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.5652351463129267, "get_ui_image": 0.02564626269870334, "step_physics": 0.11576901541815864, "survival_time": 4.449999999999992, "driven_lanedir": 0.18359233031615396, "get_state_dump": 0.005333272616068522, "get_robot_state": 0.0035870975918240017, "sim_render-ego0": 0.003569589720831977, "get_duckie_state": 0.004141349262661404, "in-drivable-lane": 2.8499999999999917, "deviation-heading": 0.7761207528371414, "agent_compute-ego0": 0.009640256563822428, "complete-iteration": 0.177878295050727, "set_robot_commands": 0.0020756138695610894, "deviation-center-line": 0.14870375868501146, "driven_lanedir_consec": 0.18359233031615396, "sim_compute_sim_state": 0.006131169531080458, "sim_compute_performance-ego0": 0.001901804076300727}}
set_robot_commands_max0.0021701509945470433
set_robot_commands_mean0.002136102400788667
set_robot_commands_median0.0021493223695232674
set_robot_commands_min0.0020756138695610894
sim_compute_performance-ego0_max0.0020410347422328565
sim_compute_performance-ego0_mean0.0019683160674872024
sim_compute_performance-ego0_median0.001965212725707613
sim_compute_performance-ego0_min0.001901804076300727
sim_compute_sim_state_max0.014874450110514229
sim_compute_sim_state_mean0.009974004420183648
sim_compute_sim_state_median0.009445199019569956
sim_compute_sim_state_min0.006131169531080458
sim_render-ego0_max0.003920071168777046
sim_render-ego0_mean0.0037523456229725137
sim_render-ego0_median0.003759860801140515
sim_render-ego0_min0.003569589720831977
simulation-passed1
step_physics_max0.12682311031796517
step_physics_mean0.12116815922221227
step_physics_median0.1212536870470308
step_physics_min0.11534215247682236
survival_time_max21.750000000000178
survival_time_mean13.650000000000077
survival_time_min4.449999999999992
No reset possible
5345012573Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simsuccessyesnogpu-prod-050:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3579094317793634
survival_time_median8.425000000000008
deviation-center-line_median0.21236679449239873
in-drivable-lane_median6.025000000000009


other stats
agent_compute-ego0_max0.010958039432490638
agent_compute-ego0_mean0.010632569934613752
agent_compute-ego0_median0.010827282187721804
agent_compute-ego0_min0.009917675930520762
complete-iteration_max0.22538054152710796
complete-iteration_mean0.19850093717118517
complete-iteration_median0.2107173127832828
complete-iteration_min0.1471885815910671
deviation-center-line_max0.5964967745601558
deviation-center-line_mean0.3037866553491125
deviation-center-line_min0.19391625785149663
deviation-heading_max4.030174130599222
deviation-heading_mean1.5662700472035307
deviation-heading_median0.8378098930105895
deviation-heading_min0.5592862721937217
driven_any_max2.5770107475902955
driven_any_mean1.360021889155406
driven_any_median1.219952871297259
driven_any_min0.4231710664368103
driven_lanedir_consec_max0.7194134144724139
driven_lanedir_consec_mean0.4165275566138344
driven_lanedir_consec_min0.23087794842419673
driven_lanedir_max0.7194134144724139
driven_lanedir_mean0.4165275566138344
driven_lanedir_median0.3579094317793634
driven_lanedir_min0.23087794842419673
get_duckie_state_max1.7323625197104358e-06
get_duckie_state_mean1.5406150712223398e-06
get_duckie_state_median1.544367053551588e-06
get_duckie_state_min1.3413636580757473e-06
get_robot_state_max0.004116518856727914
get_robot_state_mean0.0039383553108667466
get_robot_state_median0.003988312344194041
get_robot_state_min0.0036602776983509894
get_state_dump_max0.005614385212937447
get_state_dump_mean0.005110027336627445
get_state_dump_median0.005126641951622115
get_state_dump_min0.0045724402303281035
get_ui_image_max0.03739398753571653
get_ui_image_mean0.03142525404440706
get_ui_image_median0.03194450160524302
get_ui_image_min0.024418025431425676
in-drivable-lane_max10.30000000000009
in-drivable-lane_mean5.925000000000026
in-drivable-lane_min1.3499999999999952
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.7192218816906563, "get_ui_image": 0.030183190599494022, "step_physics": 0.13719897751414448, "survival_time": 5.399999999999989, "driven_lanedir": 0.41855318778047534, "get_state_dump": 0.005164185795215292, "get_robot_state": 0.004039521611064946, "sim_render-ego0": 0.004089578576044205, "get_duckie_state": 1.7323625197104358e-06, "in-drivable-lane": 2.3999999999999915, "deviation-heading": 0.9046951075035689, "agent_compute-ego0": 0.010958039432490638, "complete-iteration": 0.2040675211390224, "set_robot_commands": 0.002418988341585212, "deviation-center-line": 0.22380117884654163, "driven_lanedir_consec": 0.41855318778047534, "sim_compute_sim_state": 0.007843096321875897, "sim_compute_performance-ego0": 0.002076437713903025}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.5770107475902955, "get_ui_image": 0.03739398753571653, "step_physics": 0.1389793079056426, "survival_time": 16.6500000000001, "driven_lanedir": 0.7194134144724139, "get_state_dump": 0.005089098108028938, "get_robot_state": 0.0039371030773231366, "sim_render-ego0": 0.004056347344449894, "get_duckie_state": 1.4198040533922389e-06, "in-drivable-lane": 10.30000000000009, "deviation-heading": 4.030174130599222, "agent_compute-ego0": 0.01089495598912953, "complete-iteration": 0.21736710442754323, "set_robot_commands": 0.0023696950809684344, "deviation-center-line": 0.5964967745601558, "driven_lanedir_consec": 0.7194134144724139, "sim_compute_sim_state": 0.01236456739688348, "sim_compute_performance-ego0": 0.002186738088459312}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.4231710664368103, "get_ui_image": 0.033705812610992016, "step_physics": 0.1510413215584951, "survival_time": 3.599999999999995, "driven_lanedir": 0.29726567577825147, "get_state_dump": 0.005614385212937447, "get_robot_state": 0.004116518856727914, "sim_render-ego0": 0.004183988048605723, "get_duckie_state": 1.6689300537109375e-06, "in-drivable-lane": 1.3499999999999952, "deviation-heading": 0.7709246785176104, "agent_compute-ego0": 0.010759608386314078, "complete-iteration": 0.22538054152710796, "set_robot_commands": 0.002310256435446543, "deviation-center-line": 0.19391625785149663, "driven_lanedir_consec": 0.29726567577825147, "sim_compute_sim_state": 0.01133509204812246, "sim_compute_performance-ego0": 0.0022130567733555625}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7206838609038615, "get_ui_image": 0.024418025431425676, "step_physics": 0.09059588494508164, "survival_time": 11.450000000000028, "driven_lanedir": 0.23087794842419673, "get_state_dump": 0.0045724402303281035, "get_robot_state": 0.0036602776983509894, "sim_render-ego0": 0.003665626567343007, "get_duckie_state": 1.3413636580757473e-06, "in-drivable-lane": 9.650000000000029, "deviation-heading": 0.5592862721937217, "agent_compute-ego0": 0.009917675930520762, "complete-iteration": 0.1471885815910671, "set_robot_commands": 0.0021110752354497496, "deviation-center-line": 0.20093241013825583, "driven_lanedir_consec": 0.23087794842419673, "sim_compute_sim_state": 0.006277761252030082, "sim_compute_performance-ego0": 0.0018896548644356105}}
set_robot_commands_max0.002418988341585212
set_robot_commands_mean0.002302503773362485
set_robot_commands_median0.0023399757582074888
set_robot_commands_min0.0021110752354497496
sim_compute_performance-ego0_max0.0022130567733555625
sim_compute_performance-ego0_mean0.0020914718600383774
sim_compute_performance-ego0_median0.0021315879011811686
sim_compute_performance-ego0_min0.0018896548644356105
sim_compute_sim_state_max0.01236456739688348
sim_compute_sim_state_mean0.00945512925472798
sim_compute_sim_state_median0.00958909418499918
sim_compute_sim_state_min0.006277761252030082
sim_render-ego0_max0.004183988048605723
sim_render-ego0_mean0.0039988851341107075
sim_render-ego0_median0.00407296296024705
sim_render-ego0_min0.003665626567343007
simulation-passed1
step_physics_max0.1510413215584951
step_physics_mean0.12945387298084096
step_physics_median0.13808914270989353
step_physics_min0.09059588494508164
survival_time_max16.6500000000001
survival_time_mean9.275000000000029
survival_time_min3.599999999999995
No reset possible
5342912577Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-050:17:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.46767534266050315
survival_time_median14.550000000000072
deviation-center-line_median0.4947914603921105
in-drivable-lane_median6.1250000000000435


other stats
agent_compute-ego0_max0.01067417629515927
agent_compute-ego0_mean0.010635014779713323
agent_compute-ego0_median0.010635014779713323
agent_compute-ego0_min0.01059585326426738
agent_compute-ego1_max0.010446322930825725
agent_compute-ego1_mean0.010372309581867096
agent_compute-ego1_median0.010372309581867096
agent_compute-ego1_min0.01029829623290847
agent_compute-ego2_max0.010741844907537237
agent_compute-ego2_mean0.010396144281049074
agent_compute-ego2_median0.010396144281049074
agent_compute-ego2_min0.010050443654560912
agent_compute-ego3_max0.01068904320838043
agent_compute-ego3_mean0.010590171740983196
agent_compute-ego3_median0.010590171740983196
agent_compute-ego3_min0.010491300273585963
complete-iteration_max0.9990478120408616
complete-iteration_mean0.9478181665749816
complete-iteration_median0.9478181665749816
complete-iteration_min0.8965885211091015
deviation-center-line_max1.2340961821728105
deviation-center-line_mean0.5740882372190792
deviation-center-line_min0.18439074482977807
deviation-heading_max9.89336417759698
deviation-heading_mean3.8469412731858306
deviation-heading_median2.5994044932190894
deviation-heading_min0.7805520674724286
driven_any_max2.811085470195488
driven_any_mean1.6353907877707912
driven_any_median1.6388351926111284
driven_any_min0.38992907230453727
driven_lanedir_consec_max1.729279566578996
driven_lanedir_consec_mean0.6731111064412199
driven_lanedir_consec_min0.3192616717652883
driven_lanedir_max1.985679044301906
driven_lanedir_mean0.7183405276415334
driven_lanedir_median0.5144441989315507
driven_lanedir_min0.3192616717652883
get_duckie_state_max2.047633597863972e-06
get_duckie_state_mean1.944735409650859e-06
get_duckie_state_median1.944735409650859e-06
get_duckie_state_min1.8418372214377463e-06
get_robot_state_max0.014895616973961256
get_robot_state_mean0.01485111937872488
get_robot_state_median0.01485111937872488
get_robot_state_min0.014806621783488506
get_state_dump_max0.010286526785371054
get_state_dump_mean0.010107259566784736
get_state_dump_median0.010107259566784736
get_state_dump_min0.009927992348198418
get_ui_image_max0.05456344791538808
get_ui_image_mean0.05318710540954995
get_ui_image_median0.05318710540954995
get_ui_image_min0.05181076290371182
in-drivable-lane_max14.700000000000127
in-drivable-lane_mean7.787500000000053
in-drivable-lane_min3.149999999999989
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 2.811085470195488, "get_ui_image": 0.05456344791538808, "step_physics": 0.7086342606096636, "survival_time": 18.05000000000012, "driven_lanedir": 1.985679044301906, "get_state_dump": 0.010286526785371054, "get_robot_state": 0.014895616973961256, "sim_render-ego0": 0.003943679741074367, "sim_render-ego1": 0.0038280322406832024, "sim_render-ego2": 0.0038034784201100382, "sim_render-ego3": 0.003868151764843345, "get_duckie_state": 2.047633597863972e-06, "in-drivable-lane": 5.4500000000000774, "deviation-heading": 1.1835461994210874, "agent_compute-ego0": 0.01067417629515927, "agent_compute-ego1": 0.01029829623290847, "agent_compute-ego2": 0.010050443654560912, "agent_compute-ego3": 0.01068904320838043, "complete-iteration": 0.8965885211091015, "set_robot_commands": 0.0023283174683375913, "deviation-center-line": 0.8433943002957107, "driven_lanedir_consec": 1.729279566578996, "sim_compute_sim_state": 0.03326428331722871, "sim_compute_performance-ego0": 0.00221443439715475, "sim_compute_performance-ego1": 0.0020189318209063284, "sim_compute_performance-ego2": 0.0020438011179971433, "sim_compute_performance-ego3": 0.0020523677214733145}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.281856013323797, "get_ui_image": 0.05456344791538808, "step_physics": 0.7086342606096636, "survival_time": 18.05000000000012, "driven_lanedir": 0.4319797592418459, "get_state_dump": 0.010286526785371054, "get_robot_state": 0.014895616973961256, "sim_render-ego0": 0.003943679741074367, "sim_render-ego1": 0.0038280322406832024, "sim_render-ego2": 0.0038034784201100382, "sim_render-ego3": 0.003868151764843345, "get_duckie_state": 2.047633597863972e-06, "in-drivable-lane": 14.050000000000129, "deviation-heading": 2.5819444733430332, "agent_compute-ego0": 0.01067417629515927, "agent_compute-ego1": 0.01029829623290847, "agent_compute-ego2": 0.010050443654560912, "agent_compute-ego3": 0.01068904320838043, "complete-iteration": 0.8965885211091015, "set_robot_commands": 0.0023283174683375913, "deviation-center-line": 0.34051915970784424, "driven_lanedir_consec": 0.4319797592418459, "sim_compute_sim_state": 0.03326428331722871, "sim_compute_performance-ego0": 0.00221443439715475, "sim_compute_performance-ego1": 0.0020189318209063284, "sim_compute_performance-ego2": 0.0020438011179971433, "sim_compute_performance-ego3": 0.0020523677214733145}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 2.05404400432433, "get_ui_image": 0.05456344791538808, "step_physics": 0.7086342606096636, "survival_time": 18.05000000000012, "driven_lanedir": 0.3452608587421049, "get_state_dump": 0.010286526785371054, "get_robot_state": 0.014895616973961256, "sim_render-ego0": 0.003943679741074367, "sim_render-ego1": 0.0038280322406832024, "sim_render-ego2": 0.0038034784201100382, "sim_render-ego3": 0.003868151764843345, "get_duckie_state": 2.047633597863972e-06, "in-drivable-lane": 14.700000000000127, "deviation-heading": 2.616864513095146, "agent_compute-ego0": 0.01067417629515927, "agent_compute-ego1": 0.01029829623290847, "agent_compute-ego2": 0.010050443654560912, "agent_compute-ego3": 0.01068904320838043, "complete-iteration": 0.8965885211091015, "set_robot_commands": 0.0023283174683375913, "deviation-center-line": 0.2744113396428254, "driven_lanedir_consec": 0.3452608587421049, "sim_compute_sim_state": 0.03326428331722871, "sim_compute_performance-ego0": 0.00221443439715475, "sim_compute_performance-ego1": 0.0020189318209063284, "sim_compute_performance-ego2": 0.0020438011179971433, "sim_compute_performance-ego3": 0.0020523677214733145}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 2.1921646557830226, "get_ui_image": 0.05456344791538808, "step_physics": 0.7086342606096636, "survival_time": 18.05000000000012, "driven_lanedir": 0.950247335154313, "get_state_dump": 0.010286526785371054, "get_robot_state": 0.014895616973961256, "sim_render-ego0": 0.003943679741074367, "sim_render-ego1": 0.0038280322406832024, "sim_render-ego2": 0.0038034784201100382, "sim_render-ego3": 0.003868151764843345, "get_duckie_state": 2.047633597863972e-06, "in-drivable-lane": 5.900000000000056, "deviation-heading": 9.89336417759698, "agent_compute-ego0": 0.01067417629515927, "agent_compute-ego1": 0.01029829623290847, "agent_compute-ego2": 0.010050443654560912, "agent_compute-ego3": 0.01068904320838043, "complete-iteration": 0.8965885211091015, "set_robot_commands": 0.0023283174683375913, "deviation-center-line": 1.2340961821728105, "driven_lanedir_consec": 0.9383491558168096, "sim_compute_sim_state": 0.03326428331722871, "sim_compute_performance-ego0": 0.00221443439715475, "sim_compute_performance-ego1": 0.0020189318209063284, "sim_compute_performance-ego2": 0.0020438011179971433, "sim_compute_performance-ego3": 0.0020523677214733145}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 1.6265458788524405, "get_ui_image": 0.05181076290371182, "step_physics": 0.8170517328623179, "survival_time": 11.050000000000022, "driven_lanedir": 0.5969086386212554, "get_state_dump": 0.009927992348198418, "get_robot_state": 0.014806621783488506, "sim_render-ego0": 0.00391433690045331, "sim_render-ego1": 0.003816589578851923, "sim_render-ego2": 0.003818088823610598, "sim_render-ego3": 0.003806490081924576, "get_duckie_state": 1.8418372214377463e-06, "in-drivable-lane": 4.099999999999986, "deviation-heading": 5.515599778378545, "agent_compute-ego0": 0.01059585326426738, "agent_compute-ego1": 0.010446322930825725, "agent_compute-ego2": 0.010741844907537237, "agent_compute-ego3": 0.010491300273585963, "complete-iteration": 0.9990478120408616, "set_robot_commands": 0.0023964289072397594, "deviation-center-line": 0.6490637610763768, "driven_lanedir_consec": 0.5033709260791603, "sim_compute_sim_state": 0.030363270828315803, "sim_compute_performance-ego0": 0.0021793616784585488, "sim_compute_performance-ego1": 0.002011116560514983, "sim_compute_performance-ego2": 0.0019911613550272073, "sim_compute_performance-ego3": 0.001969181739532196}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.6511245063698163, "get_ui_image": 0.05181076290371182, "step_physics": 0.8170517328623179, "survival_time": 11.050000000000022, "driven_lanedir": 0.7044487625693081, "get_state_dump": 0.009927992348198418, "get_robot_state": 0.014806621783488506, "sim_render-ego0": 0.00391433690045331, "sim_render-ego1": 0.003816589578851923, "sim_render-ego2": 0.003818088823610598, "sim_render-ego3": 0.003806490081924576, "get_duckie_state": 1.8418372214377463e-06, "in-drivable-lane": 6.350000000000031, "deviation-heading": 0.7805520674724286, "agent_compute-ego0": 0.01059585326426738, "agent_compute-ego1": 0.010446322930825725, "agent_compute-ego2": 0.010741844907537237, "agent_compute-ego3": 0.010491300273585963, "complete-iteration": 0.9990478120408616, "set_robot_commands": 0.0023964289072397594, "deviation-center-line": 0.20859790767505185, "driven_lanedir_consec": 0.7044487625693081, "sim_compute_sim_state": 0.030363270828315803, "sim_compute_performance-ego0": 0.0021793616784585488, "sim_compute_performance-ego1": 0.002011116560514983, "sim_compute_performance-ego2": 0.0019911613550272073, "sim_compute_performance-ego3": 0.001969181739532196}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 1.076376701012898, "get_ui_image": 0.05181076290371182, "step_physics": 0.8170517328623179, "survival_time": 11.050000000000022, "driven_lanedir": 0.4129381507362462, "get_state_dump": 0.009927992348198418, "get_robot_state": 0.014806621783488506, "sim_render-ego0": 0.00391433690045331, "sim_render-ego1": 0.003816589578851923, "sim_render-ego2": 0.003818088823610598, "sim_render-ego3": 0.003806490081924576, "get_duckie_state": 1.8418372214377463e-06, "in-drivable-lane": 3.149999999999989, "deviation-heading": 7.197997781935392, "agent_compute-ego0": 0.01059585326426738, "agent_compute-ego1": 0.010446322930825725, "agent_compute-ego2": 0.010741844907537237, "agent_compute-ego3": 0.010491300273585963, "complete-iteration": 0.9990478120408616, "set_robot_commands": 0.0023964289072397594, "deviation-center-line": 0.8582325023522362, "driven_lanedir_consec": 0.4129381507362462, "sim_compute_sim_state": 0.030363270828315803, "sim_compute_performance-ego0": 0.0021793616784585488, "sim_compute_performance-ego1": 0.002011116560514983, "sim_compute_performance-ego2": 0.0019911613550272073, "sim_compute_performance-ego3": 0.001969181739532196}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.38992907230453727, "get_ui_image": 0.05181076290371182, "step_physics": 0.8170517328623179, "survival_time": 11.050000000000022, "driven_lanedir": 0.3192616717652883, "get_state_dump": 0.009927992348198418, "get_robot_state": 0.014806621783488506, "sim_render-ego0": 0.00391433690045331, "sim_render-ego1": 0.003816589578851923, "sim_render-ego2": 0.003818088823610598, "sim_render-ego3": 0.003806490081924576, "get_duckie_state": 1.8418372214377463e-06, "in-drivable-lane": 8.600000000000023, "deviation-heading": 1.0056611942440323, "agent_compute-ego0": 0.01059585326426738, "agent_compute-ego1": 0.010446322930825725, "agent_compute-ego2": 0.010741844907537237, "agent_compute-ego3": 0.010491300273585963, "complete-iteration": 0.9990478120408616, "set_robot_commands": 0.0023964289072397594, "deviation-center-line": 0.18439074482977807, "driven_lanedir_consec": 0.3192616717652883, "sim_compute_sim_state": 0.030363270828315803, "sim_compute_performance-ego0": 0.0021793616784585488, "sim_compute_performance-ego1": 0.002011116560514983, "sim_compute_performance-ego2": 0.0019911613550272073, "sim_compute_performance-ego3": 0.001969181739532196}}
set_robot_commands_max0.0023964289072397594
set_robot_commands_mean0.0023623731877886753
set_robot_commands_median0.0023623731877886753
set_robot_commands_min0.0023283174683375913
sim_compute_performance-ego0_max0.00221443439715475
sim_compute_performance-ego0_mean0.0021968980378066494
sim_compute_performance-ego0_median0.0021968980378066494
sim_compute_performance-ego0_min0.0021793616784585488
sim_compute_performance-ego1_max0.0020189318209063284
sim_compute_performance-ego1_mean0.0020150241907106554
sim_compute_performance-ego1_median0.0020150241907106554
sim_compute_performance-ego1_min0.002011116560514983
sim_compute_performance-ego2_max0.0020438011179971433
sim_compute_performance-ego2_mean0.002017481236512175
sim_compute_performance-ego2_median0.002017481236512175
sim_compute_performance-ego2_min0.0019911613550272073
sim_compute_performance-ego3_max0.0020523677214733145
sim_compute_performance-ego3_mean0.0020107747305027554
sim_compute_performance-ego3_median0.0020107747305027554
sim_compute_performance-ego3_min0.001969181739532196
sim_compute_sim_state_max0.03326428331722871
sim_compute_sim_state_mean0.031813777072772255
sim_compute_sim_state_median0.031813777072772255
sim_compute_sim_state_min0.030363270828315803
sim_render-ego0_max0.003943679741074367
sim_render-ego0_mean0.0039290083207638386
sim_render-ego0_median0.0039290083207638386
sim_render-ego0_min0.00391433690045331
sim_render-ego1_max0.0038280322406832024
sim_render-ego1_mean0.0038223109097675623
sim_render-ego1_median0.0038223109097675623
sim_render-ego1_min0.003816589578851923
sim_render-ego2_max0.003818088823610598
sim_render-ego2_mean0.0038107836218603183
sim_render-ego2_median0.0038107836218603183
sim_render-ego2_min0.0038034784201100382
sim_render-ego3_max0.003868151764843345
sim_render-ego3_mean0.00383732092338396
sim_render-ego3_median0.00383732092338396
sim_render-ego3_min0.003806490081924576
simulation-passed1
step_physics_max0.8170517328623179
step_physics_mean0.7628429967359908
step_physics_median0.7628429967359908
step_physics_min0.7086342606096636
survival_time_max18.05000000000012
survival_time_mean14.550000000000072
survival_time_min11.050000000000022
No reset possible
5341311681Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simabortednonogpu-prod-050:00:38
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5340311410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simabortednonogpu-prod-050:00:36
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5337812572Bea Baselines 🐤straightaido5-LFI-full-sim-validationLFVIv-simabortednonogpu-prod-050:46:07
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5335912605Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simabortednonogpu-prod-050:02:30
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5334212570Bea Baselines 🐤straightaido5-LFI-sim-validationLFVIv-simabortednonogpu-prod-050:06:24
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5332912534Bea Baselines 🐤template-rosaido5-LFV-sim-validationLFVv-simabortednonogpu-prod-050:09:10
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5329212476Bea Baselines 🐤straightaido5-LFP-sim-validationLFP-simabortednonogpu-prod-050:19:39
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5325912546Bea Baselines 🐤template-rosaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-050:02:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140374802864064
- M:video_aido:cmdline(in:/;out:/) 140374802855824
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5321612478Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornonogpu-prod-050:08:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139917276037376
- M:video_aido:cmdline(in:/;out:/) 139917276728000
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5319812484Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simerrornonogpu-prod-050:02:52
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139825317469536
- M:video_aido:cmdline(in:/;out:/) 139825317240448
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5317711763Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-050:09:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139626965551280
- M:video_aido:cmdline(in:/;out:/) 139626965969408
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5313611774Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-050:09:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140624442739584
- M:video_aido:cmdline(in:/;out:/) 140624442737328
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5312612341Bea Baselines 🐤template-rosaido5-LFP-sim-validationLFP-simerrornonogpu-prod-050:02:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140627148312832
- M:video_aido:cmdline(in:/;out:/) 140627148378752
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5310911777Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-050:03:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140696484485632
- M:video_aido:cmdline(in:/;out:/) 140696484484816
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5309611868Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simhost-errornonogpu-prod-050:01:33
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5307512347Bea Baselines 🐤template-rosaido5-LFI-full-sim-validationLFVIv-simerrornonogpu-prod-050:01:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140404484660432
- M:video_aido:cmdline(in:/;out:/) 140404484660288
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5306412348Bea Baselines 🐤template-rosaido5-LF-sim-testingLFt-simerrornonogpu-prod-050:01:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139800310721552
- M:video_aido:cmdline(in:/;out:/) 139800310720400
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5302212389Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-testingLFVmultibodyv-simerrornonogpu-prod-050:30:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139911292962896
- M:video_aido:cmdline(in:/;out:/) 139911292963232
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5297012397Bea Baselines 🐤baseline-duckietownaido5-LFVI_multi-sim-validationLFVIv-simhost-errornonogpu-prod-050:16:06
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5295412408Bea Baselines 🐤template-randomaido5-LFI-full-sim-validationLFVIv-simerrornonogpu-prod-050:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140174319660672
- M:video_aido:cmdline(in:/;out:/) 140174318928848
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5294012407Bea Baselines 🐤template-randomaido5-LFI-sim-testingLFVIv-simerrornonogpu-prod-050:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140620182211840
- M:video_aido:cmdline(in:/;out:/) 140620182225536
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5292712410Bea Baselines 🐤template-randomaido5-LFV-sim-testingLFVv-simerrornonogpu-prod-050:01:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140656382690064
- M:video_aido:cmdline(in:/;out:/) 140656382679264
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5287411410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simerrornonogpu-prod-050:09:11
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140166643282992
- M:video_aido:cmdline(in:/;out:/) 140166643250080
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5285012431Bea Baselines 🐤straightaido5-LFP-sim-validationLFP-simerrornonogpu-prod-050:01:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140408281078320
- M:video_aido:cmdline(in:/;out:/) 140408281220192
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5283912434Bea Baselines 🐤straightaido5-LFV_multi-sim-testingLFVmultibodyv-simabortednonogpu-prod-050:00:30
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5282412438Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simerrornonogpu-prod-050:01:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140372771929344
- M:video_aido:cmdline(in:/;out:/) 140372772344736
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5279311410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simabortednonogpu-prod-050:03:14
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5277312224Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simerrornonogpu-prod-050:02:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139624790636432
- M:video_aido:cmdline(in:/;out:/) 139624790634848
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5276012393Bea Baselines 🐤baseline-duckietownaido5-LF-sim-testingLFt-simabortednonogpu-prod-050:00:30
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5275112337Bea Baselines 🐤template-randomaido5-LFVI_multi-sim-validationLFVIv-simabortednonogpu-prod-050:01:58
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5267611772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednonogpu-prod-050:00:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
526526800Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simfailednonogpu-prod-050:01:10
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 39, in on_received_observations
              ||     jpg_data = data['camera']['jpg_data']
              || TypeError: 'Duckiebot1Observations' object is not subscriptable
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
              ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
              || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method ROSBaselineAgent.on_received_observations of <__main__.ROSBaselineAgent object at 0x7f6bd444f3d0>>.
              || │       f: <bound method ROSBaselineAgent.on_received_observations of <__main__.ROSBaselineAgent object at 0x7f6bd444f3d0>>
              || │    args: dict[2]
              || │          │ data:
              || │          │ Duckiebot1Observations
              || │          │ │ camera: JPGImage(jpg_data=70473 bytes b'\xff\xd8\xff\xe0\x00\x10JFIF')
              || │          │ context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f6bb8395fa0>
              || │ argspec: <class 'inspect.FullArgSpec'>[7]
              || │          #0 [self, context, data]
              || │          #1 None
              || │          #2 None
              || │          #3 None
              || │          #4 []
              || │          #5 None
              || │          #6 dict[2]
              || │             │ context: <class 'zuper_nodes_wrapper.interface.Context'>
              || │             │ data:
              || │             │ dataclass aido_schemas.schemas.Duckiebot1Observations
              || │             │  field  camera : dataclass aido_schemas.protocol_simulator.JPGImage
              || │             │                   field jpg_data : bytes
              || │             │                          __doc__
              || │             │                                            An image in JPG format.
              || │             │
              || │             │                                            jpg_data
              || │             │        __doc__   Duckiebot1Observations(camera: aido_schemas.protoc
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
526016802Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-050:03:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525756805Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simfailednonogpu-prod-050:02:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525069274Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-050:11:24
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524716842Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-050:04:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139712162812064
- M:video_aido:cmdline(in:/;out:/) 139712162730624
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524409286Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-050:03:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524119312Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-050:03:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139751068943744
- M:video_aido:cmdline(in:/;out:/) 139751070121216
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
523649297Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-050:03:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
523109324Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-050:08:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140197553323216
- M:video_aido:cmdline(in:/;out:/) 140197374438512
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5226410048Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-050:05:52
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140675159237392
- M:video_aido:cmdline(in:/;out:/) 140675158801664
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
522319373Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-050:02:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140537611121424
- M:video_aido:cmdline(in:/;out:/) 140537612778656
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
521799381Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-050:03:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139910471557904
- M:video_aido:cmdline(in:/;out:/) 139910471690848
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5211010014Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-050:10:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139665293225408
- M:video_aido:cmdline(in:/;out:/) 139665293224928
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5208310066Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-050:02:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140521246494000
- M:video_aido:cmdline(in:/;out:/) 140521246491600
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5199110048Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simtimeoutnonogpu-prod-050:13:10
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5194710058Jean-Sébastien Grondin 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-050:03:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140307771509104
- M:video_aido:cmdline(in:/;out:/) 140307771509392
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5188410763Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-050:04:30
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140321321896160
- M:video_aido:cmdline(in:/;out:/) 140321357081280
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5186910367Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-050:01:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139809121899040
- M:video_aido:cmdline(in:/;out:/) 139809121900672
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5177410761Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-050:08:51
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139621818492912
- M:video_aido:cmdline(in:/;out:/) 139621818494448
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5169910827Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-050:08:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140563946377168
- M:video_aido:cmdline(in:/;out:/) 140563946375440
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5166910833Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-050:02:55
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 30 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5162110815Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-050:05:11
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140084851986336
- M:video_aido:cmdline(in:/;out:/) 140084851984416
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5156210831Raphael Jeanreal-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-050:06:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140442073902336
- M:video_aido:cmdline(in:/;out:/) 140442073923696
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes: