Duckietown Challenges Home Challenges Submissions

Evaluator 4718

ID4718
evaluatorgpu-prod-01
ownerI don't have one 😀
machinegpu_15e5cbf8d1df
processgpu-prod-01_15e5cbf8d1df
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success54 53431
# timeout3 50141
# failed29 47670
# error88 47705
# aborted25 47256
# host-error13 47857
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
581429340Jerome Labonte 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simtimeoutyesgpu-prod-01----No reset possible
581379364Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
581329371Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:04:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47469644768734554
survival_time_median5.799999999999987
deviation-center-line_median0.1652944732306097
in-drivable-lane_median3.424999999999989


other stats
agent_compute-ego0_max0.01382817198696746
agent_compute-ego0_mean0.012755732551247512
agent_compute-ego0_median0.012507190294422484
agent_compute-ego0_min0.01218037762917763
complete-iteration_max0.19003757165402785
complete-iteration_mean0.171097195250837
complete-iteration_median0.1741588892308361
complete-iteration_min0.1460334308876479
deviation-center-line_max0.2107574672154177
deviation-center-line_mean0.1581138428629571
deviation-center-line_min0.09110895777519126
deviation-heading_max1.6028043324994483
deviation-heading_mean0.9765701606930464
deviation-heading_median0.9303809734441494
deviation-heading_min0.4427143633844387
driven_any_max2.7421381859627276
driven_any_mean1.6170509091491754
driven_any_median1.3305380001207268
driven_any_min1.0649894503925208
driven_lanedir_consec_max0.6308086958038627
driven_lanedir_consec_mean0.4762920812562057
driven_lanedir_consec_min0.32496673384626873
driven_lanedir_max0.6308086958038627
driven_lanedir_mean0.4762920812562057
driven_lanedir_median0.47469644768734554
driven_lanedir_min0.32496673384626873
get_duckie_state_max1.840354982486441e-06
get_duckie_state_mean1.790634910644407e-06
get_duckie_state_median1.800253566563846e-06
get_duckie_state_min1.7216775269634955e-06
get_robot_state_max0.0037621929220957298
get_robot_state_mean0.003598052634700853
get_robot_state_median0.003562041480256929
get_robot_state_min0.003505934656193826
get_state_dump_max0.004582935272286472
get_state_dump_mean0.004471293400712769
get_state_dump_median0.004502654447586104
get_state_dump_min0.004296929435392396
get_ui_image_max0.03643066482206361
get_ui_image_mean0.03106379994801351
get_ui_image_median0.030859677847806345
get_ui_image_min0.026105179274377745
in-drivable-lane_max8.850000000000005
in-drivable-lane_mean4.462499999999994
in-drivable-lane_min2.1499999999999924
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.7421381859627276, "get_ui_image": 0.02842319392722491, "step_physics": 0.0903270865139896, "survival_time": 10.90000000000002, "driven_lanedir": 0.32496673384626873, "get_state_dump": 0.004582935272286472, "get_robot_state": 0.0037621929220957298, "sim_render-ego0": 0.0039798865035244315, "get_duckie_state": 1.7734423075636772e-06, "in-drivable-lane": 8.850000000000005, "deviation-heading": 1.3836203939543363, "agent_compute-ego0": 0.01382817198696746, "complete-iteration": 0.15902993450426076, "set_robot_commands": 0.002308665889583222, "deviation-center-line": 0.2107574672154177, "driven_lanedir_consec": 0.32496673384626873, "sim_compute_sim_state": 0.009714092838165425, "sim_compute_performance-ego0": 0.002030624102239739}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2746330422663896, "get_ui_image": 0.03643066482206361, "step_physics": 0.11554833851029388, "survival_time": 5.599999999999988, "driven_lanedir": 0.3485414367201807, "get_state_dump": 0.004296929435392396, "get_robot_state": 0.003505934656193826, "sim_render-ego0": 0.0036096340787094257, "get_duckie_state": 1.7216775269634955e-06, "in-drivable-lane": 3.3999999999999906, "deviation-heading": 1.6028043324994483, "agent_compute-ego0": 0.01235421779936394, "complete-iteration": 0.1892878439574115, "set_robot_commands": 0.0020658421305428565, "deviation-center-line": 0.17269441294522414, "driven_lanedir_consec": 0.3485414367201807, "sim_compute_sim_state": 0.00955655722491509, "sim_compute_performance-ego0": 0.0018503581528115064}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0649894503925208, "get_ui_image": 0.033296161768387775, "step_physics": 0.11968599290263895, "survival_time": 4.849999999999991, "driven_lanedir": 0.6308086958038627, "get_state_dump": 0.0045427278596527725, "get_robot_state": 0.0035644088472638813, "sim_render-ego0": 0.003878929177109076, "get_duckie_state": 1.8270648255640147e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 0.4771415529339624, "agent_compute-ego0": 0.012660162789481028, "complete-iteration": 0.19003757165402785, "set_robot_commands": 0.0022201392115378865, "deviation-center-line": 0.09110895777519126, "driven_lanedir_consec": 0.6308086958038627, "sim_compute_sim_state": 0.008166697560524454, "sim_compute_performance-ego0": 0.001950847859285316}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3864429579750637, "get_ui_image": 0.026105179274377745, "step_physics": 0.08705854415893555, "survival_time": 5.999999999999987, "driven_lanedir": 0.6008514586545104, "get_state_dump": 0.004462581035519435, "get_robot_state": 0.003559674113249976, "sim_render-ego0": 0.003668917112114016, "get_duckie_state": 1.840354982486441e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.4427143633844387, "agent_compute-ego0": 0.01218037762917763, "complete-iteration": 0.1460334308876479, "set_robot_commands": 0.0020906570529149585, "deviation-center-line": 0.15789453351599525, "driven_lanedir_consec": 0.6008514586545104, "sim_compute_sim_state": 0.004977919838645242, "sim_compute_performance-ego0": 0.0018608944475158188}}
set_robot_commands_max0.002308665889583222
set_robot_commands_mean0.00217132607114473
set_robot_commands_median0.0021553981322264227
set_robot_commands_min0.0020658421305428565
sim_compute_performance-ego0_max0.002030624102239739
sim_compute_performance-ego0_mean0.001923181140463095
sim_compute_performance-ego0_median0.0019058711534005672
sim_compute_performance-ego0_min0.0018503581528115064
sim_compute_sim_state_max0.009714092838165425
sim_compute_sim_state_mean0.008103816865562552
sim_compute_sim_state_median0.008861627392719772
sim_compute_sim_state_min0.004977919838645242
sim_render-ego0_max0.0039798865035244315
sim_render-ego0_mean0.003784341717864237
sim_render-ego0_median0.003773923144611546
sim_render-ego0_min0.0036096340787094257
simulation-passed1
step_physics_max0.11968599290263895
step_physics_mean0.1031549905214645
step_physics_median0.10293771251214172
step_physics_min0.08705854415893555
survival_time_max10.90000000000002
survival_time_mean6.837499999999996
survival_time_min4.849999999999991
No reset possible
581209379Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:08:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.664586287619241
survival_time_median7.799999999999983
deviation-center-line_median0.18589507121796056
in-drivable-lane_median4.824999999999986


other stats
agent_compute-ego0_max0.013354838335955584
agent_compute-ego0_mean0.012840156664322554
agent_compute-ego0_median0.012733931381880958
agent_compute-ego0_min0.012537925557572712
complete-iteration_max0.19371954161545327
complete-iteration_mean0.17362162322233787
complete-iteration_median0.174371063165065
complete-iteration_min0.1520248249437682
deviation-center-line_max0.7912525173354148
deviation-center-line_mean0.31388639712890726
deviation-center-line_min0.09250292874429314
deviation-heading_max3.2542913673840577
deviation-heading_mean1.3899664044572266
deviation-heading_median0.9118944807681812
deviation-heading_min0.4817852889084867
driven_any_max5.848500177104306
driven_any_mean2.5703552151823112
driven_any_median1.575655852130133
driven_any_min1.2816089793646732
driven_lanedir_consec_max2.503869486648233
driven_lanedir_consec_mean1.119162856171703
driven_lanedir_consec_min0.6436093628000976
driven_lanedir_max2.503869486648233
driven_lanedir_mean1.119162856171703
driven_lanedir_median0.664586287619241
driven_lanedir_min0.6436093628000976
get_duckie_state_max1.2291802300347223e-06
get_duckie_state_mean1.115572935576448e-06
get_duckie_state_median1.0870447258053202e-06
get_duckie_state_min1.0590220606604288e-06
get_robot_state_max0.003597341212191323
get_robot_state_mean0.003542802092952411
get_robot_state_median0.003530260551325967
get_robot_state_min0.0035133460569663866
get_state_dump_max0.004453338948331138
get_state_dump_mean0.004423030067607054
get_state_dump_median0.00443970170514337
get_state_dump_min0.004359377911810339
get_ui_image_max0.035940920073410564
get_ui_image_mean0.030788036563594245
get_ui_image_median0.03043918971046099
get_ui_image_min0.026332846760044437
in-drivable-lane_max20.30000000000027
in-drivable-lane_mean8.337500000000059
in-drivable-lane_min3.399999999999988
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.848500177104306, "get_ui_image": 0.028287716429362925, "step_physics": 0.09958602920059086, "survival_time": 32.20000000000031, "driven_lanedir": 2.503869486648233, "get_state_dump": 0.004453338948331138, "get_robot_state": 0.003597341212191323, "sim_render-ego0": 0.003926581005717433, "get_duckie_state": 1.0590220606604288e-06, "in-drivable-lane": 20.30000000000027, "deviation-heading": 3.2542913673840577, "agent_compute-ego0": 0.012537925557572712, "complete-iteration": 0.16763352090998213, "set_robot_commands": 0.0022916727287824764, "deviation-center-line": 0.7912525173354148, "driven_lanedir_consec": 2.503869486648233, "sim_compute_sim_state": 0.01086082236711369, "sim_compute_performance-ego0": 0.0020185470581054687}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2816089793646732, "get_ui_image": 0.035940920073410564, "step_physics": 0.11921850072926488, "survival_time": 7.199999999999982, "driven_lanedir": 0.6436093628000976, "get_state_dump": 0.0044364731887291215, "get_robot_state": 0.003520245387636382, "sim_render-ego0": 0.003716771355990706, "get_duckie_state": 1.0835713353650324e-06, "in-drivable-lane": 3.399999999999988, "deviation-heading": 1.306559101290942, "agent_compute-ego0": 0.012820462522835568, "complete-iteration": 0.19371954161545327, "set_robot_commands": 0.00235194337779078, "deviation-center-line": 0.23717552402323355, "driven_lanedir_consec": 0.6436093628000976, "sim_compute_sim_state": 0.009780178398921572, "sim_compute_performance-ego0": 0.0018619175614981815}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4262069309267722, "get_ui_image": 0.03259066299155906, "step_physics": 0.11059750804194696, "survival_time": 6.699999999999984, "driven_lanedir": 0.6509130328483849, "get_state_dump": 0.004442930221557617, "get_robot_state": 0.0035402757150155527, "sim_render-ego0": 0.003889133312084057, "get_duckie_state": 1.2291802300347223e-06, "in-drivable-lane": 4.099999999999985, "deviation-heading": 0.4817852889084867, "agent_compute-ego0": 0.013354838335955584, "complete-iteration": 0.18110860542014792, "set_robot_commands": 0.0021888997819688584, "deviation-center-line": 0.09250292874429314, "driven_lanedir_consec": 0.6509130328483849, "sim_compute_sim_state": 0.008463645864416051, "sim_compute_performance-ego0": 0.001966962107905635}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.725104773333494, "get_ui_image": 0.026332846760044437, "step_physics": 0.09246573645687668, "survival_time": 8.399999999999984, "driven_lanedir": 0.678259542390097, "get_state_dump": 0.004359377911810339, "get_robot_state": 0.0035133460569663866, "sim_render-ego0": 0.0037024684206268497, "get_duckie_state": 1.0905181162456085e-06, "in-drivable-lane": 5.5499999999999865, "deviation-heading": 0.5172298602454205, "agent_compute-ego0": 0.012647400240926348, "complete-iteration": 0.1520248249437682, "set_robot_commands": 0.002074904695770444, "deviation-center-line": 0.13461461841268754, "driven_lanedir_consec": 0.678259542390097, "sim_compute_sim_state": 0.004990797776442308, "sim_compute_performance-ego0": 0.0018664972316583936}}
set_robot_commands_max0.00235194337779078
set_robot_commands_mean0.00222685514607814
set_robot_commands_median0.0022402862553756674
set_robot_commands_min0.002074904695770444
sim_compute_performance-ego0_max0.0020185470581054687
sim_compute_performance-ego0_mean0.00192848098979192
sim_compute_performance-ego0_median0.0019167296697820144
sim_compute_performance-ego0_min0.0018619175614981815
sim_compute_sim_state_max0.01086082236711369
sim_compute_sim_state_mean0.008523861101723405
sim_compute_sim_state_median0.00912191213166881
sim_compute_sim_state_min0.004990797776442308
sim_render-ego0_max0.003926581005717433
sim_render-ego0_mean0.0038087385236047614
sim_render-ego0_median0.003802952334037381
sim_render-ego0_min0.0037024684206268497
simulation-passed1
step_physics_max0.11921850072926488
step_physics_mean0.10546694360716984
step_physics_median0.10509176862126891
step_physics_min0.09246573645687668
survival_time_max32.20000000000031
survival_time_mean13.625000000000064
survival_time_min6.699999999999984
No reset possible
581129693Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 172 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
581109760Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 166 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
581039761Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 180 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
580999772Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:03:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4878194764503748
survival_time_median4.94999999999999
deviation-center-line_median0.12630906156743948
in-drivable-lane_median2.874999999999992


other stats
agent_compute-ego0_max0.01709718330233705
agent_compute-ego0_mean0.014167568880155204
agent_compute-ego0_median0.01331767120531627
agent_compute-ego0_min0.012937749807651226
complete-iteration_max0.18851732964418372
complete-iteration_mean0.17848007109434844
complete-iteration_median0.1823460224729318
complete-iteration_min0.16071090978734634
deviation-center-line_max0.13724062151319663
deviation-center-line_mean0.12368389871311487
deviation-center-line_min0.10487685020438396
deviation-heading_max1.300849486169797
deviation-heading_mean0.6920282708280252
deviation-heading_median0.5597693887704731
deviation-heading_min0.3477248196013577
driven_any_max1.436048932677318
driven_any_mean1.2919208887514126
driven_any_median1.3661701504181052
driven_any_min0.9992943214921226
driven_lanedir_consec_max0.6829888011023852
driven_lanedir_consec_mean0.46523199756675665
driven_lanedir_consec_min0.2023002362638917
driven_lanedir_max0.6829888011023852
driven_lanedir_mean0.46523199756675665
driven_lanedir_median0.4878194764503748
driven_lanedir_min0.2023002362638917
get_duckie_state_max1.2809155034083945e-06
get_duckie_state_mean1.1567349173294878e-06
get_duckie_state_median1.1353538586543157e-06
get_duckie_state_min1.0753164486009248e-06
get_robot_state_max0.003661952766717649
get_robot_state_mean0.0035816375479342023
get_robot_state_median0.003606070348849663
get_robot_state_min0.003452456727319834
get_state_dump_max0.004524418711662292
get_state_dump_mean0.004391091679754866
get_state_dump_median0.004419463747047551
get_state_dump_min0.004201020513262067
get_ui_image_max0.03554749002262038
get_ui_image_mean0.03060047264029787
get_ui_image_median0.030498231718173393
get_ui_image_min0.025857937102224313
in-drivable-lane_max3.0999999999999934
in-drivable-lane_mean2.862499999999992
in-drivable-lane_min2.5999999999999908
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.9992943214921226, "get_ui_image": 0.028178730607032777, "step_physics": 0.11193726360797882, "survival_time": 3.949999999999994, "driven_lanedir": 0.2023002362638917, "get_state_dump": 0.004524418711662292, "get_robot_state": 0.0036475628614425657, "sim_render-ego0": 0.004051503539085388, "get_duckie_state": 1.087784767150879e-06, "in-drivable-lane": 2.949999999999994, "deviation-heading": 0.3477248196013577, "agent_compute-ego0": 0.013669952750205994, "complete-iteration": 0.17856939136981964, "set_robot_commands": 0.002364656329154968, "deviation-center-line": 0.10487685020438396, "driven_lanedir_consec": 0.2023002362638917, "sim_compute_sim_state": 0.00802357792854309, "sim_compute_performance-ego0": 0.002096077799797058}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3312319676747273, "get_ui_image": 0.03554749002262038, "step_physics": 0.1152703859368149, "survival_time": 4.849999999999991, "driven_lanedir": 0.33248639976392735, "get_state_dump": 0.004201020513262067, "get_robot_state": 0.003452456727319834, "sim_render-ego0": 0.003619709793402224, "get_duckie_state": 1.0753164486009248e-06, "in-drivable-lane": 3.0999999999999934, "deviation-heading": 1.300849486169797, "agent_compute-ego0": 0.01296538966042655, "complete-iteration": 0.18851732964418372, "set_robot_commands": 0.002018979617527553, "deviation-center-line": 0.13116767334226032, "driven_lanedir_consec": 0.33248639976392735, "sim_compute_sim_state": 0.009540338905490177, "sim_compute_performance-ego0": 0.0018279601116569675}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.436048932677318, "get_ui_image": 0.03281773282931401, "step_physics": 0.11601037245530348, "survival_time": 5.14999999999999, "driven_lanedir": 0.6829888011023852, "get_state_dump": 0.00436470600274893, "get_robot_state": 0.0035645778362567607, "sim_render-ego0": 0.003729760646820069, "get_duckie_state": 1.1829229501577524e-06, "in-drivable-lane": 2.5999999999999908, "deviation-heading": 0.7485124898694265, "agent_compute-ego0": 0.012937749807651226, "complete-iteration": 0.18612265357604393, "set_robot_commands": 0.002152174711227417, "deviation-center-line": 0.13724062151319663, "driven_lanedir_consec": 0.6829888011023852, "sim_compute_sim_state": 0.008556040433736948, "sim_compute_performance-ego0": 0.0019070345621842605}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.401108333161483, "get_ui_image": 0.025857937102224313, "step_physics": 0.09658537425246894, "survival_time": 5.04999999999999, "driven_lanedir": 0.6431525531368223, "get_state_dump": 0.0044742214913461725, "get_robot_state": 0.003661952766717649, "sim_render-ego0": 0.003742012323117724, "get_duckie_state": 1.2809155034083945e-06, "in-drivable-lane": 2.79999999999999, "deviation-heading": 0.37102628767151974, "agent_compute-ego0": 0.01709718330233705, "complete-iteration": 0.16071090978734634, "set_robot_commands": 0.0022261516720640893, "deviation-center-line": 0.12145044979261864, "driven_lanedir_consec": 0.6431525531368223, "sim_compute_sim_state": 0.00503853021883497, "sim_compute_performance-ego0": 0.001941807129803826}}
set_robot_commands_max0.002364656329154968
set_robot_commands_mean0.0021904905824935072
set_robot_commands_median0.002189163191645753
set_robot_commands_min0.002018979617527553
sim_compute_performance-ego0_max0.002096077799797058
sim_compute_performance-ego0_mean0.001943219900860528
sim_compute_performance-ego0_median0.001924420845994043
sim_compute_performance-ego0_min0.0018279601116569675
sim_compute_sim_state_max0.009540338905490177
sim_compute_sim_state_mean0.007789621871651296
sim_compute_sim_state_median0.008289809181140018
sim_compute_sim_state_min0.00503853021883497
sim_render-ego0_max0.004051503539085388
sim_render-ego0_mean0.003785746575606351
sim_render-ego0_median0.003735886484968896
sim_render-ego0_min0.003619709793402224
simulation-passed1
step_physics_max0.11601037245530348
step_physics_mean0.10995084906314154
step_physics_median0.11360382477239686
step_physics_min0.09658537425246894
survival_time_max5.14999999999999
survival_time_mean4.749999999999991
survival_time_min3.949999999999994
No reset possible
580929762Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 174 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5807710018Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:29:26
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.674327842779965
survival_time_median59.99999999999873
deviation-center-line_median3.088156441438067
in-drivable-lane_median8.099999999999902


other stats
agent_compute-ego0_max0.013006936104271833
agent_compute-ego0_mean0.012540798338495878
agent_compute-ego0_median0.012659930341885063
agent_compute-ego0_min0.01183639656594155
complete-iteration_max0.1861827952713616
complete-iteration_mean0.16808114663093324
complete-iteration_median0.17102153444171053
complete-iteration_min0.14409872236895024
deviation-center-line_max3.8528252604487774
deviation-center-line_mean3.045781054599126
deviation-center-line_min2.153986075071594
deviation-heading_max15.560536791766536
deviation-heading_mean12.6436555486199
deviation-heading_median12.638978633630876
deviation-heading_min9.73612813545131
driven_any_max12.27559320304324
driven_any_mean8.562767301906662
driven_any_median8.66915844334013
driven_any_min4.637159117903151
driven_lanedir_consec_max11.268769760145537
driven_lanedir_consec_mean7.058648004242245
driven_lanedir_consec_min3.617166571263514
driven_lanedir_max11.268769760145537
driven_lanedir_mean7.060146488600249
driven_lanedir_median6.675352006935174
driven_lanedir_min3.621112180385114
get_duckie_state_max1.2300095887704255e-06
get_duckie_state_mean1.1962929400810813e-06
get_duckie_state_median1.1880856897385735e-06
get_duckie_state_min1.1789907920767523e-06
get_robot_state_max0.003675696851808165
get_robot_state_mean0.0035413834145643173
get_robot_state_median0.0035065142475537
get_robot_state_min0.003476808311341704
get_state_dump_max0.004442503609129233
get_state_dump_mean0.004327292097275607
get_state_dump_median0.0043090029985198095
get_state_dump_min0.0042486587829335745
get_ui_image_max0.035752205525414416
get_ui_image_mean0.030330893846054727
get_ui_image_median0.03005049677315997
get_ui_image_min0.02547037631248455
in-drivable-lane_max24.799999999998896
in-drivable-lane_mean11.42499999999965
in-drivable-lane_min4.699999999999903
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.27559320304324, "get_ui_image": 0.02784354680781559, "step_physics": 0.0920112430801201, "survival_time": 59.99999999999873, "driven_lanedir": 11.268769760145537, "get_state_dump": 0.004442503609129233, "get_robot_state": 0.003675696851808165, "sim_render-ego0": 0.003800658957348775, "get_duckie_state": 1.1789907920767523e-06, "in-drivable-lane": 4.699999999999903, "deviation-heading": 11.89178064610324, "agent_compute-ego0": 0.013006936104271833, "complete-iteration": 0.1582524284137278, "set_robot_commands": 0.002241695850318318, "deviation-center-line": 3.114699412944494, "driven_lanedir_consec": 11.268769760145537, "sim_compute_sim_state": 0.00917552313538614, "sim_compute_performance-ego0": 0.0019738590786796523}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.637159117903151, "get_ui_image": 0.035752205525414416, "step_physics": 0.1118081818192692, "survival_time": 35.35000000000013, "driven_lanedir": 3.621112180385114, "get_state_dump": 0.004273701859059307, "get_robot_state": 0.0034890508247634113, "sim_render-ego0": 0.003608012603501142, "get_duckie_state": 1.1803066663149387e-06, "in-drivable-lane": 10.999999999999986, "deviation-heading": 9.73612813545131, "agent_compute-ego0": 0.012547747226758192, "complete-iteration": 0.1861827952713616, "set_robot_commands": 0.002058189804271116, "deviation-center-line": 2.153986075071594, "driven_lanedir_consec": 3.617166571263514, "sim_compute_sim_state": 0.010732802294068417, "sim_compute_performance-ego0": 0.0018349727668331168}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.561308603839357, "get_ui_image": 0.03225744673850435, "step_physics": 0.10901343832405085, "survival_time": 59.99999999999873, "driven_lanedir": 4.762629021851451, "get_state_dump": 0.004344304137980312, "get_robot_state": 0.0035239776703439884, "sim_render-ego0": 0.00385050193951787, "get_duckie_state": 1.2300095887704255e-06, "in-drivable-lane": 24.799999999998896, "deviation-heading": 13.386176621158514, "agent_compute-ego0": 0.01277211345701194, "complete-iteration": 0.18379064046969323, "set_robot_commands": 0.0022772089031514874, "deviation-center-line": 3.0616134699316397, "driven_lanedir_consec": 4.760580693541032, "sim_compute_sim_state": 0.013716547614231791, "sim_compute_performance-ego0": 0.001958059530075543}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.7770082828409, "get_ui_image": 0.02547037631248455, "step_physics": 0.0856842756469879, "survival_time": 59.99999999999873, "driven_lanedir": 8.588074992018898, "get_state_dump": 0.0042486587829335745, "get_robot_state": 0.003476808311341704, "sim_render-ego0": 0.003545721802088144, "get_duckie_state": 1.1958647131622086e-06, "in-drivable-lane": 5.199999999999818, "deviation-heading": 15.560536791766536, "agent_compute-ego0": 0.01183639656594155, "complete-iteration": 0.14409872236895024, "set_robot_commands": 0.002062456693180793, "deviation-center-line": 3.8528252604487774, "driven_lanedir_consec": 8.588074992018898, "sim_compute_sim_state": 0.005873959626285956, "sim_compute_performance-ego0": 0.0018251956650656923}}
set_robot_commands_max0.0022772089031514874
set_robot_commands_mean0.002159887812730428
set_robot_commands_median0.0021520762717495553
set_robot_commands_min0.002058189804271116
sim_compute_performance-ego0_max0.0019738590786796523
sim_compute_performance-ego0_mean0.0018980217601635011
sim_compute_performance-ego0_median0.00189651614845433
sim_compute_performance-ego0_min0.0018251956650656923
sim_compute_sim_state_max0.013716547614231791
sim_compute_sim_state_mean0.009874708167493076
sim_compute_sim_state_median0.00995416271472728
sim_compute_sim_state_min0.005873959626285956
sim_render-ego0_max0.00385050193951787
sim_render-ego0_mean0.0037012238256139826
sim_render-ego0_median0.0037043357804249586
sim_render-ego0_min0.003545721802088144
simulation-passed1
step_physics_max0.1118081818192692
step_physics_mean0.099629284717607
step_physics_median0.10051234070208548
step_physics_min0.0856842756469879
survival_time_max59.99999999999873
survival_time_mean53.83749999999908
survival_time_min35.35000000000013
No reset possible
5805510021Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:32:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.878289282278228
survival_time_median59.99999999999873
deviation-center-line_median2.5748941428289753
in-drivable-lane_median5.249999999999947


other stats
agent_compute-ego0_max0.01222954681771284
agent_compute-ego0_mean0.012131985478556026
agent_compute-ego0_median0.012124981014655097
agent_compute-ego0_min0.01204843306720108
complete-iteration_max0.1790138196190827
complete-iteration_mean0.1636386408992453
complete-iteration_median0.1668847012182358
complete-iteration_min0.14177134154142687
deviation-center-line_max2.9399277446928913
deviation-center-line_mean2.633283673135987
deviation-center-line_min2.4434186621931056
deviation-heading_max14.549592092759678
deviation-heading_mean10.547063530424849
deviation-heading_median10.526839270612314
deviation-heading_min6.584983487715089
driven_any_max5.757567163097471
driven_any_mean5.584849426207779
driven_any_median5.649575240489652
driven_any_min5.28268006075434
driven_lanedir_consec_max5.48446831113593
driven_lanedir_consec_mean4.6378223243634285
driven_lanedir_consec_min3.3102424217613295
driven_lanedir_max5.48446831113593
driven_lanedir_mean4.988771484950056
driven_lanedir_median5.097163389962613
driven_lanedir_min4.276290848739066
get_duckie_state_max1.153977685526547e-06
get_duckie_state_mean1.1262846032745336e-06
get_duckie_state_median1.1266816367118385e-06
get_duckie_state_min1.0977974541479106e-06
get_robot_state_max0.0035933469554764543
get_robot_state_mean0.003514497107411305
get_robot_state_median0.0034935109124989636
get_robot_state_min0.003477619649170837
get_state_dump_max0.0043251383413780145
get_state_dump_mean0.004269148834936823
get_state_dump_median0.004255280903634382
get_state_dump_min0.004240895191100515
get_ui_image_max0.03573447996928829
get_ui_image_mean0.03043469957864652
get_ui_image_median0.030188751458923187
get_ui_image_min0.02562681542745141
in-drivable-lane_max10.650000000000071
in-drivable-lane_mean5.287499999999992
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.6187703072383615, "get_ui_image": 0.028068043607954778, "step_physics": 0.09692875074407242, "survival_time": 59.99999999999873, "driven_lanedir": 4.714039064107837, "get_state_dump": 0.0043251383413780145, "get_robot_state": 0.0035933469554764543, "sim_render-ego0": 0.003705979584655, "get_duckie_state": 1.0977974541479106e-06, "in-drivable-lane": 10.650000000000071, "deviation-heading": 6.584983487715089, "agent_compute-ego0": 0.012049207083887103, "complete-iteration": 0.16217327554656702, "set_robot_commands": 0.0022102373029469053, "deviation-center-line": 2.479109531433643, "driven_lanedir_consec": 3.3102424217613295, "sim_compute_sim_state": 0.009302456908976409, "sim_compute_performance-ego0": 0.0019204938143715076}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.757567163097471, "get_ui_image": 0.03573447996928829, "step_physics": 0.10406702861102991, "survival_time": 59.99999999999873, "driven_lanedir": 5.480287715817389, "get_state_dump": 0.004260802844680418, "get_robot_state": 0.0034921201043680845, "sim_render-ego0": 0.00363943479539552, "get_duckie_state": 1.1160609922639335e-06, "in-drivable-lane": 1.8499999999998948, "deviation-heading": 8.212963066103612, "agent_compute-ego0": 0.01222954681771284, "complete-iteration": 0.1790138196190827, "set_robot_commands": 0.0021381795058937297, "deviation-center-line": 2.4434186621931056, "driven_lanedir_consec": 5.480287715817389, "sim_compute_sim_state": 0.011522080876448073, "sim_compute_performance-ego0": 0.001860280914370166}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.680380173740943, "get_ui_image": 0.0323094593098916, "step_physics": 0.09892391543106473, "survival_time": 59.99999999999873, "driven_lanedir": 5.48446831113593, "get_state_dump": 0.004240895191100515, "get_robot_state": 0.003477619649170837, "sim_render-ego0": 0.0036082644942995903, "get_duckie_state": 1.1373022811597432e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.840715475121016, "agent_compute-ego0": 0.012200754945423085, "complete-iteration": 0.17159612688990458, "set_robot_commands": 0.002080144929846161, "deviation-center-line": 2.9399277446928913, "driven_lanedir_consec": 5.48446831113593, "sim_compute_sim_state": 0.012837254534553826, "sim_compute_performance-ego0": 0.0018501158657915685}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.28268006075434, "get_ui_image": 0.02562681542745141, "step_physics": 0.08286725472252533, "survival_time": 59.99999999999873, "driven_lanedir": 4.276290848739066, "get_state_dump": 0.004249758962588346, "get_robot_state": 0.003494901720629842, "sim_render-ego0": 0.003579005512170847, "get_duckie_state": 1.153977685526547e-06, "in-drivable-lane": 8.649999999999999, "deviation-heading": 14.549592092759678, "agent_compute-ego0": 0.01204843306720108, "complete-iteration": 0.14177134154142687, "set_robot_commands": 0.002050990566028147, "deviation-center-line": 2.6706787542243076, "driven_lanedir_consec": 4.276290848739066, "sim_compute_sim_state": 0.005949886911219105, "sim_compute_performance-ego0": 0.0018359592415510269}}
set_robot_commands_max0.0022102373029469053
set_robot_commands_mean0.002119888076178736
set_robot_commands_median0.0021091622178699455
set_robot_commands_min0.002050990566028147
sim_compute_performance-ego0_max0.0019204938143715076
sim_compute_performance-ego0_mean0.0018667124590210672
sim_compute_performance-ego0_median0.001855198390080867
sim_compute_performance-ego0_min0.0018359592415510269
sim_compute_sim_state_max0.012837254534553826
sim_compute_sim_state_mean0.009902919807799351
sim_compute_sim_state_median0.01041226889271224
sim_compute_sim_state_min0.005949886911219105
sim_render-ego0_max0.003705979584655
sim_render-ego0_mean0.003633171096630239
sim_render-ego0_median0.0036238496448475553
sim_render-ego0_min0.003579005512170847
simulation-passed1
step_physics_max0.10406702861102991
step_physics_mean0.09569673737717307
step_physics_median0.09792633308756855
step_physics_min0.08286725472252533
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5803710037Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:34:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median7.863865263324104
survival_time_median59.99999999999873
deviation-center-line_median2.953243355142726
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012031659992608698
agent_compute-ego0_mean0.01187153392588467
agent_compute-ego0_median0.011843194770971802
agent_compute-ego0_min0.011768086168986376
complete-iteration_max0.18584380280862345
complete-iteration_mean0.16401613508037088
complete-iteration_median0.16477888450336697
complete-iteration_min0.14066296850612617
deviation-center-line_max3.1441805344430693
deviation-center-line_mean2.7663774126943856
deviation-center-line_min2.0148424060490218
deviation-heading_max12.552144741516717
deviation-heading_mean11.27720268783578
deviation-heading_median11.529702882222244
deviation-heading_min9.497260245381913
driven_any_max9.103056691322385
driven_any_mean8.290953713018869
driven_any_median8.032295843567876
driven_any_min7.996166473617342
driven_lanedir_consec_max8.891608073435302
driven_lanedir_consec_mean8.107734743454653
driven_lanedir_consec_min7.811600373735101
driven_lanedir_max8.891608073435302
driven_lanedir_mean8.107734743454653
driven_lanedir_median7.863865263324104
driven_lanedir_min7.811600373735101
get_duckie_state_max1.1607272539607294e-06
get_duckie_state_mean1.1296097583119618e-06
get_duckie_state_median1.1513969681840657e-06
get_duckie_state_min1.0549178429189869e-06
get_robot_state_max0.003515342590116045
get_robot_state_mean0.003472238853511763
get_robot_state_median0.0034659989767527205
get_robot_state_min0.003441614870425565
get_state_dump_max0.00428205108166138
get_state_dump_mean0.004239823895628308
get_state_dump_median0.004244128730672285
get_state_dump_min0.004188987039507279
get_ui_image_max0.03565759007678639
get_ui_image_mean0.030341423173232636
get_ui_image_median0.03007669155047795
get_ui_image_min0.02555471951518825
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.103056691322385, "get_ui_image": 0.028166912675995713, "step_physics": 0.08902563381750915, "survival_time": 59.99999999999873, "driven_lanedir": 8.891608073435302, "get_state_dump": 0.004188987039507279, "get_robot_state": 0.003515342590116045, "sim_render-ego0": 0.0036081785365604142, "get_duckie_state": 1.0549178429189869e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.000459764736483, "agent_compute-ego0": 0.011789248249711445, "complete-iteration": 0.1534597202701235, "set_robot_commands": 0.002089776762518458, "deviation-center-line": 2.8380927717527915, "driven_lanedir_consec": 8.891608073435302, "sim_compute_sim_state": 0.009149933734801687, "sim_compute_performance-ego0": 0.0018540464968208863}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.045108440611068, "get_ui_image": 0.03565759007678639, "step_physics": 0.11112775274557832, "survival_time": 59.99999999999873, "driven_lanedir": 7.836470607784016, "get_state_dump": 0.00428205108166138, "get_robot_state": 0.0034565649659905606, "sim_render-ego0": 0.003576776367937099, "get_duckie_state": 1.147029600373712e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.552144741516717, "agent_compute-ego0": 0.01189714129223216, "complete-iteration": 0.18584380280862345, "set_robot_commands": 0.0020505220665721275, "deviation-center-line": 3.0683939385326604, "driven_lanedir_consec": 7.836470607784016, "sim_compute_sim_state": 0.011899630096333906, "sim_compute_performance-ego0": 0.0018239978151853437}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.019483246524683, "get_ui_image": 0.031986470424960195, "step_physics": 0.1036531190689557, "survival_time": 59.99999999999873, "driven_lanedir": 7.811600373735101, "get_state_dump": 0.0042674253624146626, "get_robot_state": 0.003441614870425565, "sim_render-ego0": 0.003556436146427253, "get_duckie_state": 1.1607272539607294e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.058945999708005, "agent_compute-ego0": 0.012031659992608698, "complete-iteration": 0.1760980487366104, "set_robot_commands": 0.0022170138696548246, "deviation-center-line": 3.1441805344430693, "driven_lanedir_consec": 7.811600373735101, "sim_compute_sim_state": 0.013060794484109108, "sim_compute_performance-ego0": 0.0018126241968235905}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.996166473617342, "get_ui_image": 0.02555471951518825, "step_physics": 0.08208332411157003, "survival_time": 59.99999999999873, "driven_lanedir": 7.891259918864193, "get_state_dump": 0.0042208320989299076, "get_robot_state": 0.0034754329875148803, "sim_render-ego0": 0.0035698937933014195, "get_duckie_state": 1.1557643359944187e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.497260245381913, "agent_compute-ego0": 0.011768086168986376, "complete-iteration": 0.14066296850612617, "set_robot_commands": 0.002113868950010835, "deviation-center-line": 2.0148424060490218, "driven_lanedir_consec": 7.891259918864193, "sim_compute_sim_state": 0.005963419398896204, "sim_compute_performance-ego0": 0.0018393387901693655}}
set_robot_commands_max0.0022170138696548246
set_robot_commands_mean0.002117795412189061
set_robot_commands_median0.0021018228562646466
set_robot_commands_min0.0020505220665721275
sim_compute_performance-ego0_max0.0018540464968208863
sim_compute_performance-ego0_mean0.0018325018247497965
sim_compute_performance-ego0_median0.0018316683026773548
sim_compute_performance-ego0_min0.0018126241968235905
sim_compute_sim_state_max0.013060794484109108
sim_compute_sim_state_mean0.010018444428535226
sim_compute_sim_state_median0.010524781915567796
sim_compute_sim_state_min0.005963419398896204
sim_render-ego0_max0.0036081785365604142
sim_render-ego0_mean0.003577821211056547
sim_render-ego0_median0.003573335080619259
sim_render-ego0_min0.003556436146427253
simulation-passed1
step_physics_max0.11112775274557832
step_physics_mean0.09647245743590332
step_physics_median0.09633937644323244
step_physics_min0.08208332411157003
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5803410038Raphael Jeanexercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5801510040Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:20:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.996648855240479
survival_time_median29.200000000000266
deviation-center-line_median1.0987482149787355
in-drivable-lane_median19.4000000000002


other stats
agent_compute-ego0_max0.012603881624009874
agent_compute-ego0_mean0.012135032317907128
agent_compute-ego0_median0.01225303732597762
agent_compute-ego0_min0.011430172995663405
complete-iteration_max0.1998972532189923
complete-iteration_mean0.1672427818823903
complete-iteration_median0.16223830190198174
complete-iteration_min0.1445972705066055
deviation-center-line_max2.5839610230276473
deviation-center-line_mean1.242666323796337
deviation-center-line_min0.18920784220022951
deviation-heading_max6.441824032987864
deviation-heading_mean3.6262970856250334
deviation-heading_median3.5531556925356007
deviation-heading_min0.957052924441068
driven_any_max12.370643309057144
driven_any_mean7.165012603302218
driven_any_median5.898052410226418
driven_any_min4.493302283698894
driven_lanedir_consec_max6.435448648029588
driven_lanedir_consec_mean3.293956769552369
driven_lanedir_consec_min0.7470807196989301
driven_lanedir_max6.435448648029588
driven_lanedir_mean3.293956769552369
driven_lanedir_median2.996648855240479
driven_lanedir_min0.7470807196989301
get_duckie_state_max1.1067307064872698e-06
get_duckie_state_mean1.0691819990136833e-06
get_duckie_state_median1.0677399458708586e-06
get_duckie_state_min1.0345173978257454e-06
get_robot_state_max0.003607939029562062
get_robot_state_mean0.003491968120352176
get_robot_state_median0.0034572684995362027
get_robot_state_min0.0034453964527742364
get_state_dump_max0.004370786221091318
get_state_dump_mean0.004270613805812654
get_state_dump_median0.004259434128984993
get_state_dump_min0.004192800744189311
get_ui_image_max0.035237644925529575
get_ui_image_mean0.030202740168893363
get_ui_image_median0.03013769416516768
get_ui_image_min0.025297927419708533
in-drivable-lane_max27.899999999999437
in-drivable-lane_mean18.424999999999983
in-drivable-lane_min7.0000000000000995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.232614616401465, "get_ui_image": 0.028059873087652797, "step_physics": 0.09242883176182422, "survival_time": 26.050000000000235, "driven_lanedir": 3.816560111337852, "get_state_dump": 0.004370786221091318, "get_robot_state": 0.003607939029562062, "sim_render-ego0": 0.003786884961913829, "get_duckie_state": 1.0345173978257454e-06, "in-drivable-lane": 7.0000000000000995, "deviation-heading": 2.7237546719808776, "agent_compute-ego0": 0.012051521133189, "complete-iteration": 0.15899262574440676, "set_robot_commands": 0.002289866578990015, "deviation-center-line": 1.2645589533031767, "driven_lanedir_consec": 3.816560111337852, "sim_compute_sim_state": 0.01034639804299307, "sim_compute_performance-ego0": 0.0019766754574245876}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.56349020405137, "get_ui_image": 0.035237644925529575, "step_physics": 0.12461017200976242, "survival_time": 32.3500000000003, "driven_lanedir": 2.1767375991431064, "get_state_dump": 0.004274974634617935, "get_robot_state": 0.0034453964527742364, "sim_render-ego0": 0.0036322993260842784, "get_duckie_state": 1.0673646573667174e-06, "in-drivable-lane": 20.50000000000021, "deviation-heading": 4.382556713090324, "agent_compute-ego0": 0.012454553518766238, "complete-iteration": 0.1998972532189923, "set_robot_commands": 0.0020030781074806495, "deviation-center-line": 0.9329374766542944, "driven_lanedir_consec": 2.1767375991431064, "sim_compute_sim_state": 0.012348175784687936, "sim_compute_performance-ego0": 0.001820258520267628}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.493302283698894, "get_ui_image": 0.03221551524268256, "step_physics": 0.0957403998904758, "survival_time": 22.450000000000184, "driven_lanedir": 0.7470807196989301, "get_state_dump": 0.004243893623352051, "get_robot_state": 0.003468569649590386, "sim_render-ego0": 0.003650524351331923, "get_duckie_state": 1.068115234375e-06, "in-drivable-lane": 18.30000000000019, "deviation-heading": 0.957052924441068, "agent_compute-ego0": 0.012603881624009874, "complete-iteration": 0.16548397805955675, "set_robot_commands": 0.0020369386672973635, "deviation-center-line": 0.18920784220022951, "driven_lanedir_consec": 0.7470807196989301, "sim_compute_sim_state": 0.00961972130669488, "sim_compute_performance-ego0": 0.0018343485726250543}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.370643309057144, "get_ui_image": 0.025297927419708533, "step_physics": 0.08670143620556936, "survival_time": 59.99999999999873, "driven_lanedir": 6.435448648029588, "get_state_dump": 0.004192800744189311, "get_robot_state": 0.0034459673494820196, "sim_render-ego0": 0.0035692968535284315, "get_duckie_state": 1.1067307064872698e-06, "in-drivable-lane": 27.899999999999437, "deviation-heading": 6.441824032987864, "agent_compute-ego0": 0.011430172995663405, "complete-iteration": 0.1445972705066055, "set_robot_commands": 0.002052596764798764, "deviation-center-line": 2.5839610230276473, "driven_lanedir_consec": 6.435448648029588, "sim_compute_sim_state": 0.00597306016482084, "sim_compute_performance-ego0": 0.0018600097405324868}}
set_robot_commands_max0.002289866578990015
set_robot_commands_mean0.0020956200296416982
set_robot_commands_median0.002044767716048064
set_robot_commands_min0.0020030781074806495
sim_compute_performance-ego0_max0.0019766754574245876
sim_compute_performance-ego0_mean0.0018728230727124392
sim_compute_performance-ego0_median0.0018471791565787704
sim_compute_performance-ego0_min0.001820258520267628
sim_compute_sim_state_max0.012348175784687936
sim_compute_sim_state_mean0.00957183882479918
sim_compute_sim_state_median0.009983059674843977
sim_compute_sim_state_min0.00597306016482084
sim_render-ego0_max0.003786884961913829
sim_render-ego0_mean0.003659751373214615
sim_render-ego0_median0.003641411838708101
sim_render-ego0_min0.0035692968535284315
simulation-passed1
step_physics_max0.12461017200976242
step_physics_mean0.09987020996690796
step_physics_median0.09408461582615002
step_physics_min0.08670143620556936
survival_time_max59.99999999999873
survival_time_mean35.212499999999864
survival_time_min22.450000000000184
No reset possible
5800612732Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:03:13
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5799812732Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5798010363Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:04:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.488584191979378
survival_time_median3.4999999999999956
deviation-center-line_median0.07758239282468801
in-drivable-lane_median2.199999999999995


other stats
agent_compute-ego0_max0.013259912359303442
agent_compute-ego0_mean0.012657902474215004
agent_compute-ego0_median0.012664937440574025
agent_compute-ego0_min0.012041822656408532
complete-iteration_max0.21140515620891864
complete-iteration_mean0.1822189112685851
complete-iteration_median0.1833752760367346
complete-iteration_min0.15071993679195256
deviation-center-line_max0.10684186896330188
deviation-center-line_mean0.07729907710055074
deviation-center-line_min0.047189653789525034
deviation-heading_max0.8140505946962051
deviation-heading_mean0.5074529429688938
deviation-heading_median0.49878448466908976
deviation-heading_min0.2181922078411904
driven_any_max3.0360000000003033
driven_any_mean1.7685013432513452
driven_any_median1.476000406124966
driven_any_min1.0860045607551458
driven_lanedir_consec_max0.6588300859048648
driven_lanedir_consec_mean0.4764574830897389
driven_lanedir_consec_min0.26983146249533463
driven_lanedir_max0.6588300859048648
driven_lanedir_mean0.4764574830897389
driven_lanedir_median0.488584191979378
driven_lanedir_min0.26983146249533463
get_duckie_state_max1.178633782171434e-06
get_duckie_state_mean1.12404140080497e-06
get_duckie_state_median1.12464636643306e-06
get_duckie_state_min1.0682390881823254e-06
get_robot_state_max0.0035847656188472627
get_robot_state_mean0.003520504159260431
get_robot_state_median0.0035138569869004287
get_robot_state_min0.003469537044393605
get_state_dump_max0.004416829155337426
get_state_dump_mean0.0043355462498358265
get_state_dump_median0.004343866396855403
get_state_dump_min0.004237623050295073
get_ui_image_max0.037536111244788534
get_ui_image_mean0.03164036863749518
get_ui_image_median0.030961762280830155
get_ui_image_min0.027101838743531857
in-drivable-lane_max5.049999999999987
in-drivable-lane_mean2.699999999999994
in-drivable-lane_min1.3499999999999972
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0360000000003033, "get_ui_image": 0.0290762762869558, "step_physics": 0.10024614295651836, "survival_time": 6.149999999999986, "driven_lanedir": 0.26983146249533463, "get_state_dump": 0.004416829155337426, "get_robot_state": 0.0035847656188472627, "sim_render-ego0": 0.003701081199030722, "get_duckie_state": 1.178633782171434e-06, "in-drivable-lane": 5.049999999999987, "deviation-heading": 0.7416324962356469, "agent_compute-ego0": 0.012941575819446195, "complete-iteration": 0.1675865150267078, "set_robot_commands": 0.0021126827886027676, "deviation-center-line": 0.10684186896330188, "driven_lanedir_consec": 0.26983146249533463, "sim_compute_sim_state": 0.009540559784058602, "sim_compute_performance-ego0": 0.0018963525372166787}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2960007751037872, "get_ui_image": 0.037536111244788534, "step_physics": 0.13667864799499513, "survival_time": 3.1999999999999966, "driven_lanedir": 0.3579515953954717, "get_state_dump": 0.004360624460073618, "get_robot_state": 0.0035210132598876955, "sim_render-ego0": 0.003643993230966421, "get_duckie_state": 1.151745135967548e-06, "in-drivable-lane": 1.999999999999996, "deviation-heading": 0.8140505946962051, "agent_compute-ego0": 0.012388299061701849, "complete-iteration": 0.21140515620891864, "set_robot_commands": 0.0020440174983097957, "deviation-center-line": 0.0833109354260745, "driven_lanedir_consec": 0.3579515953954717, "sim_compute_sim_state": 0.00929891146146334, "sim_compute_performance-ego0": 0.001865849128136268}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0860045607551458, "get_ui_image": 0.032847248274704505, "step_physics": 0.12994901476235227, "survival_time": 2.849999999999998, "driven_lanedir": 0.6588300859048648, "get_state_dump": 0.004237623050295073, "get_robot_state": 0.003469537044393605, "sim_render-ego0": 0.003787628535566658, "get_duckie_state": 1.0975475968985723e-06, "in-drivable-lane": 1.3499999999999972, "deviation-heading": 0.25593647310253265, "agent_compute-ego0": 0.013259912359303442, "complete-iteration": 0.19916403704676136, "set_robot_commands": 0.0022103622041899583, "deviation-center-line": 0.047189653789525034, "driven_lanedir_consec": 0.6588300859048648, "sim_compute_sim_state": 0.007380226562763083, "sim_compute_performance-ego0": 0.0019374263697657093}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6560000371461447, "get_ui_image": 0.027101838743531857, "step_physics": 0.09127339759430328, "survival_time": 3.7999999999999945, "driven_lanedir": 0.6192167885632842, "get_state_dump": 0.004327108333637188, "get_robot_state": 0.003506700713913162, "sim_render-ego0": 0.0036106945632340074, "get_duckie_state": 1.0682390881823254e-06, "in-drivable-lane": 2.399999999999994, "deviation-heading": 0.2181922078411904, "agent_compute-ego0": 0.012041822656408532, "complete-iteration": 0.15071993679195256, "set_robot_commands": 0.002047789561284053, "deviation-center-line": 0.07185385022330154, "driven_lanedir_consec": 0.6192167885632842, "sim_compute_sim_state": 0.004891878598696226, "sim_compute_performance-ego0": 0.0018526516951523817}}
set_robot_commands_max0.0022103622041899583
set_robot_commands_mean0.0021037130130966437
set_robot_commands_median0.0020802361749434105
set_robot_commands_min0.0020440174983097957
sim_compute_performance-ego0_max0.0019374263697657093
sim_compute_performance-ego0_mean0.0018880699325677596
sim_compute_performance-ego0_median0.0018811008326764737
sim_compute_performance-ego0_min0.0018526516951523817
sim_compute_sim_state_max0.009540559784058602
sim_compute_sim_state_mean0.007777894101745312
sim_compute_sim_state_median0.008339569012113211
sim_compute_sim_state_min0.004891878598696226
sim_render-ego0_max0.003787628535566658
sim_render-ego0_mean0.003685849382199453
sim_render-ego0_median0.003672537214998572
sim_render-ego0_min0.0036106945632340074
simulation-passed1
step_physics_max0.13667864799499513
step_physics_mean0.11453680082704223
step_physics_median0.1150975788594353
step_physics_min0.09127339759430328
survival_time_max6.149999999999986
survival_time_mean3.999999999999994
survival_time_min2.849999999999998
No reset possible
5795410724Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:33:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.79977770471843
survival_time_median59.99999999999873
deviation-center-line_median3.758657642305023
in-drivable-lane_median7.0749999999999496


other stats
agent_compute-ego0_max0.012311740084353533
agent_compute-ego0_mean0.012257088779112775
agent_compute-ego0_median0.012300387012472162
agent_compute-ego0_min0.01211584100715326
complete-iteration_max0.1854501737345267
complete-iteration_mean0.16584670097008036
complete-iteration_median0.16450193323362478
complete-iteration_min0.14893276367854516
deviation-center-line_max4.23121213368777
deviation-center-line_mean3.6989844796235145
deviation-center-line_min3.0474105001962424
deviation-heading_max10.828402547751626
deviation-heading_mean8.514697782692064
deviation-heading_median8.381909373683438
deviation-heading_min6.4665698356497545
driven_any_max11.20929175590407
driven_any_mean10.104717634764
driven_any_median9.880766547454972
driven_any_min9.448045688241988
driven_lanedir_consec_max9.88442842458958
driven_lanedir_consec_mean8.084276250631312
driven_lanedir_consec_min4.853121168498808
driven_lanedir_max9.88442842458958
driven_lanedir_mean8.81221261102457
driven_lanedir_median8.79977770471843
driven_lanedir_min7.764866610071841
get_duckie_state_max1.2196867194004996e-06
get_duckie_state_mean1.1091129071110986e-06
get_duckie_state_median1.1011722383650018e-06
get_duckie_state_min1.014420432313892e-06
get_robot_state_max0.0036201953490906016
get_robot_state_mean0.00354355687801288
get_robot_state_median0.0035312294860763613
get_robot_state_min0.003491573190808197
get_state_dump_max0.004563974599655621
get_state_dump_mean0.004315611424791525
get_state_dump_median0.004251195032531078
get_state_dump_min0.0041960810344483235
get_ui_image_max0.03503718324545321
get_ui_image_mean0.030107565664629656
get_ui_image_median0.029773754045230763
get_ui_image_min0.02584557132260389
in-drivable-lane_max8.799999999999873
in-drivable-lane_mean6.4874999999999
in-drivable-lane_min2.9999999999998295
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.20929175590407, "get_ui_image": 0.027775584212151493, "step_physics": 0.08528923015610364, "survival_time": 59.99999999999873, "driven_lanedir": 9.88442842458958, "get_state_dump": 0.0041960810344483235, "get_robot_state": 0.0035464815255704272, "sim_render-ego0": 0.003628815937598083, "get_duckie_state": 1.014420432313892e-06, "in-drivable-lane": 5.949999999999783, "deviation-heading": 6.4665698356497545, "agent_compute-ego0": 0.01211584100715326, "complete-iteration": 0.14984319212037658, "set_robot_commands": 0.002158758741532833, "deviation-center-line": 3.873854830090388, "driven_lanedir_consec": 9.88442842458958, "sim_compute_sim_state": 0.009165535759270736, "sim_compute_performance-ego0": 0.001892286375301466}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.68784948641916, "get_ui_image": 0.03503718324545321, "step_physics": 0.1097259987998664, "survival_time": 59.99999999999873, "driven_lanedir": 9.025660559003036, "get_state_dump": 0.004240653397737197, "get_robot_state": 0.003491573190808197, "sim_render-ego0": 0.0035870819663525026, "get_duckie_state": 1.1057381228940076e-06, "in-drivable-lane": 2.9999999999998295, "deviation-heading": 8.738463816979133, "agent_compute-ego0": 0.012291606121714368, "complete-iteration": 0.1854501737345267, "set_robot_commands": 0.002198589532996693, "deviation-center-line": 4.23121213368777, "driven_lanedir_consec": 9.025660559003036, "sim_compute_sim_state": 0.012964924805170292, "sim_compute_performance-ego0": 0.0018423141587485285}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.448045688241988, "get_ui_image": 0.03177192387831003, "step_physics": 0.10711549184006716, "survival_time": 59.99999999999873, "driven_lanedir": 7.764866610071841, "get_state_dump": 0.004261736667324959, "get_robot_state": 0.003515977446582295, "sim_render-ego0": 0.003619336367248992, "get_duckie_state": 1.096606353835996e-06, "in-drivable-lane": 8.799999999999873, "deviation-heading": 10.828402547751626, "agent_compute-ego0": 0.012311740084353533, "complete-iteration": 0.179160674346873, "set_robot_commands": 0.002104793361184202, "deviation-center-line": 3.0474105001962424, "driven_lanedir_consec": 4.853121168498808, "sim_compute_sim_state": 0.012528973157757228, "sim_compute_performance-ego0": 0.0018593312103881328}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.073683608490786, "get_ui_image": 0.02584557132260389, "step_physics": 0.08838499158149357, "survival_time": 59.99999999999873, "driven_lanedir": 8.573894850433822, "get_state_dump": 0.004563974599655621, "get_robot_state": 0.0036201953490906016, "sim_render-ego0": 0.003746642359686731, "get_duckie_state": 1.2196867194004996e-06, "in-drivable-lane": 8.200000000000117, "deviation-heading": 8.025354930387742, "agent_compute-ego0": 0.012309167903229954, "complete-iteration": 0.14893276367854516, "set_robot_commands": 0.0022025668154548946, "deviation-center-line": 3.643460454519658, "driven_lanedir_consec": 8.573894850433822, "sim_compute_sim_state": 0.006244387455923571, "sim_compute_performance-ego0": 0.0019395948945235251}}
set_robot_commands_max0.0022025668154548946
set_robot_commands_mean0.002166177112792155
set_robot_commands_median0.002178674137264763
set_robot_commands_min0.002104793361184202
sim_compute_performance-ego0_max0.0019395948945235251
sim_compute_performance-ego0_mean0.001883381659740413
sim_compute_performance-ego0_median0.0018758087928447992
sim_compute_performance-ego0_min0.0018423141587485285
sim_compute_sim_state_max0.012964924805170292
sim_compute_sim_state_mean0.010225955294530456
sim_compute_sim_state_median0.010847254458513984
sim_compute_sim_state_min0.006244387455923571
sim_render-ego0_max0.003746642359686731
sim_render-ego0_mean0.0036454691577215777
sim_render-ego0_median0.0036240761524235377
sim_render-ego0_min0.0035870819663525026
simulation-passed1
step_physics_max0.1097259987998664
step_physics_mean0.09762892809438269
step_physics_median0.09775024171078037
step_physics_min0.08528923015610364
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5794310732Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:21:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.9041425166799866
survival_time_median44.87499999999959
deviation-center-line_median0.9795525385007532
in-drivable-lane_median12.049999999999898


other stats
agent_compute-ego0_max0.01331332226118973
agent_compute-ego0_mean0.012552195061440806
agent_compute-ego0_median0.012731403253838857
agent_compute-ego0_min0.01143265147689578
complete-iteration_max0.2148593022273137
complete-iteration_mean0.17274578688774295
complete-iteration_median0.16740606546527212
complete-iteration_min0.14131171439311388
deviation-center-line_max2.9141960282240067
deviation-center-line_mean1.2639813224641083
deviation-center-line_min0.182624184630921
deviation-heading_max10.1461114790901
deviation-heading_mean4.814020088544663
deviation-heading_median3.786580093116519
deviation-heading_min1.5368086888555168
driven_any_max7.756392798877888
driven_any_mean4.801216163955366
driven_any_median5.552838477164263
driven_any_min0.342794902615051
driven_lanedir_consec_max7.617425661290963
driven_lanedir_consec_mean3.4040039073082813
driven_lanedir_consec_min0.1903049345821883
driven_lanedir_max7.617425661290963
driven_lanedir_mean3.4104426591137833
driven_lanedir_median2.917020020290991
driven_lanedir_min0.1903049345821883
get_duckie_state_max1.7681760651072818e-06
get_duckie_state_mean1.6566046329321572e-06
get_duckie_state_median1.6498571782034852e-06
get_duckie_state_min1.5585281102143763e-06
get_robot_state_max0.0035867038552148283
get_robot_state_mean0.0035454851255006803
get_robot_state_median0.003540330606266409
get_robot_state_min0.003514575434255076
get_state_dump_max0.004635171456770463
get_state_dump_mean0.004454328616254104
get_state_dump_median0.004401640942428505
get_state_dump_min0.00437886112338894
get_ui_image_max0.03539860641563332
get_ui_image_mean0.030386696736598055
get_ui_image_median0.030233044458532803
get_ui_image_min0.0256820916136933
in-drivable-lane_max27.849999999999785
in-drivable-lane_mean12.987499999999896
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.2840545071616125, "get_ui_image": 0.02789317780057052, "step_physics": 0.09041599056351073, "survival_time": 47.99999999999941, "driven_lanedir": 4.046469396539443, "get_state_dump": 0.0044160864231613745, "get_robot_state": 0.0035867038552148283, "sim_render-ego0": 0.003683213016617186, "get_duckie_state": 1.5585281102143763e-06, "in-drivable-lane": 22.3499999999998, "deviation-heading": 3.5250926902737323, "agent_compute-ego0": 0.012431978807240942, "complete-iteration": 0.15711072927707193, "set_robot_commands": 0.00210522488922532, "deviation-center-line": 1.1749661688748196, "driven_lanedir_consec": 4.046469396539443, "sim_compute_sim_state": 0.010623240446076805, "sim_compute_performance-ego0": 0.0018795313125594471}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.342794902615051, "get_ui_image": 0.03539860641563332, "step_physics": 0.14098738052032803, "survival_time": 4.499999999999992, "driven_lanedir": 0.1903049345821883, "get_state_dump": 0.00437886112338894, "get_robot_state": 0.003514575434255076, "sim_render-ego0": 0.00363904303246802, "get_duckie_state": 1.613910381610577e-06, "in-drivable-lane": 1.7499999999999938, "deviation-heading": 1.5368086888555168, "agent_compute-ego0": 0.013030827700436773, "complete-iteration": 0.2148593022273137, "set_robot_commands": 0.0020427913456172735, "deviation-center-line": 0.182624184630921, "driven_lanedir_consec": 0.1903049345821883, "sim_compute_sim_state": 0.009965466929006052, "sim_compute_performance-ego0": 0.0018304835309039104}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.821622447166915, "get_ui_image": 0.03257291111649509, "step_physics": 0.10592213002118198, "survival_time": 41.749999999999766, "driven_lanedir": 1.7875706440425387, "get_state_dump": 0.004635171456770463, "get_robot_state": 0.003554174489381781, "sim_render-ego0": 0.0037645517924185575, "get_duckie_state": 1.7681760651072818e-06, "in-drivable-lane": 27.849999999999785, "deviation-heading": 4.048067495959306, "agent_compute-ego0": 0.01331332226118973, "complete-iteration": 0.1777014016534723, "set_robot_commands": 0.002125828174883098, "deviation-center-line": 0.7841389081266864, "driven_lanedir_consec": 1.76181563682053, "sim_compute_sim_state": 0.009837596895592065, "sim_compute_performance-ego0": 0.0018998204806204616}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.756392798877888, "get_ui_image": 0.0256820916136933, "step_physics": 0.08260619273094412, "survival_time": 59.99999999999873, "driven_lanedir": 7.617425661290963, "get_state_dump": 0.004387195461695637, "get_robot_state": 0.003526486723151036, "sim_render-ego0": 0.0035960334822299775, "get_duckie_state": 1.6858039747963935e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.1461114790901, "agent_compute-ego0": 0.01143265147689578, "complete-iteration": 0.14131171439311388, "set_robot_commands": 0.0020869522666454713, "deviation-center-line": 2.9141960282240067, "driven_lanedir_consec": 7.617425661290963, "sim_compute_sim_state": 0.006061185309531587, "sim_compute_performance-ego0": 0.0018611579612331725}}
set_robot_commands_max0.002125828174883098
set_robot_commands_mean0.0020901991690927906
set_robot_commands_median0.0020960885779353956
set_robot_commands_min0.0020427913456172735
sim_compute_performance-ego0_max0.0018998204806204616
sim_compute_performance-ego0_mean0.001867748321329248
sim_compute_performance-ego0_median0.00187034463689631
sim_compute_performance-ego0_min0.0018304835309039104
sim_compute_sim_state_max0.010623240446076805
sim_compute_sim_state_mean0.009121872395051626
sim_compute_sim_state_median0.009901531912299056
sim_compute_sim_state_min0.006061185309531587
sim_render-ego0_max0.0037645517924185575
sim_render-ego0_mean0.003670710330933435
sim_render-ego0_median0.003661128024542604
sim_render-ego0_min0.0035960334822299775
simulation-passed1
step_physics_max0.14098738052032803
step_physics_mean0.1049829234589912
step_physics_median0.09816906029234634
step_physics_min0.08260619273094412
survival_time_max59.99999999999873
survival_time_mean38.562499999999474
survival_time_min4.499999999999992
No reset possible
5794210716Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5792410747Philippe Reddy 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:27:12
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6958840493919114
survival_time_median59.99999999999873
deviation-center-line_median2.929105587604598
in-drivable-lane_median4.274999999999757


other stats
agent_compute-ego0_max0.012667972636672686
agent_compute-ego0_mean0.01217018144963316
agent_compute-ego0_median0.012193490424620718
agent_compute-ego0_min0.011625772312618512
complete-iteration_max0.20347232227023693
complete-iteration_mean0.1755758875727648
complete-iteration_median0.18018325915941977
complete-iteration_min0.13846470970198277
deviation-center-line_max5.173006060111576
deviation-center-line_mean2.876204819578066
deviation-center-line_min0.4736020429914912
deviation-heading_max13.363339361617845
deviation-heading_mean7.104469958665213
deviation-heading_median6.0564647948506
deviation-heading_min2.9416108833418093
driven_any_max3.4412105262142565
driven_any_mean1.9602974517161993
driven_any_median1.8432469207926117
driven_any_min0.7134854390653182
driven_lanedir_consec_max2.976305685311349
driven_lanedir_consec_mean1.6597670697090594
driven_lanedir_consec_min0.2709944947410654
driven_lanedir_max2.976305685311349
driven_lanedir_mean1.6597670697090594
driven_lanedir_median1.6958840493919114
driven_lanedir_min0.2709944947410654
get_duckie_state_max1.1416696489700965e-06
get_duckie_state_mean1.1212999608371252e-06
get_duckie_state_median1.1312040722986486e-06
get_duckie_state_min1.0811220497811068e-06
get_robot_state_max0.003631266427973129
get_robot_state_mean0.0035424849042127904
get_robot_state_median0.0035168838076225697
get_robot_state_min0.003504905573632894
get_state_dump_max0.004471749092121108
get_state_dump_mean0.004382041844074671
get_state_dump_median0.004355325190649739
get_state_dump_min0.004345767902878096
get_ui_image_max0.03575790603205843
get_ui_image_mean0.030386696473772283
get_ui_image_median0.03013621063454761
get_ui_image_min0.025516458593935493
in-drivable-lane_max6.650000000000068
in-drivable-lane_mean3.799999999999895
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.9499546039787348, "get_ui_image": 0.028100203514893188, "step_physics": 0.13870313244993543, "survival_time": 59.99999999999873, "driven_lanedir": 0.9428498039387444, "get_state_dump": 0.004471749092121108, "get_robot_state": 0.003631266427973129, "sim_render-ego0": 0.0037294387023315938, "get_duckie_state": 1.1416696489700965e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.48423992851548, "agent_compute-ego0": 0.011625772312618512, "complete-iteration": 0.20347232227023693, "set_robot_commands": 0.0021926018717286985, "deviation-center-line": 2.7406482542628523, "driven_lanedir_consec": 0.9428498039387444, "sim_compute_sim_state": 0.009019159059738937, "sim_compute_performance-ego0": 0.0019218133550003905}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7134854390653182, "get_ui_image": 0.03575790603205843, "step_physics": 0.10377436763835404, "survival_time": 13.200000000000053, "driven_lanedir": 0.2709944947410654, "get_state_dump": 0.004345767902878096, "get_robot_state": 0.003527832930942751, "sim_render-ego0": 0.003648428647023327, "get_duckie_state": 1.123716246406987e-06, "in-drivable-lane": 6.650000000000068, "deviation-heading": 2.9416108833418093, "agent_compute-ego0": 0.012667972636672686, "complete-iteration": 0.1785239003739267, "set_robot_commands": 0.0020797990403085384, "deviation-center-line": 0.4736020429914912, "driven_lanedir_consec": 0.2709944947410654, "sim_compute_sim_state": 0.010775875595380674, "sim_compute_performance-ego0": 0.0018706033814628168}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.7365392376064888, "get_ui_image": 0.03217221775420202, "step_physics": 0.11085173271776336, "survival_time": 59.99999999999873, "driven_lanedir": 2.448918294845078, "get_state_dump": 0.004355915380854293, "get_robot_state": 0.003504905573632894, "sim_render-ego0": 0.003649488277578235, "get_duckie_state": 1.0811220497811068e-06, "in-drivable-lane": 3.3499999999998096, "deviation-heading": 7.628689661185718, "agent_compute-ego0": 0.012608919413659495, "complete-iteration": 0.18184261794491272, "set_robot_commands": 0.0022234894850172667, "deviation-center-line": 3.117562920946344, "driven_lanedir_consec": 2.448918294845078, "sim_compute_sim_state": 0.010547907723673774, "sim_compute_performance-ego0": 0.0018517957142648051}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.4412105262142565, "get_ui_image": 0.025516458593935493, "step_physics": 0.0797393101637409, "survival_time": 59.99999999999873, "driven_lanedir": 2.976305685311349, "get_state_dump": 0.004354735000445186, "get_robot_state": 0.003505934684302388, "sim_render-ego0": 0.003597113611696166, "get_duckie_state": 1.13869189819031e-06, "in-drivable-lane": 5.199999999999704, "deviation-heading": 13.363339361617845, "agent_compute-ego0": 0.01177806143558194, "complete-iteration": 0.13846470970198277, "set_robot_commands": 0.002072077607433564, "deviation-center-line": 5.173006060111576, "driven_lanedir_consec": 2.976305685311349, "sim_compute_sim_state": 0.00597327079105933, "sim_compute_performance-ego0": 0.001851162445932304}}
set_robot_commands_max0.0022234894850172667
set_robot_commands_mean0.0021419920011220167
set_robot_commands_median0.0021362004560186183
set_robot_commands_min0.002072077607433564
sim_compute_performance-ego0_max0.0019218133550003905
sim_compute_performance-ego0_mean0.001873843724165079
sim_compute_performance-ego0_median0.0018611995478638112
sim_compute_performance-ego0_min0.001851162445932304
sim_compute_sim_state_max0.010775875595380674
sim_compute_sim_state_mean0.00907905329246318
sim_compute_sim_state_median0.009783533391706355
sim_compute_sim_state_min0.00597327079105933
sim_render-ego0_max0.0037294387023315938
sim_render-ego0_mean0.0036561173096573306
sim_render-ego0_median0.003648958462300781
sim_render-ego0_min0.003597113611696166
simulation-passed1
step_physics_max0.13870313244993543
step_physics_mean0.10826713574244844
step_physics_median0.1073130501780587
step_physics_min0.0797393101637409
survival_time_max59.99999999999873
survival_time_mean48.29999999999906
survival_time_min13.200000000000053
No reset possible
5792010754Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:05:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 19 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5791310762Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:08:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.1700945377832093
survival_time_median13.450000000000056
deviation-center-line_median0.3043862039984869
in-drivable-lane_median6.725000000000055


other stats
agent_compute-ego0_max0.018971742099865685
agent_compute-ego0_mean0.014040955180103096
agent_compute-ego0_median0.012468870622936596
agent_compute-ego0_min0.012254337374673506
complete-iteration_max0.19821685667960875
complete-iteration_mean0.17169677390215612
complete-iteration_median0.17304427740732087
complete-iteration_min0.14248168411437404
deviation-center-line_max0.7319574158205373
deviation-center-line_mean0.3717492132620064
deviation-center-line_min0.14626702923051443
deviation-heading_max3.0694520387112223
deviation-heading_mean1.6490722715620365
deviation-heading_median1.4247308335486553
deviation-heading_min0.6773753804396139
driven_any_max4.026916219448446
driven_any_mean2.636207038060773
driven_any_median2.5805737191120963
driven_any_min1.3567644945704516
driven_lanedir_consec_max1.9515660775323376
driven_lanedir_consec_mean1.2159243099307204
driven_lanedir_consec_min0.571942086624126
driven_lanedir_max1.9515660775323376
driven_lanedir_mean1.2159243099307204
driven_lanedir_median1.1700945377832093
driven_lanedir_min0.571942086624126
get_duckie_state_max1.2047319527131966e-06
get_duckie_state_mean1.1146266695183028e-06
get_duckie_state_median1.0999895058437748e-06
get_duckie_state_min1.0537957136724652e-06
get_robot_state_max0.003534282442306104
get_robot_state_mean0.0034645026372065652
get_robot_state_median0.0034547185776879234
get_robot_state_min0.003414290951144311
get_state_dump_max0.004276228863656806
get_state_dump_mean0.004227166702916231
get_state_dump_median0.00423296818989919
get_state_dump_min0.00416650156820974
get_ui_image_max0.03502694406817036
get_ui_image_mean0.030025133525943687
get_ui_image_median0.02992349052370187
get_ui_image_min0.025226608988200647
in-drivable-lane_max11.300000000000122
in-drivable-lane_mean7.275000000000054
in-drivable-lane_min4.3499999999999845
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.223718654772732, "get_ui_image": 0.028027682866214623, "step_physics": 0.08937045094469882, "survival_time": 16.5000000000001, "driven_lanedir": 1.9515660775323376, "get_state_dump": 0.004204366862593821, "get_robot_state": 0.003534282442306104, "sim_render-ego0": 0.003602477358907371, "get_duckie_state": 1.0537957136724652e-06, "in-drivable-lane": 6.550000000000093, "deviation-heading": 1.6840667698474538, "agent_compute-ego0": 0.018971742099865685, "complete-iteration": 0.1617178578391176, "set_robot_commands": 0.0020718358434579165, "deviation-center-line": 0.44772309586628367, "driven_lanedir_consec": 1.9515660775323376, "sim_compute_sim_state": 0.009984777052957123, "sim_compute_performance-ego0": 0.0018782630067577537}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3567644945704516, "get_ui_image": 0.03502694406817036, "step_physics": 0.12582375926356162, "survival_time": 7.699999999999981, "driven_lanedir": 0.571942086624126, "get_state_dump": 0.00416650156820974, "get_robot_state": 0.003414290951144311, "sim_render-ego0": 0.00371337398405998, "get_duckie_state": 1.075190882528982e-06, "in-drivable-lane": 4.3499999999999845, "deviation-heading": 1.165394897249857, "agent_compute-ego0": 0.01239626330714072, "complete-iteration": 0.19821685667960875, "set_robot_commands": 0.0021698536411408455, "deviation-center-line": 0.16104931213069013, "driven_lanedir_consec": 0.571942086624126, "sim_compute_sim_state": 0.00954864409662062, "sim_compute_performance-ego0": 0.001884837304392169}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.026916219448446, "get_ui_image": 0.031819298181189115, "step_physics": 0.11440885727664074, "survival_time": 20.70000000000016, "driven_lanedir": 1.713243076186667, "get_state_dump": 0.00426156951720456, "get_robot_state": 0.003457863934068795, "sim_render-ego0": 0.003628661833613752, "get_duckie_state": 1.2047319527131966e-06, "in-drivable-lane": 11.300000000000122, "deviation-heading": 3.0694520387112223, "agent_compute-ego0": 0.012541477938732467, "complete-iteration": 0.18437069697552416, "set_robot_commands": 0.0020600922136421664, "deviation-center-line": 0.7319574158205373, "driven_lanedir_consec": 1.713243076186667, "sim_compute_sim_state": 0.010259362875697123, "sim_compute_performance-ego0": 0.001854852308709937}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.9374287834514612, "get_ui_image": 0.025226608988200647, "step_physics": 0.08482438411438864, "survival_time": 10.400000000000013, "driven_lanedir": 0.6269459993797515, "get_state_dump": 0.004276228863656806, "get_robot_state": 0.003451573221307052, "sim_render-ego0": 0.0036410988803115183, "get_duckie_state": 1.1247881291585676e-06, "in-drivable-lane": 6.900000000000017, "deviation-heading": 0.6773753804396139, "agent_compute-ego0": 0.012254337374673506, "complete-iteration": 0.14248168411437404, "set_robot_commands": 0.0020430156488737993, "deviation-center-line": 0.14626702923051443, "driven_lanedir_consec": 0.6269459993797515, "sim_compute_sim_state": 0.004863263317272423, "sim_compute_performance-ego0": 0.0018264962155282783}}
set_robot_commands_max0.0021698536411408455
set_robot_commands_mean0.0020861993367786817
set_robot_commands_median0.0020659640285500417
set_robot_commands_min0.0020430156488737993
sim_compute_performance-ego0_max0.001884837304392169
sim_compute_performance-ego0_mean0.0018611122088470343
sim_compute_performance-ego0_median0.0018665576577338453
sim_compute_performance-ego0_min0.0018264962155282783
sim_compute_sim_state_max0.010259362875697123
sim_compute_sim_state_mean0.008664011835636825
sim_compute_sim_state_median0.009766710574788874
sim_compute_sim_state_min0.004863263317272423
sim_render-ego0_max0.00371337398405998
sim_render-ego0_mean0.003646403014223155
sim_render-ego0_median0.0036348803569626353
sim_render-ego0_min0.003602477358907371
simulation-passed1
step_physics_max0.12582375926356162
step_physics_mean0.10360686289982246
step_physics_median0.10188965411066978
step_physics_min0.08482438411438864
survival_time_max20.70000000000016
survival_time_mean13.825000000000063
survival_time_min7.699999999999981
No reset possible
5789810765Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:17:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.665977740756281
survival_time_median24.800000000000217
deviation-center-line_median0.2092804184980336
in-drivable-lane_median20.675000000000217


other stats
agent_compute-ego0_max0.01291124587473662
agent_compute-ego0_mean0.012372131112406252
agent_compute-ego0_median0.012334541988429374
agent_compute-ego0_min0.011908194598029642
complete-iteration_max0.2090711391050052
complete-iteration_mean0.1817882211861229
complete-iteration_median0.18408015260429533
complete-iteration_min0.14992144043089578
deviation-center-line_max1.7945871309220285
deviation-center-line_mean0.5946995256128055
deviation-center-line_min0.16565013453312663
deviation-heading_max10.19616040767916
deviation-heading_mean3.554698248694878
deviation-heading_median1.4285533556727852
deviation-heading_min1.1655258757547844
driven_any_max12.330723817175883
driven_any_mean5.809772836296048
driven_any_median4.798920662012966
driven_any_min1.3105262039823788
driven_lanedir_consec_max6.0162073800613785
driven_lanedir_consec_mean1.9973208269049745
driven_lanedir_consec_min0.6411204460459565
driven_lanedir_max6.0162073800613785
driven_lanedir_mean1.9973208269049745
driven_lanedir_median0.665977740756281
driven_lanedir_min0.6411204460459565
get_duckie_state_max1.2249186419058538e-06
get_duckie_state_mean1.1620850134776802e-06
get_duckie_state_median1.1482210001075251e-06
get_duckie_state_min1.126979411789817e-06
get_robot_state_max0.003603132043055551
get_robot_state_mean0.00353861329875787
get_robot_state_median0.0035306703206695288
get_robot_state_min0.003489980510636872
get_state_dump_max0.004446655511856079
get_state_dump_mean0.0044165958596298635
get_state_dump_median0.004419160303276763
get_state_dump_min0.004381407320109847
get_ui_image_max0.03614472875408098
get_ui_image_mean0.030826953052445
get_ui_image_median0.03051671522209357
get_ui_image_min0.026129653011511895
in-drivable-lane_max28.099999999998776
in-drivable-lane_mean18.3624999999998
in-drivable-lane_min3.999999999999986
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.330723817175883, "get_ui_image": 0.02816305053323433, "step_physics": 0.10537014396661128, "survival_time": 59.99999999999873, "driven_lanedir": 6.0162073800613785, "get_state_dump": 0.004426533137630364, "get_robot_state": 0.003603132043055551, "sim_render-ego0": 0.003712787914037903, "get_duckie_state": 1.126979411789817e-06, "in-drivable-lane": 28.099999999998776, "deviation-heading": 10.19616040767916, "agent_compute-ego0": 0.012532425164977877, "complete-iteration": 0.1714565291392813, "set_robot_commands": 0.002161133597038072, "deviation-center-line": 1.7945871309220285, "driven_lanedir_consec": 6.0162073800613785, "sim_compute_sim_state": 0.00949537466209596, "sim_compute_performance-ego0": 0.0019162697756320212}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3105262039823788, "get_ui_image": 0.03614472875408098, "step_physics": 0.13570753265829646, "survival_time": 7.599999999999981, "driven_lanedir": 0.6411204460459565, "get_state_dump": 0.004381407320109847, "get_robot_state": 0.003489980510636872, "sim_render-ego0": 0.003634381138421351, "get_duckie_state": 1.1313195322074142e-06, "in-drivable-lane": 3.999999999999986, "deviation-heading": 1.1655258757547844, "agent_compute-ego0": 0.012136658811880871, "complete-iteration": 0.2090711391050052, "set_robot_commands": 0.002055629406100005, "deviation-center-line": 0.19726481878174665, "driven_lanedir_consec": 0.6411204460459565, "sim_compute_sim_state": 0.009604382359124477, "sim_compute_performance-ego0": 0.0018424863129659415}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.26887794448245, "get_ui_image": 0.032870379910952804, "step_physics": 0.12451606556989143, "survival_time": 27.550000000000257, "driven_lanedir": 0.6417059180922563, "get_state_dump": 0.004446655511856079, "get_robot_state": 0.003550117862397346, "sim_render-ego0": 0.003704692574514859, "get_duckie_state": 1.2249186419058538e-06, "in-drivable-lane": 23.500000000000252, "deviation-heading": 1.4696480185792251, "agent_compute-ego0": 0.01291124587473662, "complete-iteration": 0.1967037760693094, "set_robot_commands": 0.0020748471868210945, "deviation-center-line": 0.16565013453312663, "driven_lanedir_consec": 0.6417059180922563, "sim_compute_sim_state": 0.010686456725217296, "sim_compute_performance-ego0": 0.001869867245356242}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.328963379543483, "get_ui_image": 0.026129653011511895, "step_physics": 0.09116655291475322, "survival_time": 22.05000000000018, "driven_lanedir": 0.6902495634203056, "get_state_dump": 0.004411787468923163, "get_robot_state": 0.003511222778941711, "sim_render-ego0": 0.003606929498560289, "get_duckie_state": 1.1651224680076358e-06, "in-drivable-lane": 17.850000000000176, "deviation-heading": 1.3874586927663453, "agent_compute-ego0": 0.011908194598029642, "complete-iteration": 0.14992144043089578, "set_robot_commands": 0.002063151398395521, "deviation-center-line": 0.22129601821432057, "driven_lanedir_consec": 0.6902495634203056, "sim_compute_sim_state": 0.0052045848035165085, "sim_compute_performance-ego0": 0.0018461020284108987}}
set_robot_commands_max0.002161133597038072
set_robot_commands_mean0.0020886903970886734
set_robot_commands_median0.0020689992926083076
set_robot_commands_min0.002055629406100005
sim_compute_performance-ego0_max0.0019162697756320212
sim_compute_performance-ego0_mean0.001868681340591276
sim_compute_performance-ego0_median0.0018579846368835704
sim_compute_performance-ego0_min0.0018424863129659415
sim_compute_sim_state_max0.010686456725217296
sim_compute_sim_state_mean0.00874769963748856
sim_compute_sim_state_median0.00954987851061022
sim_compute_sim_state_min0.0052045848035165085
sim_render-ego0_max0.003712787914037903
sim_render-ego0_mean0.0036646977813836
sim_render-ego0_median0.003669536856468106
sim_render-ego0_min0.003606929498560289
simulation-passed1
step_physics_max0.13570753265829646
step_physics_mean0.1141900737773881
step_physics_median0.11494310476825136
step_physics_min0.09116655291475322
survival_time_max59.99999999999873
survival_time_mean29.299999999999788
survival_time_min7.599999999999981
No reset possible
5788510787Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:08:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2513698378080331
survival_time_median9.875000000000014
deviation-center-line_median0.2474591647581058
in-drivable-lane_median2.7750000000000132


other stats
agent_compute-ego0_max0.012697166496223504
agent_compute-ego0_mean0.012246283783992971
agent_compute-ego0_median0.012145376945210147
agent_compute-ego0_min0.011997214749328092
complete-iteration_max0.24037884647010735
complete-iteration_mean0.1872607153472567
complete-iteration_median0.1787681725705079
complete-iteration_min0.1511276697779035
deviation-center-line_max0.8680891883244731
deviation-center-line_mean0.3729690642212469
deviation-center-line_min0.128868739044303
deviation-heading_max1.5580863688775135
deviation-heading_mean1.152393540924997
deviation-heading_median1.2022040964942842
deviation-heading_min0.6470796018339067
driven_any_max5.76717884129794
driven_any_mean2.614688110388319
driven_any_median1.8469042659969
driven_any_min0.9977650682615364
driven_lanedir_consec_max1.9973731536122945
driven_lanedir_consec_mean1.2947641472492926
driven_lanedir_consec_min0.6789437597688088
driven_lanedir_max1.9973731536122945
driven_lanedir_mean1.2947641472492926
driven_lanedir_median1.2513698378080331
driven_lanedir_min0.6789437597688088
get_duckie_state_max1.2369237394414397e-06
get_duckie_state_mean1.221515780683357e-06
get_duckie_state_median1.2206037456352183e-06
get_duckie_state_min1.2079318920215527e-06
get_robot_state_max0.003648864002678338
get_robot_state_mean0.003554680295710803
get_robot_state_median0.0035399807083023177
get_robot_state_min0.003489895763560238
get_state_dump_max0.010389199623694789
get_state_dump_mean0.005923919068330133
get_state_dump_median0.004445276375377725
get_state_dump_min0.004415923898870295
get_ui_image_max0.03605261827126528
get_ui_image_mean0.03083221471647928
get_ui_image_median0.030569539128024112
get_ui_image_min0.026137162338603623
in-drivable-lane_max19.700000000000237
in-drivable-lane_mean6.800000000000064
in-drivable-lane_min1.949999999999993
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4234649883664434, "get_ui_image": 0.028189844033849523, "step_physics": 0.09304447530761478, "survival_time": 12.650000000000045, "driven_lanedir": 1.9973731536122945, "get_state_dump": 0.004458909898292361, "get_robot_state": 0.003648864002678338, "sim_render-ego0": 0.0038023229659073, "get_duckie_state": 1.217436602735144e-06, "in-drivable-lane": 2.600000000000037, "deviation-heading": 1.2411586114441011, "agent_compute-ego0": 0.01227505188288651, "complete-iteration": 0.15927463065920852, "set_robot_commands": 0.002186826833589809, "deviation-center-line": 0.3658189221669471, "driven_lanedir_consec": 1.9973731536122945, "sim_compute_sim_state": 0.009638090771952951, "sim_compute_performance-ego0": 0.001952812427610863}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.9977650682615364, "get_ui_image": 0.03605261827126528, "step_physics": 0.16067461274627948, "survival_time": 5.799999999999987, "driven_lanedir": 0.6789437597688088, "get_state_dump": 0.010389199623694789, "get_robot_state": 0.003489895763560238, "sim_render-ego0": 0.0036518899803487663, "get_duckie_state": 1.2369237394414397e-06, "in-drivable-lane": 1.949999999999993, "deviation-heading": 1.163249581544467, "agent_compute-ego0": 0.011997214749328092, "complete-iteration": 0.24037884647010735, "set_robot_commands": 0.00206195187364888, "deviation-center-line": 0.128868739044303, "driven_lanedir_consec": 0.6789437597688088, "sim_compute_sim_state": 0.010140498479207356, "sim_compute_performance-ego0": 0.0018463623829377005}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.2703435436273565, "get_ui_image": 0.0329492342221987, "step_physics": 0.12794115326621316, "survival_time": 7.099999999999983, "driven_lanedir": 0.7659032610067296, "get_state_dump": 0.004415923898870295, "get_robot_state": 0.0035340569236061788, "sim_render-ego0": 0.003760896362624802, "get_duckie_state": 1.2237708885352927e-06, "in-drivable-lane": 2.9499999999999895, "deviation-heading": 0.6470796018339067, "agent_compute-ego0": 0.012697166496223504, "complete-iteration": 0.19826171448180727, "set_robot_commands": 0.002136045402580208, "deviation-center-line": 0.12909940734926453, "driven_lanedir_consec": 0.7659032610067296, "sim_compute_sim_state": 0.008850591166036112, "sim_compute_performance-ego0": 0.0019011880968000505}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.76717884129794, "get_ui_image": 0.026137162338603623, "step_physics": 0.09125676105072449, "survival_time": 28.55000000000027, "driven_lanedir": 1.7368364146093371, "get_state_dump": 0.004431642852463088, "get_robot_state": 0.0035459044929984566, "sim_render-ego0": 0.003717217412028279, "get_duckie_state": 1.2079318920215527e-06, "in-drivable-lane": 19.700000000000237, "deviation-heading": 1.5580863688775135, "agent_compute-ego0": 0.012015702007533787, "complete-iteration": 0.1511276697779035, "set_robot_commands": 0.002107500613152564, "deviation-center-line": 0.8680891883244731, "driven_lanedir_consec": 1.7368364146093371, "sim_compute_sim_state": 0.005927057949813096, "sim_compute_performance-ego0": 0.001914352803797155}}
set_robot_commands_max0.002186826833589809
set_robot_commands_mean0.0021230811807428653
set_robot_commands_median0.002121773007866386
set_robot_commands_min0.00206195187364888
sim_compute_performance-ego0_max0.001952812427610863
sim_compute_performance-ego0_mean0.0019036789277864423
sim_compute_performance-ego0_median0.0019077704502986027
sim_compute_performance-ego0_min0.0018463623829377005
sim_compute_sim_state_max0.010140498479207356
sim_compute_sim_state_mean0.008639059591752379
sim_compute_sim_state_median0.00924434096899453
sim_compute_sim_state_min0.005927057949813096
sim_render-ego0_max0.0038023229659073
sim_render-ego0_mean0.003733081680227287
sim_render-ego0_median0.003739056887326541
sim_render-ego0_min0.0036518899803487663
simulation-passed1
step_physics_max0.16067461274627948
step_physics_mean0.11822925059270796
step_physics_median0.11049281428691396
step_physics_min0.09125676105072449
survival_time_max28.55000000000027
survival_time_mean13.525000000000071
survival_time_min5.799999999999987
No reset possible
5786510792Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:15:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.300045626884594
survival_time_median23.4000000000002
deviation-center-line_median0.4882183127612323
in-drivable-lane_median10.899999999999824


other stats
agent_compute-ego0_max0.012443141179434163
agent_compute-ego0_mean0.012129187752566968
agent_compute-ego0_median0.012262646495432091
agent_compute-ego0_min0.01154831683996952
complete-iteration_max0.21162516011132135
complete-iteration_mean0.16962569877384567
complete-iteration_median0.1623831543017617
complete-iteration_min0.1421113263805379
deviation-center-line_max1.831044402797884
deviation-center-line_mean0.7278420969704253
deviation-center-line_min0.10388735956135273
deviation-heading_max6.263473474867585
deviation-heading_mean2.8560448023363025
deviation-heading_median2.197702937289129
deviation-heading_min0.7652998598993676
driven_any_max9.91804902402528
driven_any_mean5.002011863735786
driven_any_median4.687561545674125
driven_any_min0.7148753395696159
driven_lanedir_consec_max7.511949801586041
driven_lanedir_consec_mean2.583491948149809
driven_lanedir_consec_min0.22192673724400613
driven_lanedir_max7.578077965152507
driven_lanedir_mean2.6000239890414254
driven_lanedir_median1.300045626884594
driven_lanedir_min0.22192673724400613
get_duckie_state_max1.266267564561632e-06
get_duckie_state_mean1.1845053701145613e-06
get_duckie_state_median1.1632577270974234e-06
get_duckie_state_min1.1452384617017663e-06
get_robot_state_max0.0037297513749864368
get_robot_state_mean0.0035740040601271164
get_robot_state_median0.0035450131000742996
get_robot_state_min0.003476238665373429
get_state_dump_max0.004639008310106066
get_state_dump_mean0.004415269031367395
get_state_dump_median0.004346410688647811
get_state_dump_min0.004329246438067892
get_ui_image_max0.03587670061323378
get_ui_image_mean0.030291808022323546
get_ui_image_median0.02984041599254511
get_ui_image_min0.02560969949097016
in-drivable-lane_max20.80000000000024
in-drivable-lane_mean11.374999999999968
in-drivable-lane_min2.8999999999999915
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.91804902402528, "get_ui_image": 0.027925000225181303, "step_physics": 0.08901219151460472, "survival_time": 48.39999999999939, "driven_lanedir": 7.578077965152507, "get_state_dump": 0.004348419768153329, "get_robot_state": 0.0035860435143343803, "sim_render-ego0": 0.003912341606998345, "get_duckie_state": 1.147558568554889e-06, "in-drivable-lane": 10.199999999999507, "deviation-heading": 6.263473474867585, "agent_compute-ego0": 0.012443141179434163, "complete-iteration": 0.15480318428685175, "set_robot_commands": 0.002394098492475732, "deviation-center-line": 1.831044402797884, "driven_lanedir_consec": 7.511949801586041, "sim_compute_sim_state": 0.009092353814895678, "sim_compute_performance-ego0": 0.002016301494633819}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7148753395696159, "get_ui_image": 0.03587670061323378, "step_physics": 0.13698185814751518, "survival_time": 4.449999999999992, "driven_lanedir": 0.22192673724400613, "get_state_dump": 0.004639008310106066, "get_robot_state": 0.0037297513749864368, "sim_render-ego0": 0.003776905271742079, "get_duckie_state": 1.266267564561632e-06, "in-drivable-lane": 2.8999999999999915, "deviation-heading": 0.7652998598993676, "agent_compute-ego0": 0.012373224894205727, "complete-iteration": 0.21162516011132135, "set_robot_commands": 0.002159926626417372, "deviation-center-line": 0.10388735956135273, "driven_lanedir_consec": 0.22192673724400613, "sim_compute_sim_state": 0.010092504819234212, "sim_compute_performance-ego0": 0.0019214630126953125}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.798660273337495, "get_ui_image": 0.031755831759908926, "step_physics": 0.0985965521439262, "survival_time": 28.700000000000273, "driven_lanedir": 1.349122135934574, "get_state_dump": 0.004329246438067892, "get_robot_state": 0.003476238665373429, "sim_render-ego0": 0.0035984375165856405, "get_duckie_state": 1.1452384617017663e-06, "in-drivable-lane": 20.80000000000024, "deviation-heading": 3.1990712444612734, "agent_compute-ego0": 0.012152068096658458, "complete-iteration": 0.16996312431667163, "set_robot_commands": 0.0020425245036249577, "deviation-center-line": 0.4930820060235158, "driven_lanedir_consec": 1.349122135934574, "sim_compute_sim_state": 0.012113393700641134, "sim_compute_performance-ego0": 0.0018277997555940049}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.5764628180107554, "get_ui_image": 0.02560969949097016, "step_physics": 0.0833194702453193, "survival_time": 18.10000000000012, "driven_lanedir": 1.2509691178346145, "get_state_dump": 0.004344401609142293, "get_robot_state": 0.003503982685814219, "sim_render-ego0": 0.0035976798738001463, "get_duckie_state": 1.1789568856399578e-06, "in-drivable-lane": 11.600000000000136, "deviation-heading": 1.1963346301169846, "agent_compute-ego0": 0.01154831683996952, "complete-iteration": 0.1421113263805379, "set_robot_commands": 0.002200271144057765, "deviation-center-line": 0.4833546194989488, "driven_lanedir_consec": 1.2509691178346145, "sim_compute_sim_state": 0.006070549494635632, "sim_compute_performance-ego0": 0.001846393606222694}}
set_robot_commands_max0.002394098492475732
set_robot_commands_mean0.0021992051916439564
set_robot_commands_median0.0021800988852375683
set_robot_commands_min0.0020425245036249577
sim_compute_performance-ego0_max0.002016301494633819
sim_compute_performance-ego0_mean0.001902989467286458
sim_compute_performance-ego0_median0.0018839283094590031
sim_compute_performance-ego0_min0.0018277997555940049
sim_compute_sim_state_max0.012113393700641134
sim_compute_sim_state_mean0.009342200457351664
sim_compute_sim_state_median0.009592429317064943
sim_compute_sim_state_min0.006070549494635632
sim_render-ego0_max0.003912341606998345
sim_render-ego0_mean0.0037213410672815527
sim_render-ego0_median0.003687671394163859
sim_render-ego0_min0.0035976798738001463
simulation-passed1
step_physics_max0.13698185814751518
step_physics_mean0.10197751801284136
step_physics_median0.09380437182926546
step_physics_min0.0833194702453193
survival_time_max48.39999999999939
survival_time_mean24.91249999999994
survival_time_min4.449999999999992
No reset possible
5785610793Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:04:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 96 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5764211428Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesgpu-prod-012:15:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5969566709909038
survival_time_median59.99999999999873
deviation-center-line_median0.5618241490776349
in-drivable-lane_median51.62499999999871


other stats
agent_compute-ego0_max0.012864036028033788
agent_compute-ego0_mean0.012573800019479412
agent_compute-ego0_median0.012753037786999908
agent_compute-ego0_min0.011525844554917003
agent_compute-ego1_max0.01274700804018756
agent_compute-ego1_mean0.011782832075926468
agent_compute-ego1_median0.0117545677759963
agent_compute-ego1_min0.011154128351775336
agent_compute-ego2_max0.012722399709226688
agent_compute-ego2_mean0.01213476487804776
agent_compute-ego2_median0.012073203189287654
agent_compute-ego2_min0.01160869173562894
agent_compute-ego3_max0.012707073225963126
agent_compute-ego3_mean0.012135380346047822
agent_compute-ego3_median0.01227203217473852
agent_compute-ego3_min0.01142703563744182
complete-iteration_max1.3011086296777146
complete-iteration_mean1.1471748941645434
complete-iteration_median1.2893632774448316
complete-iteration_min0.4075307482783741
deviation-center-line_max1.6337474380723414
deviation-center-line_mean0.7390340216476464
deviation-center-line_min0.06238799767588026
deviation-heading_max14.106478529349191
deviation-heading_mean6.315012718312645
deviation-heading_median6.232835251141916
deviation-heading_min0.6619884347192766
driven_any_max10.12700503319739
driven_any_mean5.370221769741688
driven_any_median5.864819486592522
driven_any_min0.1499667058550362
driven_lanedir_consec_max1.3069641108957928
driven_lanedir_consec_mean0.668469632669369
driven_lanedir_consec_min0.07449922085983385
driven_lanedir_max1.4997199086454116
driven_lanedir_mean0.8056025827138839
driven_lanedir_median0.9211968063979404
driven_lanedir_min0.07449922085983385
get_duckie_state_max1.265147047971905e-06
get_duckie_state_mean1.209080254718213e-06
get_duckie_state_median1.19844543050469e-06
get_duckie_state_min1.155367302557114e-06
get_robot_state_max0.013927188145925758
get_robot_state_mean0.012883684985969757
get_robot_state_median0.013876649958207945
get_robot_state_min0.007004449409211704
get_state_dump_max0.00935915884229166
get_state_dump_mean0.008744433701243967
get_state_dump_median0.009166668694184086
get_state_dump_min0.005927324295043945
get_ui_image_max0.04905221841416688
get_ui_image_mean0.043361919706409714
get_ui_image_median0.04602749182917891
get_ui_image_min0.030067536157930425
in-drivable-lane_max59.04999999999873
in-drivable-lane_mean52.27857142857021
in-drivable-lane_min43.34999999999877
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.6667723901091983, "get_ui_image": 0.041653240650123005, "step_physics": 1.0630035692210202, "survival_time": 59.99999999999873, "driven_lanedir": 0.2161199697119427, "get_state_dump": 0.009116028270356165, "get_robot_state": 0.013876649958207945, "sim_render-ego0": 0.003838483141820496, "sim_render-ego1": 0.0035906687664251143, "sim_render-ego2": 0.003689355993151764, "sim_render-ego3": 0.0035988611543704627, "get_duckie_state": 1.265147047971905e-06, "in-drivable-lane": 57.94999999999873, "deviation-heading": 1.2997840722593588, "agent_compute-ego0": 0.012628303975685748, "agent_compute-ego1": 0.011154128351775336, "agent_compute-ego2": 0.012073203189287654, "agent_compute-ego3": 0.01142703563744182, "complete-iteration": 1.2208748483141694, "set_robot_commands": 0.0021055602312683563, "deviation-center-line": 0.16496135781581422, "driven_lanedir_consec": 0.2161199697119427, "sim_compute_sim_state": 0.015111001306132016, "sim_compute_performance-ego0": 0.0018542938486523276, "sim_compute_performance-ego1": 0.001907718667976068, "sim_compute_performance-ego2": 0.0018323891168827817, "sim_compute_performance-ego3": 0.001878428518722496}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 9.074573388590196, "get_ui_image": 0.041653240650123005, "step_physics": 1.0630035692210202, "survival_time": 59.99999999999873, "driven_lanedir": 1.048270625662795, "get_state_dump": 0.009116028270356165, "get_robot_state": 0.013876649958207945, "sim_render-ego0": 0.003838483141820496, "sim_render-ego1": 0.0035906687664251143, "sim_render-ego2": 0.003689355993151764, "sim_render-ego3": 0.0035988611543704627, "get_duckie_state": 1.265147047971905e-06, "in-drivable-lane": 46.94999999999888, "deviation-heading": 12.556385456499044, "agent_compute-ego0": 0.012628303975685748, "agent_compute-ego1": 0.011154128351775336, "agent_compute-ego2": 0.012073203189287654, "agent_compute-ego3": 0.01142703563744182, "complete-iteration": 1.2208748483141694, "set_robot_commands": 0.0021055602312683563, "deviation-center-line": 1.4599128705012154, "driven_lanedir_consec": 0.7500215169193616, "sim_compute_sim_state": 0.015111001306132016, "sim_compute_performance-ego0": 0.0018542938486523276, "sim_compute_performance-ego1": 0.001907718667976068, "sim_compute_performance-ego2": 0.0018323891168827817, "sim_compute_performance-ego3": 0.001878428518722496}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 3.027009867150717, "get_ui_image": 0.041653240650123005, "step_physics": 1.0630035692210202, "survival_time": 59.99999999999873, "driven_lanedir": 0.5580329454516948, "get_state_dump": 0.009116028270356165, "get_robot_state": 0.013876649958207945, "sim_render-ego0": 0.003838483141820496, "sim_render-ego1": 0.0035906687664251143, "sim_render-ego2": 0.003689355993151764, "sim_render-ego3": 0.0035988611543704627, "get_duckie_state": 1.265147047971905e-06, "in-drivable-lane": 55.54999999999872, "deviation-heading": 2.9555023000726934, "agent_compute-ego0": 0.012628303975685748, "agent_compute-ego1": 0.011154128351775336, "agent_compute-ego2": 0.012073203189287654, "agent_compute-ego3": 0.01142703563744182, "complete-iteration": 1.2208748483141694, "set_robot_commands": 0.0021055602312683563, "deviation-center-line": 0.3653513246597538, "driven_lanedir_consec": 0.5580329454516948, "sim_compute_sim_state": 0.015111001306132016, "sim_compute_performance-ego0": 0.0018542938486523276, "sim_compute_performance-ego1": 0.001907718667976068, "sim_compute_performance-ego2": 0.0018323891168827817, "sim_compute_performance-ego3": 0.001878428518722496}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 7.863215134961797, "get_ui_image": 0.041653240650123005, "step_physics": 1.0630035692210202, "survival_time": 59.99999999999873, "driven_lanedir": 0.7952403859460621, "get_state_dump": 0.009116028270356165, "get_robot_state": 0.013876649958207945, "sim_render-ego0": 0.003838483141820496, "sim_render-ego1": 0.0035906687664251143, "sim_render-ego2": 0.003689355993151764, "sim_render-ego3": 0.0035988611543704627, "get_duckie_state": 1.265147047971905e-06, "in-drivable-lane": 53.09999999999876, "deviation-heading": 7.05390324100487, "agent_compute-ego0": 0.012628303975685748, "agent_compute-ego1": 0.011154128351775336, "agent_compute-ego2": 0.012073203189287654, "agent_compute-ego3": 0.01142703563744182, "complete-iteration": 1.2208748483141694, "set_robot_commands": 0.0021055602312683563, "deviation-center-line": 0.6364976248869058, "driven_lanedir_consec": 0.5679643878020303, "sim_compute_sim_state": 0.015111001306132016, "sim_compute_performance-ego0": 0.0018542938486523276, "sim_compute_performance-ego1": 0.001907718667976068, "sim_compute_performance-ego2": 0.0018323891168827817, "sim_compute_performance-ego3": 0.001878428518722496}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 3.616949947829921, "get_ui_image": 0.04905221841416688, "step_physics": 1.1137828052689094, "survival_time": 59.99999999999873, "driven_lanedir": 1.2558502630705, "get_state_dump": 0.009166668694184086, "get_robot_state": 0.01378683464215459, "sim_render-ego0": 0.0036486009078458585, "sim_render-ego1": 0.0035671743127726, "sim_render-ego2": 0.0035553919484871415, "sim_render-ego3": 0.003657758285560576, "get_duckie_state": 1.190504761758593e-06, "in-drivable-lane": 49.49999999999865, "deviation-heading": 7.849923758071949, "agent_compute-ego0": 0.012864036028033788, "agent_compute-ego1": 0.01274700804018756, "agent_compute-ego2": 0.012722399709226688, "agent_compute-ego3": 0.012707073225963126, "complete-iteration": 1.2893632774448316, "set_robot_commands": 0.002127083016871215, "deviation-center-line": 0.4871506732683641, "driven_lanedir_consec": 1.2558502630705, "sim_compute_sim_state": 0.021921316848805703, "sim_compute_performance-ego0": 0.0018808670980944224, "sim_compute_performance-ego1": 0.0018735342875408393, "sim_compute_performance-ego2": 0.001873492201996485, "sim_compute_performance-ego3": 0.0018436946440100372}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 5.461567476974691, "get_ui_image": 0.04905221841416688, "step_physics": 1.1137828052689094, "survival_time": 59.99999999999873, "driven_lanedir": 1.1342174132457077, "get_state_dump": 0.009166668694184086, "get_robot_state": 0.01378683464215459, "sim_render-ego0": 0.0036486009078458585, "sim_render-ego1": 0.0035671743127726, "sim_render-ego2": 0.0035553919484871415, "sim_render-ego3": 0.003657758285560576, "get_duckie_state": 1.190504761758593e-06, "in-drivable-lane": 50.149999999998656, "deviation-heading": 8.339350470373578, "agent_compute-ego0": 0.012864036028033788, "agent_compute-ego1": 0.01274700804018756, "agent_compute-ego2": 0.012722399709226688, "agent_compute-ego3": 0.012707073225963126, "complete-iteration": 1.2893632774448316, "set_robot_commands": 0.002127083016871215, "deviation-center-line": 0.937816090228152, "driven_lanedir_consec": 1.1342174132457077, "sim_compute_sim_state": 0.021921316848805703, "sim_compute_performance-ego0": 0.0018808670980944224, "sim_compute_performance-ego1": 0.0018735342875408393, "sim_compute_performance-ego2": 0.001873492201996485, "sim_compute_performance-ego3": 0.0018436946440100372}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 10.12700503319739, "get_ui_image": 0.04905221841416688, "step_physics": 1.1137828052689094, "survival_time": 59.99999999999873, "driven_lanedir": 1.1363922122194567, "get_state_dump": 0.009166668694184086, "get_robot_state": 0.01378683464215459, "sim_render-ego0": 0.0036486009078458585, "sim_render-ego1": 0.0035671743127726, "sim_render-ego2": 0.0035553919484871415, "sim_render-ego3": 0.003657758285560576, "get_duckie_state": 1.190504761758593e-06, "in-drivable-lane": 47.099999999999184, "deviation-heading": 12.092803493428775, "agent_compute-ego0": 0.012864036028033788, "agent_compute-ego1": 0.01274700804018756, "agent_compute-ego2": 0.012722399709226688, "agent_compute-ego3": 0.012707073225963126, "complete-iteration": 1.2893632774448316, "set_robot_commands": 0.002127083016871215, "deviation-center-line": 1.233095650769608, "driven_lanedir_consec": 0.4412546827902428, "sim_compute_sim_state": 0.021921316848805703, "sim_compute_performance-ego0": 0.0018808670980944224, "sim_compute_performance-ego1": 0.0018735342875408393, "sim_compute_performance-ego2": 0.001873492201996485, "sim_compute_performance-ego3": 0.0018436946440100372}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.5419806694476839, "get_ui_image": 0.04905221841416688, "step_physics": 1.1137828052689094, "survival_time": 59.99999999999873, "driven_lanedir": 0.26060187157226045, "get_state_dump": 0.009166668694184086, "get_robot_state": 0.01378683464215459, "sim_render-ego0": 0.0036486009078458585, "sim_render-ego1": 0.0035671743127726, "sim_render-ego2": 0.0035553919484871415, "sim_render-ego3": 0.003657758285560576, "get_duckie_state": 1.190504761758593e-06, "in-drivable-lane": 58.39999999999873, "deviation-heading": 0.6619884347192766, "agent_compute-ego0": 0.012864036028033788, "agent_compute-ego1": 0.01274700804018756, "agent_compute-ego2": 0.012722399709226688, "agent_compute-ego3": 0.012707073225963126, "complete-iteration": 1.2893632774448316, "set_robot_commands": 0.002127083016871215, "deviation-center-line": 0.10742927496267586, "driven_lanedir_consec": 0.26060187157226045, "sim_compute_sim_state": 0.021921316848805703, "sim_compute_performance-ego0": 0.0018808670980944224, "sim_compute_performance-ego1": 0.0018735342875408393, "sim_compute_performance-ego2": 0.001873492201996485, "sim_compute_performance-ego3": 0.0018436946440100372}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.1499667058550362, "get_ui_image": 0.04602749182917891, "step_physics": 1.1297079776347825, "survival_time": 59.99999999999873, "driven_lanedir": 0.07449922085983385, "get_state_dump": 0.00935915884229166, "get_robot_state": 0.013927188145925758, "sim_render-ego0": 0.00391751959560118, "sim_render-ego1": 0.0037193153422639138, "sim_render-ego2": 0.0036553290364744265, "sim_render-ego3": 0.0038472420964808783, "get_duckie_state": 1.19844543050469e-06, "in-drivable-lane": 59.04999999999873, "deviation-heading": 0.7723376624982456, "agent_compute-ego0": 0.012753037786999908, "agent_compute-ego1": 0.0117545677759963, "agent_compute-ego2": 0.01160869173562894, "agent_compute-ego3": 0.01227203217473852, "complete-iteration": 1.3011086296777146, "set_robot_commands": 0.002218550587573913, "deviation-center-line": 0.06238799767588026, "driven_lanedir_consec": 0.07449922085983385, "sim_compute_sim_state": 0.022056318341842004, "sim_compute_performance-ego0": 0.0019197215843359495, "sim_compute_performance-ego1": 0.0019364029442043129, "sim_compute_performance-ego2": 0.0018988278982145009, "sim_compute_performance-ego3": 0.001881014198982944}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 6.268071496210352, "get_ui_image": 0.04602749182917891, "step_physics": 1.1297079776347825, "survival_time": 59.99999999999873, "driven_lanedir": 1.0471532268498192, "get_state_dump": 0.00935915884229166, "get_robot_state": 0.013927188145925758, "sim_render-ego0": 0.00391751959560118, "sim_render-ego1": 0.0037193153422639138, "sim_render-ego2": 0.0036553290364744265, "sim_render-ego3": 0.0038472420964808783, "get_duckie_state": 1.19844543050469e-06, "in-drivable-lane": 47.94999999999883, "deviation-heading": 10.72986870617064, "agent_compute-ego0": 0.012753037786999908, "agent_compute-ego1": 0.0117545677759963, "agent_compute-ego2": 0.01160869173562894, "agent_compute-ego3": 0.01227203217473852, "complete-iteration": 1.3011086296777146, "set_robot_commands": 0.002218550587573913, "deviation-center-line": 1.40477212021685, "driven_lanedir_consec": 0.6832182042898385, "sim_compute_sim_state": 0.022056318341842004, "sim_compute_performance-ego0": 0.0019197215843359495, "sim_compute_performance-ego1": 0.0019364029442043129, "sim_compute_performance-ego2": 0.0018988278982145009, "sim_compute_performance-ego3": 0.001881014198982944}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 10.05649064284549, "get_ui_image": 0.04602749182917891, "step_physics": 1.1297079776347825, "survival_time": 59.99999999999873, "driven_lanedir": 1.3069641108957928, "get_state_dump": 0.00935915884229166, "get_robot_state": 0.013927188145925758, "sim_render-ego0": 0.00391751959560118, "sim_render-ego1": 0.0037193153422639138, "sim_render-ego2": 0.0036553290364744265, "sim_render-ego3": 0.0038472420964808783, "get_duckie_state": 1.19844543050469e-06, "in-drivable-lane": 50.04999999999893, "deviation-heading": 5.411767261278962, "agent_compute-ego0": 0.012753037786999908, "agent_compute-ego1": 0.0117545677759963, "agent_compute-ego2": 0.01160869173562894, "agent_compute-ego3": 0.01227203217473852, "complete-iteration": 1.3011086296777146, "set_robot_commands": 0.002218550587573913, "deviation-center-line": 1.26959650974031, "driven_lanedir_consec": 1.3069641108957928, "sim_compute_sim_state": 0.022056318341842004, "sim_compute_performance-ego0": 0.0019197215843359495, "sim_compute_performance-ego1": 0.0019364029442043129, "sim_compute_performance-ego2": 0.0018988278982145009, "sim_compute_performance-ego3": 0.001881014198982944}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.5395906458736648, "get_ui_image": 0.04602749182917891, "step_physics": 1.1297079776347825, "survival_time": 59.99999999999873, "driven_lanedir": 0.3194250496833191, "get_state_dump": 0.00935915884229166, "get_robot_state": 0.013927188145925758, "sim_render-ego0": 0.00391751959560118, "sim_render-ego1": 0.0037193153422639138, "sim_render-ego2": 0.0036553290364744265, "sim_render-ego3": 0.0038472420964808783, "get_duckie_state": 1.19844543050469e-06, "in-drivable-lane": 58.09999999999873, "deviation-heading": 0.8001024171209818, "agent_compute-ego0": 0.012753037786999908, "agent_compute-ego1": 0.0117545677759963, "agent_compute-ego2": 0.01160869173562894, "agent_compute-ego3": 0.01227203217473852, "complete-iteration": 1.3011086296777146, "set_robot_commands": 0.002218550587573913, "deviation-center-line": 0.10331762432368996, "driven_lanedir_consec": 0.3194250496833191, "sim_compute_sim_state": 0.022056318341842004, "sim_compute_performance-ego0": 0.0019197215843359495, "sim_compute_performance-ego1": 0.0019364029442043129, "sim_compute_performance-ego2": 0.0018988278982145009, "sim_compute_performance-ego3": 0.001881014198982944}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 8.849549670516055, "get_ui_image": 0.030067536157930425, "step_physics": 0.3158810511913824, "survival_time": 59.99999999999873, "driven_lanedir": 0.6259489541797774, "get_state_dump": 0.005927324295043945, "get_robot_state": 0.007004449409211704, "sim_render-ego0": 0.003664319858662195, "sim_render-ego1": 0.003609381150842011, "get_duckie_state": 1.155367302557114e-06, "in-drivable-lane": 54.69999999999872, "deviation-heading": 3.779982253529457, "agent_compute-ego0": 0.011525844554917003, "agent_compute-ego1": 0.011168416195566909, "complete-iteration": 0.4075307482783741, "set_robot_commands": 0.002144737704211131, "deviation-center-line": 0.4804397459454878, "driven_lanedir_consec": 0.6259489541797774, "sim_compute_sim_state": 0.0104998114901121, "sim_compute_performance-ego0": 0.0019005283924264772, "sim_compute_performance-ego1": 0.0018820306045824445}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 8.940361706821445, "get_ui_image": 0.030067536157930425, "step_physics": 0.3158810511913824, "survival_time": 59.99999999999873, "driven_lanedir": 1.4997199086454116, "get_state_dump": 0.005927324295043945, "get_robot_state": 0.007004449409211704, "sim_render-ego0": 0.003664319858662195, "sim_render-ego1": 0.003609381150842011, "get_duckie_state": 1.155367302557114e-06, "in-drivable-lane": 43.34999999999877, "deviation-heading": 14.106478529349191, "agent_compute-ego0": 0.011525844554917003, "agent_compute-ego1": 0.011168416195566909, "complete-iteration": 0.4075307482783741, "set_robot_commands": 0.002144737704211131, "deviation-center-line": 1.6337474380723414, "driven_lanedir_consec": 1.164456266898864, "sim_compute_sim_state": 0.0104998114901121, "sim_compute_performance-ego0": 0.0019005283924264772, "sim_compute_performance-ego1": 0.0018820306045824445}}
set_robot_commands_max0.002218550587573913
set_robot_commands_mean0.0021495893393768716
set_robot_commands_median0.002127083016871215
set_robot_commands_min0.0021055602312683563
sim_compute_performance-ego0_max0.0019197215843359495
sim_compute_performance-ego0_mean0.0018871847792274112
sim_compute_performance-ego0_median0.0018808670980944224
sim_compute_performance-ego0_min0.0018542938486523276
sim_compute_performance-ego1_max0.0019364029442043129
sim_compute_performance-ego1_mean0.0019024774862892691
sim_compute_performance-ego1_median0.001907718667976068
sim_compute_performance-ego1_min0.0018735342875408393
sim_compute_performance-ego2_max0.0018988278982145009
sim_compute_performance-ego2_mean0.0018682364056979224
sim_compute_performance-ego2_median0.001873492201996485
sim_compute_performance-ego2_min0.0018323891168827817
sim_compute_performance-ego3_max0.001881014198982944
sim_compute_performance-ego3_mean0.0018677124539051592
sim_compute_performance-ego3_median0.001878428518722496
sim_compute_performance-ego3_min0.0018436946440100372
sim_compute_sim_state_max0.022056318341842004
sim_compute_sim_state_mean0.018382440640524512
sim_compute_sim_state_median0.021921316848805703
sim_compute_sim_state_min0.0104998114901121
sim_render-ego0_max0.00391751959560118
sim_render-ego0_mean0.003781932449885324
sim_render-ego0_median0.003838483141820496
sim_render-ego0_min0.0036486009078458585
sim_render-ego1_max0.0037193153422639138
sim_render-ego1_mean0.003623385427680752
sim_render-ego1_median0.0035906687664251143
sim_render-ego1_min0.0035671743127726
sim_render-ego2_max0.003689355993151764
sim_render-ego2_mean0.003633358992704444
sim_render-ego2_median0.0036553290364744265
sim_render-ego2_min0.0035553919484871415
sim_render-ego3_max0.0038472420964808783
sim_render-ego3_mean0.0037012871788039726
sim_render-ego3_median0.003657758285560576
sim_render-ego3_min0.0035988611543704627
simulation-passed1
step_physics_max1.1297079776347825
step_physics_mean0.9898385364915436
step_physics_median1.1137828052689094
step_physics_min0.3158810511913824
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible
5760110912Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:25:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.509647751997459
survival_time_median46.19999999999951
deviation-center-line_median1.424207258956277
in-drivable-lane_median3.775000000000039


other stats
agent_compute-ego0_max0.012947998833410518
agent_compute-ego0_mean0.01240289454169702
agent_compute-ego0_median0.012333684632642752
agent_compute-ego0_min0.01199621006809206
complete-iteration_max0.19187017900560616
complete-iteration_mean0.17457295997225283
complete-iteration_median0.17700925565320005
complete-iteration_min0.152403149577005
deviation-center-line_max2.8860668872437514
deviation-center-line_mean1.5415620339419678
deviation-center-line_min0.4317667306115656
deviation-heading_max10.100984935732429
deviation-heading_mean6.054342708829027
deviation-heading_median6.015008145182632
deviation-heading_min2.0863696092184143
driven_any_max9.26234500858708
driven_any_mean6.7453937664037475
driven_any_median7.1416487904309145
driven_any_min3.4359324761660774
driven_lanedir_consec_max9.139274808546173
driven_lanedir_consec_mean6.006689522145926
driven_lanedir_consec_min1.868187776042612
driven_lanedir_max9.139274808546173
driven_lanedir_mean6.006689522145926
driven_lanedir_median6.509647751997459
driven_lanedir_min1.868187776042612
get_duckie_state_max1.6330443706709084e-06
get_duckie_state_mean1.586625517085588e-06
get_duckie_state_median1.580490855551282e-06
get_duckie_state_min1.55247598656888e-06
get_robot_state_max0.003651947380030651
get_robot_state_mean0.0035506122014193893
get_robot_state_median0.0035446543189555603
get_robot_state_min0.003461192787735786
get_state_dump_max0.004475025294982281
get_state_dump_mean0.004359421436338521
get_state_dump_median0.0043608839199943145
get_state_dump_min0.004240892610383172
get_ui_image_max0.035818703069377206
get_ui_image_mean0.03045590042700019
get_ui_image_median0.030048129376510253
get_ui_image_min0.025908639885603043
in-drivable-lane_max11.400000000000162
in-drivable-lane_mean4.73750000000006
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.038076366616863, "get_ui_image": 0.027705184483932235, "step_physics": 0.10013263361479724, "survival_time": 32.4000000000003, "driven_lanedir": 3.9431485038655785, "get_state_dump": 0.0044044302130700624, "get_robot_state": 0.003651947380030651, "sim_render-ego0": 0.0037474081218701848, "get_duckie_state": 1.55247598656888e-06, "in-drivable-lane": 7.550000000000079, "deviation-heading": 4.622624794990216, "agent_compute-ego0": 0.0124457837620575, "complete-iteration": 0.16689983060804464, "set_robot_commands": 0.002184230116739846, "deviation-center-line": 1.263535346444428, "driven_lanedir_consec": 3.9431485038655785, "sim_compute_sim_state": 0.01060298815346646, "sim_compute_performance-ego0": 0.001953167614106588}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.26234500858708, "get_ui_image": 0.035818703069377206, "step_physics": 0.11583376486632944, "survival_time": 59.99999999999873, "driven_lanedir": 9.07614700012934, "get_state_dump": 0.004240892610383172, "get_robot_state": 0.003461192787735786, "sim_render-ego0": 0.003571831912025623, "get_duckie_state": 1.5867441321888337e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.100984935732429, "agent_compute-ego0": 0.012221585503228004, "complete-iteration": 0.19187017900560616, "set_robot_commands": 0.002155619795177501, "deviation-center-line": 2.8860668872437514, "driven_lanedir_consec": 9.07614700012934, "sim_compute_sim_state": 0.01267140910190706, "sim_compute_performance-ego0": 0.0018274071413114804}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.4359324761660774, "get_ui_image": 0.03239107426908827, "step_physics": 0.11499869208974936, "survival_time": 24.20000000000021, "driven_lanedir": 1.868187776042612, "get_state_dump": 0.004475025294982281, "get_robot_state": 0.0036028798093500824, "sim_render-ego0": 0.0037759240140619967, "get_duckie_state": 1.6330443706709084e-06, "in-drivable-lane": 11.400000000000162, "deviation-heading": 2.0863696092184143, "agent_compute-ego0": 0.012947998833410518, "complete-iteration": 0.18711868069835544, "set_robot_commands": 0.002134158439242963, "deviation-center-line": 0.4317667306115656, "driven_lanedir_consec": 1.868187776042612, "sim_compute_sim_state": 0.010799232954831468, "sim_compute_performance-ego0": 0.0019240625125845684}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.245221214244966, "get_ui_image": 0.025908639885603043, "step_physics": 0.09296969688504464, "survival_time": 59.99999999999873, "driven_lanedir": 9.139274808546173, "get_state_dump": 0.0043173376269185675, "get_robot_state": 0.003486428828561038, "sim_render-ego0": 0.003607095627860165, "get_duckie_state": 1.5742375789137307e-06, "in-drivable-lane": 0.0, "deviation-heading": 7.407391495375048, "agent_compute-ego0": 0.01199621006809206, "complete-iteration": 0.152403149577005, "set_robot_commands": 0.002157559303518735, "deviation-center-line": 1.5848791714681267, "driven_lanedir_consec": 9.139274808546173, "sim_compute_sim_state": 0.006032830372539587, "sim_compute_performance-ego0": 0.001857799852420448}}
set_robot_commands_max0.002184230116739846
set_robot_commands_mean0.0021578919136697617
set_robot_commands_median0.002156589549348118
set_robot_commands_min0.002134158439242963
sim_compute_performance-ego0_max0.001953167614106588
sim_compute_performance-ego0_mean0.0018906092801057712
sim_compute_performance-ego0_median0.001890931182502508
sim_compute_performance-ego0_min0.0018274071413114804
sim_compute_sim_state_max0.01267140910190706
sim_compute_sim_state_mean0.010026615145686145
sim_compute_sim_state_median0.010701110554148964
sim_compute_sim_state_min0.006032830372539587
sim_render-ego0_max0.0037759240140619967
sim_render-ego0_mean0.003675564918954493
sim_render-ego0_median0.003677251874865175
sim_render-ego0_min0.003571831912025623
simulation-passed1
step_physics_max0.11583376486632944
step_physics_mean0.10598369686398018
step_physics_median0.10756566285227331
step_physics_min0.09296969688504464
survival_time_max59.99999999999873
survival_time_mean44.14999999999949
survival_time_min24.20000000000021
No reset possible
5709611427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessyesgpu-prod-012:12:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.447127254731348
survival_time_median59.99999999999873
deviation-center-line_median1.6283501088755528
in-drivable-lane_median36.77499999999916


other stats
agent_compute-ego0_max0.012595364096559753
agent_compute-ego0_mean0.012198120373330788
agent_compute-ego0_median0.012232071156307225
agent_compute-ego0_min0.011608942660761316
agent_compute-ego1_max0.011943334147495394
agent_compute-ego1_mean0.011392292772757964
agent_compute-ego1_median0.011324998044054476
agent_compute-ego1_min0.01081605676211088
agent_compute-ego2_max0.012306509168817042
agent_compute-ego2_mean0.01193543688773844
agent_compute-ego2_median0.011907718858552118
agent_compute-ego2_min0.011592082635846166
agent_compute-ego3_max0.01234396431070879
agent_compute-ego3_mean0.012158103363731652
agent_compute-ego3_median0.012108079996037543
agent_compute-ego3_min0.012022265784448628
complete-iteration_max1.3024133111316891
complete-iteration_mean1.108422967473576
complete-iteration_median1.2900912866902092
complete-iteration_min0.4026164242270388
deviation-center-line_max7.589457362821848
deviation-center-line_mean2.020982816197475
deviation-center-line_min0.6591087648584802
deviation-heading_max62.58432573331654
deviation-heading_mean19.79281609856873
deviation-heading_median17.431719611896632
deviation-heading_min5.073872371908684
driven_any_max13.500328602914006
driven_any_mean4.2237979584574665
driven_any_median2.529115884668586
driven_any_min0.26894841869576286
driven_lanedir_consec_max1.7311058069939012
driven_lanedir_consec_mean0.638779191122479
driven_lanedir_consec_min0.0366082895592188
driven_lanedir_max1.7311058069939012
driven_lanedir_mean0.6843986548769291
driven_lanedir_median0.6756708876191944
driven_lanedir_min0.0366082895592188
get_duckie_state_max1.807891756767635e-06
get_duckie_state_mean1.7330225943044348e-06
get_duckie_state_median1.739204972113896e-06
get_duckie_state_min1.6699226373041995e-06
get_robot_state_max0.013772207136257405
get_robot_state_mean0.012755784521038246
get_robot_state_median0.013720172529514386
get_robot_state_min0.0069456205677728075
get_state_dump_max0.009202363389814824
get_state_dump_mean0.008698819181901232
get_state_dump_median0.009179880577360562
get_state_dump_min0.005820003973256539
get_ui_image_max0.04912376086181844
get_ui_image_mean0.04417195052982611
get_ui_image_median0.04769778092834574
get_ui_image_min0.029137404137705884
in-drivable-lane_max52.99999999999871
in-drivable-lane_mean36.41428571428481
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.848049196456282, "get_ui_image": 0.04321158299537424, "step_physics": 0.9097056724348236, "survival_time": 59.99999999999873, "driven_lanedir": 0.7956429541975616, "get_state_dump": 0.009202363389814824, "get_robot_state": 0.013772207136257405, "sim_render-ego0": 0.0035939500492677204, "sim_render-ego1": 0.0035887834531480724, "sim_render-ego2": 0.0035813898964785814, "sim_render-ego3": 0.0035364455128589537, "get_duckie_state": 1.807891756767635e-06, "in-drivable-lane": 32.399999999999366, "deviation-heading": 21.515669528699373, "agent_compute-ego0": 0.01206151472341012, "agent_compute-ego1": 0.011324998044054476, "agent_compute-ego2": 0.011592082635846166, "agent_compute-ego3": 0.012108079996037543, "complete-iteration": 1.0856675762220982, "set_robot_commands": 0.0021444462816681492, "deviation-center-line": 2.1262894639063923, "driven_lanedir_consec": 0.327842894389599, "sim_compute_sim_state": 0.03226517896469586, "sim_compute_performance-ego0": 0.0018769999924150732, "sim_compute_performance-ego1": 0.001855133772888946, "sim_compute_performance-ego2": 0.001849114348945967, "sim_compute_performance-ego3": 0.001834084052626636}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.3871771105467976, "get_ui_image": 0.04321158299537424, "step_physics": 0.9097056724348236, "survival_time": 59.99999999999873, "driven_lanedir": 0.11622760525843834, "get_state_dump": 0.009202363389814824, "get_robot_state": 0.013772207136257405, "sim_render-ego0": 0.0035939500492677204, "sim_render-ego1": 0.0035887834531480724, "sim_render-ego2": 0.0035813898964785814, "sim_render-ego3": 0.0035364455128589537, "get_duckie_state": 1.807891756767635e-06, "in-drivable-lane": 42.04999999999868, "deviation-heading": 13.88044522197606, "agent_compute-ego0": 0.01206151472341012, "agent_compute-ego1": 0.011324998044054476, "agent_compute-ego2": 0.011592082635846166, "agent_compute-ego3": 0.012108079996037543, "complete-iteration": 1.0856675762220982, "set_robot_commands": 0.0021444462816681492, "deviation-center-line": 1.236583104972925, "driven_lanedir_consec": 0.11622760525843834, "sim_compute_sim_state": 0.03226517896469586, "sim_compute_performance-ego0": 0.0018769999924150732, "sim_compute_performance-ego1": 0.001855133772888946, "sim_compute_performance-ego2": 0.001849114348945967, "sim_compute_performance-ego3": 0.001834084052626636}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 13.500328602914006, "get_ui_image": 0.04321158299537424, "step_physics": 0.9097056724348236, "survival_time": 59.99999999999873, "driven_lanedir": 0.7849301601652918, "get_state_dump": 0.009202363389814824, "get_robot_state": 0.013772207136257405, "sim_render-ego0": 0.0035939500492677204, "sim_render-ego1": 0.0035887834531480724, "sim_render-ego2": 0.0035813898964785814, "sim_render-ego3": 0.0035364455128589537, "get_duckie_state": 1.807891756767635e-06, "in-drivable-lane": 50.69999999999875, "deviation-heading": 10.097062676648228, "agent_compute-ego0": 0.01206151472341012, "agent_compute-ego1": 0.011324998044054476, "agent_compute-ego2": 0.011592082635846166, "agent_compute-ego3": 0.012108079996037543, "complete-iteration": 1.0856675762220982, "set_robot_commands": 0.0021444462816681492, "deviation-center-line": 0.8660974976284533, "driven_lanedir_consec": 0.7554722941179006, "sim_compute_sim_state": 0.03226517896469586, "sim_compute_performance-ego0": 0.0018769999924150732, "sim_compute_performance-ego1": 0.001855133772888946, "sim_compute_performance-ego2": 0.001849114348945967, "sim_compute_performance-ego3": 0.001834084052626636}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 5.7791275800018385, "get_ui_image": 0.04321158299537424, "step_physics": 0.9097056724348236, "survival_time": 59.99999999999873, "driven_lanedir": 1.3327536407836664, "get_state_dump": 0.009202363389814824, "get_robot_state": 0.013772207136257405, "sim_render-ego0": 0.0035939500492677204, "sim_render-ego1": 0.0035887834531480724, "sim_render-ego2": 0.0035813898964785814, "sim_render-ego3": 0.0035364455128589537, "get_duckie_state": 1.807891756767635e-06, "in-drivable-lane": 38.24999999999888, "deviation-heading": 17.13243498544962, "agent_compute-ego0": 0.01206151472341012, "agent_compute-ego1": 0.011324998044054476, "agent_compute-ego2": 0.011592082635846166, "agent_compute-ego3": 0.012108079996037543, "complete-iteration": 1.0856675762220982, "set_robot_commands": 0.0021444462816681492, "deviation-center-line": 1.7994111779324422, "driven_lanedir_consec": 1.3327536407836664, "sim_compute_sim_state": 0.03226517896469586, "sim_compute_performance-ego0": 0.0018769999924150732, "sim_compute_performance-ego1": 0.001855133772888946, "sim_compute_performance-ego2": 0.001849114348945967, "sim_compute_performance-ego3": 0.001834084052626636}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 3.420565258264358, "get_ui_image": 0.04912376086181844, "step_physics": 1.09477486876425, "survival_time": 59.99999999999873, "driven_lanedir": 0.8084583546689144, "get_state_dump": 0.009153621182850655, "get_robot_state": 0.013720172529514386, "sim_render-ego0": 0.0036103933875904193, "sim_render-ego1": 0.0035840130963988547, "sim_render-ego2": 0.003542984653571365, "sim_render-ego3": 0.003552900762184772, "get_duckie_state": 1.6699226373041995e-06, "in-drivable-lane": 39.89999999999872, "deviation-heading": 16.318164544269212, "agent_compute-ego0": 0.012232071156307225, "agent_compute-ego1": 0.011943334147495394, "agent_compute-ego2": 0.011907718858552118, "agent_compute-ego3": 0.012022265784448628, "complete-iteration": 1.2900912866902092, "set_robot_commands": 0.0020652531981964492, "deviation-center-line": 2.1599560740955117, "driven_lanedir_consec": 0.8084583546689144, "sim_compute_sim_state": 0.04498387772673671, "sim_compute_performance-ego0": 0.0018801693118283593, "sim_compute_performance-ego1": 0.001851125918856072, "sim_compute_performance-ego2": 0.0018593095720657996, "sim_compute_performance-ego3": 0.0018651193623538816}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.0754661167825017, "get_ui_image": 0.04912376086181844, "step_physics": 1.09477486876425, "survival_time": 59.99999999999873, "driven_lanedir": 0.10977549119614904, "get_state_dump": 0.009153621182850655, "get_robot_state": 0.013720172529514386, "sim_render-ego0": 0.0036103933875904193, "sim_render-ego1": 0.0035840130963988547, "sim_render-ego2": 0.003542984653571365, "sim_render-ego3": 0.003552900762184772, "get_duckie_state": 1.6699226373041995e-06, "in-drivable-lane": 49.799999999998654, "deviation-heading": 7.909102863271699, "agent_compute-ego0": 0.012232071156307225, "agent_compute-ego1": 0.011943334147495394, "agent_compute-ego2": 0.011907718858552118, "agent_compute-ego3": 0.012022265784448628, "complete-iteration": 1.2900912866902092, "set_robot_commands": 0.0020652531981964492, "deviation-center-line": 0.6591087648584802, "driven_lanedir_consec": 0.10977549119614904, "sim_compute_sim_state": 0.04498387772673671, "sim_compute_performance-ego0": 0.0018801693118283593, "sim_compute_performance-ego1": 0.001851125918856072, "sim_compute_performance-ego2": 0.0018593095720657996, "sim_compute_performance-ego3": 0.0018651193623538816}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 13.19936902546716, "get_ui_image": 0.04912376086181844, "step_physics": 1.09477486876425, "survival_time": 59.99999999999873, "driven_lanedir": 1.1983701533493627, "get_state_dump": 0.009153621182850655, "get_robot_state": 0.013720172529514386, "sim_render-ego0": 0.0036103933875904193, "sim_render-ego1": 0.0035840130963988547, "sim_render-ego2": 0.003542984653571365, "sim_render-ego3": 0.003552900762184772, "get_duckie_state": 1.6699226373041995e-06, "in-drivable-lane": 48.14999999999885, "deviation-heading": 11.57034391742593, "agent_compute-ego0": 0.012232071156307225, "agent_compute-ego1": 0.011943334147495394, "agent_compute-ego2": 0.011907718858552118, "agent_compute-ego3": 0.012022265784448628, "complete-iteration": 1.2900912866902092, "set_robot_commands": 0.0020652531981964492, "deviation-center-line": 1.1011612795133203, "driven_lanedir_consec": 1.0569555866424172, "sim_compute_sim_state": 0.04498387772673671, "sim_compute_performance-ego0": 0.0018801693118283593, "sim_compute_performance-ego1": 0.001851125918856072, "sim_compute_performance-ego2": 0.0018593095720657996, "sim_compute_performance-ego3": 0.0018651193623538816}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 6.052468773087889, "get_ui_image": 0.04912376086181844, "step_physics": 1.09477486876425, "survival_time": 59.99999999999873, "driven_lanedir": 1.5291366821814316, "get_state_dump": 0.009153621182850655, "get_robot_state": 0.013720172529514386, "sim_render-ego0": 0.0036103933875904193, "sim_render-ego1": 0.0035840130963988547, "sim_render-ego2": 0.003542984653571365, "sim_render-ego3": 0.003552900762184772, "get_duckie_state": 1.6699226373041995e-06, "in-drivable-lane": 35.299999999999436, "deviation-heading": 17.731004238343644, "agent_compute-ego0": 0.012232071156307225, "agent_compute-ego1": 0.011943334147495394, "agent_compute-ego2": 0.011907718858552118, "agent_compute-ego3": 0.012022265784448628, "complete-iteration": 1.2900912866902092, "set_robot_commands": 0.0020652531981964492, "deviation-center-line": 2.59318554243184, "driven_lanedir_consec": 1.5291366821814316, "sim_compute_sim_state": 0.04498387772673671, "sim_compute_performance-ego0": 0.0018801693118283593, "sim_compute_performance-ego1": 0.001851125918856072, "sim_compute_performance-ego2": 0.0018593095720657996, "sim_compute_performance-ego3": 0.0018651193623538816}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 2.21018257288089, "get_ui_image": 0.04769778092834574, "step_physics": 1.1196536724017525, "survival_time": 59.99999999999873, "driven_lanedir": 0.2308060620348482, "get_state_dump": 0.009179880577360562, "get_robot_state": 0.013680055873975666, "sim_render-ego0": 0.003586661507942397, "sim_render-ego1": 0.0035528382294183966, "sim_render-ego2": 0.003725986695110947, "sim_render-ego3": 0.0035591117547612502, "get_duckie_state": 1.739204972113896e-06, "in-drivable-lane": 52.99999999999871, "deviation-heading": 5.073872371908684, "agent_compute-ego0": 0.012595364096559753, "agent_compute-ego1": 0.011196664132047554, "agent_compute-ego2": 0.012306509168817042, "agent_compute-ego3": 0.01234396431070879, "complete-iteration": 1.3024133111316891, "set_robot_commands": 0.002110231329658248, "deviation-center-line": 0.8038317929067985, "driven_lanedir_consec": 0.2308060620348482, "sim_compute_sim_state": 0.03327051527196422, "sim_compute_performance-ego0": 0.0018494532169847067, "sim_compute_performance-ego1": 0.001827015070792142, "sim_compute_performance-ego2": 0.0018309206887149095, "sim_compute_performance-ego3": 0.0018855860390135093}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 1.0968974276640795, "get_ui_image": 0.04769778092834574, "step_physics": 1.1196536724017525, "survival_time": 59.99999999999873, "driven_lanedir": 0.11280870900213658, "get_state_dump": 0.009179880577360562, "get_robot_state": 0.013680055873975666, "sim_render-ego0": 0.003586661507942397, "sim_render-ego1": 0.0035528382294183966, "sim_render-ego2": 0.003725986695110947, "sim_render-ego3": 0.0035591117547612502, "get_duckie_state": 1.739204972113896e-06, "in-drivable-lane": 29.649999999999373, "deviation-heading": 23.96330390774377, "agent_compute-ego0": 0.012595364096559753, "agent_compute-ego1": 0.011196664132047554, "agent_compute-ego2": 0.012306509168817042, "agent_compute-ego3": 0.01234396431070879, "complete-iteration": 1.3024133111316891, "set_robot_commands": 0.002110231329658248, "deviation-center-line": 1.457289039818663, "driven_lanedir_consec": 0.11280870900213658, "sim_compute_sim_state": 0.03327051527196422, "sim_compute_performance-ego0": 0.0018494532169847067, "sim_compute_performance-ego1": 0.001827015070792142, "sim_compute_performance-ego2": 0.0018309206887149095, "sim_compute_performance-ego3": 0.0018855860390135093}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.26894841869576286, "get_ui_image": 0.04769778092834574, "step_physics": 1.1196536724017525, "survival_time": 59.99999999999873, "driven_lanedir": 0.2285456438129891, "get_state_dump": 0.009179880577360562, "get_robot_state": 0.013680055873975666, "sim_render-ego0": 0.003586661507942397, "sim_render-ego1": 0.0035528382294183966, "sim_render-ego2": 0.003725986695110947, "sim_render-ego3": 0.0035591117547612502, "get_duckie_state": 1.739204972113896e-06, "in-drivable-lane": 0.0, "deviation-heading": 62.58432573331654, "agent_compute-ego0": 0.012595364096559753, "agent_compute-ego1": 0.011196664132047554, "agent_compute-ego2": 0.012306509168817042, "agent_compute-ego3": 0.01234396431070879, "complete-iteration": 1.3024133111316891, "set_robot_commands": 0.002110231329658248, "deviation-center-line": 7.589457362821848, "driven_lanedir_consec": 0.2285456438129891, "sim_compute_sim_state": 0.03327051527196422, "sim_compute_performance-ego0": 0.0018494532169847067, "sim_compute_performance-ego1": 0.001827015070792142, "sim_compute_performance-ego2": 0.0018309206887149095, "sim_compute_performance-ego3": 0.0018855860390135093}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 5.947830950099486, "get_ui_image": 0.04769778092834574, "step_physics": 1.1196536724017525, "survival_time": 59.99999999999873, "driven_lanedir": 1.7311058069939012, "get_state_dump": 0.009179880577360562, "get_robot_state": 0.013680055873975666, "sim_render-ego0": 0.003586661507942397, "sim_render-ego1": 0.0035528382294183966, "sim_render-ego2": 0.003725986695110947, "sim_render-ego3": 0.0035591117547612502, "get_duckie_state": 1.739204972113896e-06, "in-drivable-lane": 31.49999999999923, "deviation-heading": 22.29768596069948, "agent_compute-ego0": 0.012595364096559753, "agent_compute-ego1": 0.011196664132047554, "agent_compute-ego2": 0.012306509168817042, "agent_compute-ego3": 0.01234396431070879, "complete-iteration": 1.3024133111316891, "set_robot_commands": 0.002110231329658248, "deviation-center-line": 2.5014880337722856, "driven_lanedir_consec": 1.7311058069939012, "sim_compute_sim_state": 0.03327051527196422, "sim_compute_performance-ego0": 0.0018494532169847067, "sim_compute_performance-ego1": 0.001827015070792142, "sim_compute_performance-ego2": 0.0018309206887149095, "sim_compute_performance-ego3": 0.0018855860390135093}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.3092212615569792, "get_ui_image": 0.029137404137705884, "step_physics": 0.31281785524258704, "survival_time": 59.99999999999873, "driven_lanedir": 0.5664116150730969, "get_state_dump": 0.005820003973256539, "get_robot_state": 0.0069456205677728075, "sim_render-ego0": 0.003658638111657644, "sim_render-ego1": 0.0035943478767719, "get_duckie_state": 1.697119427759582e-06, "in-drivable-lane": 28.999999999999385, "deviation-heading": 23.710580728853778, "agent_compute-ego0": 0.011608942660761316, "agent_compute-ego1": 0.01081605676211088, "complete-iteration": 0.4026164242270388, "set_robot_commands": 0.002132779255596228, "deviation-center-line": 1.006250226407748, "driven_lanedir_consec": 0.5664116150730969, "sim_compute_sim_state": 0.010108294236868449, "sim_compute_performance-ego0": 0.0018769517528524407, "sim_compute_performance-ego1": 0.0018505944896002396}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.037539123986497, "get_ui_image": 0.029137404137705884, "step_physics": 0.31281785524258704, "survival_time": 59.99999999999873, "driven_lanedir": 0.0366082895592188, "get_state_dump": 0.005820003973256539, "get_robot_state": 0.0069456205677728075, "sim_render-ego0": 0.003658638111657644, "sim_render-ego1": 0.0035943478767719, "get_duckie_state": 1.697119427759582e-06, "in-drivable-lane": 30.099999999999355, "deviation-heading": 23.31542870135616, "agent_compute-ego0": 0.011608942660761316, "agent_compute-ego1": 0.01081605676211088, "complete-iteration": 0.4026164242270388, "set_robot_commands": 0.002132779255596228, "deviation-center-line": 2.3936500656979476, "driven_lanedir_consec": 0.0366082895592188, "sim_compute_sim_state": 0.010108294236868449, "sim_compute_performance-ego0": 0.0018769517528524407, "sim_compute_performance-ego1": 0.0018505944896002396}}
set_robot_commands_max0.0021444462816681492
set_robot_commands_mean0.002110377267805989
set_robot_commands_median0.002110231329658248
set_robot_commands_min0.0020652531981964492
sim_compute_performance-ego0_max0.0018801693118283593
sim_compute_performance-ego0_mean0.001870028113615531
sim_compute_performance-ego0_median0.0018769999924150732
sim_compute_performance-ego0_min0.0018494532169847067
sim_compute_performance-ego1_max0.001855133772888946
sim_compute_performance-ego1_mean0.001845306287810651
sim_compute_performance-ego1_median0.001851125918856072
sim_compute_performance-ego1_min0.001827015070792142
sim_compute_performance-ego2_max0.0018593095720657996
sim_compute_performance-ego2_mean0.0018464482032422257
sim_compute_performance-ego2_median0.001849114348945967
sim_compute_performance-ego2_min0.0018309206887149095
sim_compute_performance-ego3_max0.0018855860390135093
sim_compute_performance-ego3_mean0.0018615964846646757
sim_compute_performance-ego3_median0.0018651193623538816
sim_compute_performance-ego3_min0.001834084052626636
sim_compute_sim_state_max0.04498387772673671
sim_compute_sim_state_mean0.033021062594808866
sim_compute_sim_state_median0.03327051527196422
sim_compute_sim_state_min0.010108294236868449
sim_render-ego0_max0.003658638111657644
sim_render-ego0_mean0.0036058068573226734
sim_render-ego0_median0.0035939500492677204
sim_render-ego0_min0.003586661507942397
sim_render-ego1_max0.0035943478767719
sim_render-ego1_mean0.00357794534781465
sim_render-ego1_median0.0035840130963988547
sim_render-ego1_min0.0035528382294183966
sim_render-ego2_max0.003725986695110947
sim_render-ego2_mean0.0036167870817202983
sim_render-ego2_median0.0035813898964785814
sim_render-ego2_min0.003542984653571365
sim_render-ego3_max0.0035591117547612502
sim_render-ego3_mean0.003549486009934992
sim_render-ego3_median0.003552900762184772
sim_render-ego3_min0.0035364455128589537
simulation-passed1
step_physics_max1.1196536724017525
step_physics_mean0.9372980403491769
step_physics_median1.09477486876425
step_physics_min0.31281785524258704
survival_time_max59.99999999999873
survival_time_mean59.999999999998735
survival_time_min59.99999999999873
No reset possible
5704611312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simsuccessnogpu-prod-010:09:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median11.525000000000029
in-drivable-lane_median0.0
driven_lanedir_consec_median1.6441392428583057
deviation-center-line_median0.42800742228014543


other stats
agent_compute-ego0_max0.01457683152930681
agent_compute-ego0_mean0.012538291385027763
agent_compute-ego0_median0.011974360390424873
agent_compute-ego0_min0.011627613229954497
complete-iteration_max0.28338614452716915
complete-iteration_mean0.22081888597358024
complete-iteration_median0.21729086108197024
complete-iteration_min0.1653076772032113
deviation-center-line_max0.9042153477306406
deviation-center-line_mean0.5187100842813859
deviation-center-line_min0.31461014483461175
deviation-heading_max4.0841288183501225
deviation-heading_mean2.2869768736270473
deviation-heading_median1.9991372431766692
deviation-heading_min1.0655041898047282
driven_any_max2.5432513041422737
driven_any_mean1.6166185044528665
driven_any_median1.681709975736677
driven_any_min0.5598027621958375
driven_lanedir_consec_max2.407899441544939
driven_lanedir_consec_mean1.5590533953959262
driven_lanedir_consec_min0.5400356543221548
driven_lanedir_max2.407899441544939
driven_lanedir_mean1.5590533953959262
driven_lanedir_median1.6441392428583057
driven_lanedir_min0.5400356543221548
get_duckie_state_max0.02350997214621686
get_duckie_state_mean0.016895844318801014
get_duckie_state_median0.02001614004726169
get_duckie_state_min0.004041125034463817
get_robot_state_max0.003557496292646541
get_robot_state_mean0.0035064118438174335
get_robot_state_median0.003492221360630651
get_robot_state_min0.003483708361361889
get_state_dump_max0.008086775718851292
get_state_dump_mean0.007053517963622456
get_state_dump_median0.007587637416395252
get_state_dump_min0.004952021302848027
get_ui_image_max0.03899316177811733
get_ui_image_mean0.033146210010240526
get_ui_image_median0.03366213282483333
get_ui_image_min0.026267412613178123
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.1341958937664995, "get_ui_image": 0.0319269190443323, "step_physics": 0.11847992146268804, "survival_time": 11.700000000000031, "driven_lanedir": 2.074891983493592, "get_state_dump": 0.008086775718851292, "get_robot_state": 0.003483708361361889, "sim_render-ego0": 0.0034977283883602063, "get_duckie_state": 0.02350997214621686, "in-drivable-lane": 0.0, "deviation-heading": 2.4241761539618354, "agent_compute-ego0": 0.011627613229954497, "complete-iteration": 0.21230462358352983, "set_robot_commands": 0.0019955208960999835, "deviation-center-line": 0.4925853375617271, "driven_lanedir_consec": 2.074891983493592, "sim_compute_sim_state": 0.007830406757111245, "sim_compute_performance-ego0": 0.0017918951967929272}, "LFP-norm-zigzag-000-ego0": {"driven_any": 0.5598027621958375, "get_ui_image": 0.03899316177811733, "step_physics": 0.181062753810439, "survival_time": 4.249999999999993, "driven_lanedir": 0.5400356543221548, "get_state_dump": 0.00768585814986118, "get_robot_state": 0.003557496292646541, "sim_render-ego0": 0.003676711126815441, "get_duckie_state": 0.02016860662504684, "in-drivable-lane": 0.0, "deviation-heading": 1.0655041898047282, "agent_compute-ego0": 0.01457683152930681, "complete-iteration": 0.28338614452716915, "set_robot_commands": 0.002139471298040346, "deviation-center-line": 0.31461014483461175, "driven_lanedir_consec": 0.5400356543221548, "sim_compute_sim_state": 0.009572921797286632, "sim_compute_performance-ego0": 0.0018747490505839504}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.2292240577068545, "get_ui_image": 0.03539734660533436, "step_physics": 0.12294947682765492, "survival_time": 11.350000000000026, "driven_lanedir": 1.2133865022230197, "get_state_dump": 0.007489416682929324, "get_robot_state": 0.003494312888697574, "sim_render-ego0": 0.0036139571875856633, "get_duckie_state": 0.019863673469476532, "in-drivable-lane": 0.0, "deviation-heading": 1.574098332391503, "agent_compute-ego0": 0.012005684668557686, "complete-iteration": 0.2222770985804106, "set_robot_commands": 0.0020231939198678, "deviation-center-line": 0.3634295069985638, "driven_lanedir_consec": 1.2133865022230197, "sim_compute_sim_state": 0.01352880084723757, "sim_compute_performance-ego0": 0.0018364117856611289}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.5432513041422737, "get_ui_image": 0.026267412613178123, "step_physics": 0.10135654416577568, "survival_time": 14.45000000000007, "driven_lanedir": 2.407899441544939, "get_state_dump": 0.004952021302848027, "get_robot_state": 0.003490129832563729, "sim_render-ego0": 0.003563786375111547, "get_duckie_state": 0.004041125034463817, "in-drivable-lane": 0.0, "deviation-heading": 4.0841288183501225, "agent_compute-ego0": 0.01194303611229206, "complete-iteration": 0.1653076772032113, "set_robot_commands": 0.002038985285265692, "deviation-center-line": 0.9042153477306406, "driven_lanedir_consec": 2.407899441544939, "sim_compute_sim_state": 0.0057560608304780105, "sim_compute_performance-ego0": 0.001824965970269565}}
set_robot_commands_max0.002139471298040346
set_robot_commands_mean0.002049292849818455
set_robot_commands_median0.0020310896025667463
set_robot_commands_min0.0019955208960999835
sim_compute_performance-ego0_max0.0018747490505839504
sim_compute_performance-ego0_mean0.0018320055008268928
sim_compute_performance-ego0_median0.0018306888779653467
sim_compute_performance-ego0_min0.0017918951967929272
sim_compute_sim_state_max0.01352880084723757
sim_compute_sim_state_mean0.009172047558028366
sim_compute_sim_state_median0.008701664277198939
sim_compute_sim_state_min0.0057560608304780105
sim_render-ego0_max0.003676711126815441
sim_render-ego0_mean0.0035880457694682146
sim_render-ego0_median0.003588871781348605
sim_render-ego0_min0.0034977283883602063
simulation-passed1
step_physics_max0.181062753810439
step_physics_mean0.1309621740666394
step_physics_median0.12071469914517148
step_physics_min0.10135654416577568
survival_time_max14.45000000000007
survival_time_mean10.43750000000003
survival_time_min4.249999999999993
No reset possible
5687711425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simsuccessnogpu-prod-010:35:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median37.84999999999924
driven_lanedir_consec_median1.1128584350211377
deviation-center-line_median1.5914898557453565


other stats
agent_compute-ego0_max0.012723899074385123
agent_compute-ego0_mean0.012133010015436606
agent_compute-ego0_median0.012076704527912888
agent_compute-ego0_min0.011654731931535527
complete-iteration_max0.3413778647693567
complete-iteration_mean0.2917513118610713
complete-iteration_median0.3077506804276905
complete-iteration_min0.21012602181954745
deviation-center-line_max2.1690293716935805
deviation-center-line_mean1.4835020116532454
deviation-center-line_min0.5819989634286878
deviation-heading_max22.02642464706429
deviation-heading_mean13.898093955542928
deviation-heading_median12.798870715930878
deviation-heading_min7.968209743245665
driven_any_max8.308329913280556
driven_any_mean6.402305207266391
driven_any_median7.521884964696087
driven_any_min2.2571209863928297
driven_lanedir_consec_max1.8322473447798933
driven_lanedir_consec_mean1.1013177431539765
driven_lanedir_consec_min0.34730675779373754
driven_lanedir_max2.0836714763988784
driven_lanedir_mean1.4764265984246518
driven_lanedir_median1.4128749137843457
driven_lanedir_min0.9962850897310382
get_duckie_state_max0.02396595547538713
get_duckie_state_mean0.01728382582795967
get_duckie_state_median0.020548018145193157
get_duckie_state_min0.00407331154606523
get_robot_state_max0.00365063664807352
get_robot_state_mean0.0035617616429996527
get_robot_state_median0.003536409382816159
get_robot_state_min0.003523591158292772
get_state_dump_max0.008288689001116725
get_state_dump_mean0.007234482402912517
get_state_dump_median0.007808425462231714
get_state_dump_min0.005032389686069917
get_ui_image_max0.03807084923679882
get_ui_image_mean0.03236117218686037
get_ui_image_median0.032962998613962895
get_ui_image_min0.025447842282716876
in-drivable-lane_max46.44999999999921
in-drivable-lane_mean32.58749999999944
in-drivable-lane_min8.200000000000067
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 7.208936079057014, "get_ui_image": 0.03092625377378694, "step_physics": 0.1930698409465628, "survival_time": 59.99999999999873, "driven_lanedir": 2.0836714763988784, "get_state_dump": 0.008288689001116725, "get_robot_state": 0.0035244773369248364, "sim_render-ego0": 0.00359751362288425, "get_duckie_state": 0.02396595547538713, "in-drivable-lane": 33.699999999999505, "deviation-heading": 22.02642464706429, "agent_compute-ego0": 0.011654731931535527, "complete-iteration": 0.2892052623056353, "set_robot_commands": 0.0021225665630051536, "deviation-center-line": 2.1690293716935805, "driven_lanedir_consec": 1.8322473447798933, "sim_compute_sim_state": 0.0100995888817221, "sim_compute_performance-ego0": 0.001879641654390181}, "LFP-norm-zigzag-000-ego0": {"driven_any": 8.308329913280556, "get_ui_image": 0.03807084923679882, "step_physics": 0.24025197569079243, "survival_time": 59.99999999999873, "driven_lanedir": 1.2498383634289474, "get_state_dump": 0.007679084059995576, "get_robot_state": 0.003548341428707482, "sim_render-ego0": 0.003651412698648851, "get_duckie_state": 0.02019535790474389, "in-drivable-lane": 46.44999999999921, "deviation-heading": 10.445980874857558, "agent_compute-ego0": 0.012320665991574303, "complete-iteration": 0.3413778647693567, "set_robot_commands": 0.0021021562650936233, "deviation-center-line": 1.3763245257231145, "driven_lanedir_consec": 0.34730675779373754, "sim_compute_sim_state": 0.01160553909162002, "sim_compute_performance-ego0": 0.0018776761403588031}, "LFP-norm-techtrack-000-ego0": {"driven_any": 2.2571209863928297, "get_ui_image": 0.03499974345413885, "step_physics": 0.2233801722215299, "survival_time": 19.100000000000136, "driven_lanedir": 0.9962850897310382, "get_state_dump": 0.00793776686446785, "get_robot_state": 0.00365063664807352, "sim_render-ego0": 0.003731508479105897, "get_duckie_state": 0.020900678385642427, "in-drivable-lane": 8.200000000000067, "deviation-heading": 7.968209743245665, "agent_compute-ego0": 0.012723899074385123, "complete-iteration": 0.32629609854974573, "set_robot_commands": 0.002216555742308614, "deviation-center-line": 0.5819989634286878, "driven_lanedir_consec": 0.9962850897310382, "sim_compute_sim_state": 0.014714920800908738, "sim_compute_performance-ego0": 0.001960577603731081}, "LFP-norm-small_loop-000-ego0": {"driven_any": 7.83483385033516, "get_ui_image": 0.025447842282716876, "step_physics": 0.1458148646612747, "survival_time": 59.99999999999873, "driven_lanedir": 1.5759114641397434, "get_state_dump": 0.005032389686069917, "get_robot_state": 0.003523591158292772, "sim_render-ego0": 0.003627574811073068, "get_duckie_state": 0.00407331154606523, "in-drivable-lane": 41.99999999999898, "deviation-heading": 15.1517605570042, "agent_compute-ego0": 0.01183274306425147, "complete-iteration": 0.21012602181954745, "set_robot_commands": 0.0021465364641988405, "deviation-center-line": 1.8066551857675983, "driven_lanedir_consec": 1.229431780311237, "sim_compute_sim_state": 0.006680537024505133, "sim_compute_performance-ego0": 0.001872562349686317}}
set_robot_commands_max0.002216555742308614
set_robot_commands_mean0.002146953758651558
set_robot_commands_median0.002134551513601997
set_robot_commands_min0.0021021562650936233
sim_compute_performance-ego0_max0.001960577603731081
sim_compute_performance-ego0_mean0.0018976144370415951
sim_compute_performance-ego0_median0.001878658897374492
sim_compute_performance-ego0_min0.001872562349686317
sim_compute_sim_state_max0.014714920800908738
sim_compute_sim_state_mean0.010775146449688995
sim_compute_sim_state_median0.01085256398667106
sim_compute_sim_state_min0.006680537024505133
sim_render-ego0_max0.003731508479105897
sim_render-ego0_mean0.0036520024029280166
sim_render-ego0_median0.00363949375486096
sim_render-ego0_min0.00359751362288425
simulation-passed1
step_physics_max0.24025197569079243
step_physics_mean0.20062921338003997
step_physics_median0.20822500658404636
step_physics_min0.1458148646612747
survival_time_max59.99999999999873
survival_time_mean49.77499999999908
survival_time_min19.100000000000136
No reset possible
5683411301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:05:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4187274724951184
survival_time_median5.1999999999999895
deviation-center-line_median0.09883307231910972
in-drivable-lane_median3.049999999999991


other stats
agent_compute-ego0_max0.013898147855486188
agent_compute-ego0_mean0.013061392023584917
agent_compute-ego0_median0.01295130615296321
agent_compute-ego0_min0.01244480793292706
complete-iteration_max0.1881606120329637
complete-iteration_mean0.17041686802767902
complete-iteration_median0.17450928225350187
complete-iteration_min0.14448829557074874
deviation-center-line_max0.20107977724901632
deviation-center-line_mean0.12022023228356592
deviation-center-line_min0.08213500724702785
deviation-heading_max2.172360877570193
deviation-heading_mean0.7960998556182396
deviation-heading_median0.34396976646289945
deviation-heading_min0.32409901197696656
driven_any_max1.8468428149775984
driven_any_mean1.451639065539597
driven_any_median1.53490111608368
driven_any_min0.8899112150134288
driven_lanedir_consec_max0.5410004179178872
driven_lanedir_consec_mean0.3840882590205402
driven_lanedir_consec_min0.1578976731740367
driven_lanedir_max0.5410004179178872
driven_lanedir_mean0.38744020528506823
driven_lanedir_median0.4254313650241745
driven_lanedir_min0.1578976731740367
get_duckie_state_max1.1920928955078125e-06
get_duckie_state_mean1.1491357220802178e-06
get_duckie_state_median1.146297059559136e-06
get_duckie_state_min1.1118558736947866e-06
get_robot_state_max0.003698549951825823
get_robot_state_mean0.003544703100877231
get_robot_state_median0.003511650400784154
get_robot_state_min0.003456961650114793
get_state_dump_max0.004626917839050293
get_state_dump_mean0.004385862283362728
get_state_dump_median0.004350410428092902
get_state_dump_min0.004215710438214815
get_ui_image_max0.03566974401473999
get_ui_image_mean0.03079479462987919
get_ui_image_median0.030300828163835884
get_ui_image_min0.02690777817710501
in-drivable-lane_max4.399999999999985
in-drivable-lane_mean3.2874999999999908
in-drivable-lane_min2.649999999999996
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.8899112150134288, "get_ui_image": 0.027795927865164625, "step_physics": 0.10546897820064, "survival_time": 3.4499999999999957, "driven_lanedir": 0.1578976731740367, "get_state_dump": 0.004626917839050293, "get_robot_state": 0.003698549951825823, "sim_render-ego0": 0.003819346427917481, "get_duckie_state": 1.1920928955078125e-06, "in-drivable-lane": 2.649999999999996, "deviation-heading": 0.32409901197696656, "agent_compute-ego0": 0.013898147855486188, "complete-iteration": 0.17127284663064138, "set_robot_commands": 0.002299952507019043, "deviation-center-line": 0.08213500724702785, "driven_lanedir_consec": 0.1578976731740367, "sim_compute_sim_state": 0.007565644809177943, "sim_compute_performance-ego0": 0.00201805659702846}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.517103970933318, "get_ui_image": 0.03566974401473999, "step_physics": 0.11576222685667184, "survival_time": 5.14999999999999, "driven_lanedir": 0.3797378857189255, "get_state_dump": 0.004215710438214815, "get_robot_state": 0.003456961650114793, "sim_render-ego0": 0.003588192738019503, "get_duckie_state": 1.1118558736947866e-06, "in-drivable-lane": 2.699999999999993, "deviation-heading": 2.172360877570193, "agent_compute-ego0": 0.01244480793292706, "complete-iteration": 0.1881606120329637, "set_robot_commands": 0.0020623115392831657, "deviation-center-line": 0.20107977724901632, "driven_lanedir_consec": 0.3663301006608135, "sim_compute_sim_state": 0.00905678363946768, "sim_compute_performance-ego0": 0.0018272720850431}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.552698261234042, "get_ui_image": 0.03280572846250714, "step_physics": 0.10827042921534125, "survival_time": 5.249999999999989, "driven_lanedir": 0.5410004179178872, "get_state_dump": 0.004323487011891491, "get_robot_state": 0.003492962639286833, "sim_render-ego0": 0.0037055735318165905, "get_duckie_state": 1.1493574898197966e-06, "in-drivable-lane": 3.3999999999999884, "deviation-heading": 0.3548482060984422, "agent_compute-ego0": 0.01335396631708685, "complete-iteration": 0.17774571787636234, "set_robot_commands": 0.00210480420094616, "deviation-center-line": 0.09015405817252, "driven_lanedir_consec": 0.5410004179178872, "sim_compute_sim_state": 0.007718765510703033, "sim_compute_performance-ego0": 0.0018902612182329283}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8468428149775984, "get_ui_image": 0.02690777817710501, "step_physics": 0.0843921567572922, "survival_time": 6.0499999999999865, "driven_lanedir": 0.47112484432942336, "get_state_dump": 0.004377333844294314, "get_robot_state": 0.0035303381622814743, "sim_render-ego0": 0.0036883705952128424, "get_duckie_state": 1.143236629298476e-06, "in-drivable-lane": 4.399999999999985, "deviation-heading": 0.33309132682735665, "agent_compute-ego0": 0.012548645988839572, "complete-iteration": 0.14448829557074874, "set_robot_commands": 0.002201703728222456, "deviation-center-line": 0.10751208646569946, "driven_lanedir_consec": 0.47112484432942336, "sim_compute_sim_state": 0.00484364345425465, "sim_compute_performance-ego0": 0.001920444066407251}}
set_robot_commands_max0.002299952507019043
set_robot_commands_mean0.002167192993867706
set_robot_commands_median0.002153253964584308
set_robot_commands_min0.0020623115392831657
sim_compute_performance-ego0_max0.00201805659702846
sim_compute_performance-ego0_mean0.001914008491677935
sim_compute_performance-ego0_median0.0019053526423200896
sim_compute_performance-ego0_min0.0018272720850431
sim_compute_sim_state_max0.00905678363946768
sim_compute_sim_state_mean0.007296209353400827
sim_compute_sim_state_median0.007642205159940488
sim_compute_sim_state_min0.00484364345425465
sim_render-ego0_max0.003819346427917481
sim_render-ego0_mean0.003700370823241605
sim_render-ego0_median0.0036969720635147167
sim_render-ego0_min0.003588192738019503
simulation-passed1
step_physics_max0.11576222685667184
step_physics_mean0.10347344775748632
step_physics_median0.10686970370799062
step_physics_min0.0843921567572922
survival_time_max6.0499999999999865
survival_time_mean4.974999999999991
survival_time_min3.4499999999999957
No reset possible
5664711425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simsuccessnogpu-prod-010:29:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median24.075000000000024
in-drivable-lane_median15.450000000000015
driven_lanedir_consec_median0.7511381888652491
deviation-center-line_median0.5120356590287799


other stats
agent_compute-ego0_max0.01267174591300308
agent_compute-ego0_mean0.012427908111262011
agent_compute-ego0_median0.012558499604768668
agent_compute-ego0_min0.011922887322507632
complete-iteration_max0.3584592243035634
complete-iteration_mean0.29581891558029316
complete-iteration_median0.30278559110752884
complete-iteration_min0.21924525580255155
deviation-center-line_max1.24435564921438
deviation-center-line_mean0.6213083013605815
deviation-center-line_min0.21680623817038608
deviation-heading_max12.21635425666474
deviation-heading_mean6.250452605744902
deviation-heading_median5.4963502901690315
deviation-heading_min1.7927555859768056
driven_any_max10.127956352213982
driven_any_mean4.69890464843129
driven_any_median3.788229090117361
driven_any_min1.091204061276453
driven_lanedir_consec_max1.2348933256333363
driven_lanedir_consec_mean0.7716002761145387
driven_lanedir_consec_min0.3492314010943205
driven_lanedir_max1.2348933256333363
driven_lanedir_mean0.7716002761145387
driven_lanedir_median0.7511381888652491
driven_lanedir_min0.3492314010943205
get_duckie_state_max0.02386200681645819
get_duckie_state_mean0.017199061188154337
get_duckie_state_median0.020404107815907065
get_duckie_state_min0.0041260223043450405
get_robot_state_max0.003679700756585726
get_robot_state_mean0.003568187721637912
get_robot_state_median0.00354164511350591
get_robot_state_min0.0035097599029541016
get_state_dump_max0.008269352270356307
get_state_dump_mean0.007226034724999965
get_state_dump_median0.007748731957339142
get_state_dump_min0.005137322714965268
get_ui_image_max0.03929805947888282
get_ui_image_mean0.03305227780381715
get_ui_image_median0.03326575049620985
get_ui_image_min0.02637955074396608
in-drivable-lane_max48.99999999999861
in-drivable-lane_mean20.899999999999658
in-drivable-lane_min3.6999999999999913
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 1.091204061276453, "get_ui_image": 0.031849692053828677, "step_physics": 0.19211244414038692, "survival_time": 6.999999999999983, "driven_lanedir": 0.3492314010943205, "get_state_dump": 0.008269352270356307, "get_robot_state": 0.0035097599029541016, "sim_render-ego0": 0.0035838201536354444, "get_duckie_state": 0.02386200681645819, "in-drivable-lane": 3.6999999999999913, "deviation-heading": 2.5460216819447545, "agent_compute-ego0": 0.01251996155326248, "complete-iteration": 0.28876551161421105, "set_robot_commands": 0.002101852538737845, "deviation-center-line": 0.21680623817038608, "driven_lanedir_consec": 0.3492314010943205, "sim_compute_sim_state": 0.009038150733244337, "sim_compute_performance-ego0": 0.0018422806516606757}, "LFP-norm-zigzag-000-ego0": {"driven_any": 5.8683496064304235, "get_ui_image": 0.03929805947888282, "step_physics": 0.25510848145331105, "survival_time": 37.15000000000003, "driven_lanedir": 1.2348933256333363, "get_state_dump": 0.007816461786147087, "get_robot_state": 0.003679700756585726, "sim_render-ego0": 0.003829846779505411, "get_duckie_state": 0.020779590132415936, "in-drivable-lane": 23.200000000000017, "deviation-heading": 12.21635425666474, "agent_compute-ego0": 0.01267174591300308, "complete-iteration": 0.3584592243035634, "set_robot_commands": 0.0022384197481216924, "deviation-center-line": 1.24435564921438, "driven_lanedir_consec": 1.2348933256333363, "sim_compute_sim_state": 0.01095611818375126, "sim_compute_performance-ego0": 0.001998729923720001}, "LFP-norm-techtrack-000-ego0": {"driven_any": 10.127956352213982, "get_ui_image": 0.03468180893859101, "step_physics": 0.21436469362339905, "survival_time": 59.99999999999873, "driven_lanedir": 1.0906523317633705, "get_state_dump": 0.007681002128531196, "get_robot_state": 0.003522360950187283, "sim_render-ego0": 0.003653251956047166, "get_duckie_state": 0.020028625499398187, "in-drivable-lane": 48.99999999999861, "deviation-heading": 8.446678898393309, "agent_compute-ego0": 0.011922887322507632, "complete-iteration": 0.31680567060084663, "set_robot_commands": 0.002133794073061979, "deviation-center-line": 0.6780072904134627, "driven_lanedir_consec": 1.0906523317633705, "sim_compute_sim_state": 0.016875599742829057, "sim_compute_performance-ego0": 0.0018641490126331084}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.708108573804299, "get_ui_image": 0.02637955074396608, "step_physics": 0.15254704984604503, "survival_time": 11.00000000000002, "driven_lanedir": 0.4116240459671277, "get_state_dump": 0.005137322714965268, "get_robot_state": 0.003560929276824537, "sim_render-ego0": 0.003981086463410391, "get_duckie_state": 0.0041260223043450405, "in-drivable-lane": 7.700000000000019, "deviation-heading": 1.7927555859768056, "agent_compute-ego0": 0.012597037656274856, "complete-iteration": 0.21924525580255155, "set_robot_commands": 0.0024294443259951217, "deviation-center-line": 0.346064027644097, "driven_lanedir_consec": 0.4116240459671277, "sim_compute_sim_state": 0.006384983321660245, "sim_compute_performance-ego0": 0.002021051639884845}}
set_robot_commands_max0.0024294443259951217
set_robot_commands_mean0.00222587767147916
set_robot_commands_median0.0021861069105918356
set_robot_commands_min0.002101852538737845
sim_compute_performance-ego0_max0.002021051639884845
sim_compute_performance-ego0_mean0.0019315528069746577
sim_compute_performance-ego0_median0.0019314394681765549
sim_compute_performance-ego0_min0.0018422806516606757
sim_compute_sim_state_max0.016875599742829057
sim_compute_sim_state_mean0.010813712995371224
sim_compute_sim_state_median0.009997134458497797
sim_compute_sim_state_min0.006384983321660245
sim_render-ego0_max0.003981086463410391
sim_render-ego0_mean0.003762001338149603
sim_render-ego0_median0.003741549367776289
sim_render-ego0_min0.0035838201536354444
simulation-passed1
step_physics_max0.25510848145331105
step_physics_mean0.2035331672657855
step_physics_median0.20323856888189296
step_physics_min0.15254704984604503
survival_time_max59.99999999999873
survival_time_mean28.78749999999969
survival_time_min6.999999999999983
No reset possible
5647411450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simsuccessyesgpu-prod-010:19:06
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.18303465430656576
survival_time_median16.950000000000106
deviation-center-line_median0.17713103786016846
in-drivable-lane_median15.075000000000108


other stats
agent_compute-ego0_max0.012835662341812284
agent_compute-ego0_mean0.012296455625114147
agent_compute-ego0_median0.012308172362432888
agent_compute-ego0_min0.011733815433778532
complete-iteration_max0.30598646460227596
complete-iteration_mean0.25581827173067706
complete-iteration_median0.2583274540838568
complete-iteration_min0.20063171415271872
deviation-center-line_max1.7505421808460084
deviation-center-line_mean0.5462512196254039
deviation-center-line_min0.08020062193527001
deviation-heading_max19.146495358087808
deviation-heading_mean5.871361162849261
deviation-heading_median1.815713337405295
deviation-heading_min0.707522618498643
driven_any_max6.405706266653628
driven_any_mean2.6538890029416504
driven_any_median1.8939164039424683
driven_any_min0.4220169372280352
driven_lanedir_consec_max1.3173027241803177
driven_lanedir_consec_mean0.4365920118356541
driven_lanedir_consec_min0.06299601454916726
driven_lanedir_max1.3687285215609184
driven_lanedir_mean0.4494484611808043
driven_lanedir_median0.18303465430656576
driven_lanedir_min0.06299601454916726
get_duckie_state_max1.371905790360946e-06
get_duckie_state_mean1.2055665199293412e-06
get_duckie_state_median1.1660578065936542e-06
get_duckie_state_min1.1182446761691103e-06
get_robot_state_max0.003554813022720081
get_robot_state_mean0.0035171185886469104
get_robot_state_median0.003518521599771163
get_robot_state_min0.0034766181323252353
get_state_dump_max0.004480749535161024
get_state_dump_mean0.0043440391416436205
get_state_dump_median0.004347179554332226
get_state_dump_min0.004201047922749007
get_ui_image_max0.035237860911100816
get_ui_image_mean0.030025171851313037
get_ui_image_median0.029874664771218543
get_ui_image_min0.025113496951714248
in-drivable-lane_max36.599999999999355
in-drivable-lane_mean17.29999999999989
in-drivable-lane_min2.4499999999999944
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.405706266653628, "get_ui_image": 0.027773579391809824, "step_physics": 0.17811406919303088, "survival_time": 59.99999999999873, "driven_lanedir": 1.3687285215609184, "get_state_dump": 0.004201047922749007, "get_robot_state": 0.0034766181323252353, "sim_render-ego0": 0.003561035183248274, "get_duckie_state": 1.1182446761691103e-06, "in-drivable-lane": 36.599999999999355, "deviation-heading": 19.146495358087808, "agent_compute-ego0": 0.011733815433778532, "complete-iteration": 0.24063624867193903, "set_robot_commands": 0.002030724391254358, "deviation-center-line": 1.7505421808460084, "driven_lanedir_consec": 1.3173027241803177, "sim_compute_sim_state": 0.007813524743301685, "sim_compute_performance-ego0": 0.0018627216774259976}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.4220169372280352, "get_ui_image": 0.035237860911100816, "step_physics": 0.22939304009224604, "survival_time": 5.09999999999999, "driven_lanedir": 0.17631274827775956, "get_state_dump": 0.004458744549056859, "get_robot_state": 0.0035535826266390605, "sim_render-ego0": 0.003719447885902182, "get_duckie_state": 1.1481127692657766e-06, "in-drivable-lane": 2.4499999999999944, "deviation-heading": 1.805205635493098, "agent_compute-ego0": 0.012835662341812284, "complete-iteration": 0.30598646460227596, "set_robot_commands": 0.0021692340813794183, "deviation-center-line": 0.08020062193527001, "driven_lanedir_consec": 0.17631274827775956, "sim_compute_sim_state": 0.01259338045583188, "sim_compute_performance-ego0": 0.001951768560316956}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.8742128304410054, "get_ui_image": 0.031975750150627265, "step_physics": 0.2042424159343016, "survival_time": 8.899999999999991, "driven_lanedir": 0.18975656033537192, "get_state_dump": 0.004480749535161024, "get_robot_state": 0.003554813022720081, "sim_render-ego0": 0.0036628565974741673, "get_duckie_state": 1.371905790360946e-06, "in-drivable-lane": 6.199999999999997, "deviation-heading": 1.826221039317492, "agent_compute-ego0": 0.012747281090507294, "complete-iteration": 0.2760186594957746, "set_robot_commands": 0.0021231054593730905, "deviation-center-line": 0.2535852668875984, "driven_lanedir_consec": 0.18975656033537192, "sim_compute_sim_state": 0.011238016895741724, "sim_compute_performance-ego0": 0.0019196012166625297}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.913619977443932, "get_ui_image": 0.025113496951714248, "step_physics": 0.1432103068528775, "survival_time": 25.00000000000022, "driven_lanedir": 0.06299601454916726, "get_state_dump": 0.004235614559607592, "get_robot_state": 0.003483460572903266, "sim_render-ego0": 0.0035797055371983083, "get_duckie_state": 1.184002843921532e-06, "in-drivable-lane": 23.95000000000022, "deviation-heading": 0.707522618498643, "agent_compute-ego0": 0.01186906363435848, "complete-iteration": 0.20063171415271872, "set_robot_commands": 0.0020593573709209996, "deviation-center-line": 0.1006768088327385, "driven_lanedir_consec": 0.06299601454916726, "sim_compute_sim_state": 0.005169157496469463, "sim_compute_performance-ego0": 0.001840783212475196}}
set_robot_commands_max0.0021692340813794183
set_robot_commands_mean0.0020956053257319665
set_robot_commands_median0.002091231415147045
set_robot_commands_min0.002030724391254358
sim_compute_performance-ego0_max0.001951768560316956
sim_compute_performance-ego0_mean0.00189371866672017
sim_compute_performance-ego0_median0.0018911614470442635
sim_compute_performance-ego0_min0.001840783212475196
sim_compute_sim_state_max0.01259338045583188
sim_compute_sim_state_mean0.009203519897836188
sim_compute_sim_state_median0.009525770819521703
sim_compute_sim_state_min0.005169157496469463
sim_render-ego0_max0.003719447885902182
sim_render-ego0_mean0.003630761300955733
sim_render-ego0_median0.0036212810673362378
sim_render-ego0_min0.003561035183248274
simulation-passed1
step_physics_max0.22939304009224604
step_physics_mean0.188739958018114
step_physics_median0.19117824256366625
step_physics_min0.1432103068528775
survival_time_max59.99999999999873
survival_time_mean24.749999999999737
survival_time_min5.09999999999999
No reset possible
5644011305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:00:55
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5626511308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:09:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4864664613945788
survival_time_median4.324999999999992
deviation-center-line_median0.10812230413426122
in-drivable-lane_median2.5499999999999936


other stats
agent_compute-ego0_max0.013731148009909724
agent_compute-ego0_mean0.013294486518867072
agent_compute-ego0_median0.013245032333154716
agent_compute-ego0_min0.012956733399249135
complete-iteration_max0.1949076545772268
complete-iteration_mean0.1739528955387749
complete-iteration_median0.1780442545612685
complete-iteration_min0.14481541845533585
deviation-center-line_max0.1328316105393819
deviation-center-line_mean0.09983945339171968
deviation-center-line_min0.05028159475897433
deviation-heading_max1.3855208131706416
deviation-heading_mean0.6882906407562048
deviation-heading_median0.5504274156794415
deviation-heading_min0.2667869184952947
driven_any_max2.7196170296586804
driven_any_mean1.6282200464466057
driven_any_median1.3642763954266144
driven_any_min1.0647103652745131
driven_lanedir_consec_max0.6509706223069186
driven_lanedir_consec_mean0.4927310762069721
driven_lanedir_consec_min0.347020759731812
driven_lanedir_max0.6509706223069186
driven_lanedir_mean0.4927310762069721
driven_lanedir_median0.4864664613945788
driven_lanedir_min0.347020759731812
get_duckie_state_max1.2686223159601658e-06
get_duckie_state_mean1.1912118252437455e-06
get_duckie_state_median1.2121188447527677e-06
get_duckie_state_min1.071987295509281e-06
get_robot_state_max0.003697178417578676
get_robot_state_mean0.00363504466206683
get_robot_state_median0.00361723200884317
get_robot_state_min0.003608536213002306
get_state_dump_max0.00455489194482789
get_state_dump_mean0.004501893897726384
get_state_dump_median0.004495914456416872
get_state_dump_min0.004460854733243902
get_ui_image_max0.03652603068250291
get_ui_image_mean0.030913482122407812
get_ui_image_median0.030605860864684017
get_ui_image_min0.025916176077760297
in-drivable-lane_max5.2999999999999865
in-drivable-lane_mean2.9749999999999925
in-drivable-lane_min1.4999999999999951
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.7196170296586804, "get_ui_image": 0.028246470860072544, "step_physics": 0.09500881603785924, "survival_time": 6.5999999999999845, "driven_lanedir": 0.347020759731812, "get_state_dump": 0.00455489194482789, "get_robot_state": 0.003697178417578676, "sim_render-ego0": 0.003838754238042616, "get_duckie_state": 1.071987295509281e-06, "in-drivable-lane": 5.2999999999999865, "deviation-heading": 0.8064654221900623, "agent_compute-ego0": 0.013731148009909724, "complete-iteration": 0.162663477704041, "set_robot_commands": 0.002236834146026382, "deviation-center-line": 0.13038701421588786, "driven_lanedir_consec": 0.347020759731812, "sim_compute_sim_state": 0.009312181544483156, "sim_compute_performance-ego0": 0.0019605589988536403}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.280776163697676, "get_ui_image": 0.03652603068250291, "step_physics": 0.1183830017739154, "survival_time": 4.6499999999999915, "driven_lanedir": 0.35176646134013545, "get_state_dump": 0.004460854733243902, "get_robot_state": 0.003608536213002306, "sim_render-ego0": 0.003715309690921864, "get_duckie_state": 1.242820252763464e-06, "in-drivable-lane": 2.749999999999994, "deviation-heading": 1.3855208131706416, "agent_compute-ego0": 0.012956733399249135, "complete-iteration": 0.193425031418496, "set_robot_commands": 0.0021231149105315514, "deviation-center-line": 0.1328316105393819, "driven_lanedir_consec": 0.35176646134013545, "sim_compute_sim_state": 0.00964985248890329, "sim_compute_performance-ego0": 0.001923107086343968}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0647103652745131, "get_ui_image": 0.03296525086929549, "step_physics": 0.12472354120282984, "survival_time": 3.2999999999999963, "driven_lanedir": 0.6509706223069186, "get_state_dump": 0.004530184304536279, "get_robot_state": 0.003614763715373936, "sim_render-ego0": 0.0037946131692003847, "get_duckie_state": 1.181417436742071e-06, "in-drivable-lane": 1.4999999999999951, "deviation-heading": 0.2943894091688206, "agent_compute-ego0": 0.013359514635000656, "complete-iteration": 0.1949076545772268, "set_robot_commands": 0.0022034431571391093, "deviation-center-line": 0.05028159475897433, "driven_lanedir_consec": 0.6509706223069186, "sim_compute_sim_state": 0.007694671403116255, "sim_compute_performance-ego0": 0.0019468834151082964}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.4477766271555526, "get_ui_image": 0.025916176077760297, "step_physics": 0.08470244466522593, "survival_time": 3.999999999999994, "driven_lanedir": 0.6211664614490222, "get_state_dump": 0.004461644608297466, "get_robot_state": 0.0036197003023124034, "sim_render-ego0": 0.0038015253749894506, "get_duckie_state": 1.2686223159601658e-06, "in-drivable-lane": 2.349999999999993, "deviation-heading": 0.2667869184952947, "agent_compute-ego0": 0.013130550031308776, "complete-iteration": 0.14481541845533585, "set_robot_commands": 0.0022837997954568744, "deviation-center-line": 0.08585759405263459, "driven_lanedir_consec": 0.6211664614490222, "sim_compute_sim_state": 0.004843258563383126, "sim_compute_performance-ego0": 0.0019824387114724994}}
set_robot_commands_max0.0022837997954568744
set_robot_commands_mean0.0022117980022884794
set_robot_commands_median0.0022201386515827456
set_robot_commands_min0.0021231149105315514
sim_compute_performance-ego0_max0.0019824387114724994
sim_compute_performance-ego0_mean0.001953247052944601
sim_compute_performance-ego0_median0.001953721206980968
sim_compute_performance-ego0_min0.001923107086343968
sim_compute_sim_state_max0.00964985248890329
sim_compute_sim_state_mean0.007874990999971458
sim_compute_sim_state_median0.008503426473799706
sim_compute_sim_state_min0.004843258563383126
sim_render-ego0_max0.003838754238042616
sim_render-ego0_mean0.003787550618288579
sim_render-ego0_median0.0037980692720949176
sim_render-ego0_min0.003715309690921864
simulation-passed1
step_physics_max0.12472354120282984
step_physics_mean0.1057044509199576
step_physics_median0.10669590890588732
step_physics_min0.08470244466522593
survival_time_max6.5999999999999845
survival_time_mean4.637499999999991
survival_time_min3.2999999999999963
No reset possible
5585711450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simsuccessyesgpu-prod-010:35:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8565726692273552
survival_time_median59.99999999999873
deviation-center-line_median1.1434918061733277
in-drivable-lane_median42.799999999998995


other stats
agent_compute-ego0_max0.012002430167249454
agent_compute-ego0_mean0.011918801544365651
agent_compute-ego0_median0.01198882832316733
agent_compute-ego0_min0.01169511936387849
complete-iteration_max0.3069825767188944
complete-iteration_mean0.2616710799125659
complete-iteration_median0.2666657623105204
complete-iteration_min0.2063702183103283
deviation-center-line_max2.030513383767865
deviation-center-line_mean1.2286388902289824
deviation-center-line_min0.5970585648014086
deviation-heading_max16.996760380098653
deviation-heading_mean10.183859046307017
deviation-heading_median9.318905404489447
deviation-heading_min5.100864996150521
driven_any_max6.471049788035352
driven_any_mean5.180545384004477
driven_any_median6.03105269516235
driven_any_min2.189026357657851
driven_lanedir_consec_max1.0336592089872412
driven_lanedir_consec_mean0.8115241134070954
driven_lanedir_consec_min0.49929190618643027
driven_lanedir_max1.1952682251330025
driven_lanedir_mean0.8916595394607036
driven_lanedir_median0.9360390132616908
driven_lanedir_min0.49929190618643027
get_duckie_state_max1.207378682844049e-06
get_duckie_state_mean1.1371319410076091e-06
get_duckie_state_median1.1245543059396987e-06
get_duckie_state_min1.0920404693069902e-06
get_robot_state_max0.003563972833650892
get_robot_state_mean0.003499780305812374
get_robot_state_median0.0034872037129572374
get_robot_state_min0.003460740963684133
get_state_dump_max0.004335973185365345
get_state_dump_mean0.004314103854143017
get_state_dump_median0.004319670923055486
get_state_dump_min0.004281100385095753
get_ui_image_max0.034963148383684056
get_ui_image_mean0.03025761774314104
get_ui_image_median0.030350790234231435
get_ui_image_min0.025365742120417232
in-drivable-lane_max47.899999999998634
in-drivable-lane_mean37.2874999999992
in-drivable-lane_min15.650000000000157
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.175347719870316, "get_ui_image": 0.028146551014680252, "step_physics": 0.18217464906786204, "survival_time": 59.99999999999873, "driven_lanedir": 0.8384188175361404, "get_state_dump": 0.004281100385095753, "get_robot_state": 0.003563972833650892, "sim_render-ego0": 0.0036574184249382434, "get_duckie_state": 1.0920404693069902e-06, "in-drivable-lane": 47.899999999998634, "deviation-heading": 9.258616167581748, "agent_compute-ego0": 0.011994862933639284, "complete-iteration": 0.2458951191342343, "set_robot_commands": 0.002126165671114322, "deviation-center-line": 0.5970585648014086, "driven_lanedir_consec": 0.8384188175361404, "sim_compute_sim_state": 0.008006254501088671, "sim_compute_performance-ego0": 0.0018758478013800144}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.189026357657851, "get_ui_image": 0.034963148383684056, "step_physics": 0.23084183867259692, "survival_time": 23.200000000000195, "driven_lanedir": 0.49929190618643027, "get_state_dump": 0.004329791633031701, "get_robot_state": 0.003469474854007844, "sim_render-ego0": 0.0035613121524933847, "get_duckie_state": 1.1274891514931957e-06, "in-drivable-lane": 15.650000000000157, "deviation-heading": 5.100864996150521, "agent_compute-ego0": 0.012002430167249454, "complete-iteration": 0.3069825767188944, "set_robot_commands": 0.002053899149740896, "deviation-center-line": 0.8795467534476087, "driven_lanedir_consec": 0.49929190618643027, "sim_compute_sim_state": 0.01386111218442199, "sim_compute_performance-ego0": 0.0018296857034006424}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.471049788035352, "get_ui_image": 0.032555029453782615, "step_physics": 0.21515276866788968, "survival_time": 59.99999999999873, "driven_lanedir": 1.1952682251330025, "get_state_dump": 0.004335973185365345, "get_robot_state": 0.0035049325719066307, "sim_render-ego0": 0.0036279186420297743, "get_duckie_state": 1.207378682844049e-06, "in-drivable-lane": 40.199999999998994, "deviation-heading": 16.996760380098653, "agent_compute-ego0": 0.011982793712695372, "complete-iteration": 0.28743640548680643, "set_robot_commands": 0.002088764128736612, "deviation-center-line": 1.407436858899047, "driven_lanedir_consec": 0.87472652091857, "sim_compute_sim_state": 0.012242686837837162, "sim_compute_performance-ego0": 0.0018713402807662928}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.886757670454385, "get_ui_image": 0.025365742120417232, "step_physics": 0.14806374026575653, "survival_time": 59.99999999999873, "driven_lanedir": 1.0336592089872412, "get_state_dump": 0.00430955021307927, "get_robot_state": 0.003460740963684133, "sim_render-ego0": 0.0035848327719301704, "get_duckie_state": 1.1216194603862016e-06, "in-drivable-lane": 45.399999999999, "deviation-heading": 9.37919464139715, "agent_compute-ego0": 0.01169511936387849, "complete-iteration": 0.2063702183103283, "set_robot_commands": 0.0020554419064104904, "deviation-center-line": 2.030513383767865, "driven_lanedir_consec": 1.0336592089872412, "sim_compute_sim_state": 0.005922358200810136, "sim_compute_performance-ego0": 0.0018416816844829015}}
set_robot_commands_max0.002126165671114322
set_robot_commands_mean0.0020810677140005803
set_robot_commands_median0.002072103017573551
set_robot_commands_min0.002053899149740896
sim_compute_performance-ego0_max0.0018758478013800144
sim_compute_performance-ego0_mean0.0018546388675074628
sim_compute_performance-ego0_median0.0018565109826245972
sim_compute_performance-ego0_min0.0018296857034006424
sim_compute_sim_state_max0.01386111218442199
sim_compute_sim_state_mean0.01000810293103949
sim_compute_sim_state_median0.010124470669462916
sim_compute_sim_state_min0.005922358200810136
sim_render-ego0_max0.0036574184249382434
sim_render-ego0_mean0.003607870497847893
sim_render-ego0_median0.003606375706979972
sim_render-ego0_min0.0035613121524933847
simulation-passed1
step_physics_max0.23084183867259692
step_physics_mean0.1940582491685263
step_physics_median0.19866370886787588
step_physics_min0.14806374026575653
survival_time_max59.99999999999873
survival_time_mean50.799999999999095
survival_time_min23.200000000000195
No reset possible
5515511450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simsuccessyesgpu-prod-010:41:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5426371833492762
survival_time_median59.99999999999873
deviation-center-line_median2.2432067795308166
in-drivable-lane_median32.849999999999405


other stats
agent_compute-ego0_max0.013279467399273189
agent_compute-ego0_mean0.012514462727094867
agent_compute-ego0_median0.01231884251625512
agent_compute-ego0_min0.01214069847659604
complete-iteration_max0.3052324694856617
complete-iteration_mean0.2605350934198556
complete-iteration_median0.2660076099073361
complete-iteration_min0.2048926843790885
deviation-center-line_max2.6678208837462423
deviation-center-line_mean2.143774281214456
deviation-center-line_min1.4208626820499488
deviation-heading_max22.902700582966055
deviation-heading_mean19.03806070131154
deviation-heading_median21.12110915507199
deviation-heading_min11.007323912136131
driven_any_max2.597944964851911
driven_any_mean2.2764855331632807
driven_any_median2.405274990921411
driven_any_min1.6974471859583904
driven_lanedir_consec_max0.8821906369439985
driven_lanedir_consec_mean0.5659753672609918
driven_lanedir_consec_min0.29643646540141644
driven_lanedir_max0.8821906369439985
driven_lanedir_mean0.6884934316571438
driven_lanedir_median0.7876733121415802
driven_lanedir_min0.29643646540141644
get_duckie_state_max1.121817977104854e-06
get_duckie_state_mean1.1026611137548952e-06
get_duckie_state_median1.1013707550836543e-06
get_duckie_state_min1.0860849677474177e-06
get_robot_state_max0.003593192509469343
get_robot_state_mean0.0035487164764181956
get_robot_state_median0.0035437078499774154
get_robot_state_min0.0035142576962486093
get_state_dump_max0.004467482769320549
get_state_dump_mean0.004382315275571824
get_state_dump_median0.004377085799281543
get_state_dump_min0.004307606734403662
get_ui_image_max0.0347662744275934
get_ui_image_mean0.02999547955197756
get_ui_image_median0.030038968311757668
get_ui_image_min0.0251377071568015
in-drivable-lane_max45.09999999999886
in-drivable-lane_mean35.21249999999925
in-drivable-lane_min30.04999999999935
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.524138945432396, "get_ui_image": 0.027826636161137185, "step_physics": 0.17845573929525435, "survival_time": 59.99999999999873, "driven_lanedir": 0.8821906369439985, "get_state_dump": 0.004336774795875263, "get_robot_state": 0.003593192509469343, "sim_render-ego0": 0.0037037919304154497, "get_duckie_state": 1.121817977104854e-06, "in-drivable-lane": 30.04999999999935, "deviation-heading": 22.814045154697027, "agent_compute-ego0": 0.01217705264476614, "complete-iteration": 0.24220133959304083, "set_robot_commands": 0.0022352259919407166, "deviation-center-line": 2.3279044167615006, "driven_lanedir_consec": 0.8821906369439985, "sim_compute_sim_state": 0.00787318616385861, "sim_compute_performance-ego0": 0.001922367018128712}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6974471859583904, "get_ui_image": 0.0347662744275934, "step_physics": 0.2281010684919397, "survival_time": 59.99999999999873, "driven_lanedir": 0.29643646540141644, "get_state_dump": 0.004307606734403662, "get_robot_state": 0.0035142576962486093, "sim_render-ego0": 0.003560186921309472, "get_duckie_state": 1.0860849677474177e-06, "in-drivable-lane": 45.09999999999886, "deviation-heading": 11.007323912136131, "agent_compute-ego0": 0.0124606323877441, "complete-iteration": 0.3052324694856617, "set_robot_commands": 0.0020745394132615723, "deviation-center-line": 1.4208626820499488, "driven_lanedir_consec": 0.29643646540141644, "sim_compute_sim_state": 0.014532065609908915, "sim_compute_performance-ego0": 0.001839474575604924}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.597944964851911, "get_ui_image": 0.03225130046237815, "step_physics": 0.21727617694178192, "survival_time": 59.99999999999873, "driven_lanedir": 0.7918031741859766, "get_state_dump": 0.004467482769320549, "get_robot_state": 0.0035610268455460903, "sim_render-ego0": 0.0036651036026674345, "get_duckie_state": 1.10593663961266e-06, "in-drivable-lane": 35.29999999999946, "deviation-heading": 19.428173155446956, "agent_compute-ego0": 0.01214069847659604, "complete-iteration": 0.2898138802216313, "set_robot_commands": 0.00209263143293268, "deviation-center-line": 2.6678208837462423, "driven_lanedir_consec": 0.30173091660136864, "sim_compute_sim_state": 0.012391382609676262, "sim_compute_performance-ego0": 0.0018961608260994053}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.286411036410426, "get_ui_image": 0.0251377071568015, "step_physics": 0.14500490711888703, "survival_time": 59.99999999999873, "driven_lanedir": 0.7835434500971838, "get_state_dump": 0.004417396802687824, "get_robot_state": 0.0035263888544087405, "sim_render-ego0": 0.0035775037331942415, "get_duckie_state": 1.0968048705546483e-06, "in-drivable-lane": 30.39999999999935, "deviation-heading": 22.902700582966055, "agent_compute-ego0": 0.013279467399273189, "complete-iteration": 0.2048926843790885, "set_robot_commands": 0.0020970859495825214, "deviation-center-line": 2.158509142300133, "driven_lanedir_consec": 0.7835434500971838, "sim_compute_sim_state": 0.00592698622107208, "sim_compute_performance-ego0": 0.0018489342942821492}}
set_robot_commands_max0.0022352259919407166
set_robot_commands_mean0.0021248706969293723
set_robot_commands_median0.0020948586912576004
set_robot_commands_min0.0020745394132615723
sim_compute_performance-ego0_max0.001922367018128712
sim_compute_performance-ego0_mean0.0018767341785287976
sim_compute_performance-ego0_median0.0018725475601907772
sim_compute_performance-ego0_min0.001839474575604924
sim_compute_sim_state_max0.014532065609908915
sim_compute_sim_state_mean0.010180905151128967
sim_compute_sim_state_median0.010132284386767436
sim_compute_sim_state_min0.00592698622107208
sim_render-ego0_max0.0037037919304154497
sim_render-ego0_mean0.003626646546896649
sim_render-ego0_median0.003621303667930838
sim_render-ego0_min0.003560186921309472
simulation-passed1
step_physics_max0.2281010684919397
step_physics_mean0.19220947296196575
step_physics_median0.19786595811851815
step_physics_min0.14500490711888703
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5508511288Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:03:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4765745737347348
survival_time_median3.7749999999999946
deviation-center-line_median0.09392767795467052
in-drivable-lane_median2.299999999999994


other stats
agent_compute-ego0_max0.01372137214198257
agent_compute-ego0_mean0.013216697986928674
agent_compute-ego0_median0.013092381768277768
agent_compute-ego0_min0.012960656269176586
complete-iteration_max0.2038543449865805
complete-iteration_mean0.17640751040981198
complete-iteration_median0.17550475101572427
complete-iteration_min0.1507661946212189
deviation-center-line_max0.1380148856680164
deviation-center-line_mean0.09717455983582904
deviation-center-line_min0.06282799776595871
deviation-heading_max0.968296565588402
deviation-heading_mean0.5846711769257359
deviation-heading_median0.5622133355813137
deviation-heading_min0.2459614709519141
driven_any_max2.670858456059843
driven_any_mean1.6069176908550429
driven_any_median1.337875069566258
driven_any_min1.0810621682278123
driven_lanedir_consec_max0.6345547825584893
driven_lanedir_consec_mean0.4845509734062794
driven_lanedir_consec_min0.35049996359715885
driven_lanedir_max0.6345547825584893
driven_lanedir_mean0.4845509734062794
driven_lanedir_median0.4765745737347348
driven_lanedir_min0.35049996359715885
get_duckie_state_max1.6147440130060369e-06
get_duckie_state_mean1.571685212380773e-06
get_duckie_state_median1.5961728273823048e-06
get_duckie_state_min1.479651181752445e-06
get_robot_state_max0.003623421865565176
get_robot_state_mean0.00357630626307894
get_robot_state_median0.0035670205865308557
get_robot_state_min0.003547762013688872
get_state_dump_max0.004429108387715108
get_state_dump_mean0.004407185909674753
get_state_dump_median0.004407912778543429
get_state_dump_min0.004383809693897044
get_ui_image_max0.03748757452578158
get_ui_image_mean0.03152109194580811
get_ui_image_median0.031179601426977212
get_ui_image_min0.026237590403496464
in-drivable-lane_max5.149999999999987
in-drivable-lane_mean2.8249999999999926
in-drivable-lane_min1.5499999999999956
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.670858456059843, "get_ui_image": 0.02871797649004987, "step_physics": 0.09304806658329856, "survival_time": 6.499999999999985, "driven_lanedir": 0.37391627862300103, "get_state_dump": 0.004383809693897044, "get_robot_state": 0.003623421865565176, "sim_render-ego0": 0.003836002058655251, "get_duckie_state": 1.479651181752445e-06, "in-drivable-lane": 5.149999999999987, "deviation-heading": 0.8245925605185733, "agent_compute-ego0": 0.013217339988883216, "complete-iteration": 0.160345962029377, "set_robot_commands": 0.002131125399174581, "deviation-center-line": 0.1380148856680164, "driven_lanedir_consec": 0.37391627862300103, "sim_compute_sim_state": 0.009392046746406847, "sim_compute_performance-ego0": 0.001925734163240622}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2767290641649665, "get_ui_image": 0.03748757452578158, "step_physics": 0.12829340470803752, "survival_time": 3.649999999999995, "driven_lanedir": 0.35049996359715885, "get_state_dump": 0.004429108387715108, "get_robot_state": 0.003554276517919592, "sim_render-ego0": 0.003759235949129672, "get_duckie_state": 1.6109363452808278e-06, "in-drivable-lane": 2.2499999999999947, "deviation-heading": 0.968296565588402, "agent_compute-ego0": 0.012960656269176586, "complete-iteration": 0.2038543449865805, "set_robot_commands": 0.002093685639871133, "deviation-center-line": 0.1011144978161712, "driven_lanedir_consec": 0.35049996359715885, "sim_compute_sim_state": 0.009311994990786991, "sim_compute_performance-ego0": 0.0018901824951171875}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0810621682278123, "get_ui_image": 0.03364122636390455, "step_physics": 0.11975918032906271, "survival_time": 3.2499999999999964, "driven_lanedir": 0.6345547825584893, "get_state_dump": 0.004405332334113844, "get_robot_state": 0.0035797646551421194, "sim_render-ego0": 0.003786101485743667, "get_duckie_state": 1.6147440130060369e-06, "in-drivable-lane": 1.5499999999999956, "deviation-heading": 0.29983411064405396, "agent_compute-ego0": 0.01372137214198257, "complete-iteration": 0.1906635400020715, "set_robot_commands": 0.0022277868155277138, "deviation-center-line": 0.06282799776595871, "driven_lanedir_consec": 0.6345547825584893, "sim_compute_sim_state": 0.007494142561247854, "sim_compute_performance-ego0": 0.0019711761763601594}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3990210749675496, "get_ui_image": 0.026237590403496464, "step_physics": 0.090753042245213, "survival_time": 3.899999999999994, "driven_lanedir": 0.5792328688464685, "get_state_dump": 0.004410493222973015, "get_robot_state": 0.003547762013688872, "sim_render-ego0": 0.0038144829906994783, "get_duckie_state": 1.5814093094837816e-06, "in-drivable-lane": 2.3499999999999934, "deviation-heading": 0.2459614709519141, "agent_compute-ego0": 0.01296742354767232, "complete-iteration": 0.1507661946212189, "set_robot_commands": 0.002111148230637176, "deviation-center-line": 0.08674085809316982, "driven_lanedir_consec": 0.5792328688464685, "sim_compute_sim_state": 0.004950294011755835, "sim_compute_performance-ego0": 0.0019007000742079336}}
set_robot_commands_max0.0022277868155277138
set_robot_commands_mean0.002140936521302651
set_robot_commands_median0.002121136814905879
set_robot_commands_min0.002093685639871133
sim_compute_performance-ego0_max0.0019711761763601594
sim_compute_performance-ego0_mean0.0019219482272314755
sim_compute_performance-ego0_median0.0019132171187242776
sim_compute_performance-ego0_min0.0018901824951171875
sim_compute_sim_state_max0.009392046746406847
sim_compute_sim_state_mean0.007787119577549382
sim_compute_sim_state_median0.008403068776017424
sim_compute_sim_state_min0.004950294011755835
sim_render-ego0_max0.003836002058655251
sim_render-ego0_mean0.003798955621057017
sim_render-ego0_median0.003800292238221573
sim_render-ego0_min0.003759235949129672
simulation-passed1
step_physics_max0.12829340470803752
step_physics_mean0.10796342346640296
step_physics_median0.10640362345618064
step_physics_min0.090753042245213
survival_time_max6.499999999999985
survival_time_mean4.324999999999993
survival_time_min3.2499999999999964
No reset possible
5493811309Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:08:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5952771609422767
survival_time_median11.375000000000028
deviation-center-line_median0.2961593723639201
in-drivable-lane_median7.550000000000033


other stats
agent_compute-ego0_max0.01353838220674392
agent_compute-ego0_mean0.012467759180466814
agent_compute-ego0_median0.012277459979502678
agent_compute-ego0_min0.01177773455611798
complete-iteration_max0.1875041957315245
complete-iteration_mean0.1697637803159353
complete-iteration_median0.17140018195309958
complete-iteration_min0.1487505616260176
deviation-center-line_max0.4403252539159445
deviation-center-line_mean0.289108343563503
deviation-center-line_min0.1237893756102274
deviation-heading_max3.253259747004209
deviation-heading_mean1.97623874020016
deviation-heading_median1.921872735907058
deviation-heading_min0.8079497419823153
driven_any_max3.321328968109328
driven_any_mean2.21012133462522
driven_any_median2.1364074703234364
driven_any_min1.2463414297446795
driven_lanedir_consec_max0.6305083402093814
driven_lanedir_consec_mean0.5942875507588333
driven_lanedir_consec_min0.5560875409413988
driven_lanedir_max0.6340916063994556
driven_lanedir_mean0.6010986525551643
driven_lanedir_median0.6071077314399014
driven_lanedir_min0.5560875409413988
get_duckie_state_max1.1265626427722954e-06
get_duckie_state_mean1.0805763533002587e-06
get_duckie_state_median1.0789603601109689e-06
get_duckie_state_min1.0378220502068014e-06
get_robot_state_max0.0037482412237870065
get_robot_state_mean0.0035687586974022544
get_robot_state_median0.003525212643402847
get_robot_state_min0.0034763682790163184
get_state_dump_max0.004474315726966189
get_state_dump_mean0.004379905507052304
get_state_dump_median0.004396505383546544
get_state_dump_min0.004252295534149939
get_ui_image_max0.03566491820595481
get_ui_image_mean0.03057165565819167
get_ui_image_median0.03064940617098446
get_ui_image_min0.02532289208484297
in-drivable-lane_max12.750000000000068
in-drivable-lane_mean7.825000000000031
in-drivable-lane_min3.4499999999999904
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.321328968109328, "get_ui_image": 0.028148616266529463, "step_physics": 0.09948563854596768, "survival_time": 17.050000000000107, "driven_lanedir": 0.5560875409413988, "get_state_dump": 0.004474315726966189, "get_robot_state": 0.0037482412237870065, "sim_render-ego0": 0.0038231269657960417, "get_duckie_state": 1.1265626427722954e-06, "in-drivable-lane": 12.750000000000068, "deviation-heading": 3.253259747004209, "agent_compute-ego0": 0.01353838220674392, "complete-iteration": 0.1657933317429838, "set_robot_commands": 0.0022392865510014763, "deviation-center-line": 0.4403252539159445, "driven_lanedir_consec": 0.5560875409413988, "sim_compute_sim_state": 0.008267144710696929, "sim_compute_performance-ego0": 0.001997299361647221}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2463414297446795, "get_ui_image": 0.03566491820595481, "step_physics": 0.10377835649432558, "survival_time": 8.199999999999982, "driven_lanedir": 0.6305083402093814, "get_state_dump": 0.004353438001690489, "get_robot_state": 0.0034939505837180396, "sim_render-ego0": 0.003650334387114554, "get_duckie_state": 1.0736060864997632e-06, "in-drivable-lane": 3.4499999999999904, "deviation-heading": 2.2629444857136325, "agent_compute-ego0": 0.012296522024906043, "complete-iteration": 0.1770070321632154, "set_robot_commands": 0.002057076945449367, "deviation-center-line": 0.4047046375821728, "driven_lanedir_consec": 0.6305083402093814, "sim_compute_sim_state": 0.00980131264888879, "sim_compute_performance-ego0": 0.001843927845810399}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.007633677039178, "get_ui_image": 0.03315019607543945, "step_physics": 0.11818572919662684, "survival_time": 10.90000000000002, "driven_lanedir": 0.6340916063994556, "get_state_dump": 0.004439572765402598, "get_robot_state": 0.003556474703087654, "sim_render-ego0": 0.0036964579804302897, "get_duckie_state": 1.0843146337221748e-06, "in-drivable-lane": 6.650000000000027, "deviation-heading": 1.5808009861004837, "agent_compute-ego0": 0.01225839793409931, "complete-iteration": 0.1875041957315245, "set_robot_commands": 0.002095802733887276, "deviation-center-line": 0.18761410714566729, "driven_lanedir_consec": 0.6080352382911028, "sim_compute_sim_state": 0.008194246248567485, "sim_compute_performance-ego0": 0.0018601548181821225}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.265181263607695, "get_ui_image": 0.02532289208484297, "step_physics": 0.09101777216967416, "survival_time": 11.850000000000032, "driven_lanedir": 0.5837071226704214, "get_state_dump": 0.004252295534149939, "get_robot_state": 0.0034763682790163184, "sim_render-ego0": 0.0036333378623513617, "get_duckie_state": 1.0378220502068014e-06, "in-drivable-lane": 8.450000000000038, "deviation-heading": 0.8079497419823153, "agent_compute-ego0": 0.01177773455611798, "complete-iteration": 0.1487505616260176, "set_robot_commands": 0.002062616228055554, "deviation-center-line": 0.1237893756102274, "driven_lanedir_consec": 0.5825190835934504, "sim_compute_sim_state": 0.005284434607048996, "sim_compute_performance-ego0": 0.0018555176358263032}}
set_robot_commands_max0.0022392865510014763
set_robot_commands_mean0.002113695614598418
set_robot_commands_median0.002079209480971415
set_robot_commands_min0.002057076945449367
sim_compute_performance-ego0_max0.001997299361647221
sim_compute_performance-ego0_mean0.0018892249153665112
sim_compute_performance-ego0_median0.0018578362270042128
sim_compute_performance-ego0_min0.001843927845810399
sim_compute_sim_state_max0.00980131264888879
sim_compute_sim_state_mean0.00788678455380055
sim_compute_sim_state_median0.008230695479632207
sim_compute_sim_state_min0.005284434607048996
sim_render-ego0_max0.0038231269657960417
sim_render-ego0_mean0.0037008142989230614
sim_render-ego0_median0.0036733961837724215
sim_render-ego0_min0.0036333378623513617
simulation-passed1
step_physics_max0.11818572919662684
step_physics_mean0.10311687410164858
step_physics_median0.10163199752014664
step_physics_min0.09101777216967416
survival_time_max17.050000000000107
survival_time_mean12.000000000000036
survival_time_min8.199999999999982
No reset possible
5491111332Olga (Ge Ya) Xu 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simhost-erroryesgpu-prod-010:02:58
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5484711436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:10:25
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4953415167970959
survival_time_median3.8749999999999942
deviation-center-line_median0.10019431734994318
in-drivable-lane_median2.5999999999999948


other stats
agent_compute-ego0_max0.01175010785823915
agent_compute-ego0_mean0.011336147036587826
agent_compute-ego0_median0.011309269378174384
agent_compute-ego0_min0.010975941531763386
complete-iteration_max0.230394308159991
complete-iteration_mean0.196799051409612
complete-iteration_median0.1955821352192934
complete-iteration_min0.16563762703987017
deviation-center-line_max1.3347053459531408
deviation-center-line_mean0.3964925199382131
deviation-center-line_min0.050876099099825205
deviation-heading_max7.092505358170257
deviation-heading_mean2.1832773338209277
deviation-heading_median0.6958540662065884
deviation-heading_min0.24889584470027704
driven_any_max32.21451956876099
driven_any_mean9.164620243328644
driven_any_median1.53081754802698
driven_any_min1.3823263084996291
driven_lanedir_consec_max9.151844330275928
driven_lanedir_consec_mean2.6196278682405016
driven_lanedir_consec_min0.3359841090918858
driven_lanedir_max10.09337842757754
driven_lanedir_mean2.85860808999487
driven_lanedir_median0.5025349116550267
driven_lanedir_min0.3359841090918858
get_duckie_state_max1.1475880940755209e-06
get_duckie_state_mean1.070289089392213e-06
get_duckie_state_median1.0637427666814202e-06
get_duckie_state_min1.0060827301304903e-06
get_robot_state_max0.0036209676323867425
get_robot_state_mean0.003576742235143839
get_robot_state_median0.003573898071567762
get_robot_state_min0.003538205165053089
get_state_dump_max0.00456485224933159
get_state_dump_mean0.004374214157503578
get_state_dump_median0.004365205764770508
get_state_dump_min0.004201592851141708
get_ui_image_max0.03532251206839957
get_ui_image_mean0.030423980530457077
get_ui_image_median0.03015581347761702
get_ui_image_min0.026061783098194697
in-drivable-lane_max39.1499999999992
in-drivable-lane_mean11.612499999999796
in-drivable-lane_min2.0999999999999934
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 32.21451956876099, "get_ui_image": 0.02747182325955533, "step_physics": 0.11476846023165713, "survival_time": 59.99999999999873, "driven_lanedir": 10.09337842757754, "get_state_dump": 0.004201592851141708, "get_robot_state": 0.003538205165053089, "sim_render-ego0": 0.0035734361256290533, "get_duckie_state": 1.0060827301304903e-06, "in-drivable-lane": 39.1499999999992, "deviation-heading": 7.092505358170257, "agent_compute-ego0": 0.010975941531763386, "complete-iteration": 0.1762955214558394, "set_robot_commands": 0.0021024101679767795, "deviation-center-line": 1.3347053459531408, "driven_lanedir_consec": 9.151844330275928, "sim_compute_sim_state": 0.00774235352191401, "sim_compute_performance-ego0": 0.001850446197611406}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.6253119880518745, "get_ui_image": 0.03532251206839957, "step_physics": 0.15836845956197598, "survival_time": 4.049999999999994, "driven_lanedir": 0.6188196930254084, "get_state_dump": 0.00456485224933159, "get_robot_state": 0.0036209676323867425, "sim_render-ego0": 0.0037131920093443336, "get_duckie_state": 1.1019590424328316e-06, "in-drivable-lane": 2.0999999999999934, "deviation-heading": 1.1348402688492234, "agent_compute-ego0": 0.01175010785823915, "complete-iteration": 0.230394308159991, "set_robot_commands": 0.0021947418771139007, "deviation-center-line": 0.14647640362993186, "driven_lanedir_consec": 0.6044329033095468, "sim_compute_sim_state": 0.008838284306409882, "sim_compute_performance-ego0": 0.0019438644734824577}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.436323108002086, "get_ui_image": 0.03283980369567871, "step_physics": 0.14729031244913737, "survival_time": 3.699999999999995, "driven_lanedir": 0.38625013028464505, "get_state_dump": 0.0044078826904296875, "get_robot_state": 0.003598667780558268, "sim_render-ego0": 0.003671153386433919, "get_duckie_state": 1.1475880940755209e-06, "in-drivable-lane": 2.5999999999999943, "deviation-heading": 0.25686786356395347, "agent_compute-ego0": 0.011431811650594075, "complete-iteration": 0.2148687489827474, "set_robot_commands": 0.002259531021118164, "deviation-center-line": 0.050876099099825205, "driven_lanedir_consec": 0.38625013028464505, "sim_compute_sim_state": 0.007343931198120117, "sim_compute_performance-ego0": 0.0019489034016927085}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3823263084996291, "get_ui_image": 0.026061783098194697, "step_physics": 0.10775865594001666, "survival_time": 3.599999999999995, "driven_lanedir": 0.3359841090918858, "get_state_dump": 0.004322528839111328, "get_robot_state": 0.0035491283625772555, "sim_render-ego0": 0.003734311012372579, "get_duckie_state": 1.0255264909300086e-06, "in-drivable-lane": 2.599999999999995, "deviation-heading": 0.24889584470027704, "agent_compute-ego0": 0.011186727105754695, "complete-iteration": 0.16563762703987017, "set_robot_commands": 0.002157198239679206, "deviation-center-line": 0.053912231069954485, "driven_lanedir_consec": 0.3359841090918858, "sim_compute_sim_state": 0.004877733857664344, "sim_compute_performance-ego0": 0.0019154973226050808}}
set_robot_commands_max0.002259531021118164
set_robot_commands_mean0.0021784703264720127
set_robot_commands_median0.002175970058396554
set_robot_commands_min0.0021024101679767795
sim_compute_performance-ego0_max0.0019489034016927085
sim_compute_performance-ego0_mean0.0019146778488479137
sim_compute_performance-ego0_median0.0019296808980437691
sim_compute_performance-ego0_min0.001850446197611406
sim_compute_sim_state_max0.008838284306409882
sim_compute_sim_state_mean0.007200575721027089
sim_compute_sim_state_median0.007543142360017064
sim_compute_sim_state_min0.004877733857664344
sim_render-ego0_max0.003734311012372579
sim_render-ego0_mean0.0036730231334449713
sim_render-ego0_median0.0036921726978891263
sim_render-ego0_min0.0035734361256290533
simulation-passed1
step_physics_max0.15836845956197598
step_physics_mean0.13204647204569678
step_physics_median0.13102938634039724
step_physics_min0.10775865594001666
survival_time_max59.99999999999873
survival_time_mean17.83749999999968
survival_time_min3.599999999999995
No reset possible
5463211412Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:30:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median9.19294762660262
survival_time_median51.84999999999919
deviation-center-line_median2.545839304080693
in-drivable-lane_median9.874999999999966


other stats
agent_compute-ego0_max0.034113913551159045
agent_compute-ego0_mean0.033080677757399764
agent_compute-ego0_median0.03298675339693551
agent_compute-ego0_min0.03223529068456899
complete-iteration_max0.2269645137786865
complete-iteration_mean0.19661220666121176
complete-iteration_median0.1936965662634579
complete-iteration_min0.17209118033924467
deviation-center-line_max3.476827181194106
deviation-center-line_mean2.5677864808109887
deviation-center-line_min1.702640133888462
deviation-heading_max15.93785490425805
deviation-heading_mean11.463427876528954
deviation-heading_median11.071636075465808
deviation-heading_min7.7725844509261535
driven_any_max14.59033166218785
driven_any_mean12.061967462694737
driven_any_median12.511187567302674
driven_any_min8.63516305398574
driven_lanedir_consec_max14.270987459095569
driven_lanedir_consec_mean9.388663149066048
driven_lanedir_consec_min4.897769883963389
driven_lanedir_max14.270987459095569
driven_lanedir_mean9.389321819331933
driven_lanedir_median9.19294762660262
driven_lanedir_min4.900404565026925
get_duckie_state_max1.0985915210225205e-06
get_duckie_state_mean1.054575919686132e-06
get_duckie_state_median1.0557710830462717e-06
get_duckie_state_min1.0081699916294643e-06
get_robot_state_max0.003515700317243057
get_robot_state_mean0.0034713962397351908
get_robot_state_median0.003462852144675234
get_robot_state_min0.0034441803523472376
get_state_dump_max0.004321720246430282
get_state_dump_mean0.00425863558104363
get_state_dump_median0.004254086825571688
get_state_dump_min0.004204648426600865
get_ui_image_max0.034676575251988
get_ui_image_mean0.029734855696403384
get_ui_image_median0.02967730600296633
get_ui_image_min0.024908235527692887
in-drivable-lane_max13.699999999999656
in-drivable-lane_mean8.449999999999898
in-drivable-lane_min0.350000000000005
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.59033166218785, "get_ui_image": 0.027701925973312544, "step_physics": 0.08718643716531034, "survival_time": 59.99999999999873, "driven_lanedir": 14.270987459095569, "get_state_dump": 0.00422920215933845, "get_robot_state": 0.003515700317243057, "sim_render-ego0": 0.003607134140103584, "get_duckie_state": 1.0985915210225205e-06, "in-drivable-lane": 0.350000000000005, "deviation-heading": 7.7725844509261535, "agent_compute-ego0": 0.034113913551159045, "complete-iteration": 0.17384228063165694, "set_robot_commands": 0.0021132998025784585, "deviation-center-line": 2.5371197687726657, "driven_lanedir_consec": 14.270987459095569, "sim_compute_sim_state": 0.009442278983491745, "sim_compute_performance-ego0": 0.0018578677451382272}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.432559727817305, "get_ui_image": 0.034676575251988, "step_physics": 0.1318011155809675, "survival_time": 43.699999999999655, "driven_lanedir": 8.032490921554125, "get_state_dump": 0.004204648426600865, "get_robot_state": 0.0034441803523472376, "sim_render-ego0": 0.0035514910561697823, "get_duckie_state": 1.0081699916294643e-06, "in-drivable-lane": 6.999999999999985, "deviation-heading": 12.14891422468017, "agent_compute-ego0": 0.03240575299944196, "complete-iteration": 0.2269645137786865, "set_robot_commands": 0.002030834197998047, "deviation-center-line": 2.554558839388721, "driven_lanedir_consec": 8.032490921554125, "sim_compute_sim_state": 0.012965641294206891, "sim_compute_performance-ego0": 0.0018135275159563335}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.63516305398574, "get_ui_image": 0.03165268603262011, "step_physics": 0.11863765906501604, "survival_time": 36.35000000000007, "driven_lanedir": 4.900404565026925, "get_state_dump": 0.004321720246430282, "get_robot_state": 0.0034685092312949045, "sim_render-ego0": 0.004205296000281533, "get_duckie_state": 1.0774685786320613e-06, "in-drivable-lane": 12.749999999999948, "deviation-heading": 9.994357926251448, "agent_compute-ego0": 0.03356775379442906, "complete-iteration": 0.21355085189525896, "set_robot_commands": 0.002655086609033438, "deviation-center-line": 1.702640133888462, "driven_lanedir_consec": 4.897769883963389, "sim_compute_sim_state": 0.01282304001378489, "sim_compute_performance-ego0": 0.0021468826702662875}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.589815406788045, "get_ui_image": 0.024908235527692887, "step_physics": 0.093790901789161, "survival_time": 59.99999999999873, "driven_lanedir": 10.353404331651111, "get_state_dump": 0.004278971491804925, "get_robot_state": 0.003457195058055563, "sim_render-ego0": 0.0035235343825112376, "get_duckie_state": 1.0340735874604822e-06, "in-drivable-lane": 13.699999999999656, "deviation-heading": 15.93785490425805, "agent_compute-ego0": 0.03223529068456899, "complete-iteration": 0.17209118033924467, "set_robot_commands": 0.002039181600502389, "deviation-center-line": 3.476827181194106, "driven_lanedir_consec": 10.353404331651111, "sim_compute_sim_state": 0.005963011844072811, "sim_compute_performance-ego0": 0.0018239817353311327}}
set_robot_commands_max0.002655086609033438
set_robot_commands_mean0.002209600552528083
set_robot_commands_median0.002076240701540424
set_robot_commands_min0.002030834197998047
sim_compute_performance-ego0_max0.0021468826702662875
sim_compute_performance-ego0_mean0.0019105649166729951
sim_compute_performance-ego0_median0.00184092474023468
sim_compute_performance-ego0_min0.0018135275159563335
sim_compute_sim_state_max0.012965641294206891
sim_compute_sim_state_mean0.010298493033889085
sim_compute_sim_state_median0.011132659498638318
sim_compute_sim_state_min0.005963011844072811
sim_render-ego0_max0.004205296000281533
sim_render-ego0_mean0.0037218638947665345
sim_render-ego0_median0.003579312598136683
sim_render-ego0_min0.0035235343825112376
simulation-passed1
step_physics_max0.1318011155809675
step_physics_mean0.10785402840011372
step_physics_median0.10621428042708853
step_physics_min0.08718643716531034
survival_time_max59.99999999999873
survival_time_mean50.01249999999929
survival_time_min36.35000000000007
No reset possible
5460811438Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simfailedyesgpu-prod-010:02:47
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 27, in init
              ||     self.model.load("model", directory="./models")
              ||   File "/workspace/model.py", line 236, in load
              ||     self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 581, in load
              ||     with _open_file_like(f, 'rb') as opened_file:
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 230, in _open_file_like
              ||     return _open_file(name_or_buffer, mode)
              ||   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 211, in __init__
              ||     super(_open_file, self).__init__(open(name, mode))
              || FileNotFoundError: [Errno 2] No such file or directory: './models/model_actor.pth'
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 27, in init
              || |     self.model.load("model", directory="./models")
              || |   File "/workspace/model.py", line 236, in load
              || |     self.actor.load_state_dict(torch.load('{}/{}_actor.pth'.format(directory, filename), map_location=device))
              || |   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 581, in load
              || |     with _open_file_like(f, 'rb') as opened_file:
              || |   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 230, in _open_file_like
              || |     return _open_file(name_or_buffer, mode)
              || |   File "/usr/local/lib/python3.8/dist-packages/torch/serialization.py", line 211, in __init__
              || |     super(_open_file, self).__init__(open(name, mode))
              || | FileNotFoundError: [Errno 2] No such file or directory: './models/model_actor.pth'
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5452911465Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:25:03
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5010948805836644
survival_time_median58.19999999999883
deviation-center-line_median0.783250776367894
in-drivable-lane_median46.24999999999881


other stats
agent_compute-ego0_max0.012273061285408012
agent_compute-ego0_mean0.012155582649227855
agent_compute-ego0_median0.012131932741602052
agent_compute-ego0_min0.012085403828299314
complete-iteration_max0.2007841422007634
complete-iteration_mean0.18135543365470164
complete-iteration_median0.1835764525899155
complete-iteration_min0.15748468723821205
deviation-center-line_max0.9572703097964116
deviation-center-line_mean0.7173659495756043
deviation-center-line_min0.34569193577021745
deviation-heading_max7.374414200430293
deviation-heading_mean4.261700747606719
deviation-heading_median3.7349850876852138
deviation-heading_min2.202418614626154
driven_any_max13.943824640049804
driven_any_mean9.544336474314838
driven_any_median11.41970580255038
driven_any_min1.3941096521087908
driven_lanedir_consec_max2.770804039439133
driven_lanedir_consec_mean1.5940278185963876
driven_lanedir_consec_min0.6031174737790885
driven_lanedir_max3.9039565448121216
driven_lanedir_mean1.9582377671839577
driven_lanedir_median1.6560558792942108
driven_lanedir_min0.6168827653352875
get_duckie_state_max1.175020457703704e-06
get_duckie_state_mean1.1418743556293576e-06
get_duckie_state_median1.1460493966616676e-06
get_duckie_state_min1.100378171490392e-06
get_robot_state_max0.0036410965788473593
get_robot_state_mean0.0035735445032930207
get_robot_state_median0.0035690486412527367
get_robot_state_min0.00351498415181925
get_state_dump_max0.004403952690644851
get_state_dump_mean0.004388884324607061
get_state_dump_median0.004388705921415679
get_state_dump_min0.004374172764952037
get_ui_image_max0.03639690168611296
get_ui_image_mean0.0307791317072962
get_ui_image_median0.03043829215654031
get_ui_image_min0.025843040829991223
in-drivable-lane_max48.04999999999909
in-drivable-lane_mean36.26249999999918
in-drivable-lane_min4.500000000000002
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 13.943824640049804, "get_ui_image": 0.02796702142758334, "step_physics": 0.10397446919837462, "survival_time": 59.99999999999873, "driven_lanedir": 3.9039565448121216, "get_state_dump": 0.004374172764952037, "get_robot_state": 0.0036410965788473593, "sim_render-ego0": 0.0038370665265161927, "get_duckie_state": 1.100378171490392e-06, "in-drivable-lane": 45.44999999999865, "deviation-heading": 2.66498034546721, "agent_compute-ego0": 0.012273061285408012, "complete-iteration": 0.169821554576229, "set_robot_commands": 0.0022786928156234144, "deviation-center-line": 0.9572703097964116, "driven_lanedir_consec": 2.770804039439133, "sim_compute_sim_state": 0.009426008751747709, "sim_compute_performance-ego0": 0.0019788783753940603}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3941096521087908, "get_ui_image": 0.03639690168611296, "step_physics": 0.1266381806069678, "survival_time": 9.049999999999994, "driven_lanedir": 0.6168827653352875, "get_state_dump": 0.004376344628386445, "get_robot_state": 0.00351498415181925, "sim_render-ego0": 0.003702948381612589, "get_duckie_state": 1.165893051650498e-06, "in-drivable-lane": 4.500000000000002, "deviation-heading": 2.202418614626154, "agent_compute-ego0": 0.01213608993278755, "complete-iteration": 0.2007841422007634, "set_robot_commands": 0.002106104578290667, "deviation-center-line": 0.34569193577021745, "driven_lanedir_consec": 0.6031174737790885, "sim_compute_sim_state": 0.00996115967467591, "sim_compute_performance-ego0": 0.0018839665821620397}, "LF-norm-techtrack-000-ego0": {"driven_any": 10.334409451772782, "get_ui_image": 0.03290956288549729, "step_physics": 0.12634688040342237, "survival_time": 56.39999999999893, "driven_lanedir": 0.9477003439612862, "get_state_dump": 0.004403952690644851, "get_robot_state": 0.003561292526677607, "sim_render-ego0": 0.003788472277807704, "get_duckie_state": 1.126205741672837e-06, "in-drivable-lane": 48.04999999999909, "deviation-heading": 7.374414200430293, "agent_compute-ego0": 0.012127775550416551, "complete-iteration": 0.197331350603602, "set_robot_commands": 0.002193356742892675, "deviation-center-line": 0.65188329613021, "driven_lanedir_consec": 0.7229117984096568, "sim_compute_sim_state": 0.009981361292863549, "sim_compute_performance-ego0": 0.0019459758214553549}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.505002153327975, "get_ui_image": 0.025843040829991223, "step_physics": 0.09754714243219456, "survival_time": 59.99999999999873, "driven_lanedir": 2.3644114146271353, "get_state_dump": 0.004401067214444912, "get_robot_state": 0.0035768047558278663, "sim_render-ego0": 0.003750383804283174, "get_duckie_state": 1.175020457703704e-06, "in-drivable-lane": 47.049999999998974, "deviation-heading": 4.804989829903218, "agent_compute-ego0": 0.012085403828299314, "complete-iteration": 0.15748468723821205, "set_robot_commands": 0.002208530456199932, "deviation-center-line": 0.914618256605578, "driven_lanedir_consec": 2.279277962757672, "sim_compute_sim_state": 0.006077831531940749, "sim_compute_performance-ego0": 0.001924111384535511}}
set_robot_commands_max0.0022786928156234144
set_robot_commands_mean0.002196671148251672
set_robot_commands_median0.0022009435995463036
set_robot_commands_min0.002106104578290667
sim_compute_performance-ego0_max0.0019788783753940603
sim_compute_performance-ego0_mean0.0019332330408867416
sim_compute_performance-ego0_median0.0019350436029954329
sim_compute_performance-ego0_min0.0018839665821620397
sim_compute_sim_state_max0.009981361292863549
sim_compute_sim_state_mean0.008861590312806979
sim_compute_sim_state_median0.00969358421321181
sim_compute_sim_state_min0.006077831531940749
sim_render-ego0_max0.0038370665265161927
sim_render-ego0_mean0.0037697177475549152
sim_render-ego0_median0.0037694280410454383
sim_render-ego0_min0.003702948381612589
simulation-passed1
step_physics_max0.1266381806069678
step_physics_mean0.11362666816023984
step_physics_median0.1151606748008985
step_physics_min0.09754714243219456
survival_time_max59.99999999999873
survival_time_mean46.362499999999095
survival_time_min9.049999999999994
No reset possible
5446811524Jean-Sébastien Grondin 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:21:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.221068725541451
survival_time_median37.599999999999405
deviation-center-line_median0.4882753590050022
in-drivable-lane_median9.174999999999898


other stats
agent_compute-ego0_max0.01226376627312332
agent_compute-ego0_mean0.011822672123402453
agent_compute-ego0_median0.011733708982410829
agent_compute-ego0_min0.011559504255664836
complete-iteration_max0.29260787716159575
complete-iteration_mean0.2295207593526687
complete-iteration_median0.21417654295150285
complete-iteration_min0.19712207434607337
deviation-center-line_max4.131721875016161
deviation-center-line_mean1.3090116172774404
deviation-center-line_min0.1277738760835959
deviation-heading_max16.344034641317347
deviation-heading_mean5.140930173026086
deviation-heading_median1.5995839644251315
deviation-heading_min1.020518121936737
driven_any_max16.674347282900886
driven_any_mean9.515124484458417
driven_any_median10.30756324637018
driven_any_min0.7710241621924252
driven_lanedir_consec_max12.03390315336392
driven_lanedir_consec_mean3.6612719001759673
driven_lanedir_consec_min0.16904699625704822
driven_lanedir_max12.541589630258263
driven_lanedir_mean3.8523634999696865
driven_lanedir_median1.3036070365736032
driven_lanedir_min0.2606502964732753
get_duckie_state_max1.24509685938801e-06
get_duckie_state_mean1.1580750862374263e-06
get_duckie_state_median1.1579340260981164e-06
get_duckie_state_min1.0713354333654626e-06
get_robot_state_max0.003602555540741467
get_robot_state_mean0.0035482343812824474
get_robot_state_median0.0035507441758116914
get_robot_state_min0.00348889363276494
get_state_dump_max0.004504361699839107
get_state_dump_mean0.004360889772224744
get_state_dump_median0.004321784798449819
get_state_dump_min0.004295627792160232
get_ui_image_max0.03533999021951254
get_ui_image_mean0.029933660876045792
get_ui_image_median0.02959457355499059
get_ui_image_min0.02520550617468943
in-drivable-lane_max57.19999999999873
in-drivable-lane_mean19.37499999999963
in-drivable-lane_min1.9499999999999955
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.943693368238873, "get_ui_image": 0.027447900615754674, "step_physics": 0.13129059369446802, "survival_time": 15.20000000000008, "driven_lanedir": 2.010133793633059, "get_state_dump": 0.004504361699839107, "get_robot_state": 0.003602555540741467, "sim_render-ego0": 0.003899800972860367, "get_duckie_state": 1.1311202752785604e-06, "in-drivable-lane": 7.350000000000101, "deviation-heading": 1.8869874303831264, "agent_compute-ego0": 0.01226376627312332, "complete-iteration": 0.19712207434607337, "set_robot_commands": 0.0023281214667148276, "deviation-center-line": 0.6365719516531172, "driven_lanedir_consec": 2.010133793633059, "sim_compute_sim_state": 0.009681948677438204, "sim_compute_performance-ego0": 0.0020300349251168672}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7710241621924252, "get_ui_image": 0.03533999021951254, "step_physics": 0.21980711082359417, "survival_time": 3.7999999999999945, "driven_lanedir": 0.2606502964732753, "get_state_dump": 0.004295627792160232, "get_robot_state": 0.00348889363276494, "sim_render-ego0": 0.0036963828198321455, "get_duckie_state": 1.0713354333654626e-06, "in-drivable-lane": 1.9499999999999955, "deviation-heading": 1.3121804984671372, "agent_compute-ego0": 0.01184376184042398, "complete-iteration": 0.29260787716159575, "set_robot_commands": 0.0023725806892692268, "deviation-center-line": 0.1277738760835959, "driven_lanedir_consec": 0.16904699625704822, "sim_compute_sim_state": 0.009822873326091023, "sim_compute_performance-ego0": 0.0018730225501122416}, "LF-norm-techtrack-000-ego0": {"driven_any": 16.674347282900886, "get_ui_image": 0.031741246494226515, "step_physics": 0.15809188655373654, "survival_time": 59.99999999999873, "driven_lanedir": 12.541589630258263, "get_state_dump": 0.004333013499606956, "get_robot_state": 0.0035659647504058508, "sim_render-ego0": 0.003686098730832115, "get_duckie_state": 1.24509685938801e-06, "in-drivable-lane": 10.999999999999693, "deviation-heading": 16.344034641317347, "agent_compute-ego0": 0.011623656124397676, "complete-iteration": 0.22945210776857097, "set_robot_commands": 0.002232549391023126, "deviation-center-line": 4.131721875016161, "driven_lanedir_consec": 12.03390315336392, "sim_compute_sim_state": 0.012171362560059408, "sim_compute_performance-ego0": 0.001935326388039061}, "LF-norm-small_loop-000-ego0": {"driven_any": 16.671433124501487, "get_ui_image": 0.02520550617468943, "step_physics": 0.1403734211520688, "survival_time": 59.99999999999873, "driven_lanedir": 0.597080279514147, "get_state_dump": 0.004310556097292682, "get_robot_state": 0.003535523601217532, "sim_render-ego0": 0.003677569658531932, "get_duckie_state": 1.184747776917673e-06, "in-drivable-lane": 57.19999999999873, "deviation-heading": 1.020518121936737, "agent_compute-ego0": 0.011559504255664836, "complete-iteration": 0.19890097813443475, "set_robot_commands": 0.002162759647480554, "deviation-center-line": 0.33997876635688723, "driven_lanedir_consec": 0.4320036574498424, "sim_compute_sim_state": 0.006103404257120836, "sim_compute_performance-ego0": 0.0019048497043581032}}
set_robot_commands_max0.0023725806892692268
set_robot_commands_mean0.002274002798621934
set_robot_commands_median0.002280335428868977
set_robot_commands_min0.002162759647480554
sim_compute_performance-ego0_max0.0020300349251168672
sim_compute_performance-ego0_mean0.001935808391906568
sim_compute_performance-ego0_median0.0019200880461985824
sim_compute_performance-ego0_min0.0018730225501122416
sim_compute_sim_state_max0.012171362560059408
sim_compute_sim_state_mean0.009444897205177369
sim_compute_sim_state_median0.009752411001764614
sim_compute_sim_state_min0.006103404257120836
sim_render-ego0_max0.003899800972860367
sim_render-ego0_mean0.00373996304551414
sim_render-ego0_median0.0036912407753321302
sim_render-ego0_min0.003677569658531932
simulation-passed1
step_physics_max0.21980711082359417
step_physics_mean0.16239075305596687
step_physics_median0.14923265385290269
step_physics_min0.13129059369446802
survival_time_max59.99999999999873
survival_time_mean34.74999999999938
survival_time_min3.7999999999999945
No reset possible
5440511554Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:28:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.10047996230934
survival_time_median59.99999999999873
deviation-center-line_median3.715027014884324
in-drivable-lane_median1.3999999999999204


other stats
agent_compute-ego0_max0.012038790911659412
agent_compute-ego0_mean0.011844839992880909
agent_compute-ego0_median0.011887427501361613
agent_compute-ego0_min0.011565714057141002
complete-iteration_max0.2025078667093574
complete-iteration_mean0.17806893979699
complete-iteration_median0.178041674721944
complete-iteration_min0.1536845430347147
deviation-center-line_max4.306164256957552
deviation-center-line_mean3.270610098222716
deviation-center-line_min1.3462221061646649
deviation-heading_max13.127425844473825
deviation-heading_mean10.450037315560808
deviation-heading_median12.272883406171507
deviation-heading_min4.1269566054263915
driven_any_max11.808308553882846
driven_any_mean9.274904405362538
driven_any_median10.706541948705825
driven_any_min3.87822517015566
driven_lanedir_consec_max11.424825333916155
driven_lanedir_consec_mean8.731985406554575
driven_lanedir_consec_min3.302156367683468
driven_lanedir_max11.424825333916155
driven_lanedir_mean8.731985406554575
driven_lanedir_median10.10047996230934
driven_lanedir_min3.302156367683468
get_duckie_state_max1.2695144157822582e-06
get_duckie_state_mean1.1929279174355511e-06
get_duckie_state_median1.190487413505525e-06
get_duckie_state_min1.1212224269488967e-06
get_robot_state_max0.0036172130324262862
get_robot_state_mean0.003593752089230353
get_robot_state_median0.0035935702867849386
get_robot_state_min0.00357065475092525
get_state_dump_max0.0045670811877858136
get_state_dump_mean0.004475127953397269
get_state_dump_median0.004476271417163043
get_state_dump_min0.004380887791477175
get_ui_image_max0.035407958677865184
get_ui_image_mean0.030182381561509163
get_ui_image_median0.029864849412677457
get_ui_image_min0.025591868742816555
in-drivable-lane_max3.1500000000000448
in-drivable-lane_mean1.4874999999999714
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.808308553882846, "get_ui_image": 0.027424100038908005, "step_physics": 0.0980621454221422, "survival_time": 59.99999999999873, "driven_lanedir": 11.424825333916155, "get_state_dump": 0.004380887791477175, "get_robot_state": 0.0035821170632190052, "sim_render-ego0": 0.003734944960556856, "get_duckie_state": 1.1212224269488967e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.127425844473825, "agent_compute-ego0": 0.01182800963161192, "complete-iteration": 0.1624699726787634, "set_robot_commands": 0.002277863214256166, "deviation-center-line": 3.2705076729864535, "driven_lanedir_consec": 11.424825333916155, "sim_compute_sim_state": 0.009111150516062157, "sim_compute_performance-ego0": 0.001987844581508716}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.864752162877616, "get_ui_image": 0.035407958677865184, "step_physics": 0.12577056130402095, "survival_time": 59.99999999999873, "driven_lanedir": 9.943875042219217, "get_state_dump": 0.004467475821235396, "get_robot_state": 0.0036172130324262862, "sim_render-ego0": 0.0037888039359442894, "get_duckie_state": 1.2695144157822582e-06, "in-drivable-lane": 2.799999999999841, "deviation-heading": 13.054866818358414, "agent_compute-ego0": 0.012038790911659412, "complete-iteration": 0.2025078667093574, "set_robot_commands": 0.002249400482685937, "deviation-center-line": 4.159546356782195, "driven_lanedir_consec": 9.943875042219217, "sim_compute_sim_state": 0.013094180827335355, "sim_compute_performance-ego0": 0.0019900939744477665}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.87822517015566, "get_ui_image": 0.0323055987864469, "step_physics": 0.1226790731987067, "survival_time": 22.550000000000185, "driven_lanedir": 3.302156367683468, "get_state_dump": 0.0044850670130906906, "get_robot_state": 0.00357065475092525, "sim_render-ego0": 0.003738070483756277, "get_duckie_state": 1.2200490563316685e-06, "in-drivable-lane": 3.1500000000000448, "deviation-heading": 4.1269566054263915, "agent_compute-ego0": 0.011946845371111304, "complete-iteration": 0.19361337676512455, "set_robot_commands": 0.0021746580579639534, "deviation-center-line": 1.3462221061646649, "driven_lanedir_consec": 3.302156367683468, "sim_compute_sim_state": 0.010709081075887764, "sim_compute_performance-ego0": 0.0019258366221875216}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.54833173453403, "get_ui_image": 0.025591868742816555, "step_physics": 0.09433786120641044, "survival_time": 59.99999999999873, "driven_lanedir": 10.25708488239946, "get_state_dump": 0.0045670811877858136, "get_robot_state": 0.003605023510350871, "sim_render-ego0": 0.003718515319887744, "get_duckie_state": 1.1609257706793817e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.490899993984602, "agent_compute-ego0": 0.011565714057141002, "complete-iteration": 0.1536845430347147, "set_robot_commands": 0.002206563354034805, "deviation-center-line": 4.306164256957552, "driven_lanedir_consec": 10.25708488239946, "sim_compute_sim_state": 0.00606138382625024, "sim_compute_performance-ego0": 0.001952745833067374}}
set_robot_commands_max0.002277863214256166
set_robot_commands_mean0.002227121277235215
set_robot_commands_median0.002227981918360371
set_robot_commands_min0.0021746580579639534
sim_compute_performance-ego0_max0.0019900939744477665
sim_compute_performance-ego0_mean0.0019641302528028443
sim_compute_performance-ego0_median0.0019702952072880447
sim_compute_performance-ego0_min0.0019258366221875216
sim_compute_sim_state_max0.013094180827335355
sim_compute_sim_state_mean0.00974394906138388
sim_compute_sim_state_median0.00991011579597496
sim_compute_sim_state_min0.00606138382625024
sim_render-ego0_max0.0037888039359442894
sim_render-ego0_mean0.003745083675036292
sim_render-ego0_median0.0037365077221565663
sim_render-ego0_min0.003718515319887744
simulation-passed1
step_physics_max0.12577056130402095
step_physics_mean0.11021241028282008
step_physics_median0.11037060931042446
step_physics_min0.09433786120641044
survival_time_max59.99999999999873
survival_time_mean50.63749999999909
survival_time_min22.550000000000185
No reset possible
5436411564Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:07:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.47469644768734554
survival_time_median5.799999999999987
deviation-center-line_median0.1652944732306097
in-drivable-lane_median3.424999999999989


other stats
agent_compute-ego0_max0.012381721304976232
agent_compute-ego0_mean0.012087630437290027
agent_compute-ego0_median0.012032182859948164
agent_compute-ego0_min0.011904434724287554
complete-iteration_max0.1832846624661336
complete-iteration_mean0.1618178547832404
complete-iteration_median0.16053682284079218
complete-iteration_min0.14291311098524362
deviation-center-line_max0.2107574672154177
deviation-center-line_mean0.1581138428629571
deviation-center-line_min0.09110895777519126
deviation-heading_max1.6028043324994483
deviation-heading_mean0.9765701606930464
deviation-heading_median0.9303809734441494
deviation-heading_min0.4427143633844387
driven_any_max2.7421381859627276
driven_any_mean1.6170509091491754
driven_any_median1.3305380001207268
driven_any_min1.0649894503925208
driven_lanedir_consec_max0.6308086958038627
driven_lanedir_consec_mean0.4762920812562057
driven_lanedir_consec_min0.32496673384626873
driven_lanedir_max0.6308086958038627
driven_lanedir_mean0.4762920812562057
driven_lanedir_median0.47469644768734554
driven_lanedir_min0.32496673384626873
get_duckie_state_max1.2137673117897727e-06
get_duckie_state_mean1.151253720344117e-06
get_duckie_state_median1.1336371340539503e-06
get_duckie_state_min1.1239733014787949e-06
get_robot_state_max0.003622522092845342
get_robot_state_mean0.0035922639039478975
get_robot_state_median0.0035917617599951655
get_robot_state_min0.0035630100029559173
get_state_dump_max0.004503184715203479
get_state_dump_mean0.00444257505782827
get_state_dump_median0.004458788628982883
get_state_dump_min0.004349538258143834
get_ui_image_max0.03565646905814652
get_ui_image_mean0.030259242151486378
get_ui_image_median0.029868259177538103
get_ui_image_min0.025643981192722792
in-drivable-lane_max8.850000000000005
in-drivable-lane_mean4.462499999999994
in-drivable-lane_min2.1499999999999924
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.7421381859627276, "get_ui_image": 0.027785300119826783, "step_physics": 0.08230235260915539, "survival_time": 10.90000000000002, "driven_lanedir": 0.32496673384626873, "get_state_dump": 0.004466111257196017, "get_robot_state": 0.003622522092845342, "sim_render-ego0": 0.003928932425093978, "get_duckie_state": 1.1300387447827484e-06, "in-drivable-lane": 8.850000000000005, "deviation-heading": 1.3836203939543363, "agent_compute-ego0": 0.012381721304976232, "complete-iteration": 0.14842153248721607, "set_robot_commands": 0.002327956021104229, "deviation-center-line": 0.2107574672154177, "driven_lanedir_consec": 0.32496673384626873, "sim_compute_sim_state": 0.009500063717637432, "sim_compute_performance-ego0": 0.0020277086458249725}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2746330422663896, "get_ui_image": 0.03565646905814652, "step_physics": 0.10986543756670657, "survival_time": 5.599999999999988, "driven_lanedir": 0.3485414367201807, "get_state_dump": 0.004503184715203479, "get_robot_state": 0.0035967130576614785, "sim_render-ego0": 0.003752754852835056, "get_duckie_state": 1.137235523325152e-06, "in-drivable-lane": 3.3999999999999906, "deviation-heading": 1.6028043324994483, "agent_compute-ego0": 0.012032302080002506, "complete-iteration": 0.1832846624661336, "set_robot_commands": 0.002166442111530135, "deviation-center-line": 0.17269441294522414, "driven_lanedir_consec": 0.3485414367201807, "sim_compute_sim_state": 0.009692595068332368, "sim_compute_performance-ego0": 0.0019430861008905731}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0649894503925208, "get_ui_image": 0.03195121823524942, "step_physics": 0.104938057004189, "survival_time": 4.849999999999991, "driven_lanedir": 0.6308086958038627, "get_state_dump": 0.004349538258143834, "get_robot_state": 0.0035868104623288525, "sim_render-ego0": 0.003756868595979651, "get_duckie_state": 1.1239733014787949e-06, "in-drivable-lane": 2.1499999999999924, "deviation-heading": 0.4771415529339624, "agent_compute-ego0": 0.012032063639893825, "complete-iteration": 0.17265211319436832, "set_robot_commands": 0.0022075151910587233, "deviation-center-line": 0.09110895777519126, "driven_lanedir_consec": 0.6308086958038627, "sim_compute_sim_state": 0.007788653276404556, "sim_compute_performance-ego0": 0.001964092254638672}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3864429579750637, "get_ui_image": 0.025643981192722792, "step_physics": 0.08432916570300898, "survival_time": 5.999999999999987, "driven_lanedir": 0.6008514586545104, "get_state_dump": 0.004451466000769749, "get_robot_state": 0.0035630100029559173, "sim_render-ego0": 0.003814279540511202, "get_duckie_state": 1.2137673117897727e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.4427143633844387, "agent_compute-ego0": 0.011904434724287554, "complete-iteration": 0.14291311098524362, "set_robot_commands": 0.002159804352058852, "deviation-center-line": 0.15789453351599525, "driven_lanedir_consec": 0.6008514586545104, "sim_compute_sim_state": 0.005059189047695191, "sim_compute_performance-ego0": 0.001911305198984698}}
set_robot_commands_max0.002327956021104229
set_robot_commands_mean0.0022154294189379847
set_robot_commands_median0.002186978651294429
set_robot_commands_min0.002159804352058852
sim_compute_performance-ego0_max0.0020277086458249725
sim_compute_performance-ego0_mean0.001961548050084729
sim_compute_performance-ego0_median0.0019535891777646224
sim_compute_performance-ego0_min0.001911305198984698
sim_compute_sim_state_max0.009692595068332368
sim_compute_sim_state_mean0.008010125277517386
sim_compute_sim_state_median0.008644358497020993
sim_compute_sim_state_min0.005059189047695191
sim_render-ego0_max0.003928932425093978
sim_render-ego0_mean0.003813208853604972
sim_render-ego0_median0.0037855740682454266
sim_render-ego0_min0.003752754852835056
simulation-passed1
step_physics_max0.10986543756670657
step_physics_mean0.095358753220765
step_physics_median0.094633611353599
step_physics_min0.08230235260915539
survival_time_max10.90000000000002
survival_time_mean6.837499999999996
survival_time_min4.849999999999991
No reset possible
5426311624Anthony Courchesne 🇨🇦TNetR1aido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:27:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.258250148800335
survival_time_median33.824999999999925
deviation-center-line_median2.129907456238739
in-drivable-lane_median12.900000000000176


other stats
agent_compute-ego0_max0.03593138492468632
agent_compute-ego0_mean0.033623884926266716
agent_compute-ego0_median0.03333177389957775
agent_compute-ego0_min0.03190060698122506
complete-iteration_max0.22453029834076949
complete-iteration_mean0.20002578027202408
complete-iteration_median0.1997913143697551
complete-iteration_min0.17599019400781638
deviation-center-line_max4.454980390837227
deviation-center-line_mean2.3300780619397994
deviation-center-line_min0.6055169444444908
deviation-heading_max12.826926320351422
deviation-heading_mean6.927389605380998
deviation-heading_median6.414702788807551
deviation-heading_min2.053226523557464
driven_any_max12.271899658933416
driven_any_mean7.536394452624942
driven_any_median6.7898718854386395
driven_any_min4.293934380689069
driven_lanedir_consec_max8.513710320057053
driven_lanedir_consec_mean4.597290216107871
driven_lanedir_consec_min1.358950246773763
driven_lanedir_max8.513710320057053
driven_lanedir_mean4.597290216107871
driven_lanedir_median4.258250148800335
driven_lanedir_min1.358950246773763
get_duckie_state_max1.7333975482931782e-06
get_duckie_state_mean1.6852288233918534e-06
get_duckie_state_median1.6869645500480133e-06
get_duckie_state_min1.6335886451782089e-06
get_robot_state_max0.003592183817794551
get_robot_state_mean0.00353278968204628
get_robot_state_median0.003525633817080705
get_robot_state_min0.00348770727622916
get_state_dump_max0.00435643929701585
get_state_dump_mean0.004311498690325812
get_state_dump_median0.00432295717900894
get_state_dump_min0.004243641106269514
get_ui_image_max0.03514280877851542
get_ui_image_mean0.02992026544295943
get_ui_image_median0.029797310669571773
get_ui_image_min0.024943631654178768
in-drivable-lane_max15.89999999999973
in-drivable-lane_mean13.162499999999886
in-drivable-lane_min10.94999999999946
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.90750500652075, "get_ui_image": 0.0277039561603333, "step_physics": 0.10322904559606293, "survival_time": 43.79999999999965, "driven_lanedir": 6.36669793197976, "get_state_dump": 0.004243641106269514, "get_robot_state": 0.003547638280905503, "sim_render-ego0": 0.003630781934905623, "get_duckie_state": 1.6335886451782089e-06, "in-drivable-lane": 10.94999999999946, "deviation-heading": 8.226483312759692, "agent_compute-ego0": 0.03417481663833322, "complete-iteration": 0.18993914140942705, "set_robot_commands": 0.0021008110372615105, "deviation-center-line": 3.277957609874869, "driven_lanedir_consec": 6.36669793197976, "sim_compute_sim_state": 0.009370226952477762, "sim_compute_performance-ego0": 0.0018653597771917537}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.672238764356529, "get_ui_image": 0.03514280877851542, "step_physics": 0.12896998307694948, "survival_time": 23.850000000000204, "driven_lanedir": 2.1498023656209098, "get_state_dump": 0.0043427111214673665, "get_robot_state": 0.003503629353255906, "sim_render-ego0": 0.003603772638233137, "get_duckie_state": 1.7163144993482772e-06, "in-drivable-lane": 11.700000000000166, "deviation-heading": 4.602922264855411, "agent_compute-ego0": 0.03248873116082227, "complete-iteration": 0.22453029834076949, "set_robot_commands": 0.002049426653395138, "deviation-center-line": 0.9818573026026096, "driven_lanedir_consec": 2.1498023656209098, "sim_compute_sim_state": 0.012514355292380106, "sim_compute_performance-ego0": 0.0018418164432796973}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.293934380689069, "get_ui_image": 0.03189066517881024, "step_physics": 0.1143779065503385, "survival_time": 21.40000000000017, "driven_lanedir": 1.358950246773763, "get_state_dump": 0.00435643929701585, "get_robot_state": 0.003592183817794551, "sim_render-ego0": 0.003704807975075462, "get_duckie_state": 1.7333975482931782e-06, "in-drivable-lane": 14.100000000000186, "deviation-heading": 2.053226523557464, "agent_compute-ego0": 0.03593138492468632, "complete-iteration": 0.20964348733008328, "set_robot_commands": 0.002216845403462301, "deviation-center-line": 0.6055169444444908, "driven_lanedir_consec": 1.358950246773763, "sim_compute_sim_state": 0.011605985236890388, "sim_compute_performance-ego0": 0.0018946163026325072}, "LF-norm-small_loop-000-ego0": {"driven_any": 12.271899658933416, "get_ui_image": 0.024943631654178768, "step_physics": 0.09781282192265164, "survival_time": 59.99999999999873, "driven_lanedir": 8.513710320057053, "get_state_dump": 0.004303203236550515, "get_robot_state": 0.00348770727622916, "sim_render-ego0": 0.0035327465508403033, "get_duckie_state": 1.6576146007477493e-06, "in-drivable-lane": 15.89999999999973, "deviation-heading": 12.826926320351422, "agent_compute-ego0": 0.03190060698122506, "complete-iteration": 0.17599019400781638, "set_robot_commands": 0.0020505847978552214, "deviation-center-line": 4.454980390837227, "driven_lanedir_consec": 8.513710320057053, "sim_compute_sim_state": 0.0060558033227722016, "sim_compute_performance-ego0": 0.001830562366037742}}
set_robot_commands_max0.002216845403462301
set_robot_commands_mean0.0021044169729935425
set_robot_commands_median0.0020756979175583657
set_robot_commands_min0.002049426653395138
sim_compute_performance-ego0_max0.0018946163026325072
sim_compute_performance-ego0_mean0.001858088722285425
sim_compute_performance-ego0_median0.0018535881102357257
sim_compute_performance-ego0_min0.001830562366037742
sim_compute_sim_state_max0.012514355292380106
sim_compute_sim_state_mean0.009886592701130114
sim_compute_sim_state_median0.010488106094684075
sim_compute_sim_state_min0.0060558033227722016
sim_render-ego0_max0.003704807975075462
sim_render-ego0_mean0.0036180272747636313
sim_render-ego0_median0.00361727728656938
sim_render-ego0_min0.0035327465508403033
simulation-passed1
step_physics_max0.12896998307694948
step_physics_mean0.11109743928650062
step_physics_median0.1088034760732007
step_physics_min0.09781282192265164
survival_time_max59.99999999999873
survival_time_mean37.26249999999968
survival_time_min21.40000000000017
No reset possible
5418311782Kaiyi Chen 🇺🇸KK Netaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:29:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.550930849602253
survival_time_median59.99999999999873
deviation-center-line_median2.546932776590827
in-drivable-lane_median6.499999999999963


other stats
agent_compute-ego0_max0.03279397489625548
agent_compute-ego0_mean0.03179395893662453
agent_compute-ego0_median0.03155456861850432
agent_compute-ego0_min0.03127272361323399
complete-iteration_max0.2156884007211728
complete-iteration_mean0.1932926711305489
complete-iteration_median0.19493170013076305
complete-iteration_min0.1676188835394968
deviation-center-line_max3.752105356778249
deviation-center-line_mean2.3612999150883605
deviation-center-line_min0.5992287503935404
deviation-heading_max19.35222004717293
deviation-heading_mean11.129639361253613
deviation-heading_median11.17150389647392
deviation-heading_min2.823329604893674
driven_any_max14.5915508116723
driven_any_mean11.82771810353756
driven_any_median14.59138294795106
driven_any_min3.536555706575823
driven_lanedir_consec_max13.792587589832165
driven_lanedir_consec_mean9.660310114650148
driven_lanedir_consec_min1.7467911695639162
driven_lanedir_max13.792587589832165
driven_lanedir_mean9.661891779525089
driven_lanedir_median11.550930849602253
driven_lanedir_min1.7531178290636829
get_duckie_state_max1.5428719373666476e-06
get_duckie_state_mean1.5047584827582962e-06
get_duckie_state_median1.500889162117488e-06
get_duckie_state_min1.474383669431561e-06
get_robot_state_max0.003525185247543551
get_robot_state_mean0.0034753344048145465
get_robot_state_median0.0034635075919336325
get_robot_state_min0.0034491371878473706
get_state_dump_max0.004220035252821237
get_state_dump_mean0.004204352312522757
get_state_dump_median0.00420443487521114
get_state_dump_min0.004188504246847516
get_ui_image_max0.03504092210933231
get_ui_image_mean0.0298478992569107
get_ui_image_median0.02962810652026684
get_ui_image_min0.02509446187777682
in-drivable-lane_max11.049999999999798
in-drivable-lane_mean6.5499999999999385
in-drivable-lane_min2.1500000000000306
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 14.5915508116723, "get_ui_image": 0.02750971593229499, "step_physics": 0.09188282976142571, "survival_time": 59.99999999999873, "driven_lanedir": 13.792587589832165, "get_state_dump": 0.004188504246847516, "get_robot_state": 0.003525185247543551, "sim_render-ego0": 0.0035958244441252367, "get_duckie_state": 1.474383669431561e-06, "in-drivable-lane": 2.1500000000000306, "deviation-heading": 8.122304539407926, "agent_compute-ego0": 0.03279397489625548, "complete-iteration": 0.1771252113615444, "set_robot_commands": 0.0020949391897870143, "deviation-center-line": 2.4148380553763436, "driven_lanedir_consec": 13.792587589832165, "sim_compute_sim_state": 0.009611452747443437, "sim_compute_performance-ego0": 0.0018513603671008003}, "LF-norm-zigzag-000-ego0": {"driven_any": 14.591399692700351, "get_ui_image": 0.03504092210933231, "step_physics": 0.12060296823341184, "survival_time": 59.99999999999873, "driven_lanedir": 11.06957279885818, "get_state_dump": 0.004220035252821237, "get_robot_state": 0.003464711695090619, "sim_render-ego0": 0.003566496378178402, "get_duckie_state": 1.4938383078594989e-06, "in-drivable-lane": 11.049999999999798, "deviation-heading": 14.220703253539911, "agent_compute-ego0": 0.03144962841227688, "complete-iteration": 0.2156884007211728, "set_robot_commands": 0.002014427359753306, "deviation-center-line": 2.6790274978053104, "driven_lanedir_consec": 11.06957279885818, "sim_compute_sim_state": 0.013444600950966864, "sim_compute_performance-ego0": 0.0018151455576671948}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.536555706575823, "get_ui_image": 0.03174649710823869, "step_physics": 0.12397730388825344, "survival_time": 15.500000000000083, "driven_lanedir": 1.7531178290636829, "get_state_dump": 0.004198697602250568, "get_robot_state": 0.0034491371878473706, "sim_render-ego0": 0.0036613565549206504, "get_duckie_state": 1.507940016375477e-06, "in-drivable-lane": 7.150000000000064, "deviation-heading": 2.823329604893674, "agent_compute-ego0": 0.03165950882473176, "complete-iteration": 0.21273818889998164, "set_robot_commands": 0.002038466585410753, "deviation-center-line": 0.5992287503935404, "driven_lanedir_consec": 1.7467911695639162, "sim_compute_sim_state": 0.010074982689124596, "sim_compute_performance-ego0": 0.0018587442073024736}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.591366203201764, "get_ui_image": 0.02509446187777682, "step_physics": 0.09007554030438247, "survival_time": 59.99999999999873, "driven_lanedir": 12.032288900346328, "get_state_dump": 0.00421017214817171, "get_robot_state": 0.0034623034887766462, "sim_render-ego0": 0.0035450575651475333, "get_duckie_state": 1.5428719373666476e-06, "in-drivable-lane": 5.849999999999861, "deviation-heading": 19.35222004717293, "agent_compute-ego0": 0.03127272361323399, "complete-iteration": 0.1676188835394968, "set_robot_commands": 0.0020322013556411324, "deviation-center-line": 3.752105356778249, "driven_lanedir_consec": 12.032288900346328, "sim_compute_sim_state": 0.0060259158367122045, "sim_compute_performance-ego0": 0.0018300424507515913}}
set_robot_commands_max0.0020949391897870143
set_robot_commands_mean0.0020450086226480512
set_robot_commands_median0.002035333970525943
set_robot_commands_min0.002014427359753306
sim_compute_performance-ego0_max0.0018587442073024736
sim_compute_performance-ego0_mean0.0018388231457055152
sim_compute_performance-ego0_median0.001840701408926196
sim_compute_performance-ego0_min0.0018151455576671948
sim_compute_sim_state_max0.013444600950966864
sim_compute_sim_state_mean0.009789238056061775
sim_compute_sim_state_median0.009843217718284015
sim_compute_sim_state_min0.0060259158367122045
sim_render-ego0_max0.0036613565549206504
sim_render-ego0_mean0.0035921837355929556
sim_render-ego0_median0.003581160411151819
sim_render-ego0_min0.0035450575651475333
simulation-passed1
step_physics_max0.12397730388825344
step_physics_mean0.10663466054686838
step_physics_median0.1062428989974188
step_physics_min0.09007554030438247
survival_time_max59.99999999999873
survival_time_mean48.87499999999906
survival_time_min15.500000000000083
No reset possible
5406512638Bea Baselines 🐤template-pytorchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:40:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1134117085216153
survival_time_median59.99999999999873
deviation-center-line_median2.1743090991350376
in-drivable-lane_median33.74999999999912


other stats
agent_compute-ego0_max0.013084527356340725
agent_compute-ego0_mean0.012239597371773952
agent_compute-ego0_median0.012047353434026688
agent_compute-ego0_min0.011779155262701716
complete-iteration_max0.30194475926725595
complete-iteration_mean0.2542346877221958
complete-iteration_median0.2568461025485786
complete-iteration_min0.20130178652437009
deviation-center-line_max2.2452540190555976
deviation-center-line_mean1.888190043849676
deviation-center-line_min0.9588879580730324
deviation-heading_max23.080281126832592
deviation-heading_mean18.09234672354862
deviation-heading_median19.81965946121704
deviation-heading_min9.649786844927805
driven_any_max8.064697851417009
driven_any_mean7.870280647311227
driven_any_median7.84097061961888
driven_any_min7.734483498590139
driven_lanedir_consec_max2.829246171663354
driven_lanedir_consec_mean1.9192727803484977
driven_lanedir_consec_min0.6210215326874056
driven_lanedir_max2.829246171663354
driven_lanedir_mean1.9489697247571385
driven_lanedir_median2.1221061602043982
driven_lanedir_min0.7224204069564031
get_duckie_state_max1.8335004134737976e-06
get_duckie_state_mean1.677466272612992e-06
get_duckie_state_median1.6492768985643474e-06
get_duckie_state_min1.5778108798494744e-06
get_robot_state_max0.003560460675864494
get_robot_state_mean0.003498243551071637
get_robot_state_median0.0034958010013653377
get_robot_state_min0.0034409115256913794
get_state_dump_max0.004413450290321013
get_state_dump_mean0.0043289307055127905
get_state_dump_median0.0043198182918348475
get_state_dump_min0.004262635948060454
get_ui_image_max0.03501311805623457
get_ui_image_mean0.02984699554784808
get_ui_image_median0.02972552043809978
get_ui_image_min0.024923823258958193
in-drivable-lane_max49.59999999999882
in-drivable-lane_mean36.4249999999991
in-drivable-lane_min28.59999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.064697851417009, "get_ui_image": 0.0276271705325696, "step_physics": 0.1757225386804585, "survival_time": 59.99999999999873, "driven_lanedir": 2.384279618495936, "get_state_dump": 0.004369218383204629, "get_robot_state": 0.003560460675864494, "sim_render-ego0": 0.00362234052075236, "get_duckie_state": 1.6917594763559665e-06, "in-drivable-lane": 32.29999999999922, "deviation-heading": 20.240111522920376, "agent_compute-ego0": 0.01207009402044012, "complete-iteration": 0.23887992441207545, "set_robot_commands": 0.0021453640244584794, "deviation-center-line": 2.1084650585294424, "driven_lanedir_consec": 2.384279618495936, "sim_compute_sim_state": 0.007812861300427947, "sim_compute_performance-ego0": 0.0018749848492040323}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.803139442227, "get_ui_image": 0.03501311805623457, "step_physics": 0.22744252917967073, "survival_time": 59.99999999999873, "driven_lanedir": 1.8599327019128604, "get_state_dump": 0.004270418200465066, "get_robot_state": 0.0034409115256913794, "sim_render-ego0": 0.0035220550359238395, "get_duckie_state": 1.5778108798494744e-06, "in-drivable-lane": 35.19999999999901, "deviation-heading": 19.399207399513703, "agent_compute-ego0": 0.012024612847613256, "complete-iteration": 0.30194475926725595, "set_robot_commands": 0.002071823704550407, "deviation-center-line": 2.2452540190555976, "driven_lanedir_consec": 1.8425437985472943, "sim_compute_sim_state": 0.01228164415573895, "sim_compute_performance-ego0": 0.0018063641706176049}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.734483498590139, "get_ui_image": 0.03182387034362996, "step_physics": 0.2051513337969879, "survival_time": 59.99999999999873, "driven_lanedir": 2.829246171663354, "get_state_dump": 0.004413450290321013, "get_robot_state": 0.0035345768749862785, "sim_render-ego0": 0.0036207249916959663, "get_duckie_state": 1.8335004134737976e-06, "in-drivable-lane": 28.59999999999936, "deviation-heading": 23.080281126832592, "agent_compute-ego0": 0.013084527356340725, "complete-iteration": 0.2748122806850818, "set_robot_commands": 0.002175764676236193, "deviation-center-line": 2.2401531397406327, "driven_lanedir_consec": 2.829246171663354, "sim_compute_sim_state": 0.009035606368396006, "sim_compute_performance-ego0": 0.001896749825203647}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.878801797010761, "get_ui_image": 0.024923823258958193, "step_physics": 0.14360672051860926, "survival_time": 59.99999999999873, "driven_lanedir": 0.7224204069564031, "get_state_dump": 0.004262635948060454, "get_robot_state": 0.003457025127744397, "sim_render-ego0": 0.0035089525354593423, "get_duckie_state": 1.6067943207727284e-06, "in-drivable-lane": 49.59999999999882, "deviation-heading": 9.649786844927805, "agent_compute-ego0": 0.011779155262701716, "complete-iteration": 0.20130178652437009, "set_robot_commands": 0.0020734193819349355, "deviation-center-line": 0.9588879580730324, "driven_lanedir_consec": 0.6210215326874056, "sim_compute_sim_state": 0.005811897940083805, "sim_compute_performance-ego0": 0.0018070311867922767}}
set_robot_commands_max0.002175764676236193
set_robot_commands_mean0.002116592946795004
set_robot_commands_median0.002109391703196707
set_robot_commands_min0.002071823704550407
sim_compute_performance-ego0_max0.001896749825203647
sim_compute_performance-ego0_mean0.0018462825079543904
sim_compute_performance-ego0_median0.0018410080179981545
sim_compute_performance-ego0_min0.0018063641706176049
sim_compute_sim_state_max0.01228164415573895
sim_compute_sim_state_mean0.008735502441161678
sim_compute_sim_state_median0.008424233834411977
sim_compute_sim_state_min0.005811897940083805
sim_render-ego0_max0.00362234052075236
sim_render-ego0_mean0.003568518270957877
sim_render-ego0_median0.0035713900138099027
sim_render-ego0_min0.0035089525354593423
simulation-passed1
step_physics_max0.22744252917967073
step_physics_mean0.1879807805439316
step_physics_median0.1904369362387232
step_physics_min0.14360672051860926
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5396411457Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessyesgpu-prod-010:40:27
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.699269376565349
survival_time_median59.99999999999873
deviation-center-line_median8.918231471214693
in-drivable-lane_median0.8249999999999775


other stats
agent_compute-ego0_max0.013254597423277132
agent_compute-ego0_mean0.012985363093939157
agent_compute-ego0_median0.012940819118541048
agent_compute-ego0_min0.012805216715397388
complete-iteration_max0.29834771612899486
complete-iteration_mean0.24193416760426376
complete-iteration_median0.24243463187491665
complete-iteration_min0.18451969053822692
deviation-center-line_max10.299511872800483
deviation-center-line_mean8.404920548430558
deviation-center-line_min5.483707378492364
deviation-heading_max20.30331544531139
deviation-heading_mean12.997191627528588
deviation-heading_median11.725834275708335
deviation-heading_min8.23378251338629
driven_any_max18.724596237060457
driven_any_mean7.6613094154398516
driven_any_median5.2054912790654715
driven_any_min1.5096588665680055
driven_lanedir_consec_max18.21655032155434
driven_lanedir_consec_mean7.27428219357248
driven_lanedir_consec_min1.4820396996048817
driven_lanedir_max18.21655032155434
driven_lanedir_mean7.27428219357248
driven_lanedir_median4.699269376565349
driven_lanedir_min1.4820396996048817
get_duckie_state_max1.0839012838422409e-06
get_duckie_state_mean1.057796335339447e-06
get_duckie_state_median1.0558111681529229e-06
get_duckie_state_min1.0356617212097017e-06
get_robot_state_max0.0035561947500973717
get_robot_state_mean0.0035105859806495937
get_robot_state_median0.003497219899611906
get_robot_state_min0.0034917093732771925
get_state_dump_max0.004380211643533445
get_state_dump_mean0.004355217098296433
get_state_dump_median0.004349083527240229
get_state_dump_min0.0043424896951718295
get_ui_image_max0.03552302095316332
get_ui_image_mean0.03010342128072353
get_ui_image_median0.029836022982887185
get_ui_image_min0.02521861820395642
in-drivable-lane_max2.1000000000000103
in-drivable-lane_mean0.9374999999999912
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 18.724596237060457, "get_ui_image": 0.027797708900445302, "step_physics": 0.11918346252568456, "survival_time": 59.99999999999873, "driven_lanedir": 18.21655032155434, "get_state_dump": 0.004350126236304951, "get_robot_state": 0.0035561947500973717, "sim_render-ego0": 0.0037373841354789382, "get_duckie_state": 1.0696080800992663e-06, "in-drivable-lane": 0.7999999999999581, "deviation-heading": 8.659802482025997, "agent_compute-ego0": 0.012924656482858524, "complete-iteration": 0.18451969053822692, "set_robot_commands": 0.002241474305660302, "deviation-center-line": 5.483707378492364, "driven_lanedir_consec": 18.21655032155434, "sim_compute_sim_state": 0.008718264093009956, "sim_compute_performance-ego0": 0.0019406105060561511}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.557971912134239, "get_ui_image": 0.03552302095316332, "step_physics": 0.22091807274893857, "survival_time": 59.99999999999873, "driven_lanedir": 5.217030898829187, "get_state_dump": 0.004380211643533445, "get_robot_state": 0.0035012760924657714, "sim_render-ego0": 0.003845212064515939, "get_duckie_state": 1.0839012838422409e-06, "in-drivable-lane": 0.849999999999997, "deviation-heading": 20.30331544531139, "agent_compute-ego0": 0.013254597423277132, "complete-iteration": 0.29834771612899486, "set_robot_commands": 0.0022261327351261236, "deviation-center-line": 8.563362577216829, "driven_lanedir_consec": 5.217030898829187, "sim_compute_sim_state": 0.01269622011843768, "sim_compute_performance-ego0": 0.001931240318419038}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.8530106459967035, "get_ui_image": 0.031874337065329064, "step_physics": 0.2018788881246295, "survival_time": 59.99999999999873, "driven_lanedir": 4.181507854301509, "get_state_dump": 0.0043424896951718295, "get_robot_state": 0.0034917093732771925, "sim_render-ego0": 0.003632107940343497, "get_duckie_state": 1.0356617212097017e-06, "in-drivable-lane": 2.1000000000000103, "deviation-heading": 14.791866069390672, "agent_compute-ego0": 0.012956981754223572, "complete-iteration": 0.27686657377524143, "set_robot_commands": 0.002079593648918463, "deviation-center-line": 9.273100365212557, "driven_lanedir_consec": 4.181507854301509, "sim_compute_sim_state": 0.014692247757605966, "sim_compute_performance-ego0": 0.0018497865265553245}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.5096588665680055, "get_ui_image": 0.02521861820395642, "step_physics": 0.14836554443905692, "survival_time": 59.99999999999873, "driven_lanedir": 1.4820396996048817, "get_state_dump": 0.0043480408181755074, "get_robot_state": 0.00349316370675804, "sim_render-ego0": 0.0036492490649322586, "get_duckie_state": 1.0420142562065792e-06, "in-drivable-lane": 0.0, "deviation-heading": 8.23378251338629, "agent_compute-ego0": 0.012805216715397388, "complete-iteration": 0.2080026899745919, "set_robot_commands": 0.0021191762944840075, "deviation-center-line": 10.299511872800483, "driven_lanedir_consec": 1.4820396996048817, "sim_compute_sim_state": 0.00607045981211031, "sim_compute_performance-ego0": 0.001864531951383389}}
set_robot_commands_max0.002241474305660302
set_robot_commands_mean0.002166594246047224
set_robot_commands_median0.0021726545148050653
set_robot_commands_min0.002079593648918463
sim_compute_performance-ego0_max0.0019406105060561511
sim_compute_performance-ego0_mean0.0018965423256034751
sim_compute_performance-ego0_median0.0018978861349012136
sim_compute_performance-ego0_min0.0018497865265553245
sim_compute_sim_state_max0.014692247757605966
sim_compute_sim_state_mean0.010544297945290977
sim_compute_sim_state_median0.010707242105723816
sim_compute_sim_state_min0.00607045981211031
sim_render-ego0_max0.003845212064515939
sim_render-ego0_mean0.0037159883013176583
sim_render-ego0_median0.003693316600205598
sim_render-ego0_min0.003632107940343497
simulation-passed1
step_physics_max0.22091807274893857
step_physics_mean0.1725864919595774
step_physics_median0.1751222162818432
step_physics_min0.11918346252568456
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5387712641Bea Baselines 🐤template-pytorchaido5-LFP-sim-validationLFP-simsuccessnogpu-prod-010:43:49
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median59.99999999999873
in-drivable-lane_median35.22499999999927
driven_lanedir_consec_median0.6423317668482645
deviation-center-line_median2.4860268176869615


other stats
agent_compute-ego0_max0.012848620212246836
agent_compute-ego0_mean0.012331822680791749
agent_compute-ego0_median0.012355409891381054
agent_compute-ego0_min0.011767850728158053
complete-iteration_max0.351317820997659
complete-iteration_mean0.3022195585661387
complete-iteration_median0.32191897391478885
complete-iteration_min0.21372246543731815
deviation-center-line_max2.756145816719041
deviation-center-line_mean2.172213934458372
deviation-center-line_min0.9606562857405236
deviation-heading_max21.391001652080128
deviation-heading_mean17.378469201347695
deviation-heading_median19.748540067853504
deviation-heading_min8.625795017603645
driven_any_max3.947792756777426
driven_any_mean3.091180366145218
driven_any_median2.889914501244532
driven_any_min2.6370997053143843
driven_lanedir_consec_max0.976513639965779
driven_lanedir_consec_mean0.6335959293967285
driven_lanedir_consec_min0.27320654392460586
driven_lanedir_max0.976513639965779
driven_lanedir_mean0.7563104093227413
driven_lanedir_median0.8383202609772457
driven_lanedir_min0.37208747537069486
get_duckie_state_max0.02513946343421142
get_duckie_state_mean0.017327608117255245
get_duckie_state_median0.02008486866057663
get_duckie_state_min0.004001231713656283
get_robot_state_max0.0036436530771501658
get_robot_state_mean0.0035379097225465544
get_robot_state_median0.0035309419346093935
get_robot_state_min0.0034461019438172657
get_state_dump_max0.00844963186487965
get_state_dump_mean0.007141996482131285
get_state_dump_median0.007620342962946324
get_state_dump_min0.004877668137752841
get_ui_image_max0.038564985538898755
get_ui_image_mean0.03300194478253342
get_ui_image_median0.033902392300042786
get_ui_image_min0.025638008991149343
in-drivable-lane_max48.29999999999865
in-drivable-lane_mean37.562499999999105
in-drivable-lane_min31.49999999999923
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.809389869485525, "get_ui_image": 0.03180861691451887, "step_physics": 0.2022379139480146, "survival_time": 59.99999999999873, "driven_lanedir": 0.37208747537069486, "get_state_dump": 0.00844963186487965, "get_robot_state": 0.0036436530771501658, "sim_render-ego0": 0.0037430904985566024, "get_duckie_state": 0.02513946343421142, "in-drivable-lane": 48.29999999999865, "deviation-heading": 8.625795017603645, "agent_compute-ego0": 0.012848620212246836, "complete-iteration": 0.30157090980345563, "set_robot_commands": 0.0021737300783867246, "deviation-center-line": 0.9606562857405236, "driven_lanedir_consec": 0.37208747537069486, "sim_compute_sim_state": 0.009486709804360217, "sim_compute_performance-ego0": 0.0019590304753464723}, "LFP-norm-zigzag-000-ego0": {"driven_any": 3.947792756777426, "get_ui_image": 0.038564985538898755, "step_physics": 0.2506735598812691, "survival_time": 59.99999999999873, "driven_lanedir": 0.9125760583258342, "get_state_dump": 0.0074706569897145855, "get_robot_state": 0.0034874976425742625, "sim_render-ego0": 0.003550147136780344, "get_duckie_state": 0.019875619532563706, "in-drivable-lane": 36.49999999999912, "deviation-heading": 18.76714942446757, "agent_compute-ego0": 0.01193111802417968, "complete-iteration": 0.351317820997659, "set_robot_commands": 0.002059826942208804, "deviation-center-line": 2.756145816719041, "driven_lanedir_consec": 0.9125760583258342, "sim_compute_sim_state": 0.011809631350832517, "sim_compute_performance-ego0": 0.0018196421598613908}, "LFP-norm-techtrack-000-ego0": {"driven_any": 2.9704391330035387, "get_ui_image": 0.035996167685566696, "step_physics": 0.23867993072903623, "survival_time": 59.99999999999873, "driven_lanedir": 0.7640644636286571, "get_state_dump": 0.007770028936178063, "get_robot_state": 0.003574386226644524, "sim_render-ego0": 0.0036548521993162233, "get_duckie_state": 0.02029411778858957, "in-drivable-lane": 33.94999999999941, "deviation-heading": 20.729930711239444, "agent_compute-ego0": 0.012779701758582429, "complete-iteration": 0.342267038026122, "set_robot_commands": 0.0022072885356080423, "deviation-center-line": 2.6172123561555, "driven_lanedir_consec": 0.27320654392460586, "sim_compute_sim_state": 0.0153443636644095, "sim_compute_performance-ego0": 0.001886232210932723}, "LFP-norm-small_loop-000-ego0": {"driven_any": 2.6370997053143843, "get_ui_image": 0.025638008991149343, "step_physics": 0.14984386787128687, "survival_time": 59.99999999999873, "driven_lanedir": 0.976513639965779, "get_state_dump": 0.004877668137752841, "get_robot_state": 0.0034461019438172657, "sim_render-ego0": 0.003508886032358594, "get_duckie_state": 0.004001231713656283, "in-drivable-lane": 31.49999999999923, "deviation-heading": 21.391001652080128, "agent_compute-ego0": 0.011767850728158053, "complete-iteration": 0.21372246543731815, "set_robot_commands": 0.002042485514250921, "deviation-center-line": 2.3548412792184235, "driven_lanedir_consec": 0.976513639965779, "sim_compute_sim_state": 0.006720141506909728, "sim_compute_performance-ego0": 0.001802944124588661}}
set_robot_commands_max0.0022072885356080423
set_robot_commands_mean0.002120832767613623
set_robot_commands_median0.0021167785102977643
set_robot_commands_min0.002042485514250921
sim_compute_performance-ego0_max0.0019590304753464723
sim_compute_performance-ego0_mean0.0018669622426823115
sim_compute_performance-ego0_median0.001852937185397057
sim_compute_performance-ego0_min0.001802944124588661
sim_compute_sim_state_max0.0153443636644095
sim_compute_sim_state_mean0.010840211581627991
sim_compute_sim_state_median0.010648170577596369
sim_compute_sim_state_min0.006720141506909728
sim_render-ego0_max0.0037430904985566024
sim_render-ego0_mean0.003614243966752941
sim_render-ego0_median0.0036024996680482837
sim_render-ego0_min0.003508886032358594
simulation-passed1
step_physics_max0.2506735598812691
step_physics_mean0.2103588181074017
step_physics_median0.22045892233852543
step_physics_min0.14984386787128687
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5383812650Bea Baselines 🐤template-pytorchaido5-LFVI-sim-validationLFVIv-simsuccessyesgpu-prod-010:33:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6297078183959323
survival_time_median30.849999999999365
deviation-center-line_median1.6019818611337704
in-drivable-lane_median17.02499999999961


other stats
agent_compute-ego0_max0.012228019231562809
agent_compute-ego0_mean0.012099174258115387
agent_compute-ego0_median0.012099174258115387
agent_compute-ego0_min0.011970329284667968
agent_compute-npc0_max0.042519505077555815
agent_compute-npc0_mean0.03668270301092843
agent_compute-npc0_median0.03668270301092843
agent_compute-npc0_min0.03084590094430106
agent_compute-npc1_max0.04487924075543533
agent_compute-npc1_mean0.037744935122939485
agent_compute-npc1_median0.037744935122939485
agent_compute-npc1_min0.030610629490443637
agent_compute-npc2_max0.03735221633307642
agent_compute-npc2_mean0.0338329903163708
agent_compute-npc2_median0.0338329903163708
agent_compute-npc2_min0.030313764299665175
complete-iteration_max1.2271851711130262
complete-iteration_mean1.043679668283128
complete-iteration_median1.043679668283128
complete-iteration_min0.8601741654532297
deviation-center-line_max3.146003007935723
deviation-center-line_mean1.6019818611337704
deviation-center-line_min0.0579607143318177
deviation-heading_max20.35077050068233
deviation-heading_mean10.447639125526928
deviation-heading_median10.447639125526928
deviation-heading_min0.5445077503715258
driven_any_max4.200916338848442
driven_any_mean2.125878293923818
driven_any_median2.125878293923818
driven_any_min0.050840248999193705
driven_lanedir_consec_max1.2414347108223789
driven_lanedir_consec_mean0.6297078183959323
driven_lanedir_consec_min0.01798092596948564
driven_lanedir_max1.2414347108223789
driven_lanedir_mean0.6297078183959323
driven_lanedir_median0.6297078183959323
driven_lanedir_min0.01798092596948564
get_duckie_state_max1.1512211390904015e-06
get_duckie_state_mean1.0972132478044477e-06
get_duckie_state_median1.0972132478044477e-06
get_duckie_state_min1.0432053565184936e-06
get_robot_state_max0.01377398723567356
get_robot_state_mean0.013620138650446992
get_robot_state_median0.013620138650446992
get_robot_state_min0.013466290065220423
get_state_dump_max0.009172596403403049
get_state_dump_mean0.009169169911252656
get_state_dump_median0.009169169911252656
get_state_dump_min0.00916574341910226
get_ui_image_max0.05207602637154715
get_ui_image_mean0.051636628221498455
get_ui_image_median0.051636628221498455
get_ui_image_min0.05119723007144976
in-drivable-lane_max33.149999999999224
in-drivable-lane_mean17.02499999999961
in-drivable-lane_min0.9000000000000007
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 0.050840248999193705, "get_ui_image": 0.05207602637154715, "step_physics": 0.61414977482387, "survival_time": 1.7000000000000008, "driven_lanedir": 0.01798092596948564, "get_state_dump": 0.00916574341910226, "get_robot_state": 0.013466290065220423, "sim_render-ego0": 0.0035657473972865515, "sim_render-npc0": 0.0034572124481201173, "sim_render-npc1": 0.003438104901994978, "sim_render-npc2": 0.003459140232631138, "get_duckie_state": 1.1512211390904015e-06, "in-drivable-lane": 0.9000000000000007, "deviation-heading": 0.5445077503715258, "agent_compute-ego0": 0.011970329284667968, "agent_compute-npc0": 0.03084590094430106, "agent_compute-npc1": 0.030610629490443637, "agent_compute-npc2": 0.030313764299665175, "complete-iteration": 0.8601741654532297, "set_robot_commands": 0.002050978796822684, "deviation-center-line": 0.0579607143318177, "driven_lanedir_consec": 0.01798092596948564, "sim_compute_sim_state": 0.03817320551191058, "sim_compute_performance-ego0": 0.0018525872911725723, "sim_compute_performance-npc0": 0.0017815453665597095, "sim_compute_performance-npc1": 0.0017828328268868585, "sim_compute_performance-npc2": 0.001794712884085519}, "LFVI-norm-udem1-000-ego0": {"driven_any": 4.200916338848442, "get_ui_image": 0.05119723007144976, "step_physics": 0.9428351771126778, "survival_time": 59.99999999999873, "driven_lanedir": 1.2414347108223789, "get_state_dump": 0.009172596403403049, "get_robot_state": 0.01377398723567356, "sim_render-ego0": 0.003622647626116115, "sim_render-npc0": 0.003606028203463971, "sim_render-npc1": 0.003656967394953465, "sim_render-npc2": 0.0037984907577476535, "get_duckie_state": 1.0432053565184936e-06, "in-drivable-lane": 33.149999999999224, "deviation-heading": 20.35077050068233, "agent_compute-ego0": 0.012228019231562809, "agent_compute-npc0": 0.042519505077555815, "agent_compute-npc1": 0.04487924075543533, "agent_compute-npc2": 0.03735221633307642, "complete-iteration": 1.2271851711130262, "set_robot_commands": 0.0023024262834051862, "deviation-center-line": 3.146003007935723, "driven_lanedir_consec": 1.2414347108223789, "sim_compute_sim_state": 0.04179808440355338, "sim_compute_performance-ego0": 0.001862727037377401, "sim_compute_performance-npc0": 0.001848957917771669, "sim_compute_performance-npc1": 0.0019006677511629712, "sim_compute_performance-npc2": 0.001965605944618397}}
set_robot_commands_max0.0023024262834051862
set_robot_commands_mean0.0021767025401139353
set_robot_commands_median0.0021767025401139353
set_robot_commands_min0.002050978796822684
sim_compute_performance-ego0_max0.001862727037377401
sim_compute_performance-ego0_mean0.0018576571642749868
sim_compute_performance-ego0_median0.0018576571642749868
sim_compute_performance-ego0_min0.0018525872911725723
sim_compute_performance-npc0_max0.001848957917771669
sim_compute_performance-npc0_mean0.0018152516421656897
sim_compute_performance-npc0_median0.0018152516421656897
sim_compute_performance-npc0_min0.0017815453665597095
sim_compute_performance-npc1_max0.0019006677511629712
sim_compute_performance-npc1_mean0.0018417502890249147
sim_compute_performance-npc1_median0.0018417502890249147
sim_compute_performance-npc1_min0.0017828328268868585
sim_compute_performance-npc2_max0.001965605944618397
sim_compute_performance-npc2_mean0.001880159414351958
sim_compute_performance-npc2_median0.001880159414351958
sim_compute_performance-npc2_min0.001794712884085519
sim_compute_sim_state_max0.04179808440355338
sim_compute_sim_state_mean0.03998564495773198
sim_compute_sim_state_median0.03998564495773198
sim_compute_sim_state_min0.03817320551191058
sim_render-ego0_max0.003622647626116115
sim_render-ego0_mean0.003594197511701333
sim_render-ego0_median0.003594197511701333
sim_render-ego0_min0.0035657473972865515
sim_render-npc0_max0.003606028203463971
sim_render-npc0_mean0.0035316203257920445
sim_render-npc0_median0.0035316203257920445
sim_render-npc0_min0.0034572124481201173
sim_render-npc1_max0.003656967394953465
sim_render-npc1_mean0.003547536148474221
sim_render-npc1_median0.003547536148474221
sim_render-npc1_min0.003438104901994978
sim_render-npc2_max0.0037984907577476535
sim_render-npc2_mean0.003628815495189396
sim_render-npc2_median0.003628815495189396
sim_render-npc2_min0.003459140232631138
simulation-passed1
step_physics_max0.9428351771126778
step_physics_mean0.7784924759682739
step_physics_median0.7784924759682739
step_physics_min0.61414977482387
survival_time_max59.99999999999873
survival_time_mean30.849999999999365
survival_time_min1.7000000000000008
No reset possible
5379612699Bea Baselines 🐤baseline-behavior-cloningaido5-LFV-sim-validationLFVv-simsuccessyesgpu-prod-010:27:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.0526666091168733
survival_time_median14.975000000000078
deviation-center-line_median0.8739009884654972
in-drivable-lane_median1.9000000000000037


other stats
agent_compute-ego0_max0.03890066716208387
agent_compute-ego0_mean0.03379470477378194
agent_compute-ego0_median0.03222718735777645
agent_compute-ego0_min0.031823777217491
agent_compute-npc0_max0.02662731017639388
agent_compute-npc0_mean0.022231661780682616
agent_compute-npc0_median0.02132987484359359
agent_compute-npc0_min0.019639587259149407
agent_compute-npc1_max0.04876778453004126
agent_compute-npc1_mean0.042210951945066466
agent_compute-npc1_median0.04551064126973024
agent_compute-npc1_min0.032354430035427886
agent_compute-npc2_max0.04121033408636014
agent_compute-npc2_mean0.036696965193018787
agent_compute-npc2_median0.03607908230201871
agent_compute-npc2_min0.032801479190677496
agent_compute-npc3_max0.046842822773323155
agent_compute-npc3_mean0.041717971038354285
agent_compute-npc3_median0.041717971038354285
agent_compute-npc3_min0.036593119303385414
complete-iteration_max1.17238777571351
complete-iteration_mean0.8506740840411157
complete-iteration_median0.9476397509794736
complete-iteration_min0.33502905849200576
deviation-center-line_max1.2415126445993792
deviation-center-line_mean0.8732486247855841
deviation-center-line_min0.5036798776119628
deviation-heading_max6.009583597248758
deviation-heading_mean3.8769484867946815
deviation-heading_median3.514031918004536
deviation-heading_min2.470146513920896
driven_any_max4.758994818366164
driven_any_mean3.606539031203353
driven_any_median3.407846421200595
driven_any_min2.851468464046057
driven_lanedir_consec_max3.752433605467256
driven_lanedir_consec_mean3.0109795242133464
driven_lanedir_consec_min2.1861512731523813
driven_lanedir_max3.752433605467256
driven_lanedir_mean3.0109795242133464
driven_lanedir_median3.0526666091168733
driven_lanedir_min2.1861512731523813
get_duckie_state_max1.3603883631089157e-06
get_duckie_state_mean1.2801739117931358e-06
get_duckie_state_median1.2747995620607297e-06
get_duckie_state_min1.2107081599421689e-06
get_robot_state_max0.017022192711923637
get_robot_state_mean0.013650861432722452
get_robot_state_median0.015300157160518678
get_robot_state_min0.006980938697928813
get_state_dump_max0.01075879265280331
get_state_dump_mean0.009140623230981824
get_state_dump_median0.009925990386778598
get_state_dump_min0.005951719497566793
get_ui_image_max0.055378174839808704
get_ui_image_mean0.04537646479993051
get_ui_image_median0.04758390387215182
get_ui_image_min0.030959876615609696
in-drivable-lane_max2.7500000000000115
in-drivable-lane_mean1.6375000000000046
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 3.8052778682200135, "get_ui_image": 0.04314155836363096, "step_physics": 0.5091248231607156, "survival_time": 16.6000000000001, "driven_lanedir": 3.677934169239721, "get_state_dump": 0.009123785717709288, "get_robot_state": 0.013675926683901309, "sim_render-ego0": 0.00360169138636317, "sim_render-npc0": 0.0035638587252871767, "sim_render-npc1": 0.0035070542458657387, "sim_render-npc2": 0.0035194047578462253, "get_duckie_state": 1.2107081599421689e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.060180370878024, "agent_compute-ego0": 0.03216295772128635, "agent_compute-npc0": 0.019639587259149407, "agent_compute-npc1": 0.032354430035427886, "agent_compute-npc2": 0.032801479190677496, "complete-iteration": 0.7470840398255769, "set_robot_commands": 0.002188850809503962, "deviation-center-line": 0.951808955988989, "driven_lanedir_consec": 3.677934169239721, "sim_compute_sim_state": 0.02494982842568521, "sim_compute_performance-ego0": 0.0018466685985301708, "sim_compute_performance-npc0": 0.0018390635470370272, "sim_compute_performance-npc1": 0.00182953038373151, "sim_compute_performance-npc2": 0.0018305041052557685}, "LFV-norm-zigzag-000-ego0": {"driven_any": 4.758994818366164, "get_ui_image": 0.055378174839808704, "step_physics": 0.7998881096387431, "survival_time": 20.500000000000156, "driven_lanedir": 3.752433605467256, "get_state_dump": 0.01072819505584791, "get_robot_state": 0.016924387637136048, "sim_render-ego0": 0.0036817797779166786, "sim_render-npc0": 0.003627028778521684, "sim_render-npc1": 0.0035899230743556706, "sim_render-npc2": 0.003496581910590476, "sim_render-npc3": 0.003606907062576925, "get_duckie_state": 1.3005704485296912e-06, "in-drivable-lane": 2.7500000000000115, "deviation-heading": 6.009583597248758, "agent_compute-ego0": 0.032291416994266554, "agent_compute-npc0": 0.02194245888368927, "agent_compute-npc1": 0.04551064126973024, "agent_compute-npc2": 0.04121033408636014, "agent_compute-npc3": 0.046842822773323155, "complete-iteration": 1.17238777571351, "set_robot_commands": 0.00217763118790304, "deviation-center-line": 1.2415126445993792, "driven_lanedir_consec": 3.752433605467256, "sim_compute_sim_state": 0.06352495683080668, "sim_compute_performance-ego0": 0.0018947194092465145, "sim_compute_performance-npc0": 0.001878069555092322, "sim_compute_performance-npc1": 0.0018605936472723373, "sim_compute_performance-npc2": 0.0018102124949731385, "sim_compute_performance-npc3": 0.0018681325471604248}, "LFV-norm-techtrack-000-ego0": {"driven_any": 2.851468464046057, "get_ui_image": 0.05202624938067268, "step_physics": 0.7966399538750742, "survival_time": 12.700000000000044, "driven_lanedir": 2.427399048994026, "get_state_dump": 0.01075879265280331, "get_robot_state": 0.017022192711923637, "sim_render-ego0": 0.0035805029027602252, "sim_render-npc0": 0.003542635487575157, "sim_render-npc1": 0.003730174606921626, "sim_render-npc2": 0.0038766917060403263, "sim_render-npc3": 0.003652466044706457, "get_duckie_state": 1.3603883631089157e-06, "in-drivable-lane": 1.2499999999999956, "deviation-heading": 2.470146513920896, "agent_compute-ego0": 0.031823777217491, "agent_compute-npc0": 0.020717290803497913, "agent_compute-npc1": 0.04876778453004126, "agent_compute-npc2": 0.03607908230201871, "agent_compute-npc3": 0.036593119303385414, "complete-iteration": 1.14819546213337, "set_robot_commands": 0.002246830510158165, "deviation-center-line": 0.5036798776119628, "driven_lanedir_consec": 2.427399048994026, "sim_compute_sim_state": 0.05829532660690009, "sim_compute_performance-ego0": 0.0018387906691607304, "sim_compute_performance-npc0": 0.0018388738819197113, "sim_compute_performance-npc1": 0.0019501676746443207, "sim_compute_performance-npc2": 0.002083769031599456, "sim_compute_performance-npc3": 0.0019346882315242992}, "LFV-norm-small_loop-000-ego0": {"driven_any": 3.010414974181178, "get_ui_image": 0.030959876615609696, "step_physics": 0.1999883660629614, "survival_time": 13.350000000000056, "driven_lanedir": 2.1861512731523813, "get_state_dump": 0.005951719497566793, "get_robot_state": 0.006980938697928813, "sim_render-ego0": 0.003570834202552909, "sim_render-npc0": 0.0035507056250501036, "get_duckie_state": 1.2490286755917677e-06, "in-drivable-lane": 2.5500000000000114, "deviation-heading": 3.967883465131048, "agent_compute-ego0": 0.03890066716208387, "agent_compute-npc0": 0.02662731017639388, "complete-iteration": 0.33502905849200576, "set_robot_commands": 0.0020637636754050185, "deviation-center-line": 0.7959930209420055, "driven_lanedir_consec": 2.1861512731523813, "sim_compute_sim_state": 0.010562435014924008, "sim_compute_performance-ego0": 0.00184683390517733, "sim_compute_performance-npc0": 0.0018353622351119769}}
set_robot_commands_max0.002246830510158165
set_robot_commands_mean0.0021692690457425466
set_robot_commands_median0.0021832409987035013
set_robot_commands_min0.0020637636754050185
sim_compute_performance-ego0_max0.0018947194092465145
sim_compute_performance-ego0_mean0.0018567531455286864
sim_compute_performance-ego0_median0.0018467512518537503
sim_compute_performance-ego0_min0.0018387906691607304
sim_compute_performance-npc0_max0.001878069555092322
sim_compute_performance-npc0_mean0.0018478423047902592
sim_compute_performance-npc0_median0.0018389687144783691
sim_compute_performance-npc0_min0.0018353622351119769
sim_compute_performance-npc1_max0.0019501676746443207
sim_compute_performance-npc1_mean0.001880097235216056
sim_compute_performance-npc1_median0.0018605936472723373
sim_compute_performance-npc1_min0.00182953038373151
sim_compute_performance-npc2_max0.002083769031599456
sim_compute_performance-npc2_mean0.0019081618772761211
sim_compute_performance-npc2_median0.0018305041052557685
sim_compute_performance-npc2_min0.0018102124949731385
sim_compute_performance-npc3_max0.0019346882315242992
sim_compute_performance-npc3_mean0.001901410389342362
sim_compute_performance-npc3_median0.001901410389342362
sim_compute_performance-npc3_min0.0018681325471604248
sim_compute_sim_state_max0.06352495683080668
sim_compute_sim_state_mean0.03933313671957899
sim_compute_sim_state_median0.04162257751629265
sim_compute_sim_state_min0.010562435014924008
sim_render-ego0_max0.0036817797779166786
sim_render-ego0_mean0.0036087020673982455
sim_render-ego0_median0.003591097144561698
sim_render-ego0_min0.003570834202552909
sim_render-npc0_max0.003627028778521684
sim_render-npc0_mean0.0035710571541085305
sim_render-npc0_median0.00355728217516864
sim_render-npc0_min0.003542635487575157
sim_render-npc1_max0.003730174606921626
sim_render-npc1_mean0.003609050642381012
sim_render-npc1_median0.0035899230743556706
sim_render-npc1_min0.0035070542458657387
sim_render-npc2_max0.0038766917060403263
sim_render-npc2_mean0.0036308927914923423
sim_render-npc2_median0.0035194047578462253
sim_render-npc2_min0.003496581910590476
sim_render-npc3_max0.003652466044706457
sim_render-npc3_mean0.0036296865536416902
sim_render-npc3_median0.0036296865536416902
sim_render-npc3_min0.003606907062576925
simulation-passed1
step_physics_max0.7998881096387431
step_physics_mean0.5764103131843736
step_physics_median0.6528823885178949
step_physics_min0.1999883660629614
survival_time_max20.500000000000156
survival_time_mean15.787500000000088
survival_time_min12.700000000000044
No reset possible
5360512712Bea Baselines 🐤baseline-behavior-cloningaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesgpu-prod-011:24:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median8.016351205067103
survival_time_median59.99999999999873
deviation-center-line_median2.814222961560897
in-drivable-lane_median0.24999999999998845


other stats
agent_compute-ego0_max0.03453265479164854
agent_compute-ego0_mean0.03366272326413043
agent_compute-ego0_median0.03366272326413043
agent_compute-ego0_min0.032792791736612315
agent_compute-ego1_max0.03384945454148825
agent_compute-ego1_mean0.03280256957833118
agent_compute-ego1_median0.03280256957833118
agent_compute-ego1_min0.031755684615174105
agent_compute-ego2_max0.03320908089859301
agent_compute-ego2_mean0.032272800021524925
agent_compute-ego2_median0.032272800021524925
agent_compute-ego2_min0.03133651914445685
agent_compute-ego3_max0.0328103981843896
agent_compute-ego3_mean0.03211679277967951
agent_compute-ego3_median0.03211679277967951
agent_compute-ego3_min0.03142318737496941
complete-iteration_max1.1372454382795576
complete-iteration_mean1.130485832542305
complete-iteration_median1.130485832542305
complete-iteration_min1.1237262268050523
deviation-center-line_max6.953126488911857
deviation-center-line_mean3.794232240809762
deviation-center-line_min0.4805056288458936
deviation-heading_max41.46245700705427
deviation-heading_mean20.637292376687355
deviation-heading_median11.642327946047526
deviation-heading_min8.615978608684674
driven_any_max14.590355807055015
driven_any_mean7.923042483030601
driven_any_median8.415175253319164
driven_any_min0.4915565252922888
driven_lanedir_consec_max14.289296906523838
driven_lanedir_consec_mean7.632397236477832
driven_lanedir_consec_min0.4719894390008583
driven_lanedir_max14.289296906523838
driven_lanedir_mean7.652720249076826
driven_lanedir_median8.016352896319091
driven_lanedir_min0.4719894390008583
get_duckie_state_max1.1367067310037858e-06
get_duckie_state_mean1.0812213081404331e-06
get_duckie_state_median1.0812213081404331e-06
get_duckie_state_min1.0257358852770804e-06
get_robot_state_max0.01396204986540503
get_robot_state_mean0.013879901761317828
get_robot_state_median0.013879901761317828
get_robot_state_min0.013797753657230629
get_state_dump_max0.00926226025120007
get_state_dump_mean0.009220509505291763
get_state_dump_median0.009220509505291763
get_state_dump_min0.009178758759383456
get_ui_image_max0.05382773242921853
get_ui_image_mean0.053595921578355674
get_ui_image_median0.053595921578355674
get_ui_image_min0.053364110727492815
in-drivable-lane_max0.8999999999999968
in-drivable-lane_mean0.3749999999999949
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 14.590274564005348, "get_ui_image": 0.05382773242921853, "step_physics": 0.8626708192293293, "survival_time": 59.99999999999873, "driven_lanedir": 14.28710329263761, "get_state_dump": 0.00926226025120007, "get_robot_state": 0.01396204986540503, "sim_render-ego0": 0.0036216224857809937, "sim_render-ego1": 0.0035974618100206818, "sim_render-ego2": 0.003589084801526987, "sim_render-ego3": 0.003569064986001046, "get_duckie_state": 1.1367067310037858e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.621844223088113, "agent_compute-ego0": 0.032792791736612315, "agent_compute-ego1": 0.031755684615174105, "agent_compute-ego2": 0.03133651914445685, "agent_compute-ego3": 0.03142318737496941, "complete-iteration": 1.1237262268050523, "set_robot_commands": 0.0021614849716300867, "deviation-center-line": 2.868592428738889, "driven_lanedir_consec": 14.28710329263761, "sim_compute_sim_state": 0.026109077849058585, "sim_compute_performance-ego0": 0.0018804917029794509, "sim_compute_performance-ego1": 0.0018486152779152748, "sim_compute_performance-ego2": 0.001893689094435464, "sim_compute_performance-ego3": 0.0018431701628393575}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 2.240089432902503, "get_ui_image": 0.05382773242921853, "step_physics": 0.8626708192293293, "survival_time": 59.99999999999873, "driven_lanedir": 1.9003814960433445, "get_state_dump": 0.00926226025120007, "get_robot_state": 0.01396204986540503, "sim_render-ego0": 0.0036216224857809937, "sim_render-ego1": 0.0035974618100206818, "sim_render-ego2": 0.003589084801526987, "sim_render-ego3": 0.003569064986001046, "get_duckie_state": 1.1367067310037858e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 38.215030147960086, "agent_compute-ego0": 0.032792791736612315, "agent_compute-ego1": 0.031755684615174105, "agent_compute-ego2": 0.03133651914445685, "agent_compute-ego3": 0.03142318737496941, "complete-iteration": 1.1237262268050523, "set_robot_commands": 0.0021614849716300867, "deviation-center-line": 5.9544361323540524, "driven_lanedir_consec": 1.9003814960433445, "sim_compute_sim_state": 0.026109077849058585, "sim_compute_performance-ego0": 0.0018804917029794509, "sim_compute_performance-ego1": 0.0018486152779152748, "sim_compute_performance-ego2": 0.001893689094435464, "sim_compute_performance-ego3": 0.0018431701628393575}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 14.590261073735824, "get_ui_image": 0.05382773242921853, "step_physics": 0.8626708192293293, "survival_time": 59.99999999999873, "driven_lanedir": 14.289296906523838, "get_state_dump": 0.00926226025120007, "get_robot_state": 0.01396204986540503, "sim_render-ego0": 0.0036216224857809937, "sim_render-ego1": 0.0035974618100206818, "sim_render-ego2": 0.003589084801526987, "sim_render-ego3": 0.003569064986001046, "get_duckie_state": 1.1367067310037858e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.730272699257808, "agent_compute-ego0": 0.032792791736612315, "agent_compute-ego1": 0.031755684615174105, "agent_compute-ego2": 0.03133651914445685, "agent_compute-ego3": 0.03142318737496941, "complete-iteration": 1.1237262268050523, "set_robot_commands": 0.0021614849716300867, "deviation-center-line": 2.7598534943829054, "driven_lanedir_consec": 14.289296906523838, "sim_compute_sim_state": 0.026109077849058585, "sim_compute_performance-ego0": 0.0018804917029794509, "sim_compute_performance-ego1": 0.0018486152779152748, "sim_compute_performance-ego2": 0.001893689094435464, "sim_compute_performance-ego3": 0.0018431701628393575}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 0.9929038889132118, "get_ui_image": 0.05382773242921853, "step_physics": 0.8626708192293293, "survival_time": 59.99999999999873, "driven_lanedir": 0.8506605764094891, "get_state_dump": 0.00926226025120007, "get_robot_state": 0.01396204986540503, "sim_render-ego0": 0.0036216224857809937, "sim_render-ego1": 0.0035974618100206818, "sim_render-ego2": 0.003589084801526987, "sim_render-ego3": 0.003569064986001046, "get_duckie_state": 1.1367067310037858e-06, "in-drivable-lane": 0.09999999999999964, "deviation-heading": 41.46245700705427, "agent_compute-ego0": 0.032792791736612315, "agent_compute-ego1": 0.031755684615174105, "agent_compute-ego2": 0.03133651914445685, "agent_compute-ego3": 0.03142318737496941, "complete-iteration": 1.1237262268050523, "set_robot_commands": 0.0021614849716300867, "deviation-center-line": 6.953126488911857, "driven_lanedir_consec": 0.6898939120510256, "sim_compute_sim_state": 0.026109077849058585, "sim_compute_performance-ego0": 0.0018804917029794509, "sim_compute_performance-ego1": 0.0018486152779152748, "sim_compute_performance-ego2": 0.001893689094435464, "sim_compute_performance-ego3": 0.0018431701628393575}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 14.590355807055015, "get_ui_image": 0.053364110727492815, "step_physics": 0.8720231395676967, "survival_time": 59.99999999999873, "driven_lanedir": 14.266138371231111, "get_state_dump": 0.009178758759383456, "get_robot_state": 0.013797753657230629, "sim_render-ego0": 0.003587772010466538, "sim_render-ego1": 0.003564796082483144, "sim_render-ego2": 0.003554365617051708, "sim_render-ego3": 0.003535223046905492, "get_duckie_state": 1.0257358852770804e-06, "in-drivable-lane": 0.39999999999997726, "deviation-heading": 8.615978608684674, "agent_compute-ego0": 0.03453265479164854, "agent_compute-ego1": 0.03384945454148825, "agent_compute-ego2": 0.03320908089859301, "agent_compute-ego3": 0.0328103981843896, "complete-iteration": 1.1372454382795576, "set_robot_commands": 0.002099893373017704, "deviation-center-line": 2.363375472317093, "driven_lanedir_consec": 14.266134629568532, "sim_compute_sim_state": 0.02433653993471576, "sim_compute_performance-ego0": 0.001846197344282088, "sim_compute_performance-ego1": 0.001839111885559946, "sim_compute_performance-ego2": 0.0018335657254742344, "sim_compute_performance-ego3": 0.00186837821280728}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 14.590330219308878, "get_ui_image": 0.053364110727492815, "step_physics": 0.8720231395676967, "survival_time": 59.99999999999873, "driven_lanedir": 14.13232429659484, "get_state_dump": 0.009178758759383456, "get_robot_state": 0.013797753657230629, "sim_render-ego0": 0.003587772010466538, "sim_render-ego1": 0.003564796082483144, "sim_render-ego2": 0.003554365617051708, "sim_render-ego3": 0.003535223046905492, "get_duckie_state": 1.0257358852770804e-06, "in-drivable-lane": 0.6999999999999886, "deviation-heading": 9.608383271258388, "agent_compute-ego0": 0.03453265479164854, "agent_compute-ego1": 0.03384945454148825, "agent_compute-ego2": 0.03320908089859301, "agent_compute-ego3": 0.0328103981843896, "complete-iteration": 1.1372454382795576, "set_robot_commands": 0.002099893373017704, "deviation-center-line": 2.6441856314139045, "driven_lanedir_consec": 14.13232091409086, "sim_compute_sim_state": 0.02433653993471576, "sim_compute_performance-ego0": 0.001846197344282088, "sim_compute_performance-ego1": 0.001839111885559946, "sim_compute_performance-ego2": 0.0018335657254742344, "sim_compute_performance-ego3": 0.00186837821280728}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.4915565252922888, "get_ui_image": 0.053364110727492815, "step_physics": 0.8720231395676967, "survival_time": 59.99999999999873, "driven_lanedir": 0.4719894390008583, "get_state_dump": 0.009178758759383456, "get_robot_state": 0.013797753657230629, "sim_render-ego0": 0.003587772010466538, "sim_render-ego1": 0.003564796082483144, "sim_render-ego2": 0.003554365617051708, "sim_render-ego3": 0.003535223046905492, "get_duckie_state": 1.0257358852770804e-06, "in-drivable-lane": 0.0, "deviation-heading": 33.28998986335827, "agent_compute-ego0": 0.03453265479164854, "agent_compute-ego1": 0.03384945454148825, "agent_compute-ego2": 0.03320908089859301, "agent_compute-ego3": 0.0328103981843896, "complete-iteration": 1.1372454382795576, "set_robot_commands": 0.002099893373017704, "deviation-center-line": 6.3297826495135, "driven_lanedir_consec": 0.4719894390008583, "sim_compute_sim_state": 0.02433653993471576, "sim_compute_performance-ego0": 0.001846197344282088, "sim_compute_performance-ego1": 0.001839111885559946, "sim_compute_performance-ego2": 0.0018335657254742344, "sim_compute_performance-ego3": 0.00186837821280728}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 1.298568353031745, "get_ui_image": 0.053364110727492815, "step_physics": 0.8720231395676967, "survival_time": 59.99999999999873, "driven_lanedir": 1.0238676141735177, "get_state_dump": 0.009178758759383456, "get_robot_state": 0.013797753657230629, "sim_render-ego0": 0.003587772010466538, "sim_render-ego1": 0.003564796082483144, "sim_render-ego2": 0.003554365617051708, "sim_render-ego3": 0.003535223046905492, "get_duckie_state": 1.0257358852770804e-06, "in-drivable-lane": 0.8999999999999968, "deviation-heading": 12.554383192837244, "agent_compute-ego0": 0.03453265479164854, "agent_compute-ego1": 0.03384945454148825, "agent_compute-ego2": 0.03320908089859301, "agent_compute-ego3": 0.0328103981843896, "complete-iteration": 1.1372454382795576, "set_robot_commands": 0.002099893373017704, "deviation-center-line": 0.4805056288458936, "driven_lanedir_consec": 1.0220573019065868, "sim_compute_sim_state": 0.02433653993471576, "sim_compute_performance-ego0": 0.001846197344282088, "sim_compute_performance-ego1": 0.001839111885559946, "sim_compute_performance-ego2": 0.0018335657254742344, "sim_compute_performance-ego3": 0.00186837821280728}}
set_robot_commands_max0.0021614849716300867
set_robot_commands_mean0.0021306891723238955
set_robot_commands_median0.0021306891723238955
set_robot_commands_min0.002099893373017704
sim_compute_performance-ego0_max0.0018804917029794509
sim_compute_performance-ego0_mean0.0018633445236307697
sim_compute_performance-ego0_median0.0018633445236307697
sim_compute_performance-ego0_min0.001846197344282088
sim_compute_performance-ego1_max0.0018486152779152748
sim_compute_performance-ego1_mean0.0018438635817376104
sim_compute_performance-ego1_median0.0018438635817376104
sim_compute_performance-ego1_min0.001839111885559946
sim_compute_performance-ego2_max0.001893689094435464
sim_compute_performance-ego2_mean0.0018636274099548492
sim_compute_performance-ego2_median0.0018636274099548492
sim_compute_performance-ego2_min0.0018335657254742344
sim_compute_performance-ego3_max0.00186837821280728
sim_compute_performance-ego3_mean0.0018557741878233189
sim_compute_performance-ego3_median0.0018557741878233189
sim_compute_performance-ego3_min0.0018431701628393575
sim_compute_sim_state_max0.026109077849058585
sim_compute_sim_state_mean0.025222808891887175
sim_compute_sim_state_median0.025222808891887175
sim_compute_sim_state_min0.02433653993471576
sim_render-ego0_max0.0036216224857809937
sim_render-ego0_mean0.003604697248123766
sim_render-ego0_median0.003604697248123766
sim_render-ego0_min0.003587772010466538
sim_render-ego1_max0.0035974618100206818
sim_render-ego1_mean0.003581128946251913
sim_render-ego1_median0.003581128946251913
sim_render-ego1_min0.003564796082483144
sim_render-ego2_max0.003589084801526987
sim_render-ego2_mean0.0035717252092893476
sim_render-ego2_median0.0035717252092893476
sim_render-ego2_min0.003554365617051708
sim_render-ego3_max0.003569064986001046
sim_render-ego3_mean0.003552144016453269
sim_render-ego3_median0.003552144016453269
sim_render-ego3_min0.003535223046905492
simulation-passed1
step_physics_max0.8720231395676967
step_physics_mean0.867346979398513
step_physics_median0.867346979398513
step_physics_min0.8626708192293293
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5356912659Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesgpu-prod-010:14:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2711067850822737
survival_time_median6.949999999999983
deviation-center-line_median0.12166672773097312
in-drivable-lane_median3.0999999999999943


other stats
agent_compute-ego0_max0.037738812275421925
agent_compute-ego0_mean0.020362595561980203
agent_compute-ego0_median0.01370194469179426
agent_compute-ego0_min0.012958156361299402
agent_compute-ego1_max0.03804769271459335
agent_compute-ego1_mean0.02033736430592747
agent_compute-ego1_median0.013690786127663827
agent_compute-ego1_min0.012951414925711497
agent_compute-ego2_max0.037281363438337274
agent_compute-ego2_mean0.020953582245457892
agent_compute-ego2_median0.01313244444983346
agent_compute-ego2_min0.012446938848202945
agent_compute-ego3_max0.03750003606845171
agent_compute-ego3_mean0.02071982894574976
agent_compute-ego3_median0.013124148538507569
agent_compute-ego3_min0.011535302230290005
complete-iteration_max1.3313942964260397
complete-iteration_mean0.999898547689391
complete-iteration_median1.080564039616497
complete-iteration_min0.32935430582831887
deviation-center-line_max1.2712449614354393
deviation-center-line_mean0.2837733129992003
deviation-center-line_min0.03738234871858298
deviation-heading_max6.779520012490992
deviation-heading_mean1.6793482534211432
deviation-heading_median0.8111831488629011
deviation-heading_min0.3063923477335874
driven_any_max2.679198415637278
driven_any_mean1.1415435624442665
driven_any_median0.981177319392592
driven_any_min0.1697596830439804
driven_lanedir_consec_max0.6929339381585025
driven_lanedir_consec_mean0.2983238475745339
driven_lanedir_consec_min0.06438311007688036
driven_lanedir_max0.6929339381585025
driven_lanedir_mean0.2983238475745339
driven_lanedir_median0.2711067850822737
driven_lanedir_min0.06438311007688036
get_duckie_state_max1.822199140276228e-06
get_duckie_state_mean1.7777323849198866e-06
get_duckie_state_median1.8108110486364071e-06
get_duckie_state_min1.6872699444110576e-06
get_robot_state_max0.013918017729734763
get_robot_state_mean0.012892277856836038
get_robot_state_median0.01391399587903704
get_robot_state_min0.006958913803100586
get_state_dump_max0.009351754188537596
get_state_dump_mean0.008827649050566757
get_state_dump_median0.00930023804689065
get_state_dump_min0.006141365275663488
get_ui_image_max0.048708680348518565
get_ui_image_mean0.044204217978276845
get_ui_image_median0.04703675018497771
get_ui_image_min0.030426900527056527
in-drivable-lane_max6.74999999999998
in-drivable-lane_mean3.1749999999999923
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.1697596830439804, "get_ui_image": 0.0437558821269444, "step_physics": 0.756511504309518, "survival_time": 6.949999999999983, "driven_lanedir": 0.15444980778095507, "get_state_dump": 0.009351754188537596, "get_robot_state": 0.01391399587903704, "sim_render-ego0": 0.003760722705296108, "sim_render-ego1": 0.003596694128853934, "sim_render-ego2": 0.0036739724023001534, "sim_render-ego3": 0.003532670225415911, "get_duckie_state": 1.822199140276228e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.113437304920873, "agent_compute-ego0": 0.01370194469179426, "agent_compute-ego1": 0.012951414925711497, "agent_compute-ego2": 0.01313244444983346, "agent_compute-ego3": 0.011535302230290005, "complete-iteration": 0.9230094279561724, "set_robot_commands": 0.00216247524533953, "deviation-center-line": 0.9253403924627872, "driven_lanedir_consec": 0.15444980778095507, "sim_compute_sim_state": 0.01691207034247262, "sim_compute_performance-ego0": 0.001960681165967669, "sim_compute_performance-ego1": 0.001964165483202253, "sim_compute_performance-ego2": 0.0019002335412161692, "sim_compute_performance-ego3": 0.0018958159855433873}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.105135619995677, "get_ui_image": 0.0437558821269444, "step_physics": 0.756511504309518, "survival_time": 6.949999999999983, "driven_lanedir": 0.13889942350534956, "get_state_dump": 0.009351754188537596, "get_robot_state": 0.01391399587903704, "sim_render-ego0": 0.003760722705296108, "sim_render-ego1": 0.003596694128853934, "sim_render-ego2": 0.0036739724023001534, "sim_render-ego3": 0.003532670225415911, "get_duckie_state": 1.822199140276228e-06, "in-drivable-lane": 6.049999999999984, "deviation-heading": 0.7056790991036815, "agent_compute-ego0": 0.01370194469179426, "agent_compute-ego1": 0.012951414925711497, "agent_compute-ego2": 0.01313244444983346, "agent_compute-ego3": 0.011535302230290005, "complete-iteration": 0.9230094279561724, "set_robot_commands": 0.00216247524533953, "deviation-center-line": 0.08849475729101529, "driven_lanedir_consec": 0.13889942350534956, "sim_compute_sim_state": 0.01691207034247262, "sim_compute_performance-ego0": 0.001960681165967669, "sim_compute_performance-ego1": 0.001964165483202253, "sim_compute_performance-ego2": 0.0019002335412161692, "sim_compute_performance-ego3": 0.0018958159855433873}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 2.410587543949015, "get_ui_image": 0.0437558821269444, "step_physics": 0.756511504309518, "survival_time": 6.949999999999983, "driven_lanedir": 0.16645409715794734, "get_state_dump": 0.009351754188537596, "get_robot_state": 0.01391399587903704, "sim_render-ego0": 0.003760722705296108, "sim_render-ego1": 0.003596694128853934, "sim_render-ego2": 0.0036739724023001534, "sim_render-ego3": 0.003532670225415911, "get_duckie_state": 1.822199140276228e-06, "in-drivable-lane": 6.1499999999999835, "deviation-heading": 0.48784487897912127, "agent_compute-ego0": 0.01370194469179426, "agent_compute-ego1": 0.012951414925711497, "agent_compute-ego2": 0.01313244444983346, "agent_compute-ego3": 0.011535302230290005, "complete-iteration": 0.9230094279561724, "set_robot_commands": 0.00216247524533953, "deviation-center-line": 0.04383894934896015, "driven_lanedir_consec": 0.16645409715794734, "sim_compute_sim_state": 0.01691207034247262, "sim_compute_performance-ego0": 0.001960681165967669, "sim_compute_performance-ego1": 0.001964165483202253, "sim_compute_performance-ego2": 0.0019002335412161692, "sim_compute_performance-ego3": 0.0018958159855433873}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.1115203799347757, "get_ui_image": 0.0437558821269444, "step_physics": 0.756511504309518, "survival_time": 6.949999999999983, "driven_lanedir": 0.182509902157054, "get_state_dump": 0.009351754188537596, "get_robot_state": 0.01391399587903704, "sim_render-ego0": 0.003760722705296108, "sim_render-ego1": 0.003596694128853934, "sim_render-ego2": 0.0036739724023001534, "sim_render-ego3": 0.003532670225415911, "get_duckie_state": 1.822199140276228e-06, "in-drivable-lane": 6.199999999999983, "deviation-heading": 0.3363612785483374, "agent_compute-ego0": 0.01370194469179426, "agent_compute-ego1": 0.012951414925711497, "agent_compute-ego2": 0.01313244444983346, "agent_compute-ego3": 0.011535302230290005, "complete-iteration": 0.9230094279561724, "set_robot_commands": 0.00216247524533953, "deviation-center-line": 0.054262203954370945, "driven_lanedir_consec": 0.182509902157054, "sim_compute_sim_state": 0.01691207034247262, "sim_compute_performance-ego0": 0.001960681165967669, "sim_compute_performance-ego1": 0.001964165483202253, "sim_compute_performance-ego2": 0.0019002335412161692, "sim_compute_performance-ego3": 0.0018958159855433873}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 0.46018650775538855, "get_ui_image": 0.048708680348518565, "step_physics": 1.0517299358661358, "survival_time": 3.8499999999999943, "driven_lanedir": 0.32958350829417715, "get_state_dump": 0.00930023804689065, "get_robot_state": 0.013918017729734763, "sim_render-ego0": 0.0036403949444110575, "sim_render-ego1": 0.003604219510005071, "sim_render-ego2": 0.003612337968288324, "sim_render-ego3": 0.0035099433018611027, "get_duckie_state": 1.6872699444110576e-06, "in-drivable-lane": 2.3999999999999937, "deviation-heading": 0.7908566479331068, "agent_compute-ego0": 0.037738812275421925, "agent_compute-ego1": 0.03804769271459335, "agent_compute-ego2": 0.037281363438337274, "agent_compute-ego3": 0.03750003606845171, "complete-iteration": 1.3313942964260397, "set_robot_commands": 0.002104004224141439, "deviation-center-line": 0.0968842809566956, "driven_lanedir_consec": 0.32958350829417715, "sim_compute_sim_state": 0.026758860319088668, "sim_compute_performance-ego0": 0.0018962682821811773, "sim_compute_performance-ego1": 0.001868587273817796, "sim_compute_performance-ego2": 0.0018458855457794971, "sim_compute_performance-ego3": 0.0018558471630781123}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 0.8792145351757069, "get_ui_image": 0.048708680348518565, "step_physics": 1.0517299358661358, "survival_time": 3.8499999999999943, "driven_lanedir": 0.3373927736487432, "get_state_dump": 0.00930023804689065, "get_robot_state": 0.013918017729734763, "sim_render-ego0": 0.0036403949444110575, "sim_render-ego1": 0.003604219510005071, "sim_render-ego2": 0.003612337968288324, "sim_render-ego3": 0.0035099433018611027, "get_duckie_state": 1.6872699444110576e-06, "in-drivable-lane": 1.649999999999998, "deviation-heading": 1.8752741019396535, "agent_compute-ego0": 0.037738812275421925, "agent_compute-ego1": 0.03804769271459335, "agent_compute-ego2": 0.037281363438337274, "agent_compute-ego3": 0.03750003606845171, "complete-iteration": 1.3313942964260397, "set_robot_commands": 0.002104004224141439, "deviation-center-line": 0.18683835771640236, "driven_lanedir_consec": 0.3373927736487432, "sim_compute_sim_state": 0.026758860319088668, "sim_compute_performance-ego0": 0.0018962682821811773, "sim_compute_performance-ego1": 0.001868587273817796, "sim_compute_performance-ego2": 0.0018458855457794971, "sim_compute_performance-ego3": 0.0018558471630781123}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.5151742819705095, "get_ui_image": 0.048708680348518565, "step_physics": 1.0517299358661358, "survival_time": 3.8499999999999943, "driven_lanedir": 0.06438311007688036, "get_state_dump": 0.00930023804689065, "get_robot_state": 0.013918017729734763, "sim_render-ego0": 0.0036403949444110575, "sim_render-ego1": 0.003604219510005071, "sim_render-ego2": 0.003612337968288324, "sim_render-ego3": 0.0035099433018611027, "get_duckie_state": 1.6872699444110576e-06, "in-drivable-lane": 3.0999999999999943, "deviation-heading": 0.6752148137900411, "agent_compute-ego0": 0.037738812275421925, "agent_compute-ego1": 0.03804769271459335, "agent_compute-ego2": 0.037281363438337274, "agent_compute-ego3": 0.03750003606845171, "complete-iteration": 1.3313942964260397, "set_robot_commands": 0.002104004224141439, "deviation-center-line": 0.03738234871858298, "driven_lanedir_consec": 0.06438311007688036, "sim_compute_sim_state": 0.026758860319088668, "sim_compute_performance-ego0": 0.0018962682821811773, "sim_compute_performance-ego1": 0.001868587273817796, "sim_compute_performance-ego2": 0.0018458855457794971, "sim_compute_performance-ego3": 0.0018558471630781123}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.5148504416905914, "get_ui_image": 0.048708680348518565, "step_physics": 1.0517299358661358, "survival_time": 3.8499999999999943, "driven_lanedir": 0.4592100107846364, "get_state_dump": 0.00930023804689065, "get_robot_state": 0.013918017729734763, "sim_render-ego0": 0.0036403949444110575, "sim_render-ego1": 0.003604219510005071, "sim_render-ego2": 0.003612337968288324, "sim_render-ego3": 0.0035099433018611027, "get_duckie_state": 1.6872699444110576e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.570870256844199, "agent_compute-ego0": 0.037738812275421925, "agent_compute-ego1": 0.03804769271459335, "agent_compute-ego2": 0.037281363438337274, "agent_compute-ego3": 0.03750003606845171, "complete-iteration": 1.3313942964260397, "set_robot_commands": 0.002104004224141439, "deviation-center-line": 0.23344317684897503, "driven_lanedir_consec": 0.4592100107846364, "sim_compute_sim_state": 0.026758860319088668, "sim_compute_performance-ego0": 0.0018962682821811773, "sim_compute_performance-ego1": 0.001868587273817796, "sim_compute_performance-ego2": 0.0018458855457794971, "sim_compute_performance-ego3": 0.0018558471630781123}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.703336068278802, "get_ui_image": 0.04703675018497771, "step_physics": 0.9033376307575248, "survival_time": 8.09999999999998, "driven_lanedir": 0.6929339381585025, "get_state_dump": 0.009174096803723669, "get_robot_state": 0.013811501988604024, "sim_render-ego0": 0.003692793699861304, "sim_render-ego1": 0.003705140271801159, "sim_render-ego2": 0.003613824493314591, "sim_render-ego3": 0.003772210489752834, "get_duckie_state": 1.8108110486364071e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.8961088118337857, "agent_compute-ego0": 0.013349249319064836, "agent_compute-ego1": 0.013690786127663827, "agent_compute-ego2": 0.012446938848202945, "agent_compute-ego3": 0.013124148538507569, "complete-iteration": 1.080564039616497, "set_robot_commands": 0.002138918894200238, "deviation-center-line": 0.5633987971394339, "driven_lanedir_consec": 0.6929339381585025, "sim_compute_sim_state": 0.023342242270159574, "sim_compute_performance-ego0": 0.0019114836593347093, "sim_compute_performance-ego1": 0.0019175977063325283, "sim_compute_performance-ego2": 0.001889179089318024, "sim_compute_performance-ego3": 0.0019043047735296144}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.679198415637278, "get_ui_image": 0.04703675018497771, "step_physics": 0.9033376307575248, "survival_time": 8.09999999999998, "driven_lanedir": 0.5259782377628714, "get_state_dump": 0.009174096803723669, "get_robot_state": 0.013811501988604024, "sim_render-ego0": 0.003692793699861304, "sim_render-ego1": 0.003705140271801159, "sim_render-ego2": 0.003613824493314591, "sim_render-ego3": 0.003772210489752834, "get_duckie_state": 1.8108110486364071e-06, "in-drivable-lane": 5.749999999999985, "deviation-heading": 1.7520629793238731, "agent_compute-ego0": 0.013349249319064836, "agent_compute-ego1": 0.013690786127663827, "agent_compute-ego2": 0.012446938848202945, "agent_compute-ego3": 0.013124148538507569, "complete-iteration": 1.080564039616497, "set_robot_commands": 0.002138918894200238, "deviation-center-line": 0.16231357804150784, "driven_lanedir_consec": 0.5259782377628714, "sim_compute_sim_state": 0.023342242270159574, "sim_compute_performance-ego0": 0.0019114836593347093, "sim_compute_performance-ego1": 0.0019175977063325283, "sim_compute_performance-ego2": 0.001889179089318024, "sim_compute_performance-ego3": 0.0019043047735296144}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.7953508188492655, "get_ui_image": 0.04703675018497771, "step_physics": 0.9033376307575248, "survival_time": 8.09999999999998, "driven_lanedir": 0.35599896443419654, "get_state_dump": 0.009174096803723669, "get_robot_state": 0.013811501988604024, "sim_render-ego0": 0.003692793699861304, "sim_render-ego1": 0.003705140271801159, "sim_render-ego2": 0.003613824493314591, "sim_render-ego3": 0.003772210489752834, "get_duckie_state": 1.8108110486364071e-06, "in-drivable-lane": 6.74999999999998, "deviation-heading": 0.8315096497926955, "agent_compute-ego0": 0.013349249319064836, "agent_compute-ego1": 0.013690786127663827, "agent_compute-ego2": 0.012446938848202945, "agent_compute-ego3": 0.013124148538507569, "complete-iteration": 1.080564039616497, "set_robot_commands": 0.002138918894200238, "deviation-center-line": 0.1304101283019886, "driven_lanedir_consec": 0.35599896443419654, "sim_compute_sim_state": 0.023342242270159574, "sim_compute_performance-ego0": 0.0019114836593347093, "sim_compute_performance-ego1": 0.0019175977063325283, "sim_compute_performance-ego2": 0.001889179089318024, "sim_compute_performance-ego3": 0.0019043047735296144}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 0.3011394834424732, "get_ui_image": 0.04703675018497771, "step_physics": 0.9033376307575248, "survival_time": 8.09999999999998, "driven_lanedir": 0.2344061643922295, "get_state_dump": 0.009174096803723669, "get_robot_state": 0.013811501988604024, "sim_render-ego0": 0.003692793699861304, "sim_render-ego1": 0.003705140271801159, "sim_render-ego2": 0.003613824493314591, "sim_render-ego3": 0.003772210489752834, "get_duckie_state": 1.8108110486364071e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.779520012490992, "agent_compute-ego0": 0.013349249319064836, "agent_compute-ego1": 0.013690786127663827, "agent_compute-ego2": 0.012446938848202945, "agent_compute-ego3": 0.013124148538507569, "complete-iteration": 1.080564039616497, "set_robot_commands": 0.002138918894200238, "deviation-center-line": 1.2712449614354393, "driven_lanedir_consec": 0.2344061643922295, "sim_compute_sim_state": 0.023342242270159574, "sim_compute_performance-ego0": 0.0019114836593347093, "sim_compute_performance-ego1": 0.0019175977063325283, "sim_compute_performance-ego2": 0.001889179089318024, "sim_compute_performance-ego3": 0.0019043047735296144}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.0831401036094772, "get_ui_image": 0.030426900527056527, "step_physics": 0.2355572139515596, "survival_time": 4.199999999999993, "driven_lanedir": 0.2265265221176136, "get_state_dump": 0.006141365275663488, "get_robot_state": 0.006958913803100586, "sim_render-ego0": 0.0037215176750631895, "sim_render-ego1": 0.003670773786656997, "get_duckie_state": 1.80356642779182e-06, "in-drivable-lane": 3.2999999999999927, "deviation-heading": 0.3063923477335874, "agent_compute-ego0": 0.012958156361299402, "agent_compute-ego1": 0.012981762605554918, "complete-iteration": 0.32935430582831887, "set_robot_commands": 0.002177112242754768, "deviation-center-line": 0.06605112261268693, "driven_lanedir_consec": 0.2265265221176136, "sim_compute_sim_state": 0.008574107114006491, "sim_compute_performance-ego0": 0.0019500451929429, "sim_compute_performance-ego1": 0.0019181027131922105}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.2530159908867935, "get_ui_image": 0.030426900527056527, "step_physics": 0.2355572139515596, "survival_time": 4.199999999999993, "driven_lanedir": 0.3078074057723179, "get_state_dump": 0.006141365275663488, "get_robot_state": 0.006958913803100586, "sim_render-ego0": 0.0037215176750631895, "sim_render-ego1": 0.003670773786656997, "get_duckie_state": 1.80356642779182e-06, "in-drivable-lane": 3.099999999999994, "deviation-heading": 0.3897433646620584, "agent_compute-ego0": 0.012958156361299402, "agent_compute-ego1": 0.012981762605554918, "complete-iteration": 0.32935430582831887, "set_robot_commands": 0.002177112242754768, "deviation-center-line": 0.11292332715995766, "driven_lanedir_consec": 0.3078074057723179, "sim_compute_sim_state": 0.008574107114006491, "sim_compute_performance-ego0": 0.0019500451929429, "sim_compute_performance-ego1": 0.0019181027131922105}}
set_robot_commands_max0.002177112242754768
set_robot_commands_mean0.0021411298528738834
set_robot_commands_median0.002138918894200238
set_robot_commands_min0.002104004224141439
sim_compute_performance-ego0_max0.001960681165967669
sim_compute_performance-ego0_mean0.0019267016297014304
sim_compute_performance-ego0_median0.0019114836593347093
sim_compute_performance-ego0_min0.0018962682821811773
sim_compute_performance-ego1_max0.001964165483202253
sim_compute_performance-ego1_mean0.001916971948556766
sim_compute_performance-ego1_median0.0019175977063325283
sim_compute_performance-ego1_min0.001868587273817796
sim_compute_performance-ego2_max0.0019002335412161692
sim_compute_performance-ego2_mean0.0018784327254378968
sim_compute_performance-ego2_median0.001889179089318024
sim_compute_performance-ego2_min0.0018458855457794971
sim_compute_performance-ego3_max0.0019043047735296144
sim_compute_performance-ego3_mean0.0018853226407170385
sim_compute_performance-ego3_median0.0018958159855433873
sim_compute_performance-ego3_min0.0018558471630781123
sim_compute_sim_state_max0.026758860319088668
sim_compute_sim_state_mean0.0203714932824926
sim_compute_sim_state_median0.023342242270159574
sim_compute_sim_state_min0.008574107114006491
sim_render-ego0_max0.003760722705296108
sim_render-ego0_mean0.003701334339171448
sim_render-ego0_median0.003692793699861304
sim_render-ego0_min0.0036403949444110575
sim_render-ego1_max0.003705140271801159
sim_render-ego1_mean0.003640411658282475
sim_render-ego1_median0.003604219510005071
sim_render-ego1_min0.003596694128853934
sim_render-ego2_max0.0036739724023001534
sim_render-ego2_mean0.0036333782879676897
sim_render-ego2_median0.003613824493314591
sim_render-ego2_min0.003612337968288324
sim_render-ego3_max0.003772210489752834
sim_render-ego3_mean0.003604941339009949
sim_render-ego3_median0.003532670225415911
sim_render-ego3_min0.0035099433018611027
simulation-passed1
step_physics_max1.0517299358661358
step_physics_mean0.8083879079739882
step_physics_median0.9033376307575248
step_physics_min0.2355572139515596
survival_time_max8.09999999999998
survival_time_mean5.999999999999987
survival_time_min3.8499999999999943
No reset possible
5356012661Bea Baselines 🐤template-tensorflowaido5-LFI-sim-testingLFVIv-simsuccessyesgpu-prod-010:02:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.35258425174740293
survival_time_median2.275
deviation-center-line_median0.14154408686229542
in-drivable-lane_median0.7499999999999992


other stats
agent_compute-ego0_max0.05462091167767843
agent_compute-ego0_mean0.03416856891579098
agent_compute-ego0_median0.03416856891579098
agent_compute-ego0_min0.013716226153903536
complete-iteration_max0.34147607783476513
complete-iteration_mean0.3159413352608681
complete-iteration_median0.3159413352608681
complete-iteration_min0.29040659268697105
deviation-center-line_max0.19901237443280412
deviation-center-line_mean0.14154408686229542
deviation-center-line_min0.08407579929178674
deviation-heading_max0.5039005726869622
deviation-heading_mean0.5003702850535723
deviation-heading_median0.5003702850535723
deviation-heading_min0.4968399974201824
driven_any_max0.38811847224115953
driven_any_mean0.3861957923606929
driven_any_median0.3861957923606929
driven_any_min0.38427311248022633
driven_lanedir_consec_max0.3676292551254803
driven_lanedir_consec_mean0.35258425174740293
driven_lanedir_consec_min0.3375392483693256
driven_lanedir_max0.3676292551254803
driven_lanedir_mean0.35258425174740293
driven_lanedir_median0.35258425174740293
driven_lanedir_min0.3375392483693256
get_duckie_state_max1.160303751627604e-06
get_duckie_state_mean1.1513630549112956e-06
get_duckie_state_median1.1513630549112956e-06
get_duckie_state_min1.142422358194987e-06
get_robot_state_max0.0036846399307250977
get_robot_state_mean0.0036482850710550943
get_robot_state_median0.0036482850710550943
get_robot_state_min0.003611930211385091
get_state_dump_max0.004712695876757304
get_state_dump_mean0.004580226374997033
get_state_dump_median0.004580226374997033
get_state_dump_min0.004447756873236762
get_ui_image_max0.03826893170674642
get_ui_image_mean0.03809323559204737
get_ui_image_median0.03809323559204737
get_ui_image_min0.03791753947734833
in-drivable-lane_max0.7999999999999996
in-drivable-lane_mean0.7499999999999992
in-drivable-lane_min0.6999999999999988
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.38427311248022633, "get_ui_image": 0.03791753947734833, "step_physics": 0.22354102631409964, "survival_time": 2.3499999999999996, "driven_lanedir": 0.3676292551254803, "get_state_dump": 0.004712695876757304, "get_robot_state": 0.0036846399307250977, "sim_render-ego0": 0.0037924150625864663, "get_duckie_state": 1.142422358194987e-06, "in-drivable-lane": 0.6999999999999988, "deviation-heading": 0.4968399974201824, "agent_compute-ego0": 0.05462091167767843, "complete-iteration": 0.34147607783476513, "set_robot_commands": 0.002217849095662435, "deviation-center-line": 0.19901237443280412, "driven_lanedir_consec": 0.3676292551254803, "sim_compute_sim_state": 0.008896440267562866, "sim_compute_performance-ego0": 0.0020150095224380493}, "LFI-norm-udem1-000-ego0": {"driven_any": 0.38811847224115953, "get_ui_image": 0.03826893170674642, "step_physics": 0.21378562185499403, "survival_time": 2.2, "driven_lanedir": 0.3375392483693256, "get_state_dump": 0.004447756873236762, "get_robot_state": 0.003611930211385091, "sim_render-ego0": 0.003794293933444553, "get_duckie_state": 1.160303751627604e-06, "in-drivable-lane": 0.7999999999999996, "deviation-heading": 0.5039005726869622, "agent_compute-ego0": 0.013716226153903536, "complete-iteration": 0.29040659268697105, "set_robot_commands": 0.0022061665852864585, "deviation-center-line": 0.08407579929178674, "driven_lanedir_consec": 0.3375392483693256, "sim_compute_sim_state": 0.008528640535142686, "sim_compute_performance-ego0": 0.0019677850935194228}}
set_robot_commands_max0.002217849095662435
set_robot_commands_mean0.0022120078404744468
set_robot_commands_median0.0022120078404744468
set_robot_commands_min0.0022061665852864585
sim_compute_performance-ego0_max0.0020150095224380493
sim_compute_performance-ego0_mean0.001991397307978736
sim_compute_performance-ego0_median0.001991397307978736
sim_compute_performance-ego0_min0.0019677850935194228
sim_compute_sim_state_max0.008896440267562866
sim_compute_sim_state_mean0.008712540401352775
sim_compute_sim_state_median0.008712540401352775
sim_compute_sim_state_min0.008528640535142686
sim_render-ego0_max0.003794293933444553
sim_render-ego0_mean0.0037933544980155096
sim_render-ego0_median0.0037933544980155096
sim_render-ego0_min0.0037924150625864663
simulation-passed1
step_physics_max0.22354102631409964
step_physics_mean0.21866332408454683
step_physics_median0.21866332408454683
step_physics_min0.21378562185499403
survival_time_max2.3499999999999996
survival_time_mean2.275
survival_time_min2.2
No reset possible
5354612662Bea Baselines 🐤template-tensorflowaido5-LFI-full-sim-validationLFVIv-simsuccessyesgpu-prod-010:02:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.26292296557616435
survival_time_median2.3249999999999997
deviation-center-line_median0.05971403412671816
in-drivable-lane_median1.1499999999999997


other stats
agent_compute-ego0_max0.05918248133225874
agent_compute-ego0_mean0.036226735926779406
agent_compute-ego0_median0.036226735926779406
agent_compute-ego0_min0.013270990521300072
complete-iteration_max0.3276578025384383
complete-iteration_mean0.3024293722422153
complete-iteration_median0.3024293722422153
complete-iteration_min0.27720094194599226
deviation-center-line_max0.06969676999390442
deviation-center-line_mean0.05971403412671816
deviation-center-line_min0.049731298259531896
deviation-heading_max0.5000886197624697
deviation-heading_mean0.45824987158158464
deviation-heading_median0.45824987158158464
deviation-heading_min0.4164111234006996
driven_any_max0.6472976014111754
driven_any_mean0.5252193356206163
driven_any_median0.5252193356206163
driven_any_min0.4031410698300571
driven_lanedir_consec_max0.3202063921134737
driven_lanedir_consec_mean0.26292296557616435
driven_lanedir_consec_min0.205639539038855
driven_lanedir_max0.3202063921134737
driven_lanedir_mean0.26292296557616435
driven_lanedir_median0.26292296557616435
driven_lanedir_min0.205639539038855
get_duckie_state_max1.2949401257084866e-06
get_duckie_state_mean1.2597723228196195e-06
get_duckie_state_median1.2597723228196195e-06
get_duckie_state_min1.224604519930753e-06
get_robot_state_max0.003643761981617321
get_robot_state_mean0.0035848695114122143
get_robot_state_median0.0035848695114122143
get_robot_state_min0.003525977041207108
get_state_dump_max0.00451527400450273
get_state_dump_mean0.004415367216987406
get_state_dump_median0.004415367216987406
get_state_dump_min0.004315460429472082
get_ui_image_max0.03801314397291704
get_ui_image_mean0.03749298528766462
get_ui_image_median0.03749298528766462
get_ui_image_min0.03697282660241221
in-drivable-lane_max1.4499999999999988
in-drivable-lane_mean1.1499999999999997
in-drivable-lane_min0.8499999999999999
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 0.4031410698300571, "get_ui_image": 0.03801314397291704, "step_physics": 0.2036360664801164, "survival_time": 2.1500000000000004, "driven_lanedir": 0.3202063921134737, "get_state_dump": 0.00451527400450273, "get_robot_state": 0.003643761981617321, "sim_render-ego0": 0.004256416450847279, "get_duckie_state": 1.224604519930753e-06, "in-drivable-lane": 0.8499999999999999, "deviation-heading": 0.4164111234006996, "agent_compute-ego0": 0.05918248133225874, "complete-iteration": 0.3276578025384383, "set_robot_commands": 0.002672997387972745, "deviation-center-line": 0.06969676999390442, "driven_lanedir_consec": 0.3202063921134737, "sim_compute_sim_state": 0.00945535031231967, "sim_compute_performance-ego0": 0.002203188159249046}, "LFI-full-udem1-000-ego0": {"driven_any": 0.6472976014111754, "get_ui_image": 0.03697282660241221, "step_physics": 0.20203345897150973, "survival_time": 2.499999999999999, "driven_lanedir": 0.205639539038855, "get_state_dump": 0.004315460429472082, "get_robot_state": 0.003525977041207108, "sim_render-ego0": 0.003728632833443436, "get_duckie_state": 1.2949401257084866e-06, "in-drivable-lane": 1.4499999999999988, "deviation-heading": 0.5000886197624697, "agent_compute-ego0": 0.013270990521300072, "complete-iteration": 0.27720094194599226, "set_robot_commands": 0.002154682196822821, "deviation-center-line": 0.049731298259531896, "driven_lanedir_consec": 0.205639539038855, "sim_compute_sim_state": 0.009185459099563895, "sim_compute_performance-ego0": 0.001933555977017272}}
set_robot_commands_max0.002672997387972745
set_robot_commands_mean0.002413839792397783
set_robot_commands_median0.002413839792397783
set_robot_commands_min0.002154682196822821
sim_compute_performance-ego0_max0.002203188159249046
sim_compute_performance-ego0_mean0.0020683720681331586
sim_compute_performance-ego0_median0.0020683720681331586
sim_compute_performance-ego0_min0.001933555977017272
sim_compute_sim_state_max0.00945535031231967
sim_compute_sim_state_mean0.009320404705941783
sim_compute_sim_state_median0.009320404705941783
sim_compute_sim_state_min0.009185459099563895
sim_render-ego0_max0.004256416450847279
sim_render-ego0_mean0.003992524642145358
sim_render-ego0_median0.003992524642145358
sim_render-ego0_min0.003728632833443436
simulation-passed1
step_physics_max0.2036360664801164
step_physics_mean0.20283476272581308
step_physics_median0.20283476272581308
step_physics_min0.20203345897150973
survival_time_max2.499999999999999
survival_time_mean2.3249999999999997
survival_time_min2.1500000000000004
No reset possible
5353412662Bea Baselines 🐤template-tensorflowaido5-LFI-full-sim-validationLFVIv-simsuccessyesgpu-prod-010:02:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2739567479610997
survival_time_median2.3
deviation-center-line_median0.059572624843588246
in-drivable-lane_median1.0999999999999994


other stats
agent_compute-ego0_max0.05952989777853323
agent_compute-ego0_mean0.03693137661376828
agent_compute-ego0_median0.03693137661376828
agent_compute-ego0_min0.014332855449003331
complete-iteration_max0.32598857546961585
complete-iteration_mean0.30127784198025187
complete-iteration_median0.30127784198025187
complete-iteration_min0.27656710849088784
deviation-center-line_max0.06941395142764459
deviation-center-line_mean0.059572624843588246
deviation-center-line_min0.049731298259531896
deviation-heading_max0.5000886197624697
deviation-heading_mean0.4599947995369277
deviation-heading_median0.4599947995369277
deviation-heading_min0.41990097931138576
driven_any_max0.6472976014111754
driven_any_mean0.5239171708477175
driven_any_median0.5239171708477175
driven_any_min0.4005367402842595
driven_lanedir_consec_max0.3422739568833444
driven_lanedir_consec_mean0.2739567479610997
driven_lanedir_consec_min0.205639539038855
driven_lanedir_max0.3422739568833444
driven_lanedir_mean0.2739567479610997
driven_lanedir_median0.2739567479610997
driven_lanedir_min0.205639539038855
get_duckie_state_max1.3977873559091604e-06
get_duckie_state_mean1.303257052886448e-06
get_duckie_state_median1.303257052886448e-06
get_duckie_state_min1.2087267498637355e-06
get_robot_state_max0.003651402717412905
get_robot_state_mean0.003608544069612836
get_robot_state_median0.003608544069612836
get_robot_state_min0.003565685421812768
get_state_dump_max0.0049616402270747165
get_state_dump_mean0.0048184671523741705
get_state_dump_median0.0048184671523741705
get_state_dump_min0.004675294077673624
get_ui_image_max0.03739497273467308
get_ui_image_mean0.037327121448908235
get_ui_image_median0.037327121448908235
get_ui_image_min0.037259270163143385
in-drivable-lane_max1.4499999999999988
in-drivable-lane_mean1.0999999999999994
in-drivable-lane_min0.75
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 0.4005367402842595, "get_ui_image": 0.03739497273467308, "step_physics": 0.20369957768639857, "survival_time": 2.1000000000000005, "driven_lanedir": 0.3422739568833444, "get_state_dump": 0.004675294077673624, "get_robot_state": 0.003651402717412905, "sim_render-ego0": 0.0037203944006631543, "get_duckie_state": 1.2087267498637355e-06, "in-drivable-lane": 0.75, "deviation-heading": 0.41990097931138576, "agent_compute-ego0": 0.05952989777853323, "complete-iteration": 0.32598857546961585, "set_robot_commands": 0.0021678070689356605, "deviation-center-line": 0.06941395142764459, "driven_lanedir_consec": 0.3422739568833444, "sim_compute_sim_state": 0.009073479231013808, "sim_compute_performance-ego0": 0.001993484275285588}, "LFI-full-udem1-000-ego0": {"driven_any": 0.6472976014111754, "get_ui_image": 0.037259270163143385, "step_physics": 0.19916667657739975, "survival_time": 2.499999999999999, "driven_lanedir": 0.205639539038855, "get_state_dump": 0.0049616402270747165, "get_robot_state": 0.003565685421812768, "sim_render-ego0": 0.003816852382585114, "get_duckie_state": 1.3977873559091604e-06, "in-drivable-lane": 1.4499999999999988, "deviation-heading": 0.5000886197624697, "agent_compute-ego0": 0.014332855449003331, "complete-iteration": 0.27656710849088784, "set_robot_commands": 0.0022236225651759726, "deviation-center-line": 0.049731298259531896, "driven_lanedir_consec": 0.205639539038855, "sim_compute_sim_state": 0.009192279740875844, "sim_compute_performance-ego0": 0.001968682981004902}}
set_robot_commands_max0.0022236225651759726
set_robot_commands_mean0.0021957148170558168
set_robot_commands_median0.0021957148170558168
set_robot_commands_min0.0021678070689356605
sim_compute_performance-ego0_max0.001993484275285588
sim_compute_performance-ego0_mean0.001981083628145245
sim_compute_performance-ego0_median0.001981083628145245
sim_compute_performance-ego0_min0.001968682981004902
sim_compute_sim_state_max0.009192279740875844
sim_compute_sim_state_mean0.009132879485944826
sim_compute_sim_state_median0.009132879485944826
sim_compute_sim_state_min0.009073479231013808
sim_render-ego0_max0.003816852382585114
sim_render-ego0_mean0.003768623391624134
sim_render-ego0_median0.003768623391624134
sim_render-ego0_min0.0037203944006631543
simulation-passed1
step_physics_max0.20369957768639857
step_physics_mean0.20143312713189915
step_physics_median0.20143312713189915
step_physics_min0.19916667657739975
survival_time_max2.499999999999999
survival_time_mean2.3
survival_time_min2.1000000000000005
No reset possible
5351412667Bea Baselines 🐤template-tensorflowaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesgpu-prod-010:10:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3721517665539752
survival_time_median5.424999999999988
deviation-center-line_median0.09548428682411264
in-drivable-lane_median3.62499999999999


other stats
agent_compute-ego0_max0.03285019771725524
agent_compute-ego0_mean0.02363023262278047
agent_compute-ego0_median0.02363023262278047
agent_compute-ego0_min0.014410267528305706
agent_compute-ego1_max0.032014596695993464
agent_compute-ego1_mean0.02260902219827958
agent_compute-ego1_median0.02260902219827958
agent_compute-ego1_min0.013203447700565698
agent_compute-ego2_max0.03265450982486501
agent_compute-ego2_mean0.022568831196857375
agent_compute-ego2_median0.022568831196857375
agent_compute-ego2_min0.012483152568849742
agent_compute-ego3_max0.03222562518774295
agent_compute-ego3_mean0.022496738015496592
agent_compute-ego3_median0.022496738015496592
agent_compute-ego3_min0.01276785084325024
complete-iteration_max1.2176630426855648
complete-iteration_mean1.1744221821389886
complete-iteration_median1.1744221821389886
complete-iteration_min1.1311813215924125
deviation-center-line_max0.6258409130040247
deviation-center-line_mean0.22433979719424776
deviation-center-line_min0.05756082847674367
deviation-heading_max5.270201864598124
deviation-heading_mean1.7315069097414828
deviation-heading_median0.7512152569353552
deviation-heading_min0.34358688111894314
driven_any_max2.1839742128085904
driven_any_mean1.1668923509082014
driven_any_median1.1479286131534017
driven_any_min0.4606387027326224
driven_lanedir_consec_max0.730850681995064
driven_lanedir_consec_mean0.4050792857218991
driven_lanedir_consec_min0.22014418177313175
driven_lanedir_max0.730850681995064
driven_lanedir_mean0.4050796016579647
driven_lanedir_median0.3721517665539752
driven_lanedir_min0.22014418177313175
get_duckie_state_max1.276240629308364e-06
get_duckie_state_mean1.243336707758148e-06
get_duckie_state_median1.243336707758148e-06
get_duckie_state_min1.2104327862079326e-06
get_robot_state_max0.01408553824705236
get_robot_state_mean0.014069970286989284
get_robot_state_median0.014069970286989284
get_robot_state_min0.014054402326926207
get_state_dump_max0.009497390073888442
get_state_dump_mean0.009464201884032374
get_state_dump_median0.009464201884032374
get_state_dump_min0.009431013694176309
get_ui_image_max0.05553125112484663
get_ui_image_mean0.0538073448214236
get_ui_image_median0.0538073448214236
get_ui_image_min0.05208343851800058
in-drivable-lane_max4.749999999999988
in-drivable-lane_mean2.9499999999999913
in-drivable-lane_min0.0
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 0.5630315041845138, "get_ui_image": 0.05553125112484663, "step_physics": 0.9417293683076516, "survival_time": 5.799999999999987, "driven_lanedir": 0.5242244189001424, "get_state_dump": 0.009431013694176309, "get_robot_state": 0.014054402326926207, "sim_render-ego0": 0.003933185186141577, "sim_render-ego1": 0.003789033645238632, "sim_render-ego2": 0.0036067066029605702, "sim_render-ego3": 0.0036369103651780342, "get_duckie_state": 1.2104327862079326e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.270201864598124, "agent_compute-ego0": 0.014410267528305706, "agent_compute-ego1": 0.013203447700565698, "agent_compute-ego2": 0.012483152568849742, "agent_compute-ego3": 0.01276785084325024, "complete-iteration": 1.1311813215924125, "set_robot_commands": 0.002138029815804245, "deviation-center-line": 0.6095654258201965, "driven_lanedir_consec": 0.5242218914116172, "sim_compute_sim_state": 0.025735673741397697, "sim_compute_performance-ego0": 0.0019529477143898988, "sim_compute_performance-ego1": 0.001963729532355936, "sim_compute_performance-ego2": 0.001953302285610101, "sim_compute_performance-ego3": 0.0019414608295147235}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.232581973984518, "get_ui_image": 0.05553125112484663, "step_physics": 0.9417293683076516, "survival_time": 5.799999999999987, "driven_lanedir": 0.730850681995064, "get_state_dump": 0.009431013694176309, "get_robot_state": 0.014054402326926207, "sim_render-ego0": 0.003933185186141577, "sim_render-ego1": 0.003789033645238632, "sim_render-ego2": 0.0036067066029605702, "sim_render-ego3": 0.0036369103651780342, "get_duckie_state": 1.2104327862079326e-06, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 0.8949418333547714, "agent_compute-ego0": 0.014410267528305706, "agent_compute-ego1": 0.013203447700565698, "agent_compute-ego2": 0.012483152568849742, "agent_compute-ego3": 0.01276785084325024, "complete-iteration": 1.1311813215924125, "set_robot_commands": 0.002138029815804245, "deviation-center-line": 0.1755020443632793, "driven_lanedir_consec": 0.730850681995064, "sim_compute_sim_state": 0.025735673741397697, "sim_compute_performance-ego0": 0.0019529477143898988, "sim_compute_performance-ego1": 0.001963729532355936, "sim_compute_performance-ego2": 0.001953302285610101, "sim_compute_performance-ego3": 0.0019414608295147235}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 1.063275252322285, "get_ui_image": 0.05553125112484663, "step_physics": 0.9417293683076516, "survival_time": 5.799999999999987, "driven_lanedir": 0.22014418177313175, "get_state_dump": 0.009431013694176309, "get_robot_state": 0.014054402326926207, "sim_render-ego0": 0.003933185186141577, "sim_render-ego1": 0.003789033645238632, "sim_render-ego2": 0.0036067066029605702, "sim_render-ego3": 0.0036369103651780342, "get_duckie_state": 1.2104327862079326e-06, "in-drivable-lane": 4.749999999999988, "deviation-heading": 0.4874511691212228, "agent_compute-ego0": 0.014410267528305706, "agent_compute-ego1": 0.013203447700565698, "agent_compute-ego2": 0.012483152568849742, "agent_compute-ego3": 0.01276785084325024, "complete-iteration": 1.1311813215924125, "set_robot_commands": 0.002138029815804245, "deviation-center-line": 0.06782155010157959, "driven_lanedir_consec": 0.22014418177313175, "sim_compute_sim_state": 0.025735673741397697, "sim_compute_performance-ego0": 0.0019529477143898988, "sim_compute_performance-ego1": 0.001963729532355936, "sim_compute_performance-ego2": 0.001953302285610101, "sim_compute_performance-ego3": 0.0019414608295147235}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 2.1839742128085904, "get_ui_image": 0.05553125112484663, "step_physics": 0.9417293683076516, "survival_time": 5.799999999999987, "driven_lanedir": 0.3240172326356263, "get_state_dump": 0.009431013694176309, "get_robot_state": 0.014054402326926207, "sim_render-ego0": 0.003933185186141577, "sim_render-ego1": 0.003789033645238632, "sim_render-ego2": 0.0036067066029605702, "sim_render-ego3": 0.0036369103651780342, "get_duckie_state": 1.2104327862079326e-06, "in-drivable-lane": 4.149999999999989, "deviation-heading": 1.0468198240301587, "agent_compute-ego0": 0.014410267528305706, "agent_compute-ego1": 0.013203447700565698, "agent_compute-ego2": 0.012483152568849742, "agent_compute-ego3": 0.01276785084325024, "complete-iteration": 1.1311813215924125, "set_robot_commands": 0.002138029815804245, "deviation-center-line": 0.11043863735377496, "driven_lanedir_consec": 0.3240172326356263, "sim_compute_sim_state": 0.025735673741397697, "sim_compute_performance-ego0": 0.0019529477143898988, "sim_compute_performance-ego1": 0.001963729532355936, "sim_compute_performance-ego2": 0.001953302285610101, "sim_compute_performance-ego3": 0.0019414608295147235}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 1.2518433490362342, "get_ui_image": 0.05208343851800058, "step_physics": 0.9527349214927824, "survival_time": 5.04999999999999, "driven_lanedir": 0.43965205373223615, "get_state_dump": 0.009497390073888442, "get_robot_state": 0.01408553824705236, "sim_render-ego0": 0.0037778709449020086, "sim_render-ego1": 0.003743419460221833, "sim_render-ego2": 0.0037763399236342486, "sim_render-ego3": 0.003712275448967429, "get_duckie_state": 1.276240629308364e-06, "in-drivable-lane": 3.549999999999989, "deviation-heading": 0.4009304626878723, "agent_compute-ego0": 0.03285019771725524, "agent_compute-ego1": 0.032014596695993464, "agent_compute-ego2": 0.03265450982486501, "agent_compute-ego3": 0.03222562518774295, "complete-iteration": 1.2176630426855648, "set_robot_commands": 0.0022225192948883655, "deviation-center-line": 0.06745904213993315, "driven_lanedir_consec": 0.43965205373223615, "sim_compute_sim_state": 0.027434379446740244, "sim_compute_performance-ego0": 0.0020007783291386624, "sim_compute_performance-ego1": 0.0019474403530943627, "sim_compute_performance-ego2": 0.0019789957532695694, "sim_compute_performance-ego3": 0.00195921168607824}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.746074895348089, "get_ui_image": 0.05208343851800058, "step_physics": 0.9527349214927824, "survival_time": 5.04999999999999, "driven_lanedir": 0.2989175009036211, "get_state_dump": 0.009497390073888442, "get_robot_state": 0.01408553824705236, "sim_render-ego0": 0.0037778709449020086, "sim_render-ego1": 0.003743419460221833, "sim_render-ego2": 0.0037763399236342486, "sim_render-ego3": 0.003712275448967429, "get_duckie_state": 1.276240629308364e-06, "in-drivable-lane": 3.9499999999999895, "deviation-heading": 0.34358688111894314, "agent_compute-ego0": 0.03285019771725524, "agent_compute-ego1": 0.032014596695993464, "agent_compute-ego2": 0.03265450982486501, "agent_compute-ego3": 0.03222562518774295, "complete-iteration": 1.2176630426855648, "set_robot_commands": 0.0022225192948883655, "deviation-center-line": 0.05756082847674367, "driven_lanedir_consec": 0.2989175009036211, "sim_compute_sim_state": 0.027434379446740244, "sim_compute_performance-ego0": 0.0020007783291386624, "sim_compute_performance-ego1": 0.0019474403530943627, "sim_compute_performance-ego2": 0.0019789957532695694, "sim_compute_performance-ego3": 0.00195921168607824}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.4606387027326224, "get_ui_image": 0.05208343851800058, "step_physics": 0.9527349214927824, "survival_time": 5.04999999999999, "driven_lanedir": 0.42028630047232407, "get_state_dump": 0.009497390073888442, "get_robot_state": 0.01408553824705236, "sim_render-ego0": 0.0037778709449020086, "sim_render-ego1": 0.003743419460221833, "sim_render-ego2": 0.0037763399236342486, "sim_render-ego3": 0.003712275448967429, "get_duckie_state": 1.276240629308364e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.800634562504832, "agent_compute-ego0": 0.03285019771725524, "agent_compute-ego1": 0.032014596695993464, "agent_compute-ego2": 0.03265450982486501, "agent_compute-ego3": 0.03222562518774295, "complete-iteration": 1.2176630426855648, "set_robot_commands": 0.0022225192948883655, "deviation-center-line": 0.6258409130040247, "driven_lanedir_consec": 0.42028630047232407, "sim_compute_sim_state": 0.027434379446740244, "sim_compute_performance-ego0": 0.0020007783291386624, "sim_compute_performance-ego1": 0.0019474403530943627, "sim_compute_performance-ego2": 0.0019789957532695694, "sim_compute_performance-ego3": 0.00195921168607824}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.8337189168487602, "get_ui_image": 0.05208343851800058, "step_physics": 0.9527349214927824, "survival_time": 5.04999999999999, "driven_lanedir": 0.282544442851572, "get_state_dump": 0.009497390073888442, "get_robot_state": 0.01408553824705236, "sim_render-ego0": 0.0037778709449020086, "sim_render-ego1": 0.003743419460221833, "sim_render-ego2": 0.0037763399236342486, "sim_render-ego3": 0.003712275448967429, "get_duckie_state": 1.276240629308364e-06, "in-drivable-lane": 3.6999999999999895, "deviation-heading": 0.6074886805159389, "agent_compute-ego0": 0.03285019771725524, "agent_compute-ego1": 0.032014596695993464, "agent_compute-ego2": 0.03265450982486501, "agent_compute-ego3": 0.03222562518774295, "complete-iteration": 1.2176630426855648, "set_robot_commands": 0.0022225192948883655, "deviation-center-line": 0.08052993629445032, "driven_lanedir_consec": 0.282544442851572, "sim_compute_sim_state": 0.027434379446740244, "sim_compute_performance-ego0": 0.0020007783291386624, "sim_compute_performance-ego1": 0.0019474403530943627, "sim_compute_performance-ego2": 0.0019789957532695694, "sim_compute_performance-ego3": 0.00195921168607824}}
set_robot_commands_max0.0022225192948883655
set_robot_commands_mean0.0021802745553463052
set_robot_commands_median0.0021802745553463052
set_robot_commands_min0.002138029815804245
sim_compute_performance-ego0_max0.0020007783291386624
sim_compute_performance-ego0_mean0.0019768630217642806
sim_compute_performance-ego0_median0.0019768630217642806
sim_compute_performance-ego0_min0.0019529477143898988
sim_compute_performance-ego1_max0.001963729532355936
sim_compute_performance-ego1_mean0.0019555849427251495
sim_compute_performance-ego1_median0.0019555849427251495
sim_compute_performance-ego1_min0.0019474403530943627
sim_compute_performance-ego2_max0.0019789957532695694
sim_compute_performance-ego2_mean0.0019661490194398355
sim_compute_performance-ego2_median0.0019661490194398355
sim_compute_performance-ego2_min0.001953302285610101
sim_compute_performance-ego3_max0.00195921168607824
sim_compute_performance-ego3_mean0.0019503362577964816
sim_compute_performance-ego3_median0.0019503362577964816
sim_compute_performance-ego3_min0.0019414608295147235
sim_compute_sim_state_max0.027434379446740244
sim_compute_sim_state_mean0.02658502659406897
sim_compute_sim_state_median0.02658502659406897
sim_compute_sim_state_min0.025735673741397697
sim_render-ego0_max0.003933185186141577
sim_render-ego0_mean0.003855528065521792
sim_render-ego0_median0.003855528065521792
sim_render-ego0_min0.0037778709449020086
sim_render-ego1_max0.003789033645238632
sim_render-ego1_mean0.003766226552730232
sim_render-ego1_median0.003766226552730232
sim_render-ego1_min0.003743419460221833
sim_render-ego2_max0.0037763399236342486
sim_render-ego2_mean0.0036915232632974094
sim_render-ego2_median0.0036915232632974094
sim_render-ego2_min0.0036067066029605702
sim_render-ego3_max0.003712275448967429
sim_render-ego3_mean0.003674592907072732
sim_render-ego3_median0.003674592907072732
sim_render-ego3_min0.0036369103651780342
simulation-passed1
step_physics_max0.9527349214927824
step_physics_mean0.947232144900217
step_physics_median0.947232144900217
step_physics_min0.9417293683076516
survival_time_max5.799999999999987
survival_time_mean5.424999999999988
survival_time_min5.04999999999999
No reset possible
5349612676Bea Baselines 🐤baseline-duckietownaido5-LFI-sim-testingLFVIv-simsuccessyesgpu-prod-010:15:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.679533981180804
survival_time_median46.59999999999949
deviation-center-line_median3.1407818159145338
in-drivable-lane_median0.8249999999999531


other stats
agent_compute-ego0_max0.011720588153466244
agent_compute-ego0_mean0.011693091559181575
agent_compute-ego0_median0.011693091559181575
agent_compute-ego0_min0.011665594964896909
complete-iteration_max0.21289616168889783
complete-iteration_mean0.20070236095383856
complete-iteration_median0.20070236095383856
complete-iteration_min0.1885085602187793
deviation-center-line_max3.8137645162113207
deviation-center-line_mean3.1407818159145338
deviation-center-line_min2.4677991156177463
deviation-heading_max7.311840524076194
deviation-heading_mean6.811874325421524
deviation-heading_median6.811874325421524
deviation-heading_min6.311908126766853
driven_any_max7.921217550231376
driven_any_mean6.092177471001463
driven_any_median6.092177471001463
driven_any_min4.26313739177155
driven_lanedir_consec_max7.0541651583822675
driven_lanedir_consec_mean4.679533981180804
driven_lanedir_consec_min2.3049028039793407
driven_lanedir_max7.564683581572708
driven_lanedir_mean5.854240603994055
driven_lanedir_median5.854240603994055
driven_lanedir_min4.1437976264154015
get_duckie_state_max1.3348264162189062e-06
get_duckie_state_mean1.311143371683672e-06
get_duckie_state_median1.311143371683672e-06
get_duckie_state_min1.2874603271484376e-06
get_robot_state_max0.003674437587422536
get_robot_state_mean0.003616964651591644
get_robot_state_median0.003616964651591644
get_robot_state_min0.003559491715760751
get_state_dump_max0.004416181449603317
get_state_dump_mean0.004396827873051632
get_state_dump_median0.004396827873051632
get_state_dump_min0.004377474296499946
get_ui_image_max0.037605218942913785
get_ui_image_mean0.037551123567996614
get_ui_image_median0.037551123567996614
get_ui_image_min0.03749702819307944
in-drivable-lane_max1.6499999999999062
in-drivable-lane_mean0.8249999999999531
in-drivable-lane_min0.0
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 4.26313739177155, "get_ui_image": 0.03749702819307944, "step_physics": 0.13491565231093786, "survival_time": 33.20000000000025, "driven_lanedir": 4.1437976264154015, "get_state_dump": 0.004416181449603317, "get_robot_state": 0.003674437587422536, "sim_render-ego0": 0.0037684530243837742, "get_duckie_state": 1.2874603271484376e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.311908126766853, "agent_compute-ego0": 0.011720588153466244, "complete-iteration": 0.21289616168889783, "set_robot_commands": 0.0022768027800366395, "deviation-center-line": 2.4677991156177463, "driven_lanedir_consec": 2.3049028039793407, "sim_compute_sim_state": 0.012566065609006954, "sim_compute_performance-ego0": 0.001987091222203764}, "LFI-norm-udem1-000-ego0": {"driven_any": 7.921217550231376, "get_ui_image": 0.037605218942913785, "step_physics": 0.11000963789934322, "survival_time": 59.99999999999873, "driven_lanedir": 7.564683581572708, "get_state_dump": 0.004377474296499946, "get_robot_state": 0.003559491715760751, "sim_render-ego0": 0.0037218438497093895, "get_duckie_state": 1.3348264162189062e-06, "in-drivable-lane": 1.6499999999999062, "deviation-heading": 7.311840524076194, "agent_compute-ego0": 0.011665594964896909, "complete-iteration": 0.1885085602187793, "set_robot_commands": 0.0021920648840047436, "deviation-center-line": 3.8137645162113207, "driven_lanedir_consec": 7.0541651583822675, "sim_compute_sim_state": 0.01336365258266884, "sim_compute_performance-ego0": 0.001940042946757524}}
set_robot_commands_max0.0022768027800366395
set_robot_commands_mean0.0022344338320206916
set_robot_commands_median0.0022344338320206916
set_robot_commands_min0.0021920648840047436
sim_compute_performance-ego0_max0.001987091222203764
sim_compute_performance-ego0_mean0.001963567084480644
sim_compute_performance-ego0_median0.001963567084480644
sim_compute_performance-ego0_min0.001940042946757524
sim_compute_sim_state_max0.01336365258266884
sim_compute_sim_state_mean0.012964859095837895
sim_compute_sim_state_median0.012964859095837895
sim_compute_sim_state_min0.012566065609006954
sim_render-ego0_max0.0037684530243837742
sim_render-ego0_mean0.003745148437046582
sim_render-ego0_median0.003745148437046582
sim_render-ego0_min0.0037218438497093895
simulation-passed1
step_physics_max0.13491565231093786
step_physics_mean0.12246264510514054
step_physics_median0.12246264510514054
step_physics_min0.11000963789934322
survival_time_max59.99999999999873
survival_time_mean46.59999999999949
survival_time_min33.20000000000025
No reset possible
5346812564Bea Baselines 🐤straightaido5-LFV-sim-validationLFVv-simsuccessyesgpu-prod-010:19:09
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6052853975330239
survival_time_median10.400000000000013
deviation-center-line_median0.33068119559683
in-drivable-lane_median6.4250000000000185


other stats
agent_compute-ego0_max0.010610285842526716
agent_compute-ego0_mean0.010270716015809448
agent_compute-ego0_median0.01025371871287038
agent_compute-ego0_min0.009965140794970325
agent_compute-npc0_max0.02601321999515806
agent_compute-npc0_mean0.022136278053042864
agent_compute-npc0_median0.021180621662146425
agent_compute-npc0_min0.02017064889272054
agent_compute-npc1_max0.04805171366819402
agent_compute-npc1_mean0.04314244867069947
agent_compute-npc1_median0.0473838428716285
agent_compute-npc1_min0.033991789472275886
agent_compute-npc2_max0.04422519718412186
agent_compute-npc2_mean0.037355136219048464
agent_compute-npc2_median0.03455660638120985
agent_compute-npc2_min0.03328360509181368
agent_compute-npc3_max0.04637265997710905
agent_compute-npc3_mean0.040773966538002755
agent_compute-npc3_median0.040773966538002755
agent_compute-npc3_min0.03517527309889646
complete-iteration_max1.123717958165198
complete-iteration_mean0.8082934591637303
complete-iteration_median0.9050270991080268
complete-iteration_min0.2994016802736691
deviation-center-line_max0.3928686233240577
deviation-center-line_mean0.30090564831821964
deviation-center-line_min0.14939157875516085
deviation-heading_max2.4882932462564837
deviation-heading_mean1.2598791665337652
deviation-heading_median0.9819032459436928
deviation-heading_min0.5874169279911909
driven_any_max2.5526814329726717
driven_any_mean1.6505206590139387
driven_any_median1.5456861375242053
driven_any_min0.958028928034673
driven_lanedir_consec_max0.7818318353273331
driven_lanedir_consec_mean0.6206463219842938
driven_lanedir_consec_min0.4901826575437944
driven_lanedir_max0.7818318353273331
driven_lanedir_mean0.6206463219842938
driven_lanedir_median0.6052853975330239
driven_lanedir_min0.4901826575437944
get_duckie_state_max1.3788950811956346e-06
get_duckie_state_mean1.2774125270267138e-06
get_duckie_state_median1.274120724656869e-06
get_duckie_state_min1.182513577597482e-06
get_robot_state_max0.017880987184645546
get_robot_state_mean0.014004831984379068
get_robot_state_median0.015498110821620066
get_robot_state_min0.007142119109630585
get_state_dump_max0.011065933999698328
get_state_dump_mean0.009281904833620774
get_state_dump_median0.010015358006528507
get_state_dump_min0.006030969321727753
get_ui_image_max0.05780784457111647
get_ui_image_mean0.04658590775566894
get_ui_image_median0.048016784749685806
get_ui_image_min0.032502216952187676
in-drivable-lane_max12.000000000000108
in-drivable-lane_mean6.6125000000000345
in-drivable-lane_min1.5999999999999943
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 0.958028928034673, "get_ui_image": 0.04366207986638166, "step_physics": 0.5059863553530928, "survival_time": 6.849999999999984, "driven_lanedir": 0.7818318353273331, "get_state_dump": 0.009221609087957851, "get_robot_state": 0.0136626440545787, "sim_render-ego0": 0.003774691319120103, "sim_render-npc0": 0.0035844643910725913, "sim_render-npc1": 0.0035876208457393923, "sim_render-npc2": 0.003873876903368079, "get_duckie_state": 1.2387400088102922e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 0.7131079805935505, "agent_compute-ego0": 0.01032604341921599, "agent_compute-npc0": 0.02017064889272054, "agent_compute-npc1": 0.033991789472275886, "agent_compute-npc2": 0.03328360509181368, "complete-iteration": 0.7283060360645902, "set_robot_commands": 0.0023565793382948723, "deviation-center-line": 0.14939157875516085, "driven_lanedir_consec": 0.7818318353273331, "sim_compute_sim_state": 0.02637067048445992, "sim_compute_performance-ego0": 0.001912861630536508, "sim_compute_performance-npc0": 0.0018501368121824405, "sim_compute_performance-npc1": 0.001851104307865751, "sim_compute_performance-npc2": 0.002005236736242322}, "LFV-norm-zigzag-000-ego0": {"driven_any": 2.5526814329726717, "get_ui_image": 0.05780784457111647, "step_physics": 0.721555601073896, "survival_time": 16.5000000000001, "driven_lanedir": 0.6655453555451283, "get_state_dump": 0.011065933999698328, "get_robot_state": 0.017880987184645546, "sim_render-ego0": 0.00390108690521148, "sim_render-npc0": 0.003733153069487511, "sim_render-npc1": 0.003836237051695855, "sim_render-npc2": 0.0037938496857611434, "sim_render-npc3": 0.003740940929539614, "get_duckie_state": 1.309501440503446e-06, "in-drivable-lane": 12.000000000000108, "deviation-heading": 1.2506985112938351, "agent_compute-ego0": 0.010610285842526716, "agent_compute-npc0": 0.021154109805012037, "agent_compute-npc1": 0.0473838428716285, "agent_compute-npc2": 0.04422519718412186, "agent_compute-npc3": 0.04637265997710905, "complete-iteration": 1.0817481621514635, "set_robot_commands": 0.0022636216212615504, "deviation-center-line": 0.3050692260162657, "driven_lanedir_consec": 0.6655453555451283, "sim_compute_sim_state": 0.06307344206150205, "sim_compute_performance-ego0": 0.002024566298885288, "sim_compute_performance-npc0": 0.001957415814126006, "sim_compute_performance-npc1": 0.0020291077766533706, "sim_compute_performance-npc2": 0.002037394082798338, "sim_compute_performance-npc3": 0.002023184047364757}, "LFV-norm-techtrack-000-ego0": {"driven_any": 1.4238275887832712, "get_ui_image": 0.052371489632989945, "step_physics": 0.7978557348251343, "survival_time": 9.650000000000002, "driven_lanedir": 0.5450254395209196, "get_state_dump": 0.010809106925099166, "get_robot_state": 0.01733357758866143, "sim_render-ego0": 0.003643574173917475, "sim_render-npc0": 0.0035257978537647995, "sim_render-npc1": 0.003603628001262232, "sim_render-npc2": 0.003596748273397229, "sim_render-npc3": 0.0035971550597357995, "get_duckie_state": 1.3788950811956346e-06, "in-drivable-lane": 5.0500000000000105, "deviation-heading": 2.4882932462564837, "agent_compute-ego0": 0.009965140794970325, "agent_compute-npc0": 0.021207133519280816, "agent_compute-npc1": 0.04805171366819402, "agent_compute-npc2": 0.03455660638120985, "agent_compute-npc3": 0.03517527309889646, "complete-iteration": 1.123717958165198, "set_robot_commands": 0.002204914682919217, "deviation-center-line": 0.3928686233240577, "driven_lanedir_consec": 0.5450254395209196, "sim_compute_sim_state": 0.05797915851946959, "sim_compute_performance-ego0": 0.0019114988366353144, "sim_compute_performance-npc0": 0.0018288978596323544, "sim_compute_performance-npc1": 0.0018895409770847596, "sim_compute_performance-npc2": 0.00189652393773659, "sim_compute_performance-npc3": 0.0019152483989282984}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.667544686265139, "get_ui_image": 0.032502216952187676, "step_physics": 0.19194073230028152, "survival_time": 11.150000000000023, "driven_lanedir": 0.4901826575437944, "get_state_dump": 0.006030969321727753, "get_robot_state": 0.007142119109630585, "sim_render-ego0": 0.003709217267377036, "sim_render-npc0": 0.0036296099424362183, "get_duckie_state": 1.182513577597482e-06, "in-drivable-lane": 7.800000000000027, "deviation-heading": 0.5874169279911909, "agent_compute-ego0": 0.010181394006524768, "agent_compute-npc0": 0.02601321999515806, "complete-iteration": 0.2994016802736691, "set_robot_commands": 0.0023194625973701477, "deviation-center-line": 0.35629316517739434, "driven_lanedir_consec": 0.4901826575437944, "sim_compute_sim_state": 0.009860706116471971, "sim_compute_performance-ego0": 0.0019197485276630944, "sim_compute_performance-npc0": 0.0018829490457262313}}
set_robot_commands_max0.0023565793382948723
set_robot_commands_mean0.002286144559961447
set_robot_commands_median0.002291542109315849
set_robot_commands_min0.002204914682919217
sim_compute_performance-ego0_max0.002024566298885288
sim_compute_performance-ego0_mean0.0019421688234300511
sim_compute_performance-ego0_median0.0019163050790998012
sim_compute_performance-ego0_min0.0019114988366353144
sim_compute_performance-npc0_max0.001957415814126006
sim_compute_performance-npc0_mean0.0018798498829167576
sim_compute_performance-npc0_median0.001866542928954336
sim_compute_performance-npc0_min0.0018288978596323544
sim_compute_performance-npc1_max0.0020291077766533706
sim_compute_performance-npc1_mean0.0019232510205346271
sim_compute_performance-npc1_median0.0018895409770847596
sim_compute_performance-npc1_min0.001851104307865751
sim_compute_performance-npc2_max0.002037394082798338
sim_compute_performance-npc2_mean0.0019797182522590835
sim_compute_performance-npc2_median0.002005236736242322
sim_compute_performance-npc2_min0.00189652393773659
sim_compute_performance-npc3_max0.002023184047364757
sim_compute_performance-npc3_mean0.0019692162231465275
sim_compute_performance-npc3_median0.0019692162231465275
sim_compute_performance-npc3_min0.0019152483989282984
sim_compute_sim_state_max0.06307344206150205
sim_compute_sim_state_mean0.03932099429547588
sim_compute_sim_state_median0.042174914501964755
sim_compute_sim_state_min0.009860706116471971
sim_render-ego0_max0.00390108690521148
sim_render-ego0_mean0.003757142416406524
sim_render-ego0_median0.003741954293248569
sim_render-ego0_min0.003643574173917475
sim_render-npc0_max0.003733153069487511
sim_render-npc0_mean0.00361825631419028
sim_render-npc0_median0.003607037166754405
sim_render-npc0_min0.0035257978537647995
sim_render-npc1_max0.003836237051695855
sim_render-npc1_mean0.00367582863289916
sim_render-npc1_median0.003603628001262232
sim_render-npc1_min0.0035876208457393923
sim_render-npc2_max0.003873876903368079
sim_render-npc2_mean0.003754824954175484
sim_render-npc2_median0.0037938496857611434
sim_render-npc2_min0.003596748273397229
sim_render-npc3_max0.003740940929539614
sim_render-npc3_mean0.003669047994637707
sim_render-npc3_median0.003669047994637707
sim_render-npc3_min0.0035971550597357995
simulation-passed1
step_physics_max0.7978557348251343
step_physics_mean0.5543346058881011
step_physics_median0.6137709782134944
step_physics_min0.19194073230028152
survival_time_max16.5000000000001
survival_time_mean11.037500000000026
survival_time_min6.849999999999984
No reset possible
5346312571Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simsuccessyesgpu-prod-010:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24868247149189004
survival_time_median5.449999999999989
deviation-center-line_median0.24738768645821865
in-drivable-lane_median2.749999999999992


other stats
agent_compute-ego0_max0.01064089115928201
agent_compute-ego0_mean0.010300815197705484
agent_compute-ego0_median0.010300815197705484
agent_compute-ego0_min0.009960739236128958
complete-iteration_max0.24315709226271687
complete-iteration_mean0.2275586459474298
complete-iteration_median0.2275586459474298
complete-iteration_min0.21196019963214272
deviation-center-line_max0.36460756442412073
deviation-center-line_mean0.24738768645821865
deviation-center-line_min0.13016780849231657
deviation-heading_max3.1433779487453775
deviation-heading_mean1.937210401851417
deviation-heading_median1.937210401851417
deviation-heading_min0.7310428549574565
driven_any_max1.070993885628117
driven_any_mean0.7262556777434203
driven_any_median0.7262556777434203
driven_any_min0.38151746985872353
driven_lanedir_consec_max0.3721924726930572
driven_lanedir_consec_mean0.24868247149189004
driven_lanedir_consec_min0.12517247029072287
driven_lanedir_max0.3721924726930572
driven_lanedir_mean0.24868247149189004
driven_lanedir_median0.24868247149189004
driven_lanedir_min0.12517247029072287
get_duckie_state_max1.1745621176326977e-06
get_duckie_state_mean1.1464667394065268e-06
get_duckie_state_median1.1464667394065268e-06
get_duckie_state_min1.1183713611803557e-06
get_robot_state_max0.0036641569698558137
get_robot_state_mean0.003586856481091526
get_robot_state_median0.003586856481091526
get_robot_state_min0.0035095559923272383
get_state_dump_max0.004471214378581327
get_state_dump_mean0.004388997521562842
get_state_dump_median0.004388997521562842
get_state_dump_min0.004306780664544357
get_ui_image_max0.03804170771649009
get_ui_image_mean0.038005979806646106
get_ui_image_median0.038005979806646106
get_ui_image_min0.037970251896802115
in-drivable-lane_max3.399999999999988
in-drivable-lane_mean2.749999999999992
in-drivable-lane_min2.0999999999999956
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.38151746985872353, "get_ui_image": 0.037970251896802115, "step_physics": 0.16872395136777094, "survival_time": 3.349999999999996, "driven_lanedir": 0.12517247029072287, "get_state_dump": 0.004471214378581327, "get_robot_state": 0.0036641569698558137, "sim_render-ego0": 0.003857058637282428, "get_duckie_state": 1.1745621176326977e-06, "in-drivable-lane": 2.0999999999999956, "deviation-heading": 0.7310428549574565, "agent_compute-ego0": 0.01064089115928201, "complete-iteration": 0.24315709226271687, "set_robot_commands": 0.0022146070704740636, "deviation-center-line": 0.13016780849231657, "driven_lanedir_consec": 0.12517247029072287, "sim_compute_sim_state": 0.009550049024469712, "sim_compute_performance-ego0": 0.001989620573380414}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.070993885628117, "get_ui_image": 0.03804170771649009, "step_physics": 0.13744348287582395, "survival_time": 7.549999999999981, "driven_lanedir": 0.3721924726930572, "get_state_dump": 0.004306780664544357, "get_robot_state": 0.0035095559923272383, "sim_render-ego0": 0.003680869152671412, "get_duckie_state": 1.1183713611803557e-06, "in-drivable-lane": 3.399999999999988, "deviation-heading": 3.1433779487453775, "agent_compute-ego0": 0.009960739236128958, "complete-iteration": 0.21196019963214272, "set_robot_commands": 0.002073400898983604, "deviation-center-line": 0.36460756442412073, "driven_lanedir_consec": 0.3721924726930572, "sim_compute_sim_state": 0.011002302169799805, "sim_compute_performance-ego0": 0.0018712313551651804}}
set_robot_commands_max0.0022146070704740636
set_robot_commands_mean0.002144003984728834
set_robot_commands_median0.002144003984728834
set_robot_commands_min0.002073400898983604
sim_compute_performance-ego0_max0.001989620573380414
sim_compute_performance-ego0_mean0.0019304259642727972
sim_compute_performance-ego0_median0.0019304259642727972
sim_compute_performance-ego0_min0.0018712313551651804
sim_compute_sim_state_max0.011002302169799805
sim_compute_sim_state_mean0.01027617559713476
sim_compute_sim_state_median0.01027617559713476
sim_compute_sim_state_min0.009550049024469712
sim_render-ego0_max0.003857058637282428
sim_render-ego0_mean0.00376896389497692
sim_render-ego0_median0.00376896389497692
sim_render-ego0_min0.003680869152671412
simulation-passed1
step_physics_max0.16872395136777094
step_physics_mean0.15308371712179747
step_physics_median0.15308371712179747
step_physics_min0.13744348287582395
survival_time_max7.549999999999981
survival_time_mean5.449999999999989
survival_time_min3.349999999999996
No reset possible
5345512571Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simsuccessyesgpu-prod-010:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24868247149189004
survival_time_median5.449999999999989
deviation-center-line_median0.24738768645821865
in-drivable-lane_median2.749999999999992


other stats
agent_compute-ego0_max0.010098026079290051
agent_compute-ego0_mean0.009934802634797228
agent_compute-ego0_median0.009934802634797228
agent_compute-ego0_min0.009771579190304403
complete-iteration_max0.2427702370811911
complete-iteration_mean0.224437777010649
complete-iteration_median0.224437777010649
complete-iteration_min0.20610531694010684
deviation-center-line_max0.36460756442412073
deviation-center-line_mean0.24738768645821865
deviation-center-line_min0.13016780849231657
deviation-heading_max3.1433779487453775
deviation-heading_mean1.937210401851417
deviation-heading_median1.937210401851417
deviation-heading_min0.7310428549574565
driven_any_max1.070993885628117
driven_any_mean0.7262556777434203
driven_any_median0.7262556777434203
driven_any_min0.38151746985872353
driven_lanedir_consec_max0.3721924726930572
driven_lanedir_consec_mean0.24868247149189004
driven_lanedir_consec_min0.12517247029072287
driven_lanedir_max0.3721924726930572
driven_lanedir_mean0.24868247149189004
driven_lanedir_median0.24868247149189004
driven_lanedir_min0.12517247029072287
get_duckie_state_max1.2611087999845806e-06
get_duckie_state_mean1.1950454475709898e-06
get_duckie_state_median1.1950454475709898e-06
get_duckie_state_min1.128982095157399e-06
get_robot_state_max0.003565826836754294
get_robot_state_mean0.0035269241491707485
get_robot_state_median0.0035269241491707485
get_robot_state_min0.0034880214615872034
get_state_dump_max0.004392907899968764
get_state_dump_mean0.004317725221439042
get_state_dump_median0.004317725221439042
get_state_dump_min0.004242542542909321
get_ui_image_max0.03797212769003475
get_ui_image_mean0.03791949651189633
get_ui_image_median0.03791949651189633
get_ui_image_min0.0378668653337579
in-drivable-lane_max3.399999999999988
in-drivable-lane_mean2.749999999999992
in-drivable-lane_min2.0999999999999956
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.38151746985872353, "get_ui_image": 0.03797212769003475, "step_physics": 0.1694219427950242, "survival_time": 3.349999999999996, "driven_lanedir": 0.12517247029072287, "get_state_dump": 0.004392907899968764, "get_robot_state": 0.003565826836754294, "sim_render-ego0": 0.003717909840976491, "get_duckie_state": 1.128982095157399e-06, "in-drivable-lane": 2.0999999999999956, "deviation-heading": 0.7310428549574565, "agent_compute-ego0": 0.010098026079290051, "complete-iteration": 0.2427702370811911, "set_robot_commands": 0.002150111338671516, "deviation-center-line": 0.13016780849231657, "driven_lanedir_consec": 0.12517247029072287, "sim_compute_sim_state": 0.00946055440341725, "sim_compute_performance-ego0": 0.001919392277212704}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.070993885628117, "get_ui_image": 0.0378668653337579, "step_physics": 0.13235020480657878, "survival_time": 7.549999999999981, "driven_lanedir": 0.3721924726930572, "get_state_dump": 0.004242542542909321, "get_robot_state": 0.0034880214615872034, "sim_render-ego0": 0.0036024717908156546, "get_duckie_state": 1.2611087999845806e-06, "in-drivable-lane": 3.399999999999988, "deviation-heading": 3.1433779487453775, "agent_compute-ego0": 0.009771579190304403, "complete-iteration": 0.20610531694010684, "set_robot_commands": 0.002032300359324405, "deviation-center-line": 0.36460756442412073, "driven_lanedir_consec": 0.3721924726930572, "sim_compute_sim_state": 0.01082608888023778, "sim_compute_performance-ego0": 0.001852615883475856}}
set_robot_commands_max0.002150111338671516
set_robot_commands_mean0.0020912058489979605
set_robot_commands_median0.0020912058489979605
set_robot_commands_min0.002032300359324405
sim_compute_performance-ego0_max0.001919392277212704
sim_compute_performance-ego0_mean0.00188600408034428
sim_compute_performance-ego0_median0.00188600408034428
sim_compute_performance-ego0_min0.001852615883475856
sim_compute_sim_state_max0.01082608888023778
sim_compute_sim_state_mean0.010143321641827517
sim_compute_sim_state_median0.010143321641827517
sim_compute_sim_state_min0.00946055440341725
sim_render-ego0_max0.003717909840976491
sim_render-ego0_mean0.0036601908158960727
sim_render-ego0_median0.0036601908158960727
sim_render-ego0_min0.0036024717908156546
simulation-passed1
step_physics_max0.1694219427950242
step_physics_mean0.1508860738008015
step_physics_median0.1508860738008015
step_physics_min0.13235020480657878
survival_time_max7.549999999999981
survival_time_mean5.449999999999989
survival_time_min3.349999999999996
No reset possible
5344712573Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simsuccessyesgpu-prod-010:05:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.35959333685918304
survival_time_median8.350000000000007
deviation-center-line_median0.2261906350607423
in-drivable-lane_median5.875000000000008


other stats
agent_compute-ego0_max0.010393899515134478
agent_compute-ego0_mean0.010059070665222896
agent_compute-ego0_median0.010083848751849766
agent_compute-ego0_min0.009674685642057578
complete-iteration_max0.20031852264926855
complete-iteration_mean0.1767893979108904
complete-iteration_median0.17622560841273732
complete-iteration_min0.1543878521688184
deviation-center-line_max0.5984483202592711
deviation-center-line_mean0.31118892336036647
deviation-center-line_min0.19392610306071012
deviation-heading_max4.0769899671818495
deviation-heading_mean1.57688930557195
deviation-heading_median0.8334481996955507
deviation-heading_min0.5636708557148487
driven_any_max2.5717141011638973
driven_any_mean1.3551824827329972
driven_any_median1.2122466169445325
driven_any_min0.42452259587902746
driven_lanedir_consec_max0.7161257015455706
driven_lanedir_consec_mean0.4220615992587029
driven_lanedir_consec_min0.25293402177087465
driven_lanedir_max0.7161257015455706
driven_lanedir_mean0.4220615992587029
driven_lanedir_median0.35959333685918304
driven_lanedir_min0.25293402177087465
get_duckie_state_max1.2247529748367936e-06
get_duckie_state_mean1.0886557069830932e-06
get_duckie_state_median1.0534771064092585e-06
get_duckie_state_min1.022915640277063e-06
get_robot_state_max0.0036265543841440743
get_robot_state_mean0.003541746920838176
get_robot_state_median0.0035366844407219095
get_robot_state_min0.003467064417764812
get_state_dump_max0.004581954501090793
get_state_dump_mean0.004416229739441369
get_state_dump_median0.004431805450377758
get_state_dump_min0.004219353555919168
get_ui_image_max0.03561992059924645
get_ui_image_mean0.030467948583725313
get_ui_image_median0.03020549526133099
get_ui_image_min0.0258408832129928
in-drivable-lane_max10.250000000000092
in-drivable-lane_mean5.837500000000026
in-drivable-lane_min1.3499999999999952
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.7231257230208944, "get_ui_image": 0.02797936518257911, "step_physics": 0.10600579987972154, "survival_time": 5.399999999999989, "driven_lanedir": 0.4200152326848219, "get_state_dump": 0.004581954501090793, "get_robot_state": 0.0036265543841440743, "sim_render-ego0": 0.0038451120394085527, "get_duckie_state": 1.0608533106812645e-06, "in-drivable-lane": 2.3999999999999915, "deviation-heading": 0.9048776390607218, "agent_compute-ego0": 0.010393899515134478, "complete-iteration": 0.16771494357957753, "set_robot_commands": 0.002205710892283588, "deviation-center-line": 0.2301254112858052, "driven_lanedir_consec": 0.4200152326848219, "sim_compute_sim_state": 0.006991108623119669, "sim_compute_performance-ego0": 0.0020103323350258925}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.5717141011638973, "get_ui_image": 0.03561992059924645, "step_physics": 0.11270696388747165, "survival_time": 16.6500000000001, "driven_lanedir": 0.7161257015455706, "get_state_dump": 0.004219353555919168, "get_robot_state": 0.003467064417764812, "sim_render-ego0": 0.003624249361232369, "get_duckie_state": 1.022915640277063e-06, "in-drivable-lane": 10.250000000000092, "deviation-heading": 4.0769899671818495, "agent_compute-ego0": 0.009850946729054708, "complete-iteration": 0.18473627324589711, "set_robot_commands": 0.002005557814044153, "deviation-center-line": 0.5984483202592711, "driven_lanedir_consec": 0.7161257015455706, "sim_compute_sim_state": 0.011349406784879949, "sim_compute_performance-ego0": 0.001827926692848434}, "LF-norm-techtrack-000-ego0": {"driven_any": 0.42452259587902746, "get_ui_image": 0.03243162534008288, "step_physics": 0.13117539392758723, "survival_time": 3.599999999999995, "driven_lanedir": 0.2991714410335442, "get_state_dump": 0.00449574156983258, "get_robot_state": 0.003594698971264983, "sim_render-ego0": 0.0037873738432583743, "get_duckie_state": 1.2247529748367936e-06, "in-drivable-lane": 1.3499999999999952, "deviation-heading": 0.7620187603303796, "agent_compute-ego0": 0.010316750774644824, "complete-iteration": 0.20031852264926855, "set_robot_commands": 0.00210551039813316, "deviation-center-line": 0.19392610306071012, "driven_lanedir_consec": 0.2991714410335442, "sim_compute_sim_state": 0.010403185674588974, "sim_compute_performance-ego0": 0.0019360895026220037}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7013675108681705, "get_ui_image": 0.0258408832129928, "step_physics": 0.09701033835894211, "survival_time": 11.300000000000026, "driven_lanedir": 0.25293402177087465, "get_state_dump": 0.004367869330922937, "get_robot_state": 0.0034786699101788357, "sim_render-ego0": 0.003615475961290267, "get_duckie_state": 1.0461009021372525e-06, "in-drivable-lane": 9.350000000000025, "deviation-heading": 0.5636708557148487, "agent_compute-ego0": 0.009674685642057578, "complete-iteration": 0.1543878521688184, "set_robot_commands": 0.002034821699369321, "deviation-center-line": 0.22225585883567944, "driven_lanedir_consec": 0.25293402177087465, "sim_compute_sim_state": 0.00646758814740286, "sim_compute_performance-ego0": 0.001832455790515513}}
set_robot_commands_max0.002205710892283588
set_robot_commands_mean0.0020879002009575555
set_robot_commands_median0.002070166048751241
set_robot_commands_min0.002005557814044153
sim_compute_performance-ego0_max0.0020103323350258925
sim_compute_performance-ego0_mean0.0019017010802529603
sim_compute_performance-ego0_median0.0018842726465687584
sim_compute_performance-ego0_min0.001827926692848434
sim_compute_sim_state_max0.011349406784879949
sim_compute_sim_state_mean0.008802822307497862
sim_compute_sim_state_median0.008697147148854322
sim_compute_sim_state_min0.00646758814740286
sim_render-ego0_max0.0038451120394085527
sim_render-ego0_mean0.0037180528012973903
sim_render-ego0_median0.003705811602245371
sim_render-ego0_min0.003615475961290267
simulation-passed1
step_physics_max0.13117539392758723
step_physics_mean0.11172462401343064
step_physics_median0.1093563818835966
step_physics_min0.09701033835894211
survival_time_max16.6500000000001
survival_time_mean9.23750000000003
survival_time_min3.599999999999995
No reset possible
5343912576Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simsuccessyesgpu-prod-010:11:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.57719292024425
survival_time_median11.15000000000006
deviation-center-line_median0.49998082892113976
in-drivable-lane_median6.2000000000000535


other stats
agent_compute-ego0_max0.010239107063017696
agent_compute-ego0_mean0.00987357786729167
agent_compute-ego0_median0.00987357786729167
agent_compute-ego0_min0.009508048671565643
agent_compute-npc0_max0.04211459389652114
agent_compute-npc0_mean0.04211163733693746
agent_compute-npc0_median0.04211163733693746
agent_compute-npc0_min0.04210868077735378
agent_compute-npc1_max0.04179847671324948
agent_compute-npc1_mean0.039730236986364575
agent_compute-npc1_median0.039730236986364575
agent_compute-npc1_min0.03766199725947968
agent_compute-npc2_max0.0409510710153235
agent_compute-npc2_mean0.03631628080649155
agent_compute-npc2_median0.03631628080649155
agent_compute-npc2_min0.031681490597659595
complete-iteration_max1.0469188546559898
complete-iteration_mean1.0071235744959846
complete-iteration_median1.0071235744959846
complete-iteration_min0.9673282943359792
deviation-center-line_max0.880854907567805
deviation-center-line_mean0.49998082892113976
deviation-center-line_min0.11910675027447444
deviation-heading_max2.497198994678309
deviation-heading_mean1.7143984686681213
deviation-heading_median1.7143984686681213
deviation-heading_min0.9315979426579334
driven_any_max2.836260992045463
driven_any_mean1.67123286605405
driven_any_median1.67123286605405
driven_any_min0.5062047400626375
driven_lanedir_consec_max0.980436367760506
driven_lanedir_consec_mean0.57719292024425
driven_lanedir_consec_min0.17394947272799377
driven_lanedir_max1.160056111801557
driven_lanedir_mean0.6670027922647754
driven_lanedir_median0.6670027922647754
driven_lanedir_min0.17394947272799377
get_duckie_state_max1.189480089161494e-06
get_duckie_state_mean1.1792964403297585e-06
get_duckie_state_median1.1792964403297585e-06
get_duckie_state_min1.1691127914980233e-06
get_robot_state_max0.013915173978690642
get_robot_state_mean0.013838764251429448
get_robot_state_median0.013838764251429448
get_robot_state_min0.01376235452416825
get_state_dump_max0.009300197463437736
get_state_dump_mean0.009199229080028948
get_state_dump_median0.009199229080028948
get_state_dump_min0.009098260696620158
get_ui_image_max0.054568602940807606
get_ui_image_mean0.05379729054906342
get_ui_image_median0.05379729054906342
get_ui_image_min0.05302597815731922
in-drivable-lane_max9.900000000000114
in-drivable-lane_mean6.2000000000000535
in-drivable-lane_min2.499999999999993
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 2.836260992045463, "get_ui_image": 0.054568602940807606, "step_physics": 0.6964747572598392, "survival_time": 18.200000000000124, "driven_lanedir": 1.160056111801557, "get_state_dump": 0.009098260696620158, "get_robot_state": 0.01376235452416825, "sim_render-ego0": 0.0035659548354475467, "sim_render-npc0": 0.003491753094816861, "sim_render-npc1": 0.004074029399924082, "sim_render-npc2": 0.004110451920391762, "get_duckie_state": 1.189480089161494e-06, "in-drivable-lane": 9.900000000000114, "deviation-heading": 2.497198994678309, "agent_compute-ego0": 0.009508048671565643, "agent_compute-npc0": 0.04210868077735378, "agent_compute-npc1": 0.03766199725947968, "agent_compute-npc2": 0.031681490597659595, "complete-iteration": 0.9673282943359792, "set_robot_commands": 0.0026540331644554663, "deviation-center-line": 0.880854907567805, "driven_lanedir_consec": 0.980436367760506, "sim_compute_sim_state": 0.03968930440406277, "sim_compute_performance-ego0": 0.001858790933269344, "sim_compute_performance-npc0": 0.0018148481029353729, "sim_compute_performance-npc1": 0.0018423413577145092, "sim_compute_performance-npc2": 0.0018854774840890544}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.5062047400626375, "get_ui_image": 0.05302597815731922, "step_physics": 0.7579879502216017, "survival_time": 4.099999999999993, "driven_lanedir": 0.17394947272799377, "get_state_dump": 0.009300197463437736, "get_robot_state": 0.013915173978690642, "sim_render-ego0": 0.00377256037241005, "sim_render-npc0": 0.003585726381784462, "sim_render-npc1": 0.004100609974688794, "sim_render-npc2": 0.004036188125610352, "get_duckie_state": 1.1691127914980233e-06, "in-drivable-lane": 2.499999999999993, "deviation-heading": 0.9315979426579334, "agent_compute-ego0": 0.010239107063017696, "agent_compute-npc0": 0.04211459389652114, "agent_compute-npc1": 0.04179847671324948, "agent_compute-npc2": 0.0409510710153235, "complete-iteration": 1.0469188546559898, "set_robot_commands": 0.002441254006810935, "deviation-center-line": 0.11910675027447444, "driven_lanedir_consec": 0.17394947272799377, "sim_compute_sim_state": 0.04435352532260389, "sim_compute_performance-ego0": 0.0019281599895063651, "sim_compute_performance-npc0": 0.0018458711095603116, "sim_compute_performance-npc1": 0.0021241486790668533, "sim_compute_performance-npc2": 0.0021153128290750892}}
set_robot_commands_max0.0026540331644554663
set_robot_commands_mean0.0025476435856332004
set_robot_commands_median0.0025476435856332004
set_robot_commands_min0.002441254006810935
sim_compute_performance-ego0_max0.0019281599895063651
sim_compute_performance-ego0_mean0.0018934754613878545
sim_compute_performance-ego0_median0.0018934754613878545
sim_compute_performance-ego0_min0.001858790933269344
sim_compute_performance-npc0_max0.0018458711095603116
sim_compute_performance-npc0_mean0.0018303596062478424
sim_compute_performance-npc0_median0.0018303596062478424
sim_compute_performance-npc0_min0.0018148481029353729
sim_compute_performance-npc1_max0.0021241486790668533
sim_compute_performance-npc1_mean0.001983245018390681
sim_compute_performance-npc1_median0.001983245018390681
sim_compute_performance-npc1_min0.0018423413577145092
sim_compute_performance-npc2_max0.0021153128290750892
sim_compute_performance-npc2_mean0.002000395156582072
sim_compute_performance-npc2_median0.002000395156582072
sim_compute_performance-npc2_min0.0018854774840890544
sim_compute_sim_state_max0.04435352532260389
sim_compute_sim_state_mean0.04202141486333333
sim_compute_sim_state_median0.04202141486333333
sim_compute_sim_state_min0.03968930440406277
sim_render-ego0_max0.00377256037241005
sim_render-ego0_mean0.0036692576039287985
sim_render-ego0_median0.0036692576039287985
sim_render-ego0_min0.0035659548354475467
sim_render-npc0_max0.003585726381784462
sim_render-npc0_mean0.003538739738300662
sim_render-npc0_median0.003538739738300662
sim_render-npc0_min0.003491753094816861
sim_render-npc1_max0.004100609974688794
sim_render-npc1_mean0.004087319687306438
sim_render-npc1_median0.004087319687306438
sim_render-npc1_min0.004074029399924082
sim_render-npc2_max0.004110451920391762
sim_render-npc2_mean0.004073320023001057
sim_render-npc2_median0.004073320023001057
sim_render-npc2_min0.004036188125610352
simulation-passed1
step_physics_max0.7579879502216017
step_physics_mean0.7272313537407205
step_physics_median0.7272313537407205
step_physics_min0.6964747572598392
survival_time_max18.200000000000124
survival_time_mean11.15000000000006
survival_time_min4.099999999999993
No reset possible
5343112570Bea Baselines 🐤straightaido5-LFI-sim-validationLFVIv-simsuccessyesgpu-prod-010:02:59
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.24868247149189004
survival_time_median5.449999999999989
deviation-center-line_median0.24738768645821865
in-drivable-lane_median2.749999999999992


other stats
agent_compute-ego0_max0.014319234034594367
agent_compute-ego0_mean0.012109893348194864
agent_compute-ego0_median0.012109893348194864
agent_compute-ego0_min0.009900552661795363
complete-iteration_max0.2559530699954313
complete-iteration_mean0.2329666338192051
complete-iteration_median0.2329666338192051
complete-iteration_min0.20998019764297887
deviation-center-line_max0.36460756442412073
deviation-center-line_mean0.24738768645821865
deviation-center-line_min0.13016780849231657
deviation-heading_max3.1433779487453775
deviation-heading_mean1.937210401851417
deviation-heading_median1.937210401851417
deviation-heading_min0.7310428549574565
driven_any_max1.070993885628117
driven_any_mean0.7262556777434203
driven_any_median0.7262556777434203
driven_any_min0.38151746985872353
driven_lanedir_consec_max0.3721924726930572
driven_lanedir_consec_mean0.24868247149189004
driven_lanedir_consec_min0.12517247029072287
driven_lanedir_max0.3721924726930572
driven_lanedir_mean0.24868247149189004
driven_lanedir_median0.24868247149189004
driven_lanedir_min0.12517247029072287
get_duckie_state_max1.1885867399327895e-06
get_duckie_state_mean1.1448520624969765e-06
get_duckie_state_median1.1448520624969765e-06
get_duckie_state_min1.1011173850611636e-06
get_robot_state_max0.0035832769730511833
get_robot_state_mean0.0035360640970176953
get_robot_state_median0.0035360640970176953
get_robot_state_min0.003488851220984208
get_state_dump_max0.004397115286658792
get_state_dump_mean0.004305326947855875
get_state_dump_median0.004305326947855875
get_state_dump_min0.004213538609052959
get_ui_image_max0.03908970075495103
get_ui_image_mean0.03875323456507349
get_ui_image_median0.03875323456507349
get_ui_image_min0.038416768375195955
in-drivable-lane_max3.399999999999988
in-drivable-lane_mean2.749999999999992
in-drivable-lane_min2.0999999999999956
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 0.38151746985872353, "get_ui_image": 0.03908970075495103, "step_physics": 0.1770475611967199, "survival_time": 3.349999999999996, "driven_lanedir": 0.12517247029072287, "get_state_dump": 0.004397115286658792, "get_robot_state": 0.0035832769730511833, "sim_render-ego0": 0.003703576676985797, "get_duckie_state": 1.1885867399327895e-06, "in-drivable-lane": 2.0999999999999956, "deviation-heading": 0.7310428549574565, "agent_compute-ego0": 0.014319234034594367, "complete-iteration": 0.2559530699954313, "set_robot_commands": 0.0020792238852557015, "deviation-center-line": 0.13016780849231657, "driven_lanedir_consec": 0.12517247029072287, "sim_compute_sim_state": 0.00968102497213027, "sim_compute_performance-ego0": 0.0019751576816334445}, "LFI-norm-udem1-000-ego0": {"driven_any": 1.070993885628117, "get_ui_image": 0.038416768375195955, "step_physics": 0.13547141457858838, "survival_time": 7.549999999999981, "driven_lanedir": 0.3721924726930572, "get_state_dump": 0.004213538609052959, "get_robot_state": 0.003488851220984208, "sim_render-ego0": 0.003607588379006637, "get_duckie_state": 1.1011173850611636e-06, "in-drivable-lane": 3.399999999999988, "deviation-heading": 3.1433779487453775, "agent_compute-ego0": 0.009900552661795363, "complete-iteration": 0.20998019764297887, "set_robot_commands": 0.002008590259050068, "deviation-center-line": 0.36460756442412073, "driven_lanedir_consec": 0.3721924726930572, "sim_compute_sim_state": 0.010971737535376298, "sim_compute_performance-ego0": 0.0018271113696851228}}
set_robot_commands_max0.0020792238852557015
set_robot_commands_mean0.002043907072152885
set_robot_commands_median0.002043907072152885
set_robot_commands_min0.002008590259050068
sim_compute_performance-ego0_max0.0019751576816334445
sim_compute_performance-ego0_mean0.0019011345256592835
sim_compute_performance-ego0_median0.0019011345256592835
sim_compute_performance-ego0_min0.0018271113696851228
sim_compute_sim_state_max0.010971737535376298
sim_compute_sim_state_mean0.010326381253753285
sim_compute_sim_state_median0.010326381253753285
sim_compute_sim_state_min0.00968102497213027
sim_render-ego0_max0.003703576676985797
sim_render-ego0_mean0.003655582527996217
sim_render-ego0_median0.003655582527996217
sim_render-ego0_min0.003607588379006637
simulation-passed1
step_physics_max0.1770475611967199
step_physics_mean0.15625948788765415
step_physics_median0.15625948788765415
step_physics_min0.13547141457858838
survival_time_max7.549999999999981
survival_time_mean5.449999999999989
survival_time_min3.349999999999996
No reset possible
5341211122Olga (Ge Ya) Xu 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simabortednogpu-prod-010:01:17
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5339212565Bea Baselines 🐤straightaido5-LFI-full-sim-testingLFVIv-simabortednogpu-prod-010:00:55
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5336812622Bea Baselines 🐤baseline-duckietownaido5-LFVI_multi-sim-validationLFVIv-simabortednogpu-prod-010:48:01
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5335512607Bea Baselines 🐤template-randomaido5-LFVI_multi-sim-validationLFVIv-simabortednogpu-prod-010:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5335012563Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simabortednogpu-prod-010:00:41
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5331211410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simabortednogpu-prod-010:15:14
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5328912487Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simabortednogpu-prod-010:19:52
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5328512545Bea Baselines 🐤template-rosaido5-LFVI-sim-validationLFVIv-simabortednogpu-prod-010:00:38
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5326612543Bea Baselines 🐤template-rosaido5-LF-sim-testingLFt-simabortednogpu-prod-010:00:46
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5322012478Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simabortednogpu-prod-010:09:42
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5320512481Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simerrornogpu-prod-010:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139640956152080
- M:video_aido:cmdline(in:/;out:/) 139640956867776
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5319312487Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simerrornogpu-prod-010:05:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140572882432640
- M:video_aido:cmdline(in:/;out:/) 140572883691888
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5318612447Bea Baselines 🐤template-tensorflowaido5-LFP-sim-testingLFP-simerrornogpu-prod-010:01:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139900403086240
- M:video_aido:cmdline(in:/;out:/) 139900403102480
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5316912448Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornogpu-prod-010:04:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139780328695504
- M:video_aido:cmdline(in:/;out:/) 139780327330912
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5316512451Bea Baselines 🐤template-tensorflowaido5-LFI-sim-testingLFVIv-simerrornogpu-prod-010:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139962926091808
- M:video_aido:cmdline(in:/;out:/) 139962926061936
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5315812452Bea Baselines 🐤template-tensorflowaido5-LFI-full-sim-validationLFVIv-simerrornogpu-prod-010:01:52
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140127866393936
- M:video_aido:cmdline(in:/;out:/) 140127866394896
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5314812453Bea Baselines 🐤template-tensorflowaido5-LF-sim-testingLFt-simerrornogpu-prod-010:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139852919764256
- M:video_aido:cmdline(in:/;out:/) 139852919766416
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5312412455Bea Baselines 🐤template-tensorflowaido5-LFVI-sim-validationLFVIv-simerrornogpu-prod-010:05:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140711570797376
- M:video_aido:cmdline(in:/;out:/) 140711571896112
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5310312456Bea Baselines 🐤template-tensorflowaido5-LFVI-sim-testingLFVIt-simerrornogpu-prod-010:04:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139733210368128
- M:video_aido:cmdline(in:/;out:/) 139733210369568
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5308812460Bea Baselines 🐤template-pytorchaido5-LFI-full-sim-testingLFVIv-simerrornogpu-prod-010:01:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140217728001072
- M:video_aido:cmdline(in:/;out:/) 140217729180816
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5306912460Bea Baselines 🐤template-pytorchaido5-LFI-full-sim-testingLFVIv-simerrornogpu-prod-010:01:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140332555238128
- M:video_aido:cmdline(in:/;out:/) 140332555237120
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5301812464Bea Baselines 🐤template-pytorchaido5-LFV_multi-sim-testingLFVmultibodyv-simerrornogpu-prod-010:33:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139655331285504
- M:video_aido:cmdline(in:/;out:/) 139655331415184
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5301412465Bea Baselines 🐤template-pytorchaido5-LFI-sim-validationLFVIv-simerrornogpu-prod-010:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140651508929296
- M:video_aido:cmdline(in:/;out:/) 140651508930976
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5300712466Bea Baselines 🐤template-pytorchaido5-LFI-sim-testingLFVIv-simerrornogpu-prod-010:02:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140432422181520
- M:video_aido:cmdline(in:/;out:/) 140432422181280
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5300412467Bea Baselines 🐤template-pytorchaido5-LFI-full-sim-validationLFVIv-simerrornogpu-prod-010:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139838185223120
- M:video_aido:cmdline(in:/;out:/) 139838185222736
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5299112468Bea Baselines 🐤template-pytorchaido5-LF-sim-testingLFt-simerrornogpu-prod-010:04:11
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140599978398528
- M:video_aido:cmdline(in:/;out:/) 140599978401600
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5292112470Bea Baselines 🐤template-pytorchaido5-LFVI-sim-validationLFVIv-simerrornogpu-prod-010:09:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140129236772176
- M:video_aido:cmdline(in:/;out:/) 140129238112720
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5286211410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simerrornogpu-prod-010:09:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140068171582432
- M:video_aido:cmdline(in:/;out:/) 140068171416768
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5284612430Bea Baselines 🐤straightaido5-LFI-full-sim-testingLFVIv-simabortednogpu-prod-010:00:36
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5282712436Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simerrornogpu-prod-010:01:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140154372331072
- M:video_aido:cmdline(in:/;out:/) 140154372329728
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5280912440Bea Baselines 🐤straightaido5-LFVI-sim-validationLFVIv-simerrornogpu-prod-010:02:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139916022253216
- M:video_aido:cmdline(in:/;out:/) 139916021301696
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5280412427Bea Baselines 🐤template-tensorflowaido5-LFVI_multi-sim-validationLFVIv-simabortednogpu-prod-010:00:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5277212223Bea Baselines 🐤straightaido5-LFI-sim-validationLFVIv-simerrornogpu-prod-010:02:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140173428258464
- M:video_aido:cmdline(in:/;out:/) 140178317132320
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5275812397Bea Baselines 🐤baseline-duckietownaido5-LFVI_multi-sim-validationLFVIv-simabortednogpu-prod-010:00:43
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5273812348Bea Baselines 🐤template-rosaido5-LF-sim-testingLFt-simerrornogpu-prod-010:02:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139847598631904
- M:video_aido:cmdline(in:/;out:/) 139847598632864
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5266311772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednogpu-prod-010:00:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5265911772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednogpu-prod-010:03:59
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
526376760Anthony Courchesne 🇨🇦template-rosaido5-LF-sim-validationLFv-simfailednogpu-prod-010:02:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525546814Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:11:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140210736758544
- M:video_aido:cmdline(in:/;out:/) 140210736755472
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525256828Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140393315890176
- M:video_aido:cmdline(in:/;out:/) 140393211424480
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524786849Daniil Lisusexercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:07:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140713054932896
- M:video_aido:cmdline(in:/;out:/) 140713054098912
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524489286Liam Paull 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednogpu-prod-010:02:59
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 3 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524359660Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:02:04
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140082762213888
- M:video_aido:cmdline(in:/;out:/) 140082762213504
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5233411681Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornogpu-prod-010:08:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139830560157600
- M:video_aido:cmdline(in:/;out:/) 139830560168928
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
522559360Francois Hebertexercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:07:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140683450693760
- M:video_aido:cmdline(in:/;out:/) 140683450691696
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5216510004Mo Kleit 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornogpu-prod-010:08:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140005476019648
- M:video_aido:cmdline(in:/;out:/) 140005475947616
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5211210014Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornogpu-prod-010:07:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140244499385360
- M:video_aido:cmdline(in:/;out:/) 140244499383968
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5208110066Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:04:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140101684441296
- M:video_aido:cmdline(in:/;out:/) 140101684542096
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5202910036Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornogpu-prod-010:07:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140337143624320
- M:video_aido:cmdline(in:/;out:/) 140337143641328
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5196610723Dishank Bansal 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:08:49
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140251513389600
- M:video_aido:cmdline(in:/;out:/) 140251513315088
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5192510071Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailednogpu-prod-010:02:53
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5189310363Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:01:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140039930879328
- M:video_aido:cmdline(in:/;out:/) 140039930676560
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5185710743Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornogpu-prod-010:03:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140355024399232
- M:video_aido:cmdline(in:/;out:/) 140355024080272
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5183410718Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailednogpu-prod-010:02:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5178710744Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:05:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139781206786400
- M:video_aido:cmdline(in:/;out:/) 139781206895344
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5171710788Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:07:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140426778885376
- M:video_aido:cmdline(in:/;out:/) 140426777052256
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5167610792Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:03:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139810787482544
- M:video_aido:cmdline(in:/;out:/) 139810787265360
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5155610858Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simerrornogpu-prod-010:12:09
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140078481339824
- M:video_aido:cmdline(in:/;out:/) 140078481340832
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5153311010Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednogpu-prod-010:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5144910859Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:07:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139714061625232
- M:video_aido:cmdline(in:/;out:/) 139714061626384
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5137010889Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:08:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140066576487136
- M:video_aido:cmdline(in:/;out:/) 140066575104560
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5130710896Dishank Bansal 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:04:48
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140365122100528
- M:video_aido:cmdline(in:/;out:/) 140365122100864
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5127910914Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simerrornogpu-prod-010:04:03
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140480807799152
- M:video_aido:cmdline(in:/;out:/) 140480807800256
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5124110933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednogpu-prod-010:01:33
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5112710942Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:11:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140122974791136
- M:video_aido:cmdline(in:/;out:/) 140122974792144
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5109811012Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednogpu-prod-010:01:28
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5101610978Philippe Reddy 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornogpu-prod-010:08:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140282829376528
- M:video_aido:cmdline(in:/;out:/) 140282829210000
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5096610990Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:03:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140468157805664
- M:video_aido:cmdline(in:/;out:/) 140464347970864
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5089411018Olga (Ge Ya) Xu 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:09:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140602030503008
- M:video_aido:cmdline(in:/;out:/) 140602030504112
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5083211065Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornogpu-prod-010:06:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139654333290096
- M:video_aido:cmdline(in:/;out:/) 139654333289808
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5076811075Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornogpu-prod-010:06:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139896900087424
- M:video_aido:cmdline(in:/;out:/) 139896900086368
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5068211089Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornogpu-prod-010:02:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140393492844160
- M:video_aido:cmdline(in:/;out:/) 140393495267360
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5060111125Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailednogpu-prod-010:04:23
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5054511305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailednogpu-prod-010:03:06
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 70, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 67, in compute_action
              ||     return action.astype(float)
              || AttributeError: 'Tensor' object has no attribute 'astype'
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5043211300Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simtimeoutnogpu-prod-010:11:58
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5037811145Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailednogpu-prod-010:06:07
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5014111290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simtimeoutnogpu-prod-010:22:17
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5009811317Marco Calì 🇮🇹template-randomaido5-LF-sim-validationLFv-simerrornogpu-prod-010:02:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139970008533648
- M:video_aido:cmdline(in:/;out:/) 139970008534176
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5002211308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simerrornogpu-prod-010:06:44
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140650256734960
- M:video_aido:cmdline(in:/;out:/) 140650256734720
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4997111338Daniel Ng 🇸🇬template-randomaido5-LF-sim-validationLFv-simerrornogpu-prod-010:05:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139635692071952
- M:video_aido:cmdline(in:/;out:/) 139635692069552
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4990711375Charlie Gauthier 🇨🇦template-rpl-rosaido5-LF-sim-validationLFv-simerrornogpu-prod-010:08:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140711410657696
- M:video_aido:cmdline(in:/;out:/) 140711410677360
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4979011439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simerrornogpu-prod-010:13:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139744750888752
- M:video_aido:cmdline(in:/;out:/) 139744750890240
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4970911453Cliff Chandler 🇺🇸baseline-duckietownaido5-LF-sim-validationLFv-simerrornogpu-prod-010:08:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140170518652912
- M:video_aido:cmdline(in:/;out:/) 140170518563616
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4965611501Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornogpu-prod-010:08:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140652583164176
- M:video_aido:cmdline(in:/;out:/) 140652583178832
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4959711542Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornogpu-prod-010:08:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140464846847856
- M:video_aido:cmdline(in:/;out:/) 140464846739344
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4950411574Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simerrornogpu-prod-010:11:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140218433303648
- M:video_aido:cmdline(in:/;out:/) 140218433305568
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4943111629Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornogpu-prod-010:08:24
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140484116938128
- M:video_aido:cmdline(in:/;out:/) 140484116815392
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4939311605Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornogpu-prod-010:03:13
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140701266112464
- M:video_aido:cmdline(in:/;out:/) 140701266108576
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4932011635Philippe Reddy 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornogpu-prod-010:09:21
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139747279941440
- M:video_aido:cmdline(in:/;out:/) 139747279951952
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4926411640Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornogpu-prod-010:05:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140223893132672
- M:video_aido:cmdline(in:/;out:/) 140225184831904
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4923811650Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornogpu-prod-010:02:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139810628461280
- M:video_aido:cmdline(in:/;out:/) 139810627492688
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4915212231Bea Baselines 🐤baseline-behavior-cloningaido5-LF-sim-validationLFv-simerrornogpu-prod-010:08:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139661665769168
- M:video_aido:cmdline(in:/;out:/) 139661665770128
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4911312245Bea Baselines 🐤baseline-behavior-cloningaido5-LFVI_multi-sim-validationLFVIv-simhost-errornogpu-prod-010:03:08
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4909212245Bea Baselines 🐤baseline-behavior-cloningaido5-LFVI_multi-sim-validationLFVIv-simhost-errornogpu-prod-010:00:55
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4907412234Bea Baselines 🐤baseline-behavior-cloningaido5-LFP-sim-validationLFP-simerrornogpu-prod-010:01:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140394607186272
- M:video_aido:cmdline(in:/;out:/) 140394607256432
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4904812236Bea Baselines 🐤baseline-behavior-cloningaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornogpu-prod-010:01:02
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4903212237Bea Baselines 🐤baseline-behavior-cloningaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-errornogpu-prod-010:01:08
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego2" aborted with the following error:

error in ego2 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 37, in init
              ||     self.check_tensorflow_gpu()
              ||   File "solution.py", line 53, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4900112292Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simerrornogpu-prod-010:01:55
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140252672696480
- M:video_aido:cmdline(in:/;out:/) 140252672700032
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4898412291Bea Baselines 🐤template-tensorflowaido5-LF-sim-validationLFv-simerrornogpu-prod-010:01:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140456654544176
- M:video_aido:cmdline(in:/;out:/) 140456654543024
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4896912297Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-errornogpu-prod-010:01:00
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4894812297Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-errornogpu-prod-010:01:13
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4891812295Bea Baselines 🐤template-tensorflowaido5-LFP-sim-testingLFP-simerrornogpu-prod-010:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140025861366016
- M:video_aido:cmdline(in:/;out:/) 140025861369136
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4889612296Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornogpu-prod-010:00:58
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4887412298Bea Baselines 🐤template-tensorflowaido5-LFI-sim-validationLFVIv-simerrornogpu-prod-010:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139897106444736
- M:video_aido:cmdline(in:/;out:/) 139897106511088
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4885512299Bea Baselines 🐤template-tensorflowaido5-LFI-sim-testingLFVIv-simerrornogpu-prod-010:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139649989066320
- M:video_aido:cmdline(in:/;out:/) 139650101722128
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4883712302Bea Baselines 🐤template-tensorflowaido5-LFV-sim-testingLFVv-simerrornogpu-prod-010:02:26
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140127336726384
- M:video_aido:cmdline(in:/;out:/) 140126146468592
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4881912305Bea Baselines 🐤template-tensorflowaido5-LFVI_multi-sim-validationLFVIv-simhost-errornogpu-prod-010:01:10
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 322, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4863812318Bea Baselines 🐤template-pytorchaido5-LFVI-sim-validationLFVIv-simerrornogpu-prod-010:24:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139696679121152
- M:video_aido:cmdline(in:/;out:/) 139696679121440
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4860812300Bea Baselines 🐤template-tensorflowaido5-LFI-full-sim-validationLFVIv-simerrornogpu-prod-010:03:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140136412160160
- M:video_aido:cmdline(in:/;out:/) 140138687092720
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4855712273Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-validationLFVIv-simerrornogpu-prod-010:04:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139931466248352
- M:video_aido:cmdline(in:/;out:/) 139931466251040
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4850712180Bea Baselines 🐤template-tensorflowaido5-LFI-full-sim-validationLFVIv-simerrornogpu-prod-010:01:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140656813442768
- M:video_aido:cmdline(in:/;out:/) 140656813441376
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4848112174Bea Baselines 🐤template-tensorflowaido5-LFP-sim-validationLFP-simerrornogpu-prod-010:01:59
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139720382341232
- M:video_aido:cmdline(in:/;out:/) 139720383940784
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4846312181Bea Baselines 🐤template-tensorflowaido5-LF-sim-testingLFt-simerrornogpu-prod-010:01:27
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140309721803600
- M:video_aido:cmdline(in:/;out:/) 140309721801152
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4844112180Bea Baselines 🐤template-tensorflowaido5-LFI-full-sim-validationLFVIv-simerrornogpu-prod-010:01:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140323565022608
- M:video_aido:cmdline(in:/;out:/) 140323564427872
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4843112202Bea Baselines 🐤baseline-behavior-cloningaido5-LFV-sim-validationLFVv-simfailednogpu-prod-010:01:02
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4840612203Bea Baselines 🐤baseline-behavior-cloningaido5-LFI-full-sim-testingLFVIv-simfailednogpu-prod-010:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4838112207Bea Baselines 🐤baseline-behavior-cloningaido5-LFV_multi-sim-testingLFVmultibodyv-simfailednogpu-prod-010:00:54
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4835612210Bea Baselines 🐤baseline-behavior-cloningaido5-LFI-full-sim-validationLFVIv-simfailednogpu-prod-010:01:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4833012212Bea Baselines 🐤baseline-behavior-cloningaido5-LFV-sim-testingLFVv-simfailednogpu-prod-010:01:00
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4831212212Bea Baselines 🐤baseline-behavior-cloningaido5-LFV-sim-testingLFVv-simfailednogpu-prod-010:01:08
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4829612215Bea Baselines 🐤baseline-behavior-cloningaido5-LFVI_multi-sim-validationLFVIv-simfailednogpu-prod-010:00:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4814212230Bea Baselines 🐤straightaido5-LFVI_multi-sim-validationLFVIv-simerrornogpu-prod-010:05:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140087887138000
- M:video_aido:cmdline(in:/;out:/) 140087835323312
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4811711759Ayman Shams 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simabortednogpu-prod-010:02:05
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4810712176Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-errornogpu-prod-010:00:56
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4808012156Bea Baselines 🐤template-pytorchaido5-LF-sim-validationLFv-simerrornogpu-prod-010:02:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140680826404928
- M:video_aido:cmdline(in:/;out:/) 140680826354608
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4799212166Bea Baselines 🐤template-pytorchaido5-LF-sim-testingLFt-simerrornogpu-prod-010:09:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140561799414592
- M:video_aido:cmdline(in:/;out:/) 140561797620592
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4796511872Bea Baselines 🐤straightaido5-LFI-full-sim-testingLFVIv-simerrornogpu-prod-010:02:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140054511958768
- M:video_aido:cmdline(in:/;out:/) 140054512501280
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4794812185Bea Baselines 🐤template-tensorflowaido5-LFVI_multi-sim-validationLFVIv-simhost-errornogpu-prod-010:00:59
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4790512172Bea Baselines 🐤template-tensorflowaido5-LFV-sim-validationLFVv-simerrornogpu-prod-010:02:04
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140650379251376
- M:video_aido:cmdline(in:/;out:/) 140652602831536
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4786712184Bea Baselines 🐤template-tensorflowaido5-LFVI-sim-testingLFVIt-simerrornogpu-prod-010:02:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139988842292512
- M:video_aido:cmdline(in:/;out:/) 139988843682832
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4785712177Bea Baselines 🐤template-tensorflowaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-errornogpu-prod-010:00:57
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego3" aborted with the following error:

error in ego3 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 22, in init
              ||     self.check_tensorflow_gpu(context)
              ||   File "solution.py", line 41, in check_tensorflow_gpu
              ||     name = tf.test.gpu_device_name()
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/framework/test_util.py", line 106, in gpu_device_name
              ||     for x in device_lib.list_local_devices():
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/client/device_lib.py", line 43, in list_local_devices
              ||     _convert(s) for s in _pywrap_device_lib.list_devices(serialized_config)
              || RuntimeError: CUDA runtime implicit initialization on GPU:0 failed. Status: out of memory
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4783412180Bea Baselines 🐤template-tensorflowaido5-LFI-full-sim-validationLFVIv-simerrornogpu-prod-010:02:02
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140590145999440
- M:video_aido:cmdline(in:/;out:/) 140590146174400
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4781012183Bea Baselines 🐤template-tensorflowaido5-LFVI-sim-validationLFVIv-simerrornogpu-prod-010:02:33
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139907545668576
- M:video_aido:cmdline(in:/;out:/) 139907545669296
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4777912214Bea Baselines 🐤baseline-behavior-cloningaido5-LFVI-sim-testingLFVIt-simfailednogpu-prod-010:01:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4772812205Bea Baselines 🐤baseline-behavior-cloningaido5-LFP-sim-testingLFP-simfailednogpu-prod-010:02:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4770511877Bea Baselines 🐤straightaido5-LFI-sim-validationLFVIv-simerrornogpu-prod-010:01:37
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140402418909136
- M:video_aido:cmdline(in:/;out:/) 140402418908080
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4767012209Bea Baselines 🐤baseline-behavior-cloningaido5-LFI-sim-testingLFVIv-simfailednogpu-prod-010:01:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     self.model.load_weights("FrankNet.h5")
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              ||     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              ||   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              ||     with h5py.File(filepath, 'r') as f:
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              ||     fid = make_fid(name, mode, userblock_size,
              ||   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              ||     fid = h5f.open(name, flags, fapl=fapl)
              ||   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              ||   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              ||   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || OSError: Unable to open file (file signature not found)
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 329, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 320, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     self.model.load_weights("FrankNet.h5")
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/training.py", line 250, in load_weights
              || |     return super(Model, self).load_weights(filepath, by_name, skip_mismatch)
              || |   File "/usr/local/lib/python3.8/dist-packages/tensorflow/python/keras/engine/network.py", line 1259, in load_weights
              || |     with h5py.File(filepath, 'r') as f:
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 406, in __init__
              || |     fid = make_fid(name, mode, userblock_size,
              || |   File "/usr/local/lib/python3.8/dist-packages/h5py/_hl/files.py", line 173, in make_fid
              || |     fid = h5f.open(name, flags, fapl=fapl)
              || |   File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
              || |   File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
              || |   File "h5py/h5f.pyx", line 88, in h5py.h5f.open
              || | OSError: Unable to open file (file signature not found)
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 249, in main
    raise InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Getting agent protocol
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4756011882Bea Baselines 🐤straightaido5-LFVI-sim-validationLFVIv-simabortednogpu-prod-010:35:33
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4748912212Bea Baselines 🐤baseline-behavior-cloningaido5-LFV-sim-testingLFVv-simabortednogpu-prod-010:02:19
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4743311878Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simabortednogpu-prod-010:14:10
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4738911875Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simabortednogpu-prod-010:00:35
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4734511872Bea Baselines 🐤straightaido5-LFI-full-sim-testingLFVIv-simabortednogpu-prod-010:29:30
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
4725611410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simabortednogpu-prod-011:24:11
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The job has been aborted.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible