Duckietown Challenges Home Challenges Submissions

Evaluator 4769

ID4769
evaluatornogpu-prod-08
ownerI don't have one 😀
machinenogpu-prod_d45f05e64dc1
processnogpu-prod-08_d45f05e64dc1
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success48 53408
# timeout4 50033
# failed23 48735
# error81 47664
# aborted26 47302
# host-error49 47781
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5785410794Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:44:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013908347122675175
agent_compute-ego0_mean0.012964559286262074
agent_compute-ego0_median0.013117351400961388
agent_compute-ego0_min0.011715187220450346
complete-iteration_max0.35813440589682444
complete-iteration_mean0.3045175008035321
complete-iteration_median0.30358592933858064
complete-iteration_min0.25276373864014284
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max2.5255296946961515e-06
get_duckie_state_mean2.3874116876937267e-06
get_duckie_state_median2.385476149686866e-06
get_duckie_state_min2.2531647567050244e-06
get_robot_state_max0.00420236885299492
get_robot_state_mean0.004085590896955834
get_robot_state_median0.004081335889608239
get_robot_state_min0.003977322955611941
get_state_dump_max0.005219134561822972
get_state_dump_mean0.005085202130945795
get_state_dump_median0.005098878394356378
get_state_dump_min0.004923917173247453
get_ui_image_max0.03613139032622757
get_ui_image_mean0.03101805559701467
get_ui_image_median0.03055465400070076
get_ui_image_min0.02683152406042958
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02808477062666843, "step_physics": 0.2095268830768671, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004923917173247453, "get_robot_state": 0.003977322955611941, "sim_render-ego0": 0.004086050760934593, "get_duckie_state": 2.3153004896432335e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.011715187220450346, "complete-iteration": 0.27573012491745513, "set_robot_commands": 0.0023854878621732663, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00871142042765113, "sim_compute_performance-ego0": 0.002219599549915272}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03613139032622757, "step_physics": 0.27819473777186565, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.005018645778087454, "get_robot_state": 0.003981375475906512, "sim_render-ego0": 0.0041777855351405975, "get_duckie_state": 2.2531647567050244e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013908347122675175, "complete-iteration": 0.35813440589682444, "set_robot_commands": 0.0023264126614865217, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012099291859419518, "sim_compute_performance-ego0": 0.002197409152587586}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03302453737473309, "step_physics": 0.2572600795863372, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005219134561822972, "get_robot_state": 0.004181296303309966, "sim_render-ego0": 0.004252097291017353, "get_duckie_state": 2.5255296946961515e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012855546460560616, "complete-iteration": 0.33144173375970615, "set_robot_commands": 0.002364673781255997, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009817986762295356, "sim_compute_performance-ego0": 0.002354263763046582}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02683152406042958, "step_physics": 0.18735174195752552, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005179111010625301, "get_robot_state": 0.00420236885299492, "sim_render-ego0": 0.004237835651432644, "get_duckie_state": 2.455651809730498e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.01337915634136216, "complete-iteration": 0.25276373864014284, "set_robot_commands": 0.0025348766558771826, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006639568930760112, "sim_compute_performance-ego0": 0.0023029773658161654}}
set_robot_commands_max0.0025348766558771826
set_robot_commands_mean0.0024028627401982416
set_robot_commands_median0.0023750808217146316
set_robot_commands_min0.0023264126614865217
sim_compute_performance-ego0_max0.002354263763046582
sim_compute_performance-ego0_mean0.0022685624578414015
sim_compute_performance-ego0_median0.0022612884578657186
sim_compute_performance-ego0_min0.002197409152587586
sim_compute_sim_state_max0.012099291859419518
sim_compute_sim_state_mean0.00931706699503153
sim_compute_sim_state_median0.009264703594973243
sim_compute_sim_state_min0.006639568930760112
sim_render-ego0_max0.004252097291017353
sim_render-ego0_mean0.004188442309631297
sim_render-ego0_median0.0042078105932866205
sim_render-ego0_min0.004086050760934593
simulation-passed1
step_physics_max0.27819473777186565
step_physics_mean0.23308336059814888
step_physics_median0.23339348133160215
step_physics_min0.18735174195752552
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5784510796Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:03:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 40 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5781310820Raphael Jeanexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:18:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9694829458007383
survival_time_median23.925000000000203
deviation-center-line_median0.5410031314447561
in-drivable-lane_median10.57500000000015


other stats
agent_compute-ego0_max0.015054659718855544
agent_compute-ego0_mean0.013504151719826324
agent_compute-ego0_median0.01305526522634852
agent_compute-ego0_min0.012851416707752708
complete-iteration_max0.22127805129932396
complete-iteration_mean0.19638832903655673
complete-iteration_median0.1974337989043477
complete-iteration_min0.16940766703820753
deviation-center-line_max0.7554140148617973
deviation-center-line_mean0.5741356077533533
deviation-center-line_min0.45912215326210354
deviation-heading_max4.037753436258284
deviation-heading_mean2.968381009323913
deviation-heading_median2.903509508417738
deviation-heading_min2.0287515842018915
driven_any_max9.26725018069169
driven_any_mean5.070231000926355
driven_any_median3.819036468650274
driven_any_min3.3756008857131827
driven_lanedir_consec_max2.421514165143505
driven_lanedir_consec_mean2.025677831263189
driven_lanedir_consec_min1.7422312683077736
driven_lanedir_max2.4219667095443707
driven_lanedir_mean2.0257909673634056
driven_lanedir_median1.9694829458007383
driven_lanedir_min1.7422312683077736
get_duckie_state_max1.7470815119437537e-06
get_duckie_state_mean1.43376444049083e-06
get_duckie_state_median1.3513511470602658e-06
get_duckie_state_min1.2852739558990345e-06
get_robot_state_max0.004447004291054189
get_robot_state_mean0.003947648911186745
get_robot_state_median0.003841250361791048
get_robot_state_min0.003661090630110695
get_state_dump_max0.005451836665282623
get_state_dump_mean0.004934872836666597
get_state_dump_median0.004797406427928445
get_state_dump_min0.004692841825526875
get_ui_image_max0.03614976004013823
get_ui_image_mean0.03180328537305438
get_ui_image_median0.03243910149044833
get_ui_image_min0.026185178471182635
in-drivable-lane_max38.74999999999919
in-drivable-lane_mean17.212499999999903
in-drivable-lane_min8.950000000000127
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.26725018069169, "get_ui_image": 0.02878517983481288, "step_physics": 0.1084380156826228, "survival_time": 51.14999999999923, "driven_lanedir": 2.060902918476801, "get_state_dump": 0.004884242312982678, "get_robot_state": 0.00398256559856236, "sim_render-ego0": 0.004178374772891402, "get_duckie_state": 1.3478565961122513e-06, "in-drivable-lane": 38.74999999999919, "deviation-heading": 2.0287515842018915, "agent_compute-ego0": 0.01308295875787735, "complete-iteration": 0.17742721596732736, "set_robot_commands": 0.00233777635730803, "deviation-center-line": 0.46200895121803787, "driven_lanedir_consec": 2.060902918476801, "sim_compute_sim_state": 0.009388593025505544, "sim_compute_performance-ego0": 0.002255102386698127}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.3756008857131827, "get_ui_image": 0.03609302314608378, "step_physics": 0.14006482721936755, "survival_time": 22.85000000000019, "driven_lanedir": 1.8780629731246763, "get_state_dump": 0.004692841825526875, "get_robot_state": 0.003661090630110695, "sim_render-ego0": 0.0038539863569767713, "get_duckie_state": 1.2852739558990345e-06, "in-drivable-lane": 8.950000000000127, "deviation-heading": 3.4536283244492516, "agent_compute-ego0": 0.013027571694819688, "complete-iteration": 0.217440381841368, "set_robot_commands": 0.0021674445622873097, "deviation-center-line": 0.7554140148617973, "driven_lanedir_consec": 1.8780629731246763, "sim_compute_sim_state": 0.011805603597882531, "sim_compute_performance-ego0": 0.001984732119797619}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.645523685866236, "get_ui_image": 0.03614976004013823, "step_physics": 0.1377480896521634, "survival_time": 21.000000000000163, "driven_lanedir": 1.7422312683077736, "get_state_dump": 0.005451836665282623, "get_robot_state": 0.004447004291054189, "sim_render-ego0": 0.004645771765085977, "get_duckie_state": 1.7470815119437537e-06, "in-drivable-lane": 11.100000000000158, "deviation-heading": 2.3533906923862244, "agent_compute-ego0": 0.015054659718855544, "complete-iteration": 0.22127805129932396, "set_robot_commands": 0.0026293769301824503, "deviation-center-line": 0.45912215326210354, "driven_lanedir_consec": 1.7422312683077736, "sim_compute_sim_state": 0.012575145005613495, "sim_compute_performance-ego0": 0.002462054091791076}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.9925492514343106, "get_ui_image": 0.026185178471182635, "step_physics": 0.10734708247308485, "survival_time": 25.00000000000022, "driven_lanedir": 2.4219667095443707, "get_state_dump": 0.0047105705428742125, "get_robot_state": 0.003699935125019736, "sim_render-ego0": 0.003893436785943494, "get_duckie_state": 1.3548456980082805e-06, "in-drivable-lane": 10.050000000000145, "deviation-heading": 4.037753436258284, "agent_compute-ego0": 0.012851416707752708, "complete-iteration": 0.16940766703820753, "set_robot_commands": 0.0022283547414753014, "deviation-center-line": 0.6199973116714743, "driven_lanedir_consec": 2.421514165143505, "sim_compute_sim_state": 0.006393719576076119, "sim_compute_performance-ego0": 0.002006650684836382}}
set_robot_commands_max0.0026293769301824503
set_robot_commands_mean0.002340738147813273
set_robot_commands_median0.0022830655493916658
set_robot_commands_min0.0021674445622873097
sim_compute_performance-ego0_max0.002462054091791076
sim_compute_performance-ego0_mean0.0021771348207808012
sim_compute_performance-ego0_median0.002130876535767254
sim_compute_performance-ego0_min0.001984732119797619
sim_compute_sim_state_max0.012575145005613495
sim_compute_sim_state_mean0.01004076530126942
sim_compute_sim_state_median0.010597098311694038
sim_compute_sim_state_min0.006393719576076119
sim_render-ego0_max0.004645771765085977
sim_render-ego0_mean0.004142892420224411
sim_render-ego0_median0.004035905779417448
sim_render-ego0_min0.0038539863569767713
simulation-passed1
step_physics_max0.14006482721936755
step_physics_mean0.12339950375680964
step_physics_median0.1230930526673931
step_physics_min0.10734708247308485
survival_time_max51.14999999999923
survival_time_mean29.99999999999995
survival_time_min21.000000000000163
No reset possible
5779610823Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:03:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 16 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5778710826Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:03:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 20 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5778310829Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:03:16
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5778010833Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:03:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5776810840Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:09:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36273150777360785
survival_time_median14.275000000000068
deviation-center-line_median0.22488843822646104
in-drivable-lane_median11.875000000000057


other stats
agent_compute-ego0_max0.04983267301245581
agent_compute-ego0_mean0.03703559257585698
agent_compute-ego0_median0.04257616738897463
agent_compute-ego0_min0.013157362513022849
complete-iteration_max0.2411623997024343
complete-iteration_mean0.2030641813011888
complete-iteration_median0.1915104001580043
complete-iteration_min0.1880735251863124
deviation-center-line_max0.36308775180279845
deviation-center-line_mean0.22500020119176192
deviation-center-line_min0.08713617651132724
deviation-heading_max3.24705292501494
deviation-heading_mean1.5833854437979724
deviation-heading_median1.2552508491492804
deviation-heading_min0.5759871518783894
driven_any_max5.054445952561518
driven_any_mean2.8008087789706595
driven_any_median2.7746060208417713
driven_any_min0.5995771216375776
driven_lanedir_consec_max0.550223023910506
driven_lanedir_consec_mean0.36109689134607575
driven_lanedir_consec_min0.1687015259265814
driven_lanedir_max0.5550844804145785
driven_lanedir_mean0.3623122554720939
driven_lanedir_median0.36273150777360785
driven_lanedir_min0.1687015259265814
get_duckie_state_max2.158514343866027e-06
get_duckie_state_mean2.0646011760107405e-06
get_duckie_state_median2.096270863682217e-06
get_duckie_state_min1.9073486328125e-06
get_robot_state_max0.003950077472346844
get_robot_state_mean0.00372098370866921
get_robot_state_median0.0036990820787371897
get_robot_state_min0.003535693204855617
get_state_dump_max0.005064948938660703
get_state_dump_mean0.004812387418507537
get_state_dump_median0.004761775909382713
get_state_dump_min0.004661048916604021
get_ui_image_max0.03390090375006953
get_ui_image_mean0.03034885036988772
get_ui_image_median0.030703479892796648
get_ui_image_min0.026087537943888052
in-drivable-lane_max20.650000000000187
in-drivable-lane_mean11.737500000000074
in-drivable-lane_min2.5499999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.863722906810014, "get_ui_image": 0.02890063786910752, "step_physics": 0.09530105752460027, "survival_time": 14.700000000000074, "driven_lanedir": 0.4422579313867307, "get_state_dump": 0.005064948938660703, "get_robot_state": 0.003751620599779032, "sim_render-ego0": 0.003954477633460093, "get_duckie_state": 2.095658900374073e-06, "in-drivable-lane": 11.700000000000047, "deviation-heading": 1.7033728894623843, "agent_compute-ego0": 0.03636052487260205, "complete-iteration": 0.1880735251863124, "set_robot_commands": 0.0022919759912005924, "deviation-center-line": 0.32678326213046266, "driven_lanedir_consec": 0.4422579313867307, "sim_compute_sim_state": 0.010263340351945262, "sim_compute_performance-ego0": 0.0020931704569671114}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.5995771216375776, "get_ui_image": 0.03390090375006953, "step_physics": 0.13164374194567716, "survival_time": 3.899999999999994, "driven_lanedir": 0.1687015259265814, "get_state_dump": 0.004724064959755427, "get_robot_state": 0.003535693204855617, "sim_render-ego0": 0.0037121621868278407, "get_duckie_state": 1.9073486328125e-06, "in-drivable-lane": 2.5499999999999936, "deviation-heading": 0.8071288088361763, "agent_compute-ego0": 0.04983267301245581, "complete-iteration": 0.2411623997024343, "set_robot_commands": 0.002263714995565294, "deviation-center-line": 0.08713617651132724, "driven_lanedir_consec": 0.1687015259265814, "sim_compute_sim_state": 0.00953490522843373, "sim_compute_performance-ego0": 0.0019278013253513772}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.054445952561518, "get_ui_image": 0.032506321916485774, "step_physics": 0.113553788874409, "survival_time": 25.200000000000223, "driven_lanedir": 0.5550844804145785, "get_state_dump": 0.004799486859009998, "get_robot_state": 0.003950077472346844, "sim_render-ego0": 0.004067738221423461, "get_duckie_state": 2.158514343866027e-06, "in-drivable-lane": 20.650000000000187, "deviation-heading": 3.24705292501494, "agent_compute-ego0": 0.013157362513022849, "complete-iteration": 0.18872085373000344, "set_robot_commands": 0.0023933382317571357, "deviation-center-line": 0.36308775180279845, "driven_lanedir_consec": 0.550223023910506, "sim_compute_sim_state": 0.012074356267947962, "sim_compute_performance-ego0": 0.0021216996825567567}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.685489134873529, "get_ui_image": 0.026087537943888052, "step_physics": 0.0972849928217826, "survival_time": 13.850000000000062, "driven_lanedir": 0.28320508416048495, "get_state_dump": 0.004661048916604021, "get_robot_state": 0.003646543557695348, "sim_render-ego0": 0.003884589929374859, "get_duckie_state": 2.096882826990361e-06, "in-drivable-lane": 12.05000000000006, "deviation-heading": 0.5759871518783894, "agent_compute-ego0": 0.048791809905347205, "complete-iteration": 0.1942999465860051, "set_robot_commands": 0.002309417553085217, "deviation-center-line": 0.1229936143224594, "driven_lanedir_consec": 0.28320508416048495, "sim_compute_sim_state": 0.005566269373722213, "sim_compute_performance-ego0": 0.001978236136676596}}
set_robot_commands_max0.0023933382317571357
set_robot_commands_mean0.00231461169290206
set_robot_commands_median0.002300696772142905
set_robot_commands_min0.002263714995565294
sim_compute_performance-ego0_max0.0021216996825567567
sim_compute_performance-ego0_mean0.0020302269003879604
sim_compute_performance-ego0_median0.002035703296821854
sim_compute_performance-ego0_min0.0019278013253513772
sim_compute_sim_state_max0.012074356267947962
sim_compute_sim_state_mean0.00935971780551229
sim_compute_sim_state_median0.009899122790189495
sim_compute_sim_state_min0.005566269373722213
sim_render-ego0_max0.004067738221423461
sim_render-ego0_mean0.003904741992771563
sim_render-ego0_median0.003919533781417476
sim_render-ego0_min0.0037121621868278407
simulation-passed1
step_physics_max0.13164374194567716
step_physics_mean0.10944589529161725
step_physics_median0.1054193908480958
step_physics_min0.09530105752460027
survival_time_max25.200000000000223
survival_time_mean14.412500000000088
survival_time_min3.899999999999994
No reset possible
5773910854Dishank Bansal 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:18:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5194537691895438
survival_time_median33.55000000000022
deviation-center-line_median0.5943697216524126
in-drivable-lane_median15.500000000000089


other stats
agent_compute-ego0_max0.013868615325068084
agent_compute-ego0_mean0.013307605717005276
agent_compute-ego0_median0.01317758689220405
agent_compute-ego0_min0.01300663375854492
complete-iteration_max0.22514106591542565
complete-iteration_mean0.19550263054938477
complete-iteration_median0.20159220593356192
complete-iteration_min0.1536850444149896
deviation-center-line_max1.6876447165363646
deviation-center-line_mean0.7706330936869933
deviation-center-line_min0.20614821490678303
deviation-heading_max6.622767671305553
deviation-heading_mean3.8008193095731624
deviation-heading_median3.882856406141939
deviation-heading_min0.8147967547032164
driven_any_max6.360687891500069
driven_any_mean5.061462327612774
driven_any_median5.6751350322758025
driven_any_min2.53489135439942
driven_lanedir_consec_max5.640548854749638
driven_lanedir_consec_mean2.3476974540243996
driven_lanedir_consec_min0.7113334229688717
driven_lanedir_max5.640548854749638
driven_lanedir_mean2.365151128352417
driven_lanedir_median1.5543611178455796
driven_lanedir_min0.7113334229688717
get_duckie_state_max1.762708028157552e-06
get_duckie_state_mean1.636105626178633e-06
get_duckie_state_median1.63043629127076e-06
get_duckie_state_min1.52084189401546e-06
get_robot_state_max0.00406731216000839
get_robot_state_mean0.003936390326915401
get_robot_state_median0.0039708314614418224
get_robot_state_min0.003736586224769568
get_state_dump_max0.005272598602832892
get_state_dump_mean0.0051280476745716175
get_state_dump_median0.005156455100422175
get_state_dump_min0.004926681894609228
get_ui_image_max0.03591840839385986
get_ui_image_mean0.03107013319969467
get_ui_image_median0.03164054070861386
get_ui_image_min0.02508104298769111
in-drivable-lane_max27.650000000000087
in-drivable-lane_mean15.100000000000072
in-drivable-lane_min1.7500000000000249
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.53489135439942, "get_ui_image": 0.029632798372170865, "step_physics": 0.12139778488721605, "survival_time": 15.550000000000086, "driven_lanedir": 2.294322651815086, "get_state_dump": 0.005272598602832892, "get_robot_state": 0.004060233250642434, "sim_render-ego0": 0.00419653608248784, "get_duckie_state": 1.723185563698793e-06, "in-drivable-lane": 1.7500000000000249, "deviation-heading": 2.469157109886499, "agent_compute-ego0": 0.013231379099381275, "complete-iteration": 0.1931807299455007, "set_robot_commands": 0.0024162171742854975, "deviation-center-line": 0.6546034593058261, "driven_lanedir_consec": 2.294322651815086, "sim_compute_sim_state": 0.01057974344644791, "sim_compute_performance-ego0": 0.002283356892756927}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.360687891500069, "get_ui_image": 0.03591840839385986, "step_physics": 0.1463206040064494, "survival_time": 37.45000000000001, "driven_lanedir": 5.640548854749638, "get_state_dump": 0.0050588598251342775, "get_robot_state": 0.003881429672241211, "sim_render-ego0": 0.004124044418334961, "get_duckie_state": 1.762708028157552e-06, "in-drivable-lane": 3.899999999999853, "deviation-heading": 6.622767671305553, "agent_compute-ego0": 0.01300663375854492, "complete-iteration": 0.22514106591542565, "set_robot_commands": 0.0023411070505777996, "deviation-center-line": 1.6876447165363646, "driven_lanedir_consec": 5.640548854749638, "sim_compute_sim_state": 0.012197839736938476, "sim_compute_performance-ego0": 0.002181396802266439}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.002676161280174, "get_ui_image": 0.03364828304505684, "step_physics": 0.1333158362079674, "survival_time": 35.450000000000124, "driven_lanedir": 0.814399583876073, "get_state_dump": 0.005254050375710071, "get_robot_state": 0.00406731216000839, "sim_render-ego0": 0.0043405898859803105, "get_duckie_state": 1.52084189401546e-06, "in-drivable-lane": 27.650000000000087, "deviation-heading": 5.29655570239738, "agent_compute-ego0": 0.013868615325068084, "complete-iteration": 0.2100036819216231, "set_robot_commands": 0.0024648622727729903, "deviation-center-line": 0.5341359839989991, "driven_lanedir_consec": 0.7445848865640013, "sim_compute_sim_state": 0.010651876892842038, "sim_compute_performance-ego0": 0.002286855603607607}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.347593903271432, "get_ui_image": 0.02508104298769111, "step_physics": 0.09202215912214214, "survival_time": 31.650000000000315, "driven_lanedir": 0.7113334229688717, "get_state_dump": 0.004926681894609228, "get_robot_state": 0.003736586224769568, "sim_render-ego0": 0.003979855155343137, "get_duckie_state": 1.5376870188427273e-06, "in-drivable-lane": 27.10000000000032, "deviation-heading": 0.8147967547032164, "agent_compute-ego0": 0.013123794685026825, "complete-iteration": 0.1536850444149896, "set_robot_commands": 0.0022718315996958253, "deviation-center-line": 0.20614821490678303, "driven_lanedir_consec": 0.7113334229688717, "sim_compute_sim_state": 0.006350917018926482, "sim_compute_performance-ego0": 0.0020877604228841016}}
set_robot_commands_max0.0024648622727729903
set_robot_commands_mean0.002373504524333028
set_robot_commands_median0.0023786621124316483
set_robot_commands_min0.0022718315996958253
sim_compute_performance-ego0_max0.002286855603607607
sim_compute_performance-ego0_mean0.0022098424303787687
sim_compute_performance-ego0_median0.0022323768475116827
sim_compute_performance-ego0_min0.0020877604228841016
sim_compute_sim_state_max0.012197839736938476
sim_compute_sim_state_mean0.009945094273788728
sim_compute_sim_state_median0.010615810169644977
sim_compute_sim_state_min0.006350917018926482
sim_render-ego0_max0.0043405898859803105
sim_render-ego0_mean0.004160256385536562
sim_render-ego0_median0.0041602902504114005
sim_render-ego0_min0.003979855155343137
simulation-passed1
step_physics_max0.1463206040064494
step_physics_mean0.12326409605594375
step_physics_median0.12735681054759174
step_physics_min0.09202215912214214
survival_time_max37.45000000000001
survival_time_mean30.025000000000137
survival_time_min15.550000000000086
No reset possible
5772810859Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:13:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5273948526900347
survival_time_median20.22500000000015
deviation-center-line_median0.3540010305085299
in-drivable-lane_median11.300000000000132


other stats
agent_compute-ego0_max0.05099265037044402
agent_compute-ego0_mean0.040300344203314006
agent_compute-ego0_median0.04830845983773074
agent_compute-ego0_min0.013591806767350535
complete-iteration_max0.2659061339593703
complete-iteration_mean0.2183188115898484
complete-iteration_median0.2040651084020878
complete-iteration_min0.1992388955958478
deviation-center-line_max1.5197923101395143
deviation-center-line_mean0.5838416668685458
deviation-center-line_min0.1075722963176089
deviation-heading_max5.73307750193262
deviation-heading_mean2.280114743833894
deviation-heading_median1.2572644224193672
deviation-heading_min0.8728526285642216
driven_any_max6.760613260394322
driven_any_mean3.5947169020619874
driven_any_median3.485720612781348
driven_any_min0.6468131222909315
driven_lanedir_consec_max3.451713185689859
driven_lanedir_consec_mean1.6716721842130693
driven_lanedir_consec_min0.1801858457823489
driven_lanedir_max3.451713185689859
driven_lanedir_mean1.6716721842130693
driven_lanedir_median1.5273948526900347
driven_lanedir_min0.1801858457823489
get_duckie_state_max1.6476003597555293e-06
get_duckie_state_mean1.567993756678287e-06
get_duckie_state_median1.5632048480222051e-06
get_duckie_state_min1.4979649709132068e-06
get_robot_state_max0.004090809915336201
get_robot_state_mean0.003931552550015731
get_robot_state_median0.003890250168970686
get_robot_state_min0.003854899946785353
get_state_dump_max0.005268017658198828
get_state_dump_mean0.00505675273843698
get_state_dump_median0.005019408599112088
get_state_dump_min0.004920176097324916
get_ui_image_max0.038653094281432446
get_ui_image_mean0.032739310586380424
get_ui_image_median0.031939045752826814
get_ui_image_min0.028426056558435612
in-drivable-lane_max17.299999999999798
in-drivable-lane_mean10.737500000000011
in-drivable-lane_min3.049999999999991
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.371470659509529, "get_ui_image": 0.029501196404337647, "step_physics": 0.09963103791117432, "survival_time": 25.10000000000022, "driven_lanedir": 2.2873882889245527, "get_state_dump": 0.005106795616225741, "get_robot_state": 0.003854899946785353, "sim_render-ego0": 0.004042625427246094, "get_duckie_state": 1.6476003597555293e-06, "in-drivable-lane": 12.00000000000017, "deviation-heading": 1.6155546557209632, "agent_compute-ego0": 0.0506573131022823, "complete-iteration": 0.20884557841549337, "set_robot_commands": 0.0027435261970959884, "deviation-center-line": 0.556389447991766, "driven_lanedir_consec": 2.2873882889245527, "sim_compute_sim_state": 0.01112922949061005, "sim_compute_performance-ego0": 0.002081678591476046}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6468131222909315, "get_ui_image": 0.038653094281432446, "step_physics": 0.14778996283008206, "survival_time": 4.599999999999992, "driven_lanedir": 0.1801858457823489, "get_state_dump": 0.0049320215819984355, "get_robot_state": 0.003924603103309549, "sim_render-ego0": 0.004024244123889554, "get_duckie_state": 1.5689480689264114e-06, "in-drivable-lane": 3.049999999999991, "deviation-heading": 0.8989741891177712, "agent_compute-ego0": 0.05099265037044402, "complete-iteration": 0.2659061339593703, "set_robot_commands": 0.0024667375831193823, "deviation-center-line": 0.1075722963176089, "driven_lanedir_consec": 0.1801858457823489, "sim_compute_sim_state": 0.010983403011034894, "sim_compute_performance-ego0": 0.0020446751707343643}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.760613260394322, "get_ui_image": 0.034376895101315974, "step_physics": 0.11873406537042291, "survival_time": 38.29999999999996, "driven_lanedir": 3.451713185689859, "get_state_dump": 0.005268017658198828, "get_robot_state": 0.004090809915336201, "sim_render-ego0": 0.004350536338975253, "get_duckie_state": 1.4979649709132068e-06, "in-drivable-lane": 17.299999999999798, "deviation-heading": 5.73307750193262, "agent_compute-ego0": 0.013591806767350535, "complete-iteration": 0.1992846383886822, "set_robot_commands": 0.00238995228783559, "deviation-center-line": 1.5197923101395143, "driven_lanedir_consec": 3.451713185689859, "sim_compute_sim_state": 0.014070993296636906, "sim_compute_performance-ego0": 0.002311806946099193}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.5999705660531665, "get_ui_image": 0.028426056558435612, "step_physics": 0.10169636196904368, "survival_time": 15.350000000000083, "driven_lanedir": 0.7674014164555167, "get_state_dump": 0.004920176097324916, "get_robot_state": 0.003855897234631823, "sim_render-ego0": 0.004018873363346248, "get_duckie_state": 1.5574616271179993e-06, "in-drivable-lane": 10.600000000000092, "deviation-heading": 0.8728526285642216, "agent_compute-ego0": 0.04595960657317917, "complete-iteration": 0.1992388955958478, "set_robot_commands": 0.0023439836192440675, "deviation-center-line": 0.1516126130252937, "driven_lanedir_consec": 0.7674014164555167, "sim_compute_sim_state": 0.005849222084144493, "sim_compute_performance-ego0": 0.0020731912030802144}}
set_robot_commands_max0.0027435261970959884
set_robot_commands_mean0.002486049921823757
set_robot_commands_median0.002428344935477486
set_robot_commands_min0.0023439836192440675
sim_compute_performance-ego0_max0.002311806946099193
sim_compute_performance-ego0_mean0.0021278379778474545
sim_compute_performance-ego0_median0.0020774348972781302
sim_compute_performance-ego0_min0.0020446751707343643
sim_compute_sim_state_max0.014070993296636906
sim_compute_sim_state_mean0.010508211970606586
sim_compute_sim_state_median0.011056316250822472
sim_compute_sim_state_min0.005849222084144493
sim_render-ego0_max0.004350536338975253
sim_render-ego0_mean0.004109069813364287
sim_render-ego0_median0.004033434775567824
sim_render-ego0_min0.004018873363346248
simulation-passed1
step_physics_max0.14778996283008206
step_physics_mean0.11696285702018074
step_physics_median0.1102152136697333
step_physics_min0.09963103791117432
survival_time_max38.29999999999996
survival_time_mean20.837500000000063
survival_time_min4.599999999999992
No reset possible
5770710872Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:06:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3880299303451338
survival_time_median8.349999999999993
deviation-center-line_median0.10717137130859086
in-drivable-lane_median6.224999999999994


other stats
agent_compute-ego0_max0.014044863278748558
agent_compute-ego0_mean0.012917936995437952
agent_compute-ego0_median0.01271332127354394
agent_compute-ego0_min0.012200242155915374
complete-iteration_max0.2295367956161499
complete-iteration_mean0.18858472816248664
complete-iteration_median0.17982775053920858
complete-iteration_min0.16514661595537947
deviation-center-line_max0.2590211685140501
deviation-center-line_mean0.13832437135092346
deviation-center-line_min0.07993357427246195
deviation-heading_max1.2178910040494402
deviation-heading_mean0.6876609288295099
deviation-heading_median0.5581353710374076
deviation-heading_min0.4164819691937842
driven_any_max3.0915348222982515
driven_any_mean1.962951903258524
driven_any_median2.043315260341421
driven_any_min0.6736422700530028
driven_lanedir_consec_max0.52293605867608
driven_lanedir_consec_mean0.3796816215794572
driven_lanedir_consec_min0.21973056695148108
driven_lanedir_max0.52293605867608
driven_lanedir_mean0.3796816215794572
driven_lanedir_median0.3880299303451338
driven_lanedir_min0.21973056695148108
get_duckie_state_max2.279182789856906e-06
get_duckie_state_mean2.128637648323151e-06
get_duckie_state_median2.103988124838478e-06
get_duckie_state_min2.0273915537587412e-06
get_robot_state_max0.004061370315947064
get_robot_state_mean0.0038958305811568105
get_robot_state_median0.003951038390989084
get_robot_state_min0.003619875226702009
get_state_dump_max0.00510765685409796
get_state_dump_mean0.004977064487879554
get_state_dump_median0.004981491271039404
get_state_dump_min0.004837618555341448
get_ui_image_max0.0347438028880528
get_ui_image_mean0.031116970231322143
get_ui_image_median0.0313964394383733
get_ui_image_min0.02693119916048917
in-drivable-lane_max10.250000000000036
in-drivable-lane_mean6.225000000000005
in-drivable-lane_min2.1999999999999953
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.3927253969986526, "get_ui_image": 0.029495908806361062, "step_physics": 0.10871572321560716, "survival_time": 9.6, "driven_lanedir": 0.52293605867608, "get_state_dump": 0.005053290431363595, "get_robot_state": 0.004061370315947064, "sim_render-ego0": 0.004023445702587385, "get_duckie_state": 2.279182789856906e-06, "in-drivable-lane": 7.100000000000006, "deviation-heading": 1.2178910040494402, "agent_compute-ego0": 0.012443211412182744, "complete-iteration": 0.17846080676261625, "set_robot_commands": 0.002278009226902779, "deviation-center-line": 0.2590211685140501, "driven_lanedir_consec": 0.52293605867608, "sim_compute_sim_state": 0.010014815651691022, "sim_compute_performance-ego0": 0.00226828100767778}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6736422700530028, "get_ui_image": 0.0347438028880528, "step_physics": 0.15528500420706612, "survival_time": 3.4499999999999957, "driven_lanedir": 0.21973056695148108, "get_state_dump": 0.004837618555341448, "get_robot_state": 0.003619875226702009, "sim_render-ego0": 0.004013170514787947, "get_duckie_state": 2.029963902064732e-06, "in-drivable-lane": 2.1999999999999953, "deviation-heading": 0.631039348248356, "agent_compute-ego0": 0.012983431134905134, "complete-iteration": 0.2295367956161499, "set_robot_commands": 0.00217914240700858, "deviation-center-line": 0.07993357427246195, "driven_lanedir_consec": 0.21973056695148108, "sim_compute_sim_state": 0.009735373088291713, "sim_compute_performance-ego0": 0.002044112341744559}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.0915348222982515, "get_ui_image": 0.03329697007038554, "step_physics": 0.1073791286984428, "survival_time": 12.150000000000038, "driven_lanedir": 0.3986522318721164, "get_state_dump": 0.00510765685409796, "get_robot_state": 0.003947086021548412, "sim_render-ego0": 0.00415185631298628, "get_duckie_state": 2.178012347612225e-06, "in-drivable-lane": 10.250000000000036, "deviation-heading": 0.4852313938264593, "agent_compute-ego0": 0.014044863278748558, "complete-iteration": 0.1811946943158009, "set_robot_commands": 0.0023178731808896924, "deviation-center-line": 0.10515342805588686, "driven_lanedir_consec": 0.3986522318721164, "sim_compute_sim_state": 0.008739217382962586, "sim_compute_performance-ego0": 0.002106225881420198}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.693905123684189, "get_ui_image": 0.02693119916048917, "step_physics": 0.10345064176546112, "survival_time": 7.099999999999983, "driven_lanedir": 0.3774076288181511, "get_state_dump": 0.004909692110715212, "get_robot_state": 0.003954990760429756, "sim_render-ego0": 0.003886076120229868, "get_duckie_state": 2.0273915537587412e-06, "in-drivable-lane": 5.349999999999982, "deviation-heading": 0.4164819691937842, "agent_compute-ego0": 0.012200242155915374, "complete-iteration": 0.16514661595537947, "set_robot_commands": 0.0022134964282696065, "deviation-center-line": 0.10918931456129488, "driven_lanedir_consec": 0.3774076288181511, "sim_compute_sim_state": 0.005440158443851071, "sim_compute_performance-ego0": 0.00206477492005675}}
set_robot_commands_max0.0023178731808896924
set_robot_commands_mean0.002247130310767664
set_robot_commands_median0.0022457528275861924
set_robot_commands_min0.00217914240700858
sim_compute_performance-ego0_max0.00226828100767778
sim_compute_performance-ego0_mean0.0021208485377248215
sim_compute_performance-ego0_median0.002085500400738474
sim_compute_performance-ego0_min0.002044112341744559
sim_compute_sim_state_max0.010014815651691022
sim_compute_sim_state_mean0.0084823911416991
sim_compute_sim_state_median0.00923729523562715
sim_compute_sim_state_min0.005440158443851071
sim_render-ego0_max0.00415185631298628
sim_render-ego0_mean0.004018637162647869
sim_render-ego0_median0.004018308108687666
sim_render-ego0_min0.003886076120229868
simulation-passed1
step_physics_max0.15528500420706612
step_physics_mean0.1187076244716443
step_physics_median0.108047425957025
step_physics_min0.10345064176546112
survival_time_max12.150000000000038
survival_time_mean8.075000000000005
survival_time_min3.4499999999999957
No reset possible
5768710875Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:07:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.780953312212118
survival_time_median9.5
deviation-center-line_median0.20970093177283936
in-drivable-lane_median3.949999999999986


other stats
agent_compute-ego0_max0.047272043463624555
agent_compute-ego0_mean0.03433211757394099
agent_compute-ego0_median0.03824612535146009
agent_compute-ego0_min0.013564176129219228
complete-iteration_max0.2416533679324012
complete-iteration_mean0.20243953331070805
complete-iteration_median0.1932943201624981
complete-iteration_min0.1815161249854348
deviation-center-line_max0.46741883944372525
deviation-center-line_mean0.2469353430283508
deviation-center-line_min0.10092066912399922
deviation-heading_max1.633991146363377
deviation-heading_mean0.980940488772625
deviation-heading_median0.8853301330639434
deviation-heading_min0.5191105425992363
driven_any_max3.0229875997518953
driven_any_mean2.1272450026883423
driven_any_median2.0691747350438714
driven_any_min1.3476429409137318
driven_lanedir_consec_max2.0270456792841967
driven_lanedir_consec_mean1.0739791721567769
driven_lanedir_consec_min0.7069643849186755
driven_lanedir_max2.0270456792841967
driven_lanedir_mean1.0739791721567769
driven_lanedir_median0.780953312212118
driven_lanedir_min0.7069643849186755
get_duckie_state_max1.4627786507283834e-06
get_duckie_state_mean1.409655434260312e-06
get_duckie_state_median1.4057192906817345e-06
get_duckie_state_min1.3644045049493965e-06
get_robot_state_max0.003910600917489998
get_robot_state_mean0.003786794105199394
get_robot_state_median0.003790810968421533
get_robot_state_min0.003654953566464511
get_state_dump_max0.005122112961949912
get_state_dump_mean0.004913274307139094
get_state_dump_median0.004937902036222654
get_state_dump_min0.004655180194161155
get_ui_image_max0.0361712563879871
get_ui_image_mean0.030629021448857343
get_ui_image_median0.02999913255726729
get_ui_image_min0.026346564292907715
in-drivable-lane_max9.250000000000064
in-drivable-lane_mean4.837500000000016
in-drivable-lane_min2.2000000000000313
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4238219389770435, "get_ui_image": 0.02709234411066229, "step_physics": 0.09643963792107324, "survival_time": 10.95000000000002, "driven_lanedir": 2.0270456792841967, "get_state_dump": 0.004655180194161155, "get_robot_state": 0.003654953566464511, "sim_render-ego0": 0.0038722742687572137, "get_duckie_state": 1.3644045049493965e-06, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 1.2106981015772045, "agent_compute-ego0": 0.03213148984042081, "complete-iteration": 0.1815161249854348, "set_robot_commands": 0.002290349656885321, "deviation-center-line": 0.46741883944372525, "driven_lanedir_consec": 2.0270456792841967, "sim_compute_sim_state": 0.00930829806761308, "sim_compute_performance-ego0": 0.0019841692664406517}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.0229875997518953, "get_ui_image": 0.0361712563879871, "step_physics": 0.13205463824218977, "survival_time": 13.400000000000055, "driven_lanedir": 0.8482957103711357, "get_state_dump": 0.005122112961949912, "get_robot_state": 0.003910600917489998, "sim_render-ego0": 0.004104353681372887, "get_duckie_state": 1.3941725833708468e-06, "in-drivable-lane": 9.250000000000064, "deviation-heading": 1.633991146363377, "agent_compute-ego0": 0.04436076086249936, "complete-iteration": 0.2416533679324012, "set_robot_commands": 0.0024270683416203497, "deviation-center-line": 0.2804358978221607, "driven_lanedir_consec": 0.8482957103711357, "sim_compute_sim_state": 0.01123858916272018, "sim_compute_performance-ego0": 0.0021672807218416916}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3476429409137318, "get_ui_image": 0.03290592100387229, "step_physics": 0.12623182992289836, "survival_time": 6.5999999999999845, "driven_lanedir": 0.7069643849186755, "get_state_dump": 0.004968282871676567, "get_robot_state": 0.003793598117684959, "sim_render-ego0": 0.004076495206445679, "get_duckie_state": 1.4627786507283834e-06, "in-drivable-lane": 3.1999999999999886, "deviation-heading": 0.5599621645506823, "agent_compute-ego0": 0.013564176129219228, "complete-iteration": 0.19861936927738047, "set_robot_commands": 0.0022620401884380138, "deviation-center-line": 0.10092066912399922, "driven_lanedir_consec": 0.7069643849186755, "sim_compute_sim_state": 0.008640655001303307, "sim_compute_performance-ego0": 0.0020870355735147805}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7145275311106989, "get_ui_image": 0.026346564292907715, "step_physics": 0.09184457784817544, "survival_time": 8.04999999999998, "driven_lanedir": 0.7136109140531002, "get_state_dump": 0.004907521200768742, "get_robot_state": 0.0037880238191581065, "sim_render-ego0": 0.0039766717840124055, "get_duckie_state": 1.4172659979926216e-06, "in-drivable-lane": 4.699999999999983, "deviation-heading": 0.5191105425992363, "agent_compute-ego0": 0.047272043463624555, "complete-iteration": 0.1879692710476157, "set_robot_commands": 0.0023395043832284434, "deviation-center-line": 0.13896596572351808, "driven_lanedir_consec": 0.7136109140531002, "sim_compute_sim_state": 0.005361740971788948, "sim_compute_performance-ego0": 0.002040247858306508}}
set_robot_commands_max0.0024270683416203497
set_robot_commands_mean0.0023297406425430317
set_robot_commands_median0.002314927020056882
set_robot_commands_min0.0022620401884380138
sim_compute_performance-ego0_max0.0021672807218416916
sim_compute_performance-ego0_mean0.0020696833550259077
sim_compute_performance-ego0_median0.0020636417159106443
sim_compute_performance-ego0_min0.0019841692664406517
sim_compute_sim_state_max0.01123858916272018
sim_compute_sim_state_mean0.008637320800856378
sim_compute_sim_state_median0.008974476534458195
sim_compute_sim_state_min0.005361740971788948
sim_render-ego0_max0.004104353681372887
sim_render-ego0_mean0.004007448735147046
sim_render-ego0_median0.004026583495229042
sim_render-ego0_min0.0038722742687572137
simulation-passed1
step_physics_max0.13205463824218977
step_physics_mean0.1116426709835842
step_physics_median0.1113357339219858
step_physics_min0.09184457784817544
survival_time_max13.400000000000055
survival_time_mean9.75000000000001
survival_time_min6.5999999999999845
No reset possible
5763810900Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:29:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.843168880330584
survival_time_median59.99999999999873
deviation-center-line_median3.1214469802729594
in-drivable-lane_median3.1749999999999567


other stats
agent_compute-ego0_max0.033931988462818155
agent_compute-ego0_mean0.02063924256489979
agent_compute-ego0_median0.01800341756376091
agent_compute-ego0_min0.012618146669259178
complete-iteration_max0.20363806606232376
complete-iteration_mean0.1794782663797011
complete-iteration_median0.17483819751914198
complete-iteration_min0.16459860441819676
deviation-center-line_max3.768746474379085
deviation-center-line_mean2.528392674061533
deviation-center-line_min0.10193026132112556
deviation-heading_max19.175089177656275
deviation-heading_mean11.80233490199574
deviation-heading_median13.789006918899709
deviation-heading_min0.4562365925272608
driven_any_max9.006500056781215
driven_any_mean7.128892101158408
driven_any_median8.370358522564915
driven_any_min2.7683513027225897
driven_lanedir_consec_max6.234729361970917
driven_lanedir_consec_mean4.0181055044631435
driven_lanedir_consec_min0.15135489522048928
driven_lanedir_max8.320973240073235
driven_lanedir_mean5.904959341231086
driven_lanedir_median7.573754614815311
driven_lanedir_min0.15135489522048928
get_duckie_state_max2.0224883296309066e-06
get_duckie_state_mean1.914672994544479e-06
get_duckie_state_median1.8826910459832776e-06
get_duckie_state_min1.870821556580454e-06
get_robot_state_max0.003710086101497043
get_robot_state_mean0.0036445066490990575
get_robot_state_median0.0036277469244438737
get_robot_state_min0.0036124466460114414
get_state_dump_max0.0046874041561282345
get_state_dump_mean0.004630415451210825
get_state_dump_median0.004646447746465493
get_state_dump_min0.004541362155784079
get_ui_image_max0.03531216999374758
get_ui_image_mean0.03012093964216924
get_ui_image_median0.029535585111827564
get_ui_image_min0.02610041835127425
in-drivable-lane_max14.80000000000009
in-drivable-lane_mean5.687499999999988
in-drivable-lane_min1.5999999999999464
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.7683513027225897, "get_ui_image": 0.02751120006513296, "step_physics": 0.0981023536538178, "survival_time": 15.85000000000009, "driven_lanedir": 0.15135489522048928, "get_state_dump": 0.004631406106289078, "get_robot_state": 0.003624761629404512, "sim_render-ego0": 0.003921819183061707, "get_duckie_state": 1.888605033826528e-06, "in-drivable-lane": 14.80000000000009, "deviation-heading": 0.4562365925272608, "agent_compute-ego0": 0.013125131715018794, "complete-iteration": 0.16459860441819676, "set_robot_commands": 0.002129152885772897, "deviation-center-line": 0.10193026132112556, "driven_lanedir_consec": 0.15135489522048928, "sim_compute_sim_state": 0.009485438184918095, "sim_compute_performance-ego0": 0.00198142408574902}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.129801460960026, "get_ui_image": 0.03531216999374758, "step_physics": 0.1178447890539749, "survival_time": 59.99999999999873, "driven_lanedir": 7.217269273798594, "get_state_dump": 0.004541362155784079, "get_robot_state": 0.0036124466460114414, "sim_render-ego0": 0.003775502720244421, "get_duckie_state": 1.8767770581400264e-06, "in-drivable-lane": 3.4499999999999273, "deviation-heading": 19.175089177656275, "agent_compute-ego0": 0.022881703412503028, "complete-iteration": 0.20363806606232376, "set_robot_commands": 0.002171984322362895, "deviation-center-line": 3.768746474379085, "driven_lanedir_consec": 3.646313174083749, "sim_compute_sim_state": 0.011429205028143256, "sim_compute_performance-ego0": 0.0019771290460692953}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.006500056781215, "get_ui_image": 0.031559970158522174, "step_physics": 0.10374001301297736, "survival_time": 59.99999999999873, "driven_lanedir": 8.320973240073235, "get_state_dump": 0.00466148938664191, "get_robot_state": 0.003630732219483235, "sim_render-ego0": 0.003830802529975834, "get_duckie_state": 1.870821556580454e-06, "in-drivable-lane": 2.899999999999986, "deviation-heading": 12.214565523149396, "agent_compute-ego0": 0.012618146669259178, "complete-iteration": 0.17563200036651586, "set_robot_commands": 0.0021585741209844862, "deviation-center-line": 2.8642076819711866, "driven_lanedir_consec": 6.040024586577419, "sim_compute_sim_state": 0.011366976587897436, "sim_compute_performance-ego0": 0.001977234259930181}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.610915584169804, "get_ui_image": 0.02610041835127425, "step_physics": 0.0912550170653865, "survival_time": 59.99999999999873, "driven_lanedir": 7.930239955832027, "get_state_dump": 0.0046874041561282345, "get_robot_state": 0.003710086101497043, "sim_render-ego0": 0.003903587890802871, "get_duckie_state": 2.0224883296309066e-06, "in-drivable-lane": 1.5999999999999464, "deviation-heading": 15.363448314650022, "agent_compute-ego0": 0.033931988462818155, "complete-iteration": 0.17404439467176808, "set_robot_commands": 0.0023580286326158255, "deviation-center-line": 3.3786862785747327, "driven_lanedir_consec": 6.234729361970917, "sim_compute_sim_state": 0.005970190208619282, "sim_compute_performance-ego0": 0.002039066262288852}}
set_robot_commands_max0.0023580286326158255
set_robot_commands_mean0.002204434990434026
set_robot_commands_median0.0021652792216736907
set_robot_commands_min0.002129152885772897
sim_compute_performance-ego0_max0.002039066262288852
sim_compute_performance-ego0_mean0.0019937134135093373
sim_compute_performance-ego0_median0.0019793291728396004
sim_compute_performance-ego0_min0.0019771290460692953
sim_compute_sim_state_max0.011429205028143256
sim_compute_sim_state_mean0.009562952502394518
sim_compute_sim_state_median0.010426207386407768
sim_compute_sim_state_min0.005970190208619282
sim_render-ego0_max0.003921819183061707
sim_render-ego0_mean0.003857928081021209
sim_render-ego0_median0.003867195210389353
sim_render-ego0_min0.003775502720244421
simulation-passed1
step_physics_max0.1178447890539749
step_physics_mean0.10273554319653912
step_physics_median0.10092118333339758
step_physics_min0.0912550170653865
survival_time_max59.99999999999873
survival_time_mean48.96249999999907
survival_time_min15.85000000000009
No reset possible
5763411426Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-testingLFP-simhost-erroryesnogpu-prod-080:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5759110887Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:29:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.4166391314411095
survival_time_median48.424999999999386
deviation-center-line_median1.4848404473899186
in-drivable-lane_median21.6499999999998


other stats
agent_compute-ego0_max0.04920014356955504
agent_compute-ego0_mean0.037011546171209046
agent_compute-ego0_median0.04102707214760639
agent_compute-ego0_min0.01679189682006836
complete-iteration_max0.2161442886164159
complete-iteration_mean0.19640686770045385
complete-iteration_median0.19681122393895076
complete-iteration_min0.17586073430749796
deviation-center-line_max3.4656612903398663
deviation-center-line_mean1.841699372692139
deviation-center-line_min0.9314553056488512
deviation-heading_max11.215007060483195
deviation-heading_mean6.757828264329937
deviation-heading_median5.9950228733581445
deviation-heading_min3.8262602501202623
driven_any_max7.864796492241269
driven_any_mean6.425870645679611
driven_any_median6.3193770778699925
driven_any_min5.199931934737188
driven_lanedir_consec_max7.682166675716279
driven_lanedir_consec_mean4.2945763205798775
driven_lanedir_consec_min2.662860343721012
driven_lanedir_max7.682166675716279
driven_lanedir_mean4.2945763205798775
driven_lanedir_median3.4166391314411095
driven_lanedir_min2.662860343721012
get_duckie_state_max1.4101492392050254e-06
get_duckie_state_mean1.2999811512939418e-06
get_duckie_state_median1.2684681772776435e-06
get_duckie_state_min1.2528390114154545e-06
get_robot_state_max0.003906090195114548
get_robot_state_mean0.003751656886650841
get_robot_state_median0.003706868615349744
get_robot_state_min0.003686800120789328
get_state_dump_max0.004873257096264384
get_state_dump_mean0.004722195340215951
get_state_dump_median0.004713215987319739
get_state_dump_min0.004589092289959943
get_ui_image_max0.035015518577010546
get_ui_image_mean0.030337516199618435
get_ui_image_median0.030235325704347133
get_ui_image_min0.02586389481276894
in-drivable-lane_max24.749999999999815
in-drivable-lane_mean17.012499999999854
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.888367926538822, "get_ui_image": 0.028498298787976627, "step_physics": 0.09793499353134186, "survival_time": 50.64999999999926, "driven_lanedir": 4.029411176300184, "get_state_dump": 0.004741073360104532, "get_robot_state": 0.003694411565566204, "sim_render-ego0": 0.003976240901081755, "get_duckie_state": 1.280970827362241e-06, "in-drivable-lane": 24.749999999999815, "deviation-heading": 3.8262602501202623, "agent_compute-ego0": 0.04920014356955504, "complete-iteration": 0.2034696754384088, "set_robot_commands": 0.0023075669004602073, "deviation-center-line": 0.9314553056488512, "driven_lanedir_consec": 4.029411176300184, "sim_compute_sim_state": 0.010960954180835971, "sim_compute_performance-ego0": 0.0020660507608447555}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.199931934737188, "get_ui_image": 0.035015518577010546, "step_physics": 0.10851422003757806, "survival_time": 40.44999999999984, "driven_lanedir": 2.662860343721012, "get_state_dump": 0.004589092289959943, "get_robot_state": 0.003686800120789328, "sim_render-ego0": 0.003910663098464777, "get_duckie_state": 1.255965527193046e-06, "in-drivable-lane": 18.79999999999978, "deviation-heading": 6.316140143783819, "agent_compute-ego0": 0.04371218534163487, "complete-iteration": 0.2161442886164159, "set_robot_commands": 0.002293060149675534, "deviation-center-line": 1.4524962049117016, "driven_lanedir_consec": 2.662860343721012, "sim_compute_sim_state": 0.012290706752259054, "sim_compute_performance-ego0": 0.002043379677666558}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.750386229201163, "get_ui_image": 0.03197235262071764, "step_physics": 0.11261032439566948, "survival_time": 46.19999999999951, "driven_lanedir": 2.8038670865820348, "get_state_dump": 0.004685358614534945, "get_robot_state": 0.003906090195114548, "sim_render-ego0": 0.0041485353418298666, "get_duckie_state": 1.4101492392050254e-06, "in-drivable-lane": 24.499999999999815, "deviation-heading": 5.67390560293247, "agent_compute-ego0": 0.01679189682006836, "complete-iteration": 0.19015277243949272, "set_robot_commands": 0.002344953176137563, "deviation-center-line": 1.5171846898681354, "driven_lanedir_consec": 2.8038670865820348, "sim_compute_sim_state": 0.011436546686533336, "sim_compute_performance-ego0": 0.002161379891472894}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.864796492241269, "get_ui_image": 0.02586389481276894, "step_physics": 0.08853073997561084, "survival_time": 59.99999999999873, "driven_lanedir": 7.682166675716279, "get_state_dump": 0.004873257096264384, "get_robot_state": 0.0037193256651332834, "sim_render-ego0": 0.0038520799489144384, "get_duckie_state": 1.2528390114154545e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.215007060483195, "agent_compute-ego0": 0.03834195895357791, "complete-iteration": 0.17586073430749796, "set_robot_commands": 0.0022867607335861676, "deviation-center-line": 3.4656612903398663, "driven_lanedir_consec": 7.682166675716279, "sim_compute_sim_state": 0.006251548748032239, "sim_compute_performance-ego0": 0.0020552163914181014}}
set_robot_commands_max0.002344953176137563
set_robot_commands_mean0.002308085239964868
set_robot_commands_median0.0023003135250678707
set_robot_commands_min0.0022867607335861676
sim_compute_performance-ego0_max0.002161379891472894
sim_compute_performance-ego0_mean0.0020815066803505774
sim_compute_performance-ego0_median0.002060633576131428
sim_compute_performance-ego0_min0.002043379677666558
sim_compute_sim_state_max0.012290706752259054
sim_compute_sim_state_mean0.01023493909191515
sim_compute_sim_state_median0.011198750433684656
sim_compute_sim_state_min0.006251548748032239
sim_render-ego0_max0.0041485353418298666
sim_render-ego0_mean0.003971879822572709
sim_render-ego0_median0.0039434519997732665
sim_render-ego0_min0.0038520799489144384
simulation-passed1
step_physics_max0.11261032439566948
step_physics_mean0.10189756948505004
step_physics_median0.10322460678445997
step_physics_min0.08853073997561084
survival_time_max59.99999999999873
survival_time_mean49.324999999999335
survival_time_min40.44999999999984
No reset possible
5740810939Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:46:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01372744161620128
agent_compute-ego0_mean0.01197754239956604
agent_compute-ego0_median0.011623790321699488
agent_compute-ego0_min0.010935147338663909
complete-iteration_max0.3431875916146716
complete-iteration_mean0.2819384545906696
complete-iteration_median0.2773478630678937
complete-iteration_min0.2298705006122192
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max2.3567904838415903e-06
get_duckie_state_mean2.1411516982053935e-06
get_duckie_state_median2.1546012058940955e-06
get_duckie_state_min1.8986138971917933e-06
get_robot_state_max0.0037630503620335104
get_robot_state_mean0.003623916644240101
get_robot_state_median0.003598380446136246
get_robot_state_min0.0035358553226544
get_state_dump_max0.0047575617511504695
get_state_dump_mean0.004563366245171311
get_state_dump_median0.004581871278875575
get_state_dump_min0.004332160671783625
get_ui_image_max0.035143668804438685
get_ui_image_mean0.029520571132583683
get_ui_image_median0.02867869681660877
get_ui_image_min0.025581222092678504
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02726738935307003, "step_physics": 0.20304327007138065, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004689367486475707, "get_robot_state": 0.003605052890825232, "sim_render-ego0": 0.003775285344437497, "get_duckie_state": 2.169390701433701e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.011138775465788196, "complete-iteration": 0.2661885770532511, "set_robot_commands": 0.0021651672582443707, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008454847693145523, "sim_compute_performance-ego0": 0.0019675702675494623}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.035143668804438685, "step_physics": 0.26571058810104636, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.0047575617511504695, "get_robot_state": 0.0037630503620335104, "sim_render-ego0": 0.003997087677154414, "get_duckie_state": 2.3567904838415903e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.01372744161620128, "complete-iteration": 0.3431875916146716, "set_robot_commands": 0.002290023554373939, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011625096760224938, "sim_compute_performance-ego0": 0.002080904057778288}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.030090004280147502, "step_physics": 0.22349725853493568, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004332160671783625, "get_robot_state": 0.0035358553226544, "sim_render-ego0": 0.003697358202080643, "get_duckie_state": 1.8986138971917933e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.010935147338663909, "complete-iteration": 0.2885071490825364, "set_robot_commands": 0.00211318168513086, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008334739122859246, "sim_compute_performance-ego0": 0.0018936825433837484}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.025581222092678504, "step_physics": 0.17027820774557986, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004474375071275443, "get_robot_state": 0.0035917080014472597, "sim_render-ego0": 0.0037628937323424937, "get_duckie_state": 2.13981171035449e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.01210880517761078, "complete-iteration": 0.2298705006122192, "set_robot_commands": 0.0021718765277846668, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.005897629171684323, "sim_compute_performance-ego0": 0.001922623501729211}}
set_robot_commands_max0.002290023554373939
set_robot_commands_mean0.002185062256383459
set_robot_commands_median0.0021685218930145187
set_robot_commands_min0.00211318168513086
sim_compute_performance-ego0_max0.002080904057778288
sim_compute_performance-ego0_mean0.0019661950926101773
sim_compute_performance-ego0_median0.0019450968846393365
sim_compute_performance-ego0_min0.0018936825433837484
sim_compute_sim_state_max0.011625096760224938
sim_compute_sim_state_mean0.008578078186978507
sim_compute_sim_state_median0.008394793408002385
sim_compute_sim_state_min0.005897629171684323
sim_render-ego0_max0.003997087677154414
sim_render-ego0_mean0.003808156239003762
sim_render-ego0_median0.003769089538389995
sim_render-ego0_min0.003697358202080643
simulation-passed1
step_physics_max0.26571058810104636
step_physics_mean0.21563233111323565
step_physics_median0.21327026430315815
step_physics_min0.17027820774557986
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5731510963Himanshu Arora 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:20:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.907163730460652
survival_time_median38.849999999999795
deviation-center-line_median1.2060585384482845
in-drivable-lane_median10.999999999999815


other stats
agent_compute-ego0_max0.013060460909448488
agent_compute-ego0_mean0.01226931632706915
agent_compute-ego0_median0.012131619169097066
agent_compute-ego0_min0.01175356606063398
complete-iteration_max0.21159451802571613
complete-iteration_mean0.17897678179181953
complete-iteration_median0.17566759297271828
complete-iteration_min0.15297742319612537
deviation-center-line_max3.0659195904610113
deviation-center-line_mean1.417364958738819
deviation-center-line_min0.1914231675976956
deviation-heading_max12.629613778997404
deviation-heading_mean6.990340676488913
deviation-heading_median7.126335248161704
deviation-heading_min1.0790784306348389
driven_any_max10.980568696938027
driven_any_mean6.250207853072632
driven_any_median6.58804766334865
driven_any_min0.8441673886551984
driven_lanedir_consec_max8.113450746013758
driven_lanedir_consec_mean3.100439366696336
driven_lanedir_consec_min0.47397925985028255
driven_lanedir_max8.154394033480369
driven_lanedir_mean3.4730888514704565
driven_lanedir_median2.631991056275587
driven_lanedir_min0.47397925985028255
get_duckie_state_max2.0015119302152384e-06
get_duckie_state_mean1.908232343931776e-06
get_duckie_state_median1.8835734703234704e-06
get_duckie_state_min1.864270504864924e-06
get_robot_state_max0.003691785263292717
get_robot_state_mean0.0035198767053964187
get_robot_state_median0.003508064645760472
get_robot_state_min0.003371592266772014
get_state_dump_max0.005141361020900336
get_state_dump_mean0.0046336376572665705
get_state_dump_median0.004543943627916202
get_state_dump_min0.004305302352333546
get_ui_image_max0.03324825366338094
get_ui_image_mean0.02931404282259728
get_ui_image_median0.02941798482113953
get_ui_image_min0.02517194798472913
in-drivable-lane_max34.899999999999366
in-drivable-lane_mean14.862499999999748
in-drivable-lane_min2.549999999999991
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.980568696938027, "get_ui_image": 0.026162483809294052, "step_physics": 0.0945819716568692, "survival_time": 59.99999999999873, "driven_lanedir": 8.154394033480369, "get_state_dump": 0.004305302352333546, "get_robot_state": 0.003371592266772014, "sim_render-ego0": 0.0035980680800794464, "get_duckie_state": 1.864270504864924e-06, "in-drivable-lane": 14.099999999999564, "deviation-heading": 12.629613778997404, "agent_compute-ego0": 0.01175356606063398, "complete-iteration": 0.15689001829796886, "set_robot_commands": 0.002004846347360984, "deviation-center-line": 3.0659195904610113, "driven_lanedir_consec": 8.113450746013758, "sim_compute_sim_state": 0.009234120704847809, "sim_compute_performance-ego0": 0.0017971275847321446}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.8441673886551984, "get_ui_image": 0.03324825366338094, "step_physics": 0.14119286934534708, "survival_time": 5.949999999999987, "driven_lanedir": 0.47397925985028255, "get_state_dump": 0.004467195272445679, "get_robot_state": 0.003469228744506836, "sim_render-ego0": 0.0035765846570332844, "get_duckie_state": 1.8854935963948567e-06, "in-drivable-lane": 2.549999999999991, "deviation-heading": 1.0790784306348389, "agent_compute-ego0": 0.011971515417099, "complete-iteration": 0.21159451802571613, "set_robot_commands": 0.002160880963007609, "deviation-center-line": 0.1914231675976956, "driven_lanedir_consec": 0.47397925985028255, "sim_compute_sim_state": 0.009607509771982829, "sim_compute_performance-ego0": 0.001817484696706136}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.404751249516611, "get_ui_image": 0.032673485832985, "step_physics": 0.12018656778817224, "survival_time": 49.44999999999933, "driven_lanedir": 1.980046732695704, "get_state_dump": 0.004620691983386723, "get_robot_state": 0.003691785263292717, "sim_render-ego0": 0.004021681197965988, "get_duckie_state": 2.0015119302152384e-06, "in-drivable-lane": 34.899999999999366, "deviation-heading": 7.552274597637076, "agent_compute-ego0": 0.013060460909448488, "complete-iteration": 0.19444516764746772, "set_robot_commands": 0.0022314721887761895, "deviation-center-line": 1.1422696604476965, "driven_lanedir_consec": 1.9767815320485005, "sim_compute_sim_state": 0.011841689456592908, "sim_compute_performance-ego0": 0.0020260933673743047}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.7713440771806885, "get_ui_image": 0.02517194798472913, "step_physics": 0.0936280821742944, "survival_time": 28.250000000000263, "driven_lanedir": 3.2839353798554702, "get_state_dump": 0.005141361020900336, "get_robot_state": 0.0035469005470141085, "sim_render-ego0": 0.003767943213769488, "get_duckie_state": 1.8816533442520845e-06, "in-drivable-lane": 7.900000000000065, "deviation-heading": 6.700395898686332, "agent_compute-ego0": 0.01229172292109513, "complete-iteration": 0.15297742319612537, "set_robot_commands": 0.0020703869236652927, "deviation-center-line": 1.269847416448872, "driven_lanedir_consec": 1.8375459288728035, "sim_compute_sim_state": 0.0054342211767136, "sim_compute_performance-ego0": 0.0018424431763773672}}
set_robot_commands_max0.0022314721887761895
set_robot_commands_mean0.002116896605702519
set_robot_commands_median0.002115633943336451
set_robot_commands_min0.002004846347360984
sim_compute_performance-ego0_max0.0020260933673743047
sim_compute_performance-ego0_mean0.0018707872062974885
sim_compute_performance-ego0_median0.0018299639365417517
sim_compute_performance-ego0_min0.0017971275847321446
sim_compute_sim_state_max0.011841689456592908
sim_compute_sim_state_mean0.009029385277534286
sim_compute_sim_state_median0.009420815238415318
sim_compute_sim_state_min0.0054342211767136
sim_render-ego0_max0.004021681197965988
sim_render-ego0_mean0.003741069287212051
sim_render-ego0_median0.003683005646924467
sim_render-ego0_min0.0035765846570332844
simulation-passed1
step_physics_max0.14119286934534708
step_physics_mean0.11239737274117072
step_physics_median0.10738426972252071
step_physics_min0.0936280821742944
survival_time_max59.99999999999873
survival_time_mean35.912499999999575
survival_time_min5.949999999999987
No reset possible
5723210987Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:15:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5008219613069828
survival_time_median24.5750000000002
deviation-center-line_median0.3846654861523663
in-drivable-lane_median19.550000000000068


other stats
agent_compute-ego0_max0.01334709279677447
agent_compute-ego0_mean0.012947748750170813
agent_compute-ego0_median0.01296359257358944
agent_compute-ego0_min0.0125167170567299
complete-iteration_max0.1990322517898847
complete-iteration_mean0.1828328416010067
complete-iteration_median0.17902157071225888
complete-iteration_min0.17425597318962438
deviation-center-line_max0.4480489643034822
deviation-center-line_mean0.3811775882638106
deviation-center-line_min0.3073304164470277
deviation-heading_max3.042138348952368
deviation-heading_mean2.311358484477011
deviation-heading_median2.798936735894708
deviation-heading_min0.6054221171662615
driven_any_max6.584810833123453
driven_any_mean4.4339710913812
driven_any_median4.56331370776409
driven_any_min2.0244461168731673
driven_lanedir_consec_max0.977180437930188
driven_lanedir_consec_mean0.5736183338176724
driven_lanedir_consec_min0.3156489747265361
driven_lanedir_max0.977180437930188
driven_lanedir_mean0.5736183338176724
driven_lanedir_median0.5008219613069828
driven_lanedir_min0.3156489747265361
get_duckie_state_max1.7004193000073702e-06
get_duckie_state_mean1.6048655843347978e-06
get_duckie_state_median1.6018498505024083e-06
get_duckie_state_min1.515343336327004e-06
get_robot_state_max0.003969361888828562
get_robot_state_mean0.0039095088145280985
get_robot_state_median0.003933344797402923
get_robot_state_min0.003801983774477987
get_state_dump_max0.005049624371884474
get_state_dump_mean0.004916328888223112
get_state_dump_median0.0049012063791859135
get_state_dump_min0.004813278422636145
get_ui_image_max0.03490012726693783
get_ui_image_mean0.03066080932144889
get_ui_image_median0.030624421974502665
get_ui_image_min0.02649426606985239
in-drivable-lane_max29.550000000000285
in-drivable-lane_mean19.48750000000012
in-drivable-lane_min9.300000000000058
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.8610465046159046, "get_ui_image": 0.028528363669096533, "step_physics": 0.10519293600053928, "survival_time": 16.700000000000102, "driven_lanedir": 0.495878773169077, "get_state_dump": 0.005049624371884474, "get_robot_state": 0.003969361888828562, "sim_render-ego0": 0.004030776379713372, "get_duckie_state": 1.6183995488864273e-06, "in-drivable-lane": 11.80000000000005, "deviation-heading": 3.042138348952368, "agent_compute-ego0": 0.0125167170567299, "complete-iteration": 0.17425597318962438, "set_robot_commands": 0.0022149235454957876, "deviation-center-line": 0.435566367148998, "driven_lanedir_consec": 0.495878773169077, "sim_compute_sim_state": 0.010449474961010376, "sim_compute_performance-ego0": 0.002199109632577469}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.0244461168731673, "get_ui_image": 0.03490012726693783, "step_physics": 0.12261389426465304, "survival_time": 13.200000000000053, "driven_lanedir": 0.3156489747265361, "get_state_dump": 0.004867975666837872, "get_robot_state": 0.0039149482295198264, "sim_render-ego0": 0.004036829606542047, "get_duckie_state": 1.7004193000073702e-06, "in-drivable-lane": 9.300000000000058, "deviation-heading": 2.941510305865754, "agent_compute-ego0": 0.013328263444720576, "complete-iteration": 0.1990322517898847, "set_robot_commands": 0.002214394875292508, "deviation-center-line": 0.33376460515573453, "driven_lanedir_consec": 0.3156489747265361, "sim_compute_sim_state": 0.010856454777267745, "sim_compute_performance-ego0": 0.0021881337435740345}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.584810833123453, "get_ui_image": 0.0327204802799088, "step_physics": 0.10942414022415577, "survival_time": 34.80000000000016, "driven_lanedir": 0.977180437930188, "get_state_dump": 0.004813278422636145, "get_robot_state": 0.003801983774477987, "sim_render-ego0": 0.0040379897764799754, "get_duckie_state": 1.515343336327004e-06, "in-drivable-lane": 27.30000000000008, "deviation-heading": 2.656363165923662, "agent_compute-ego0": 0.01334709279677447, "complete-iteration": 0.18301905894724163, "set_robot_commands": 0.002358086653043071, "deviation-center-line": 0.4480489643034822, "driven_lanedir_consec": 0.977180437930188, "sim_compute_sim_state": 0.010340730976340076, "sim_compute_performance-ego0": 0.002072957530083239}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.265580910912274, "get_ui_image": 0.02649426606985239, "step_physics": 0.11214235709263728, "survival_time": 32.450000000000294, "driven_lanedir": 0.5057651494448885, "get_state_dump": 0.004934437091533955, "get_robot_state": 0.00395174136528602, "sim_render-ego0": 0.003979254869314341, "get_duckie_state": 1.5853001521183894e-06, "in-drivable-lane": 29.550000000000285, "deviation-heading": 0.6054221171662615, "agent_compute-ego0": 0.012598921702458308, "complete-iteration": 0.17502408247727613, "set_robot_commands": 0.0022844332915086013, "deviation-center-line": 0.3073304164470277, "driven_lanedir_consec": 0.5057651494448885, "sim_compute_sim_state": 0.0063754129409790035, "sim_compute_performance-ego0": 0.0021607758448674128}}
set_robot_commands_max0.002358086653043071
set_robot_commands_mean0.002267959591334992
set_robot_commands_median0.0022496784185021945
set_robot_commands_min0.002214394875292508
sim_compute_performance-ego0_max0.002199109632577469
sim_compute_performance-ego0_mean0.0021552441877755388
sim_compute_performance-ego0_median0.0021744547942207236
sim_compute_performance-ego0_min0.002072957530083239
sim_compute_sim_state_max0.010856454777267745
sim_compute_sim_state_mean0.0095055184138993
sim_compute_sim_state_median0.010395102968675228
sim_compute_sim_state_min0.0063754129409790035
sim_render-ego0_max0.0040379897764799754
sim_render-ego0_mean0.004021212658012434
sim_render-ego0_median0.00403380299312771
sim_render-ego0_min0.003979254869314341
simulation-passed1
step_physics_max0.12261389426465304
step_physics_mean0.11234333189549636
step_physics_median0.11078324865839652
step_physics_min0.10519293600053928
survival_time_max34.80000000000016
survival_time_mean24.28750000000015
survival_time_min13.200000000000053
No reset possible
5710511018Olga (Ge Ya) Xu 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:33:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.821182641104963
survival_time_median59.99999999999873
deviation-center-line_median4.015458440025259
in-drivable-lane_median8.29999999999974


other stats
agent_compute-ego0_max0.013148894602918673
agent_compute-ego0_mean0.012874079878956987
agent_compute-ego0_median0.012931029167302342
agent_compute-ego0_min0.012485366578304598
complete-iteration_max0.200455980237378
complete-iteration_mean0.17641832344663716
complete-iteration_median0.17627908624730612
complete-iteration_min0.1526591410545584
deviation-center-line_max4.430745394382918
deviation-center-line_mean3.8390069959439383
deviation-center-line_min2.8943657093423183
deviation-heading_max18.10465164932552
deviation-heading_mean14.763295216153072
deviation-heading_median13.705678382118212
deviation-heading_min13.53717245105035
driven_any_max9.459738457758643
driven_any_mean7.082075247793877
driven_any_median6.862902068250334
driven_any_min5.1427583969161965
driven_lanedir_consec_max8.692790577152854
driven_lanedir_consec_mean5.9782472275460385
driven_lanedir_consec_min3.5778330508213747
driven_lanedir_max8.692790577152854
driven_lanedir_mean5.984491223019331
driven_lanedir_median5.821182641104963
driven_lanedir_min3.6028090327145477
get_duckie_state_max1.3570602887079775e-06
get_duckie_state_mean1.321703671447261e-06
get_duckie_state_median1.3265466897136606e-06
get_duckie_state_min1.2766610176537457e-06
get_robot_state_max0.003824319370978083
get_robot_state_mean0.0037462663364852536
get_robot_state_median0.003760138354473257
get_robot_state_min0.003640469266016418
get_state_dump_max0.004770158640927779
get_state_dump_mean0.0047374530029833765
get_state_dump_median0.004731615913797675
get_state_dump_min0.0047164215434103785
get_ui_image_max0.03604175863813897
get_ui_image_mean0.03050493081112651
get_ui_image_median0.03023722872083659
get_ui_image_min0.025503507164693892
in-drivable-lane_max14.599999999999415
in-drivable-lane_mean9.124999999999648
in-drivable-lane_min5.299999999999699
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.459738457758643, "get_ui_image": 0.028262561405826662, "step_physics": 0.09798473223956997, "survival_time": 59.99999999999873, "driven_lanedir": 8.692790577152854, "get_state_dump": 0.004732255832440252, "get_robot_state": 0.003722513645118123, "sim_render-ego0": 0.003888047009483166, "get_duckie_state": 1.354876604802801e-06, "in-drivable-lane": 5.299999999999699, "deviation-heading": 13.573941263432914, "agent_compute-ego0": 0.012778357006330275, "complete-iteration": 0.16473702506955518, "set_robot_commands": 0.0022139783505099103, "deviation-center-line": 3.9246438190069832, "driven_lanedir_consec": 8.692790577152854, "sim_compute_sim_state": 0.009075291051554938, "sim_compute_performance-ego0": 0.0019946231333838214}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.796734594696745, "get_ui_image": 0.03604175863813897, "step_physics": 0.12217413217797068, "survival_time": 59.99999999999873, "driven_lanedir": 5.533063227058496, "get_state_dump": 0.004730975995155099, "get_robot_state": 0.003824319370978083, "sim_render-ego0": 0.004070726461354938, "get_duckie_state": 1.3570602887079775e-06, "in-drivable-lane": 9.999999999999538, "deviation-heading": 18.10465164932552, "agent_compute-ego0": 0.01308370132827441, "complete-iteration": 0.200455980237378, "set_robot_commands": 0.0023002695977737465, "deviation-center-line": 4.106273061043534, "driven_lanedir_consec": 5.533063227058496, "sim_compute_sim_state": 0.011992656420311464, "sim_compute_performance-ego0": 0.002148538108273013}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.1427583969161965, "get_ui_image": 0.03221189603584651, "step_physics": 0.11334031970359287, "survival_time": 49.59999999999932, "driven_lanedir": 3.6028090327145477, "get_state_dump": 0.004770158640927779, "get_robot_state": 0.0037977630638283905, "sim_render-ego0": 0.0039823912421742234, "get_duckie_state": 1.29821677462452e-06, "in-drivable-lane": 14.599999999999415, "deviation-heading": 13.53717245105035, "agent_compute-ego0": 0.013148894602918673, "complete-iteration": 0.18782114742505707, "set_robot_commands": 0.0022819632850024636, "deviation-center-line": 2.8943657093423183, "driven_lanedir_consec": 3.5778330508213747, "sim_compute_sim_state": 0.012127714694926866, "sim_compute_performance-ego0": 0.002071811113232692}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.929069541803924, "get_ui_image": 0.025503507164693892, "step_physics": 0.09224697811021892, "survival_time": 59.99999999999873, "driven_lanedir": 6.10930205515143, "get_state_dump": 0.0047164215434103785, "get_robot_state": 0.003640469266016418, "sim_render-ego0": 0.003791806898347345, "get_duckie_state": 1.2766610176537457e-06, "in-drivable-lane": 6.599999999999941, "deviation-heading": 13.837415500803507, "agent_compute-ego0": 0.012485366578304598, "complete-iteration": 0.1526591410545584, "set_robot_commands": 0.002153562963455543, "deviation-center-line": 4.430745394382918, "driven_lanedir_consec": 6.10930205515143, "sim_compute_sim_state": 0.006101877663554399, "sim_compute_performance-ego0": 0.0019360871041049369}}
set_robot_commands_max0.0023002695977737465
set_robot_commands_mean0.002237443549185415
set_robot_commands_median0.0022479708177561867
set_robot_commands_min0.002153562963455543
sim_compute_performance-ego0_max0.002148538108273013
sim_compute_performance-ego0_mean0.0020377648647486157
sim_compute_performance-ego0_median0.0020332171233082568
sim_compute_performance-ego0_min0.0019360871041049369
sim_compute_sim_state_max0.012127714694926866
sim_compute_sim_state_mean0.009824384957586916
sim_compute_sim_state_median0.010533973735933202
sim_compute_sim_state_min0.006101877663554399
sim_render-ego0_max0.004070726461354938
sim_render-ego0_mean0.003933242902839918
sim_render-ego0_median0.003935219125828695
sim_render-ego0_min0.003791806898347345
simulation-passed1
step_physics_max0.12217413217797068
step_physics_mean0.1064365405578381
step_physics_median0.1056625259715814
step_physics_min0.09224697811021892
survival_time_max59.99999999999873
survival_time_mean57.39999999999888
survival_time_min49.59999999999932
No reset possible
5709011024Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 66, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 62, in compute_action
              ||     action = self.model.predict(observation)
              ||   File "/workspace/model.py", line 118, in predict
              ||     output = self.model(images)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/site-packages/torchvision/models/squeezenet.py", line 100, in forward
              ||     x = self.features(x)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/container.py", line 117, in forward
              ||     input = module(input)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/conv.py", line 423, in forward
              ||     return self._conv_forward(input, self.weight)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/conv.py", line 419, in _conv_forward
              ||     return F.conv2d(input, weight, self.bias, self.stride,
              || TypeError: conv2d(): argument 'input' (position 1) must be Tensor, not numpy.ndarray
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
              ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
              || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7f52beb828e0>>.
              || │       f: <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7f52beb828e0>>
              || │    args: {context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f52b5eb33a0>}
              || │ argspec: ([self, context], None, None, None, [], None, {context: <class 'zuper_nodes_wrapper.interface.Context'>} )
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5702911033Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:11:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 1287 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5700211312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-080:02:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5696111313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-080:08:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5687311064Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:20:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.5340788903083244
survival_time_median33.34999999999994
deviation-center-line_median1.2589088136783315
in-drivable-lane_median8.37499999999996


other stats
agent_compute-ego0_max0.03766069073362399
agent_compute-ego0_mean0.03128691562793475
agent_compute-ego0_median0.03487148455826557
agent_compute-ego0_min0.01774400266158388
complete-iteration_max0.2434007720744356
complete-iteration_mean0.2029826578412803
complete-iteration_median0.19350479977154453
complete-iteration_min0.1815202597475965
deviation-center-line_max2.050895098393646
deviation-center-line_mean1.177028263524785
deviation-center-line_min0.13940032834883098
deviation-heading_max10.017511770698883
deviation-heading_mean6.232751276261876
deviation-heading_median7.053207641782653
deviation-heading_min0.8070780507833191
driven_any_max11.522718669475076
driven_any_mean6.30946626866957
driven_any_median6.060924090455951
driven_any_min1.5932982242912994
driven_lanedir_consec_max8.187459647952615
driven_lanedir_consec_mean3.990713314191413
driven_lanedir_consec_min0.7072358281963844
driven_lanedir_max8.200762693293337
driven_lanedir_mean4.395661784097202
driven_lanedir_median4.337324307449543
driven_lanedir_min0.7072358281963844
get_duckie_state_max2.148187705102911e-06
get_duckie_state_mean2.0313941184430374e-06
get_duckie_state_median2.092689174696899e-06
get_duckie_state_min1.792010419275441e-06
get_robot_state_max0.003863021077515071
get_robot_state_mean0.0036918212122423622
get_robot_state_median0.0036868380449647095
get_robot_state_min0.003530587681524958
get_state_dump_max0.004812161586576466
get_state_dump_mean0.0046873367800114515
get_state_dump_median0.004759883248454513
get_state_dump_min0.004417419036560313
get_ui_image_max0.03643636602036496
get_ui_image_mean0.0309042994022401
get_ui_image_median0.030169304234807043
get_ui_image_min0.02684222311898135
in-drivable-lane_max15.599999999999266
in-drivable-lane_mean9.4499999999998
in-drivable-lane_min5.450000000000012
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.522718669475076, "get_ui_image": 0.02684222311898135, "step_physics": 0.09546332395046976, "survival_time": 59.99999999999873, "driven_lanedir": 8.200762693293337, "get_state_dump": 0.004417419036560313, "get_robot_state": 0.003530587681524958, "sim_render-ego0": 0.003748645194861216, "get_duckie_state": 1.792010419275441e-06, "in-drivable-lane": 15.599999999999266, "deviation-heading": 10.017511770698883, "agent_compute-ego0": 0.03359532038635457, "complete-iteration": 0.1815202597475965, "set_robot_commands": 0.0021510624468673973, "deviation-center-line": 2.050895098393646, "driven_lanedir_consec": 8.187459647952615, "sim_compute_sim_state": 0.009760716872648038, "sim_compute_performance-ego0": 0.001926097742822347}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.056606363530191, "get_ui_image": 0.03643636602036496, "step_physics": 0.14237297950906955, "survival_time": 23.4500000000002, "driven_lanedir": 2.0956780717542225, "get_state_dump": 0.004719081330806651, "get_robot_state": 0.0036727032762892704, "sim_render-ego0": 0.003948690536174368, "get_duckie_state": 2.076778006046376e-06, "in-drivable-lane": 9.950000000000085, "deviation-heading": 5.865843628110143, "agent_compute-ego0": 0.03614764873017656, "complete-iteration": 0.2434007720744356, "set_robot_commands": 0.0022719271639560132, "deviation-center-line": 0.8469048877252254, "driven_lanedir_consec": 1.3207093173291418, "sim_compute_sim_state": 0.01171970063067497, "sim_compute_performance-ego0": 0.00201781709143456}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.065241817381711, "get_ui_image": 0.03315188675499403, "step_physics": 0.12061006257495484, "survival_time": 43.24999999999968, "driven_lanedir": 6.578970543144863, "get_state_dump": 0.004812161586576466, "get_robot_state": 0.003863021077515071, "sim_render-ego0": 0.004061628434179011, "get_duckie_state": 2.1086003433474217e-06, "in-drivable-lane": 6.799999999999835, "deviation-heading": 8.240571655455163, "agent_compute-ego0": 0.01774400266158388, "complete-iteration": 0.2005125889877249, "set_robot_commands": 0.002370628693913202, "deviation-center-line": 1.6709127396314385, "driven_lanedir_consec": 5.747448463287507, "sim_compute_sim_state": 0.011652198454524296, "sim_compute_performance-ego0": 0.0021519790345471673}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.5932982242912994, "get_ui_image": 0.027186721714620055, "step_physics": 0.09960972476126578, "survival_time": 9.800000000000004, "driven_lanedir": 0.7072358281963844, "get_state_dump": 0.004800685166102376, "get_robot_state": 0.003700972813640149, "sim_render-ego0": 0.003943273863816625, "get_duckie_state": 2.148187705102911e-06, "in-drivable-lane": 5.450000000000012, "deviation-heading": 0.8070780507833191, "agent_compute-ego0": 0.03766069073362399, "complete-iteration": 0.18649701055536416, "set_robot_commands": 0.002277000301380448, "deviation-center-line": 0.13940032834883098, "driven_lanedir_consec": 0.7072358281963844, "sim_compute_sim_state": 0.005241899926045219, "sim_compute_performance-ego0": 0.001984084318131965}}
set_robot_commands_max0.002370628693913202
set_robot_commands_mean0.002267654651529265
set_robot_commands_median0.0022744637326682308
set_robot_commands_min0.0021510624468673973
sim_compute_performance-ego0_max0.0021519790345471673
sim_compute_performance-ego0_mean0.0020199945467340094
sim_compute_performance-ego0_median0.0020009507047832626
sim_compute_performance-ego0_min0.001926097742822347
sim_compute_sim_state_max0.01171970063067497
sim_compute_sim_state_mean0.009593628970973132
sim_compute_sim_state_median0.010706457663586168
sim_compute_sim_state_min0.005241899926045219
sim_render-ego0_max0.004061628434179011
sim_render-ego0_mean0.0039255595072578055
sim_render-ego0_median0.0039459821999954965
sim_render-ego0_min0.003748645194861216
simulation-passed1
step_physics_max0.14237297950906955
step_physics_mean0.11451402269893998
step_physics_median0.1101098936681103
step_physics_min0.09546332395046976
survival_time_max59.99999999999873
survival_time_mean34.12499999999965
survival_time_min9.800000000000004
No reset possible
5681511079Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:06:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5656941015845567
survival_time_median5.524999999999988
deviation-center-line_median0.14843715359454046
in-drivable-lane_median3.049999999999989


other stats
agent_compute-ego0_max0.014155477285385132
agent_compute-ego0_mean0.013146339599682928
agent_compute-ego0_median0.013389433016010545
agent_compute-ego0_min0.0116510150813255
complete-iteration_max0.20969956408264817
complete-iteration_mean0.18410843931988805
complete-iteration_median0.18892036133658305
complete-iteration_min0.14889347052373805
deviation-center-line_max0.20841425658109217
deviation-center-line_mean0.14465774709223966
deviation-center-line_min0.07334242459878557
deviation-heading_max1.685762571620015
deviation-heading_mean0.9391998110779252
deviation-heading_median0.8219095688745973
deviation-heading_min0.4272175349424907
driven_any_max3.759594763265387
driven_any_mean2.0300398410571896
driven_any_median1.5583442442885769
driven_any_min1.2438761123862176
driven_lanedir_consec_max0.6908539380889679
driven_lanedir_consec_mean0.561672825353186
driven_lanedir_consec_min0.4244491601546625
driven_lanedir_max0.6908539380889679
driven_lanedir_mean0.561672825353186
driven_lanedir_median0.5656941015845567
driven_lanedir_min0.4244491601546625
get_duckie_state_max1.9113725750758177e-06
get_duckie_state_mean1.5597868040484817e-06
get_duckie_state_median1.5306680835903885e-06
get_duckie_state_min1.266438473937332e-06
get_robot_state_max0.004084055240337665
get_robot_state_mean0.00379302710189884
get_robot_state_median0.003806386899993552
get_robot_state_min0.0034752793672705898
get_state_dump_max0.00498886750294612
get_state_dump_mean0.004771108747749749
get_state_dump_median0.004854254679110678
get_state_dump_min0.004387058129831522
get_ui_image_max0.035011419685938024
get_ui_image_mean0.0307158871382636
get_ui_image_median0.031138703328609005
get_ui_image_min0.025574722209898364
in-drivable-lane_max9.95000000000002
in-drivable-lane_mean4.5749999999999975
in-drivable-lane_min2.249999999999994
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.759594763265387, "get_ui_image": 0.02950994576079936, "step_physics": 0.10671003659566244, "survival_time": 11.800000000000033, "driven_lanedir": 0.4244491601546625, "get_state_dump": 0.004980261315776326, "get_robot_state": 0.004005439170805211, "sim_render-ego0": 0.0042077519219635914, "get_duckie_state": 1.9113725750758177e-06, "in-drivable-lane": 9.95000000000002, "deviation-heading": 1.042391190542748, "agent_compute-ego0": 0.01342387239641278, "complete-iteration": 0.1786236209708427, "set_robot_commands": 0.002385611272562405, "deviation-center-line": 0.18924505204096648, "driven_lanedir_consec": 0.4244491601546625, "sim_compute_sim_state": 0.011006034376249032, "sim_compute_performance-ego0": 0.0022893354359558365}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2438761123862176, "get_ui_image": 0.035011419685938024, "step_physics": 0.13498293968939012, "survival_time": 4.599999999999992, "driven_lanedir": 0.450771250019423, "get_state_dump": 0.004728248042445029, "get_robot_state": 0.0036073346291818926, "sim_render-ego0": 0.003991914051835255, "get_duckie_state": 1.266438473937332e-06, "in-drivable-lane": 2.249999999999994, "deviation-heading": 1.685762571620015, "agent_compute-ego0": 0.013354993635608305, "complete-iteration": 0.20969956408264817, "set_robot_commands": 0.0022161365837179204, "deviation-center-line": 0.20841425658109217, "driven_lanedir_consec": 0.450771250019423, "sim_compute_sim_state": 0.009729672503727738, "sim_compute_performance-ego0": 0.0019950071970621743}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4185824788955408, "get_ui_image": 0.032767460896418646, "step_physics": 0.1250136150763585, "survival_time": 5.14999999999999, "driven_lanedir": 0.6908539380889679, "get_state_dump": 0.00498886750294612, "get_robot_state": 0.004084055240337665, "sim_render-ego0": 0.004255709739831777, "get_duckie_state": 1.636835244985727e-06, "in-drivable-lane": 2.5999999999999908, "deviation-heading": 0.6014279472064468, "agent_compute-ego0": 0.014155477285385132, "complete-iteration": 0.19921710170232332, "set_robot_commands": 0.0023503143053788403, "deviation-center-line": 0.10762925514811442, "driven_lanedir_consec": 0.6908539380889679, "sim_compute_sim_state": 0.009171632620004509, "sim_compute_performance-ego0": 0.0023248172723329985}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.698106009681613, "get_ui_image": 0.025574722209898364, "step_physics": 0.09114512074895266, "survival_time": 5.899999999999987, "driven_lanedir": 0.6806169531496904, "get_state_dump": 0.004387058129831522, "get_robot_state": 0.0034752793672705898, "sim_render-ego0": 0.003693422349561162, "get_duckie_state": 1.42450092219505e-06, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 0.4272175349424907, "agent_compute-ego0": 0.0116510150813255, "complete-iteration": 0.14889347052373805, "set_robot_commands": 0.002128759352098994, "deviation-center-line": 0.07334242459878557, "driven_lanedir_consec": 0.6806169531496904, "sim_compute_sim_state": 0.004886543049531824, "sim_compute_performance-ego0": 0.0018713995188224216}}
set_robot_commands_max0.002385611272562405
set_robot_commands_mean0.00227020537843954
set_robot_commands_median0.0022832254445483806
set_robot_commands_min0.002128759352098994
sim_compute_performance-ego0_max0.0023248172723329985
sim_compute_performance-ego0_mean0.0021201398560433578
sim_compute_performance-ego0_median0.0021421713165090056
sim_compute_performance-ego0_min0.0018713995188224216
sim_compute_sim_state_max0.011006034376249032
sim_compute_sim_state_mean0.008698470637378275
sim_compute_sim_state_median0.009450652561866123
sim_compute_sim_state_min0.004886543049531824
sim_render-ego0_max0.004255709739831777
sim_render-ego0_mean0.004037199515797947
sim_render-ego0_median0.004099832986899423
sim_render-ego0_min0.003693422349561162
simulation-passed1
step_physics_max0.13498293968939012
step_physics_mean0.11446292802759092
step_physics_median0.11586182583601046
step_physics_min0.09114512074895266
survival_time_max11.800000000000033
survival_time_mean6.862500000000001
survival_time_min4.599999999999992
No reset possible
5680611425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-080:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5678511427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-080:00:50
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5655411107Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:36:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.982038558168971
survival_time_median59.99999999999873
deviation-center-line_median1.8815147483746024
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01207488899326245
agent_compute-ego0_mean0.011868459944125515
agent_compute-ego0_median0.011955183511173396
agent_compute-ego0_min0.01148858376089282
complete-iteration_max0.1859413644455553
complete-iteration_mean0.1708863838626185
complete-iteration_median0.16855259094508265
complete-iteration_min0.1604989891147534
deviation-center-line_max2.8486548793347946
deviation-center-line_mean2.072639054086614
deviation-center-line_min1.678871840262458
deviation-heading_max5.96031837842016
deviation-heading_mean4.2833300302687105
deviation-heading_median4.292728493410808
deviation-heading_min2.587544755833066
driven_any_max4.002342205615914
driven_any_mean4.001496412096653
driven_any_median4.002332859056294
driven_any_min3.9989777246581113
driven_lanedir_consec_max3.9952040725269575
driven_lanedir_consec_mean3.9814764546686785
driven_lanedir_consec_min3.966624629809815
driven_lanedir_max3.9952040725269575
driven_lanedir_mean3.9814764546686785
driven_lanedir_median3.982038558168971
driven_lanedir_min3.966624629809815
get_duckie_state_max1.2002320809725618e-06
get_duckie_state_mean1.1456399833431449e-06
get_duckie_state_median1.1431585243599897e-06
get_duckie_state_min1.0960108036800388e-06
get_robot_state_max0.0035859156806304195
get_robot_state_mean0.00346855636838076
get_robot_state_median0.0034689300761036237
get_robot_state_min0.0033504496406853747
get_state_dump_max0.00447606960998586
get_state_dump_mean0.004383786830378015
get_state_dump_median0.0043618317746202916
get_state_dump_min0.00433541416228562
get_ui_image_max0.03277504195976416
get_ui_image_mean0.028656423786696944
get_ui_image_median0.028269762699054145
get_ui_image_min0.025311127788915325
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.002342205615914, "get_ui_image": 0.02587879587470443, "step_physics": 0.10551343452523491, "survival_time": 59.99999999999873, "driven_lanedir": 3.9863557899508857, "get_state_dump": 0.00433541416228562, "get_robot_state": 0.0033504496406853747, "sim_render-ego0": 0.003470482377585126, "get_duckie_state": 1.1091129071110988e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.663337511845712, "agent_compute-ego0": 0.01148858376089282, "complete-iteration": 0.16739883371237216, "set_robot_commands": 0.001984958346936228, "deviation-center-line": 2.8486548793347946, "driven_lanedir_consec": 3.9863557899508857, "sim_compute_sim_state": 0.009532415698112596, "sim_compute_performance-ego0": 0.0017637287349526233}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.0023319718820725, "get_ui_image": 0.03277504195976416, "step_physics": 0.11508508705278916, "survival_time": 59.99999999999873, "driven_lanedir": 3.977721326387055, "get_state_dump": 0.004387062654010858, "get_robot_state": 0.003404910518763762, "sim_render-ego0": 0.0036381430471072486, "get_duckie_state": 1.1772041416088803e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.9221194749759025, "agent_compute-ego0": 0.01207488899326245, "complete-iteration": 0.1859413644455553, "set_robot_commands": 0.002047387884618043, "deviation-center-line": 2.045753331408925, "driven_lanedir_consec": 3.977721326387055, "sim_compute_sim_state": 0.010547091422926674, "sim_compute_performance-ego0": 0.0019009504389703323}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.9989777246581113, "get_ui_image": 0.030660729523403856, "step_physics": 0.1004241711888881, "survival_time": 59.99999999999873, "driven_lanedir": 3.966624629809815, "get_state_dump": 0.004336600895229724, "get_robot_state": 0.0035859156806304195, "sim_render-ego0": 0.0037489842614166742, "get_duckie_state": 1.0960108036800388e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.96031837842016, "agent_compute-ego0": 0.011979349447626754, "complete-iteration": 0.16970634817779312, "set_robot_commands": 0.0021287910547185, "deviation-center-line": 1.678871840262458, "driven_lanedir_consec": 3.966624629809815, "sim_compute_sim_state": 0.010823062218595404, "sim_compute_performance-ego0": 0.0019350149153074953}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.002333746230515, "get_ui_image": 0.025311127788915325, "step_physics": 0.10148427726624908, "survival_time": 59.99999999999873, "driven_lanedir": 3.9952040725269575, "get_state_dump": 0.00447606960998586, "get_robot_state": 0.003532949633443485, "sim_render-ego0": 0.003712334303335782, "get_duckie_state": 1.2002320809725618e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.587544755833066, "agent_compute-ego0": 0.01193101757472004, "complete-iteration": 0.1604989891147534, "set_robot_commands": 0.0021154036827627366, "deviation-center-line": 1.7172761653402793, "driven_lanedir_consec": 3.9952040725269575, "sim_compute_sim_state": 0.00597602858531485, "sim_compute_performance-ego0": 0.0018720614920051568}}
set_robot_commands_max0.0021287910547185
set_robot_commands_mean0.002069135242258877
set_robot_commands_median0.0020813957836903897
set_robot_commands_min0.001984958346936228
sim_compute_performance-ego0_max0.0019350149153074953
sim_compute_performance-ego0_mean0.001867938895308902
sim_compute_performance-ego0_median0.0018865059654877448
sim_compute_performance-ego0_min0.0017637287349526233
sim_compute_sim_state_max0.010823062218595404
sim_compute_sim_state_mean0.00921964948123738
sim_compute_sim_state_median0.010039753560519636
sim_compute_sim_state_min0.00597602858531485
sim_render-ego0_max0.0037489842614166742
sim_render-ego0_mean0.003642485997361207
sim_render-ego0_median0.0036752386752215154
sim_render-ego0_min0.003470482377585126
simulation-passed1
step_physics_max0.11508508705278916
step_physics_mean0.10562674250829032
step_physics_median0.103498855895742
step_physics_min0.1004241711888881
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5651011115Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:03:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5646411289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5640711133Mo Kleit 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:03:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5634311278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:01:58
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5632611278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5629711282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:02:08
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5622611308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:02:03
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5614811281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:03:49
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5577411419Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-080:34:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1253887402315756
survival_time_median11.575000000000053
deviation-center-line_median0.5267204178062265
in-drivable-lane_median0.8000000000000012


other stats
agent_compute-ego0_max0.043883819999934744
agent_compute-ego0_mean0.04273736779047232
agent_compute-ego0_median0.04323831749367646
agent_compute-ego0_min0.040589016174601616
agent_compute-npc0_max0.02210882222541025
agent_compute-npc0_mean0.02160748706368629
agent_compute-npc0_median0.021897853271095728
agent_compute-npc0_min0.020525419487143464
agent_compute-npc1_max0.029873334136898914
agent_compute-npc1_mean0.027423852855011477
agent_compute-npc1_median0.02760997845160725
agent_compute-npc1_min0.024788245976528275
agent_compute-npc2_max0.03374728755416157
agent_compute-npc2_mean0.0312877554061051
agent_compute-npc2_median0.03163755614802523
agent_compute-npc2_min0.028478422516128497
agent_compute-npc3_max0.04218088938899486
agent_compute-npc3_mean0.04188351388333735
agent_compute-npc3_median0.04188351388333735
agent_compute-npc3_min0.04158613837767984
complete-iteration_max1.352332867576448
complete-iteration_mean0.9192278884678876
complete-iteration_median0.9855886787294666
complete-iteration_min0.35340132883616854
deviation-center-line_max1.9105102008993984
deviation-center-line_mean0.8061948659048513
deviation-center-line_min0.26082842710755383
deviation-heading_max6.290265571629366
deviation-heading_mean3.407731937881018
deviation-heading_median2.90307150625943
deviation-heading_min1.5345191673758465
driven_any_max11.398827339954666
driven_any_mean4.398329620314531
driven_any_median2.576347834505067
driven_any_min1.041795472293323
driven_lanedir_consec_max11.089455557538962
driven_lanedir_consec_mean4.025870838815462
driven_lanedir_consec_min0.7632503172597338
driven_lanedir_max11.089455557538962
driven_lanedir_mean4.025870838815462
driven_lanedir_median2.1253887402315756
driven_lanedir_min0.7632503172597338
get_duckie_state_max2.615174895980878e-06
get_duckie_state_mean2.182030065325248e-06
get_duckie_state_median2.270968614012945e-06
get_duckie_state_min1.5710081372942244e-06
get_robot_state_max0.017806519867678203
get_robot_state_mean0.01364276884122608
get_robot_state_median0.015143310261822814
get_robot_state_min0.006477934973580497
get_state_dump_max0.011290908197505617
get_state_dump_mean0.0091276965195641
get_state_dump_median0.009846118394361425
get_state_dump_min0.005527641092027936
get_ui_image_max0.05221961369024259
get_ui_image_mean0.04365338724017463
get_ui_image_median0.04714887876109228
get_ui_image_min0.028096177748271396
in-drivable-lane_max2.3000000000000096
in-drivable-lane_mean0.975000000000003
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 11.398827339954666, "get_ui_image": 0.042888795304848217, "step_physics": 0.5823145852398822, "survival_time": 47.64999999999943, "driven_lanedir": 11.089455557538962, "get_state_dump": 0.009332898277906504, "get_robot_state": 0.0138195818075344, "sim_render-ego0": 0.0038291060949521495, "sim_render-npc0": 0.003740154722201749, "sim_render-npc1": 0.0037345388900308983, "sim_render-npc2": 0.0037737397527794663, "get_duckie_state": 2.262477354933381e-06, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 6.290265571629366, "agent_compute-ego0": 0.043883819999934744, "agent_compute-npc0": 0.020525419487143464, "agent_compute-npc1": 0.029873334136898914, "agent_compute-npc2": 0.03163755614802523, "complete-iteration": 0.8395478280585267, "set_robot_commands": 0.0021920446579811207, "deviation-center-line": 1.9105102008993984, "driven_lanedir_consec": 11.089455557538962, "sim_compute_sim_state": 0.03363484081732152, "sim_compute_performance-ego0": 0.0020221871649944057, "sim_compute_performance-npc0": 0.0019015876002281716, "sim_compute_performance-npc1": 0.001891946642653747, "sim_compute_performance-npc2": 0.0018894374995361584}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.041795472293323, "get_ui_image": 0.05221961369024259, "step_physics": 0.7939599763567202, "survival_time": 5.299999999999989, "driven_lanedir": 0.9676818382990876, "get_state_dump": 0.010359338510816342, "get_robot_state": 0.01646703871611123, "sim_render-ego0": 0.0038063748974666418, "sim_render-npc0": 0.003709775265132155, "sim_render-npc1": 0.00362079834269586, "sim_render-npc2": 0.00362551546542444, "sim_render-npc3": 0.003695381021945276, "get_duckie_state": 2.2794598730925087e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.039777560201971, "agent_compute-ego0": 0.040589016174601616, "agent_compute-npc0": 0.02210882222541025, "agent_compute-npc1": 0.024788245976528275, "agent_compute-npc2": 0.03374728755416157, "agent_compute-npc3": 0.04158613837767984, "complete-iteration": 1.1316295294004066, "set_robot_commands": 0.0021722071638731197, "deviation-center-line": 0.3565211169349438, "driven_lanedir_consec": 0.9676818382990876, "sim_compute_sim_state": 0.056861904179938486, "sim_compute_performance-ego0": 0.002055116903002017, "sim_compute_performance-npc0": 0.0019109516500312592, "sim_compute_performance-npc1": 0.0018320573824588385, "sim_compute_performance-npc2": 0.0018301589466701044, "sim_compute_performance-npc3": 0.0019617303509578527}, "LFV-norm-techtrack-000-ego0": {"driven_any": 4.049784571756448, "get_ui_image": 0.05140896221733634, "step_physics": 1.015251423752004, "survival_time": 17.600000000000115, "driven_lanedir": 3.283095642164064, "get_state_dump": 0.011290908197505617, "get_robot_state": 0.017806519867678203, "sim_render-ego0": 0.003894986917209355, "sim_render-npc0": 0.003840803762333251, "sim_render-npc1": 0.0038953266467994063, "sim_render-npc2": 0.003934173340837949, "sim_render-npc3": 0.003939650889496628, "get_duckie_state": 2.615174895980878e-06, "in-drivable-lane": 2.3000000000000096, "deviation-heading": 3.7663654523168897, "agent_compute-ego0": 0.042685460098742085, "agent_compute-npc0": 0.021727303945309043, "agent_compute-npc1": 0.02760997845160725, "agent_compute-npc2": 0.028478422516128497, "agent_compute-npc3": 0.04218088938899486, "complete-iteration": 1.352332867576448, "set_robot_commands": 0.0022535607767510345, "deviation-center-line": 0.6969197186775091, "driven_lanedir_consec": 3.283095642164064, "sim_compute_sim_state": 0.05288074306995943, "sim_compute_performance-ego0": 0.0021729800248618844, "sim_compute_performance-npc0": 0.001956629685572119, "sim_compute_performance-npc1": 0.0019890242190266465, "sim_compute_performance-npc2": 0.0019843875517588498, "sim_compute_performance-npc3": 0.0019537727150633383}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.1029110972536864, "get_ui_image": 0.028096177748271396, "step_physics": 0.2242213977234704, "survival_time": 5.549999999999988, "driven_lanedir": 0.7632503172597338, "get_state_dump": 0.005527641092027936, "get_robot_state": 0.006477934973580497, "sim_render-ego0": 0.003393222178731646, "sim_render-npc0": 0.0034653437989098685, "get_duckie_state": 1.5710081372942244e-06, "in-drivable-lane": 1.149999999999996, "deviation-heading": 1.5345191673758465, "agent_compute-ego0": 0.04379117488861084, "agent_compute-npc0": 0.022068402596882412, "complete-iteration": 0.35340132883616854, "set_robot_commands": 0.001863283770424979, "deviation-center-line": 0.26082842710755383, "driven_lanedir_consec": 0.7632503172597338, "sim_compute_sim_state": 0.009093499609402249, "sim_compute_performance-ego0": 0.001711313213620867, "sim_compute_performance-npc0": 0.0016706330435616629}}
set_robot_commands_max0.0022535607767510345
set_robot_commands_mean0.0021202740922575637
set_robot_commands_median0.00218212591092712
set_robot_commands_min0.001863283770424979
sim_compute_performance-ego0_max0.0021729800248618844
sim_compute_performance-ego0_mean0.001990399326619793
sim_compute_performance-ego0_median0.0020386520339982115
sim_compute_performance-ego0_min0.001711313213620867
sim_compute_performance-npc0_max0.001956629685572119
sim_compute_performance-npc0_mean0.0018599504948483031
sim_compute_performance-npc0_median0.0019062696251297153
sim_compute_performance-npc0_min0.0016706330435616629
sim_compute_performance-npc1_max0.0019890242190266465
sim_compute_performance-npc1_mean0.0019043427480464105
sim_compute_performance-npc1_median0.001891946642653747
sim_compute_performance-npc1_min0.0018320573824588385
sim_compute_performance-npc2_max0.0019843875517588498
sim_compute_performance-npc2_mean0.001901327999321704
sim_compute_performance-npc2_median0.0018894374995361584
sim_compute_performance-npc2_min0.0018301589466701044
sim_compute_performance-npc3_max0.0019617303509578527
sim_compute_performance-npc3_mean0.0019577515330105955
sim_compute_performance-npc3_median0.0019577515330105955
sim_compute_performance-npc3_min0.0019537727150633383
sim_compute_sim_state_max0.056861904179938486
sim_compute_sim_state_mean0.038117746919155426
sim_compute_sim_state_median0.043257791943640475
sim_compute_sim_state_min0.009093499609402249
sim_render-ego0_max0.003894986917209355
sim_render-ego0_mean0.003730922522089948
sim_render-ego0_median0.003817740496209395
sim_render-ego0_min0.003393222178731646
sim_render-npc0_max0.003840803762333251
sim_render-npc0_mean0.003689019387144256
sim_render-npc0_median0.003724964993666952
sim_render-npc0_min0.0034653437989098685
sim_render-npc1_max0.0038953266467994063
sim_render-npc1_mean0.003750221293175388
sim_render-npc1_median0.0037345388900308983
sim_render-npc1_min0.00362079834269586
sim_render-npc2_max0.003934173340837949
sim_render-npc2_mean0.0037778095196806184
sim_render-npc2_median0.0037737397527794663
sim_render-npc2_min0.00362551546542444
sim_render-npc3_max0.003939650889496628
sim_render-npc3_mean0.003817515955720952
sim_render-npc3_median0.003817515955720952
sim_render-npc3_min0.003695381021945276
simulation-passed1
step_physics_max1.015251423752004
step_physics_mean0.6539368457680192
step_physics_median0.6881372807983013
step_physics_min0.2242213977234704
survival_time_max47.64999999999943
survival_time_mean19.02499999999988
survival_time_min5.299999999999989
No reset possible
5570711162Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:02:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5565311161Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:02:51
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5559311303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:03:16
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5556511283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:56
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5554611284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:53
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5552411290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5548711302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:01:18
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5538411275Vincenzo Polizzi 🇮🇹template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:04:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.011792675308559252
agent_compute-ego0_mean0.011592058522063738
agent_compute-ego0_median0.011597921241352494
agent_compute-ego0_min0.011379716296990711
complete-iteration_max0.18588569112445996
complete-iteration_mean0.1644040945250356
complete-iteration_median0.1644331267740153
complete-iteration_min0.14286443342765173
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.3113021850585938e-06
get_duckie_state_mean1.2672365546437903e-06
get_duckie_state_median1.2594520123531375e-06
get_duckie_state_min1.2387400088102922e-06
get_robot_state_max0.00365447998046875
get_robot_state_mean0.0035713352659353967
get_robot_state_median0.003572253832585701
get_robot_state_min0.003486353418101435
get_state_dump_max0.004620442787806193
get_state_dump_mean0.004515909147828987
get_state_dump_median0.004493406400223912
get_state_dump_min0.004456381003061931
get_ui_image_max0.03217809355777243
get_ui_image_mean0.027873407700348213
get_ui_image_median0.027436524147558143
get_ui_image_min0.02444248894850413
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02652428119997435, "step_physics": 0.0938493013381958, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004530422295196147, "get_robot_state": 0.0035288650778275503, "sim_render-ego0": 0.003782183309144611, "get_duckie_state": 1.2539610078063191e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.011563492726676072, "complete-iteration": 0.15695188468015647, "set_robot_commands": 0.002127209796181208, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.00904615619514562, "sim_compute_performance-ego0": 0.0019157310075397732}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03217809355777243, "step_physics": 0.11758047342300416, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.0044563905052516775, "get_robot_state": 0.003486353418101435, "sim_render-ego0": 0.00370000756305197, "get_duckie_state": 1.2387400088102922e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.011792675308559252, "complete-iteration": 0.18588569112445996, "set_robot_commands": 0.0020937530890755033, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.008563207543414572, "sim_compute_performance-ego0": 0.0019489837729412575}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.02834876709514194, "step_physics": 0.10888192388746472, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004456381003061931, "get_robot_state": 0.00365447998046875, "sim_render-ego0": 0.0037322243054707846, "get_duckie_state": 1.2649430168999566e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.011632349756028917, "complete-iteration": 0.17191436886787417, "set_robot_commands": 0.002090715699725681, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.007059882084528605, "sim_compute_performance-ego0": 0.0019753873348236084}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.02444248894850413, "step_physics": 0.08617988973855972, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004620442787806193, "get_robot_state": 0.003615642587343851, "sim_render-ego0": 0.003783727685610453, "get_duckie_state": 1.3113021850585938e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.011379716296990711, "complete-iteration": 0.14286443342765173, "set_robot_commands": 0.002047056953112284, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.004777203003565471, "sim_compute_performance-ego0": 0.00193223108847936}}
set_robot_commands_max0.002127209796181208
set_robot_commands_mean0.0020896838845236693
set_robot_commands_median0.002092234394400592
set_robot_commands_min0.002047056953112284
sim_compute_performance-ego0_max0.0019753873348236084
sim_compute_performance-ego0_mean0.0019430833009459996
sim_compute_performance-ego0_median0.0019406074307103088
sim_compute_performance-ego0_min0.0019157310075397732
sim_compute_sim_state_max0.00904615619514562
sim_compute_sim_state_mean0.007361612206663567
sim_compute_sim_state_median0.007811544813971588
sim_compute_sim_state_min0.004777203003565471
sim_render-ego0_max0.003783727685610453
sim_render-ego0_mean0.0037495357158194545
sim_render-ego0_median0.003757203807307698
sim_render-ego0_min0.00370000756305197
simulation-passed1
step_physics_max0.11758047342300416
step_physics_mean0.10162289709680612
step_physics_median0.10136561261283028
step_physics_min0.08617988973855972
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5533611301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:02:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5531611450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-080:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5529111306Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5526911280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:38
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5524311285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5522311436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5521011287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5519911296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:48
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5516911311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:01:59
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5514611310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:34
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5509811296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:02:27
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5481311360Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:29:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.542963085100893
survival_time_median59.99999999999873
deviation-center-line_median1.437284494377637
in-drivable-lane_median23.97499999999971


other stats
agent_compute-ego0_max0.03326430864675555
agent_compute-ego0_mean0.017600808404732465
agent_compute-ego0_median0.01253032942397906
agent_compute-ego0_min0.012078266124216194
complete-iteration_max0.1987001562999749
complete-iteration_mean0.18245509672839383
complete-iteration_median0.1823194732673956
complete-iteration_min0.16648128407880924
deviation-center-line_max4.328177012481768
deviation-center-line_mean1.9447128931102144
deviation-center-line_min0.5761055712038152
deviation-heading_max10.885073160862838
deviation-heading_mean5.74765621121861
deviation-heading_median5.231926181300579
deviation-heading_min1.6416993214104427
driven_any_max11.352267440617172
driven_any_mean8.564004538822855
driven_any_median9.65305247277113
driven_any_min3.597645769131991
driven_lanedir_consec_max9.528568036956928
driven_lanedir_consec_mean4.171282444298217
driven_lanedir_consec_min2.070635570034153
driven_lanedir_max9.528568036956928
driven_lanedir_mean4.2193687531439465
driven_lanedir_median2.6391357027923537
driven_lanedir_min2.070635570034153
get_duckie_state_max1.4299159244534178e-06
get_duckie_state_mean1.3347020884998323e-06
get_duckie_state_median1.3240563746921795e-06
get_duckie_state_min1.2607796801615517e-06
get_robot_state_max0.003873146146064396
get_robot_state_mean0.0036603240748126833
get_robot_state_median0.003638867951490817
get_robot_state_min0.003490414250204704
get_state_dump_max0.004965833978390912
get_state_dump_mean0.004706449629077369
get_state_dump_median0.004655534381374133
get_state_dump_min0.004548895775170297
get_ui_image_max0.03509308816960705
get_ui_image_mean0.03027068031016063
get_ui_image_median0.030562098675425305
get_ui_image_min0.02486543572018486
in-drivable-lane_max49.64999999999871
in-drivable-lane_mean25.52499999999947
in-drivable-lane_min4.499999999999744
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.352267440617172, "get_ui_image": 0.028203821896911164, "step_physics": 0.10024106135277028, "survival_time": 59.99999999999873, "driven_lanedir": 2.070635570034153, "get_state_dump": 0.00468250813829611, "get_robot_state": 0.003728524334325481, "sim_render-ego0": 0.003973298823208138, "get_duckie_state": 1.3620232066742884e-06, "in-drivable-lane": 49.64999999999871, "deviation-heading": 1.6416993214104427, "agent_compute-ego0": 0.012218892226906045, "complete-iteration": 0.16648128407880924, "set_robot_commands": 0.0022909524141005136, "deviation-center-line": 0.5761055712038152, "driven_lanedir_consec": 2.070635570034153, "sim_compute_sim_state": 0.008993747530134393, "sim_compute_performance-ego0": 0.002060945782435129}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.597645769131991, "get_ui_image": 0.03509308816960705, "step_physics": 0.12419561438981512, "survival_time": 24.30000000000021, "driven_lanedir": 2.108884018418952, "get_state_dump": 0.004548895775170297, "get_robot_state": 0.003549211568656154, "sim_render-ego0": 0.0037939289022520094, "get_duckie_state": 1.2860895427100711e-06, "in-drivable-lane": 10.050000000000145, "deviation-heading": 3.6514744221332416, "agent_compute-ego0": 0.012078266124216194, "complete-iteration": 0.1987001562999749, "set_robot_commands": 0.0021388036269671617, "deviation-center-line": 1.084483228306131, "driven_lanedir_consec": 2.108884018418952, "sim_compute_sim_state": 0.011308746416221163, "sim_compute_performance-ego0": 0.0019096848411481728}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.01161347033565, "get_ui_image": 0.03292037545393944, "step_physics": 0.1211159266996741, "survival_time": 59.99999999999873, "driven_lanedir": 3.169387387165756, "get_state_dump": 0.004965833978390912, "get_robot_state": 0.003873146146064396, "sim_render-ego0": 0.004083231227979572, "get_duckie_state": 1.4299159244534178e-06, "in-drivable-lane": 37.89999999999928, "deviation-heading": 6.812377940467916, "agent_compute-ego0": 0.012841766621052075, "complete-iteration": 0.19538552794825725, "set_robot_commands": 0.0023228979229827805, "deviation-center-line": 1.7900857604491434, "driven_lanedir_consec": 2.977042151782834, "sim_compute_sim_state": 0.011020134728119631, "sim_compute_performance-ego0": 0.002144641225085866}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.29449147520661, "get_ui_image": 0.02486543572018486, "step_physics": 0.08928427847100734, "survival_time": 59.99999999999873, "driven_lanedir": 9.528568036956928, "get_state_dump": 0.004628560624452157, "get_robot_state": 0.003490414250204704, "sim_render-ego0": 0.003698818689579769, "get_duckie_state": 1.2607796801615517e-06, "in-drivable-lane": 4.499999999999744, "deviation-heading": 10.885073160862838, "agent_compute-ego0": 0.03326430864675555, "complete-iteration": 0.16925341858653403, "set_robot_commands": 0.0021342625725179983, "deviation-center-line": 4.328177012481768, "driven_lanedir_consec": 9.528568036956928, "sim_compute_sim_state": 0.00592787160563727, "sim_compute_performance-ego0": 0.0018778256234479487}}
set_robot_commands_max0.0023228979229827805
set_robot_commands_mean0.0022217291341421136
set_robot_commands_median0.0022148780205338376
set_robot_commands_min0.0021342625725179983
sim_compute_performance-ego0_max0.002144641225085866
sim_compute_performance-ego0_mean0.001998274368029279
sim_compute_performance-ego0_median0.001985315311791651
sim_compute_performance-ego0_min0.0018778256234479487
sim_compute_sim_state_max0.011308746416221163
sim_compute_sim_state_mean0.009312625070028117
sim_compute_sim_state_median0.010006941129127011
sim_compute_sim_state_min0.00592787160563727
sim_render-ego0_max0.004083231227979572
sim_render-ego0_mean0.003887319410754872
sim_render-ego0_median0.0038836138627300737
sim_render-ego0_min0.003698818689579769
simulation-passed1
step_physics_max0.12419561438981512
step_physics_mean0.10870922022831672
step_physics_median0.1106784940262222
step_physics_min0.08928427847100734
survival_time_max59.99999999999873
survival_time_mean51.0749999999991
survival_time_min24.30000000000021
No reset possible
5479911424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5477611365brian wongtemplate-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:03:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.011494981745878857
agent_compute-ego0_mean0.011396646640986606
agent_compute-ego0_median0.011377890485583814
agent_compute-ego0_min0.011335823846899944
complete-iteration_max0.19557219225427375
complete-iteration_mean0.16805420416534686
complete-iteration_median0.16538162734857256
complete-iteration_min0.14588136970996857
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.3994133990743889e-06
get_duckie_state_mean1.2672571709693585e-06
get_duckie_state_median1.248695302110181e-06
get_duckie_state_min1.1722246805826824e-06
get_robot_state_max0.003554683664570684
get_robot_state_mean0.0034339641061575197
get_robot_state_median0.003413021103406925
get_robot_state_min0.0033551305532455444
get_state_dump_max0.00449833403462949
get_state_dump_mean0.004347140992880742
get_state_dump_median0.004308529355354953
get_state_dump_min0.004273171226183574
get_ui_image_max0.03399996394696443
get_ui_image_mean0.02831193300483807
get_ui_image_median0.027464701656550797
get_ui_image_min0.024318364759286244
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.026354181615612173, "step_physics": 0.09158589417421364, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004307454145407375, "get_robot_state": 0.003417484367950053, "sim_render-ego0": 0.003436402429508258, "get_duckie_state": 1.22830837587767e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.011344935320600678, "complete-iteration": 0.15319033212299588, "set_robot_commands": 0.0019172762013688872, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.008978932718687419, "sim_compute_performance-ego0": 0.0017697448971905286}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03399996394696443, "step_physics": 0.1254723953164142, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.00449833403462949, "get_robot_state": 0.003554683664570684, "sim_render-ego0": 0.0036026887271715245, "get_duckie_state": 1.3994133990743889e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.011335823846899944, "complete-iteration": 0.19557219225427375, "set_robot_commands": 0.002040160738903543, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.00913328450659047, "sim_compute_performance-ego0": 0.001855140147001847}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.02857522169748942, "step_physics": 0.1155965659353468, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.004309604565302531, "get_robot_state": 0.003408557838863797, "sim_render-ego0": 0.0034516884220971, "get_duckie_state": 1.1722246805826824e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.011410845650566949, "complete-iteration": 0.17757292257414925, "set_robot_commands": 0.0019879473580254447, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.006907767719692654, "sim_compute_performance-ego0": 0.0018451015154520671}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.024318364759286244, "step_physics": 0.09055196990569432, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004273171226183574, "get_robot_state": 0.0033551305532455444, "sim_render-ego0": 0.003424483040968577, "get_duckie_state": 1.269082228342692e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.011494981745878857, "complete-iteration": 0.14588136970996857, "set_robot_commands": 0.00198879341284434, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.004611420134703319, "sim_compute_performance-ego0": 0.0017861401041348777}}
set_robot_commands_max0.002040160738903543
set_robot_commands_mean0.001983544427785554
set_robot_commands_median0.001988370385434892
set_robot_commands_min0.0019172762013688872
sim_compute_performance-ego0_max0.001855140147001847
sim_compute_performance-ego0_mean0.00181403166594483
sim_compute_performance-ego0_median0.0018156208097934725
sim_compute_performance-ego0_min0.0017697448971905286
sim_compute_sim_state_max0.00913328450659047
sim_compute_sim_state_mean0.007407851269918465
sim_compute_sim_state_median0.007943350219190036
sim_compute_sim_state_min0.004611420134703319
sim_render-ego0_max0.0036026887271715245
sim_render-ego0_mean0.0034788156549363644
sim_render-ego0_median0.0034440454258026785
sim_render-ego0_min0.003424483040968577
simulation-passed1
step_physics_max0.1254723953164142
step_physics_mean0.10580170633291724
step_physics_median0.10359123005478024
step_physics_min0.09055196990569432
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5477211439Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5468411385Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:12:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9655864370909095
survival_time_median16.075000000000095
deviation-center-line_median0.5825968292086792
in-drivable-lane_median9.175000000000072


other stats
agent_compute-ego0_max0.012431191159533216
agent_compute-ego0_mean0.011891687941455148
agent_compute-ego0_median0.011884303603953828
agent_compute-ego0_min0.01136695339837972
complete-iteration_max0.1905459781775728
complete-iteration_mean0.16987450626128575
complete-iteration_median0.16657309173193888
complete-iteration_min0.15580586340369248
deviation-center-line_max0.7527117049823938
deviation-center-line_mean0.5072092180511889
deviation-center-line_min0.11093150880500328
deviation-heading_max3.5602176871642115
deviation-heading_mean2.2850886641909733
deviation-heading_median2.5608963101797615
deviation-heading_min0.4583443492401582
driven_any_max9.592685901206965
driven_any_mean4.452555253636784
driven_any_median3.1888965740404833
driven_any_min1.8397419652592055
driven_lanedir_consec_max2.2204131145179633
driven_lanedir_consec_mean1.705604779156001
driven_lanedir_consec_min0.6708331279242208
driven_lanedir_max2.2204131145179633
driven_lanedir_mean1.705604779156001
driven_lanedir_median1.9655864370909095
driven_lanedir_min0.6708331279242208
get_duckie_state_max1.2199600021560471e-06
get_duckie_state_mean1.126028264323966e-06
get_duckie_state_median1.1586238375201136e-06
get_duckie_state_min9.669053800995902e-07
get_robot_state_max0.003579382256512002
get_robot_state_mean0.0034878697222420277
get_robot_state_median0.003512656410577314
get_robot_state_min0.003346783811301479
get_state_dump_max0.004549944110032989
get_state_dump_mean0.004412098596612681
get_state_dump_median0.004473182389050941
get_state_dump_min0.0041520854983158545
get_ui_image_max0.03412354050051187
get_ui_image_mean0.028473232960540808
get_ui_image_median0.02744452361495321
get_ui_image_min0.02488034411174495
in-drivable-lane_max36.04999999999961
in-drivable-lane_mean14.012499999999944
in-drivable-lane_min1.6500000000000234
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4726666443641805, "get_ui_image": 0.026651336001111317, "step_physics": 0.10542394794943012, "survival_time": 11.500000000000028, "driven_lanedir": 2.2204131145179633, "get_state_dump": 0.004514951210517388, "get_robot_state": 0.003579382256512002, "sim_render-ego0": 0.003664039430164155, "get_duckie_state": 1.2199600021560471e-06, "in-drivable-lane": 1.6500000000000234, "deviation-heading": 1.6464191744957437, "agent_compute-ego0": 0.012431191159533216, "complete-iteration": 0.16981497161832207, "set_robot_commands": 0.002195916650615213, "deviation-center-line": 0.5446575548017998, "driven_lanedir_consec": 2.2204131145179633, "sim_compute_sim_state": 0.009306448362606428, "sim_compute_performance-ego0": 0.001969011315019616}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.9051265037167866, "get_ui_image": 0.03412354050051187, "step_physics": 0.11834617167855233, "survival_time": 20.65000000000016, "driven_lanedir": 1.8433766712079305, "get_state_dump": 0.004431413567584494, "get_robot_state": 0.003506240637406059, "sim_render-ego0": 0.003669588462166165, "get_duckie_state": 1.1391109890407986e-06, "in-drivable-lane": 10.950000000000133, "deviation-heading": 3.475373445863779, "agent_compute-ego0": 0.011968352944378691, "complete-iteration": 0.1905459781775728, "set_robot_commands": 0.002145074415897978, "deviation-center-line": 0.7527117049823938, "driven_lanedir_consec": 1.8433766712079305, "sim_compute_sim_state": 0.010364681050397348, "sim_compute_performance-ego0": 0.0019111207141968363}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.592685901206965, "get_ui_image": 0.0282377112287951, "step_physics": 0.09736363594628004, "survival_time": 45.89999999999953, "driven_lanedir": 2.0877962029738892, "get_state_dump": 0.0041520854983158545, "get_robot_state": 0.003346783811301479, "sim_render-ego0": 0.003434949652803606, "get_duckie_state": 9.669053800995902e-07, "in-drivable-lane": 36.04999999999961, "deviation-heading": 3.5602176871642115, "agent_compute-ego0": 0.01136695339837972, "complete-iteration": 0.16333121184555568, "set_robot_commands": 0.001965912952775924, "deviation-center-line": 0.6205361036155584, "driven_lanedir_consec": 2.0877962029738892, "sim_compute_sim_state": 0.011655660396820831, "sim_compute_performance-ego0": 0.0017357959581277575}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.8397419652592055, "get_ui_image": 0.02488034411174495, "step_physics": 0.09868125217716868, "survival_time": 10.20000000000001, "driven_lanedir": 0.6708331279242208, "get_state_dump": 0.004549944110032989, "get_robot_state": 0.003519072183748571, "sim_render-ego0": 0.0035926423421720178, "get_duckie_state": 1.1781366859994283e-06, "in-drivable-lane": 7.400000000000012, "deviation-heading": 0.4583443492401582, "agent_compute-ego0": 0.011800254263528964, "complete-iteration": 0.15580586340369248, "set_robot_commands": 0.002085290304044398, "deviation-center-line": 0.11093150880500328, "driven_lanedir_consec": 0.6708331279242208, "sim_compute_sim_state": 0.00475676583080757, "sim_compute_performance-ego0": 0.0018629748646805928}}
set_robot_commands_max0.002195916650615213
set_robot_commands_mean0.002098048580833378
set_robot_commands_median0.0021151823599711876
set_robot_commands_min0.001965912952775924
sim_compute_performance-ego0_max0.001969011315019616
sim_compute_performance-ego0_mean0.0018697257130062008
sim_compute_performance-ego0_median0.0018870477894387145
sim_compute_performance-ego0_min0.0017357959581277575
sim_compute_sim_state_max0.011655660396820831
sim_compute_sim_state_mean0.009020888910158044
sim_compute_sim_state_median0.009835564706501888
sim_compute_sim_state_min0.00475676583080757
sim_render-ego0_max0.003669588462166165
sim_render-ego0_mean0.003590304971826486
sim_render-ego0_median0.0036283408861680863
sim_render-ego0_min0.003434949652803606
simulation-passed1
step_physics_max0.11834617167855233
step_physics_mean0.1049537519378578
step_physics_median0.1020526000632994
step_physics_min0.09736363594628004
survival_time_max45.89999999999953
survival_time_mean22.06249999999993
survival_time_min10.20000000000001
No reset possible
5453011467Thomas Wiggers 🇳🇱ppo_v1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:34:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.502875102661835
survival_time_median59.99999999999873
deviation-center-line_median5.2954410398618155
in-drivable-lane_median5.1999999999998625


other stats
agent_compute-ego0_max0.05493656860402383
agent_compute-ego0_mean0.04933939569766663
agent_compute-ego0_median0.04853293987039126
agent_compute-ego0_min0.04535513444586015
complete-iteration_max0.22375560033080985
complete-iteration_mean0.20170668372491468
complete-iteration_median0.20510194928918055
complete-iteration_min0.17286723599048776
deviation-center-line_max6.061768661214005
deviation-center-line_mean5.063762689148781
deviation-center-line_min3.6024000156574876
deviation-heading_max14.875158874025365
deviation-heading_mean10.551020696830578
deviation-heading_median9.93213722960492
deviation-heading_min7.464649454087107
driven_any_max11.898116917328304
driven_any_mean8.542058806534033
driven_any_median8.173114501214597
driven_any_min5.923889306378633
driven_lanedir_consec_max11.585449892529164
driven_lanedir_consec_mean7.457584230467629
driven_lanedir_consec_min5.239136824017681
driven_lanedir_max11.585449892529164
driven_lanedir_mean7.457584230467629
driven_lanedir_median6.502875102661835
driven_lanedir_min5.239136824017681
get_duckie_state_max1.6465871500940651e-06
get_duckie_state_mean1.4887488737519118e-06
get_duckie_state_median1.4985034507478307e-06
get_duckie_state_min1.31140144341792e-06
get_robot_state_max0.003942684488081564
get_robot_state_mean0.003688972587898969
get_robot_state_median0.0036855637282753465
get_robot_state_min0.0034420784069636185
get_state_dump_max0.005348991527534748
get_state_dump_mean0.0047820148007680155
get_state_dump_median0.004664816824621602
get_state_dump_min0.004449434026294108
get_ui_image_max0.035966857896580814
get_ui_image_mean0.03035414824714151
get_ui_image_median0.030777464599831716
get_ui_image_min0.023894805892321788
in-drivable-lane_max16.1999999999998
in-drivable-lane_mean7.3624999999998915
in-drivable-lane_min2.8500000000000405
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.898116917328304, "get_ui_image": 0.02882046306460823, "step_physics": 0.0923456591829273, "survival_time": 59.99999999999873, "driven_lanedir": 11.585449892529164, "get_state_dump": 0.004662702522309594, "get_robot_state": 0.003696553018269789, "sim_render-ego0": 0.003775323658164197, "get_duckie_state": 1.5369164358070749e-06, "in-drivable-lane": 2.8500000000000405, "deviation-heading": 7.464649454087107, "agent_compute-ego0": 0.05493656860402383, "complete-iteration": 0.20182832035792064, "set_robot_commands": 0.002159709835131897, "deviation-center-line": 5.959875911529018, "driven_lanedir_consec": 11.585449892529164, "sim_compute_sim_state": 0.00934288364762966, "sim_compute_performance-ego0": 0.0019988455839895585}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.923889306378633, "get_ui_image": 0.035966857896580814, "step_physics": 0.11227752333716848, "survival_time": 42.099999999999746, "driven_lanedir": 5.239136824017681, "get_state_dump": 0.005348991527534748, "get_robot_state": 0.003942684488081564, "sim_render-ego0": 0.004058496524996322, "get_duckie_state": 1.6465871500940651e-06, "in-drivable-lane": 5.699999999999886, "deviation-heading": 8.267172164362425, "agent_compute-ego0": 0.04535513444586015, "complete-iteration": 0.22375560033080985, "set_robot_commands": 0.0024416879402785114, "deviation-center-line": 3.6024000156574876, "driven_lanedir_consec": 5.239136824017681, "sim_compute_sim_state": 0.01214488036267698, "sim_compute_performance-ego0": 0.0021272769036524944}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.359697634538843, "get_ui_image": 0.0327344661350552, "step_physics": 0.10117676970762178, "survival_time": 59.99999999999873, "driven_lanedir": 6.629961273638655, "get_state_dump": 0.00466693112693361, "get_robot_state": 0.003674574438280905, "sim_render-ego0": 0.003854834765419178, "get_duckie_state": 1.4600904656885864e-06, "in-drivable-lane": 16.1999999999998, "deviation-heading": 11.597102294847415, "agent_compute-ego0": 0.045630555268032766, "complete-iteration": 0.20837557822044048, "set_robot_commands": 0.002219797868117206, "deviation-center-line": 4.631006168194613, "driven_lanedir_consec": 6.629961273638655, "sim_compute_sim_state": 0.012287950634857102, "sim_compute_performance-ego0": 0.002035731776965647}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.9865313678903505, "get_ui_image": 0.023894805892321788, "step_physics": 0.07690529025266013, "survival_time": 59.99999999999873, "driven_lanedir": 6.375788931685015, "get_state_dump": 0.004449434026294108, "get_robot_state": 0.0034420784069636185, "sim_render-ego0": 0.003413583912718405, "get_duckie_state": 1.31140144341792e-06, "in-drivable-lane": 4.699999999999839, "deviation-heading": 14.875158874025365, "agent_compute-ego0": 0.05143532447274976, "complete-iteration": 0.17286723599048776, "set_robot_commands": 0.001933989179422218, "deviation-center-line": 6.061768661214005, "driven_lanedir_consec": 6.375788931685015, "sim_compute_sim_state": 0.00556190960810246, "sim_compute_performance-ego0": 0.0017513472472102717}}
set_robot_commands_max0.0024416879402785114
set_robot_commands_mean0.002188796205737458
set_robot_commands_median0.0021897538516245513
set_robot_commands_min0.001933989179422218
sim_compute_performance-ego0_max0.0021272769036524944
sim_compute_performance-ego0_mean0.001978300377954493
sim_compute_performance-ego0_median0.002017288680477603
sim_compute_performance-ego0_min0.0017513472472102717
sim_compute_sim_state_max0.012287950634857102
sim_compute_sim_state_mean0.009834406063316552
sim_compute_sim_state_median0.010743882005153322
sim_compute_sim_state_min0.00556190960810246
sim_render-ego0_max0.004058496524996322
sim_render-ego0_mean0.0037755597153245257
sim_render-ego0_median0.0038150792117916874
sim_render-ego0_min0.003413583912718405
simulation-passed1
step_physics_max0.11227752333716848
step_physics_mean0.09567631062009442
step_physics_median0.09676121444527454
step_physics_min0.07690529025266013
survival_time_max59.99999999999873
survival_time_mean55.52499999999898
survival_time_min42.099999999999746
No reset possible
5449011500Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:12:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7183308839753266
survival_time_median16.975000000000108
deviation-center-line_median0.4004120080545197
in-drivable-lane_median12.975000000000112


other stats
agent_compute-ego0_max0.013172946062432717
agent_compute-ego0_mean0.012400764745307637
agent_compute-ego0_median0.012249086152237304
agent_compute-ego0_min0.01193194061432322
complete-iteration_max0.20711800363874927
complete-iteration_mean0.17569320532145388
complete-iteration_median0.17140542043739534
complete-iteration_min0.15284397677227557
deviation-center-line_max1.2578132310613344
deviation-center-line_mean0.559789861811471
deviation-center-line_min0.18052220007551023
deviation-heading_max5.9073513013987915
deviation-heading_mean2.453119583753688
deviation-heading_median1.5469906450452724
deviation-heading_min0.8111457435254176
driven_any_max7.397644403383126
driven_any_mean3.61974516789212
driven_any_median2.848991504318751
driven_any_min1.3833532595478517
driven_lanedir_consec_max4.268202035199609
driven_lanedir_consec_mean1.5867145258239643
driven_lanedir_consec_min0.6419943001455969
driven_lanedir_max4.268202035199609
driven_lanedir_mean1.5888240946784888
driven_lanedir_median0.7200413791487882
driven_lanedir_min0.6470115852167703
get_duckie_state_max2.0585109278098823e-06
get_duckie_state_mean1.9902366880871132e-06
get_duckie_state_median2.0058020707415532e-06
get_duckie_state_min1.890831683055464e-06
get_robot_state_max0.0037826515833536785
get_robot_state_mean0.0037205049751904617
get_robot_state_median0.003713929321805832
get_robot_state_min0.0036715096737965046
get_state_dump_max0.004808811187744141
get_state_dump_mean0.0047443573782027315
get_state_dump_median0.004739008580015332
get_state_dump_min0.004690601165036121
get_ui_image_max0.03670604327290328
get_ui_image_mean0.030882604185715624
get_ui_image_median0.030038072630104773
get_ui_image_min0.026748228209749675
in-drivable-lane_max17.149999999999803
in-drivable-lane_mean11.92500000000001
in-drivable-lane_min4.600000000000012
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.397644403383126, "get_ui_image": 0.02833029206593831, "step_physics": 0.09691474056243896, "survival_time": 37.45000000000001, "driven_lanedir": 4.268202035199609, "get_state_dump": 0.004808811187744141, "get_robot_state": 0.0037826515833536785, "sim_render-ego0": 0.003852353731791178, "get_duckie_state": 1.978556315104167e-06, "in-drivable-lane": 17.149999999999803, "deviation-heading": 5.9073513013987915, "agent_compute-ego0": 0.01216293207804362, "complete-iteration": 0.16415781180063885, "set_robot_commands": 0.0022471599578857424, "deviation-center-line": 1.2578132310613344, "driven_lanedir_consec": 4.268202035199609, "sim_compute_sim_state": 0.00995324452718099, "sim_compute_performance-ego0": 0.0020183108647664387}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.3833532595478517, "get_ui_image": 0.03670604327290328, "step_physics": 0.13133340152268558, "survival_time": 9.650000000000002, "driven_lanedir": 0.6900343507579227, "get_state_dump": 0.004774135412629118, "get_robot_state": 0.0037008167542133138, "sim_render-ego0": 0.0038526488333633264, "get_duckie_state": 2.0585109278098823e-06, "in-drivable-lane": 4.600000000000012, "deviation-heading": 1.9597775204680876, "agent_compute-ego0": 0.012335240226430993, "complete-iteration": 0.20711800363874927, "set_robot_commands": 0.0022596120834350586, "deviation-center-line": 0.3144243835959748, "driven_lanedir_consec": 0.6866133604109996, "sim_compute_sim_state": 0.010034097838647588, "sim_compute_performance-ego0": 0.0020329866212667877}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.124818643042986, "get_ui_image": 0.03174585319427123, "step_physics": 0.10839076789028672, "survival_time": 16.5500000000001, "driven_lanedir": 0.6470115852167703, "get_state_dump": 0.004690601165036121, "get_robot_state": 0.0036715096737965046, "sim_render-ego0": 0.003839641450399376, "get_duckie_state": 1.890831683055464e-06, "in-drivable-lane": 13.8500000000001, "deviation-heading": 1.1342037696224572, "agent_compute-ego0": 0.013172946062432717, "complete-iteration": 0.17865302907415184, "set_robot_commands": 0.002214076289211411, "deviation-center-line": 0.18052220007551023, "driven_lanedir_consec": 0.6419943001455969, "sim_compute_sim_state": 0.008864155734877989, "sim_compute_performance-ego0": 0.0019773532109088206}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.573164365594516, "get_ui_image": 0.026748228209749675, "step_physics": 0.09179871813274045, "survival_time": 17.400000000000112, "driven_lanedir": 0.7500484075396536, "get_state_dump": 0.004703881747401546, "get_robot_state": 0.003727041889398351, "sim_render-ego0": 0.0038606061634839776, "get_duckie_state": 2.03304782637894e-06, "in-drivable-lane": 12.100000000000122, "deviation-heading": 0.8111457435254176, "agent_compute-ego0": 0.01193194061432322, "complete-iteration": 0.15284397677227557, "set_robot_commands": 0.0022882370006047552, "deviation-center-line": 0.48639963251306456, "driven_lanedir_consec": 0.7500484075396536, "sim_compute_sim_state": 0.005679916174159009, "sim_compute_performance-ego0": 0.002018249478927656}}
set_robot_commands_max0.0022882370006047552
set_robot_commands_mean0.002252271332784242
set_robot_commands_median0.0022533860206604005
set_robot_commands_min0.002214076289211411
sim_compute_performance-ego0_max0.0020329866212667877
sim_compute_performance-ego0_mean0.002011725043967426
sim_compute_performance-ego0_median0.0020182801718470473
sim_compute_performance-ego0_min0.0019773532109088206
sim_compute_sim_state_max0.010034097838647588
sim_compute_sim_state_mean0.008632853568716393
sim_compute_sim_state_median0.009408700131029488
sim_compute_sim_state_min0.005679916174159009
sim_render-ego0_max0.0038606061634839776
sim_render-ego0_mean0.003851312544759465
sim_render-ego0_median0.003852501282577252
sim_render-ego0_min0.003839641450399376
simulation-passed1
step_physics_max0.13133340152268558
step_physics_mean0.10710940702703792
step_physics_median0.10265275422636286
step_physics_min0.09179871813274045
survival_time_max37.45000000000001
survival_time_mean20.26250000000006
survival_time_min9.650000000000002
No reset possible
5443611542Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:23:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.580376389869327
survival_time_median38.424999999999415
deviation-center-line_median1.8718327039452485
in-drivable-lane_median3.8500000000000143


other stats
agent_compute-ego0_max0.0145944053604758
agent_compute-ego0_mean0.013288309787590751
agent_compute-ego0_median0.012923881175813829
agent_compute-ego0_min0.01271107143825955
complete-iteration_max0.22438437634959607
complete-iteration_mean0.19758519447866532
complete-iteration_median0.1958820394700055
complete-iteration_min0.17419232262505424
deviation-center-line_max4.267876940088551
deviation-center-line_mean2.03884390702695
deviation-center-line_min0.143833280128752
deviation-heading_max13.302550185326046
deviation-heading_mean6.757807456656779
deviation-heading_median6.505302248312352
deviation-heading_min0.7180751446763654
driven_any_max12.401675525515111
driven_any_mean7.088808331387816
driven_any_median7.012927511101918
driven_any_min1.9277027778323197
driven_lanedir_consec_max12.044980846182364
driven_lanedir_consec_mean5.974419009601634
driven_lanedir_consec_min0.6919424124855156
driven_lanedir_max12.044980846182364
driven_lanedir_mean5.974419009601634
driven_lanedir_median5.580376389869327
driven_lanedir_min0.6919424124855156
get_duckie_state_max2.2602081298828126e-06
get_duckie_state_mean2.15969366482924e-06
get_duckie_state_median2.164936996470561e-06
get_duckie_state_min2.0486925364930265e-06
get_robot_state_max0.003889398461968236
get_robot_state_mean0.003843513294329649
get_robot_state_median0.003843872571633387
get_robot_state_min0.003796909572083587
get_state_dump_max0.005269947842028014
get_state_dump_mean0.004936771634664181
get_state_dump_median0.004857999837104063
get_state_dump_min0.004761139022420586
get_ui_image_max0.036012384119279976
get_ui_image_mean0.03146182762762739
get_ui_image_median0.031071429251590815
get_ui_image_min0.02769206788804796
in-drivable-lane_max13.300000000000107
in-drivable-lane_mean5.250000000000035
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.401675525515111, "get_ui_image": 0.029260074963279807, "step_physics": 0.11527396161589992, "survival_time": 59.99999999999873, "driven_lanedir": 12.044980846182364, "get_state_dump": 0.004790411702202917, "get_robot_state": 0.003810585388831553, "sim_render-ego0": 0.003774394004370747, "get_duckie_state": 2.1558915645653363e-06, "in-drivable-lane": 0.0, "deviation-heading": 12.212253384319943, "agent_compute-ego0": 0.013125486715350123, "complete-iteration": 0.1842251342103245, "set_robot_commands": 0.002247185631655932, "deviation-center-line": 3.520476477798656, "driven_lanedir_consec": 12.044980846182364, "sim_compute_sim_state": 0.009808174080892369, "sim_compute_performance-ego0": 0.0020384192963027637}, "LF-norm-zigzag-000-ego0": {"driven_any": 10.844035108513411, "get_ui_image": 0.036012384119279976, "step_physics": 0.14492907512197883, "survival_time": 59.99999999999873, "driven_lanedir": 10.440601770726373, "get_state_dump": 0.004761139022420586, "get_robot_state": 0.003796909572083587, "sim_render-ego0": 0.0038147159261965537, "get_duckie_state": 2.0486925364930265e-06, "in-drivable-lane": 0.0, "deviation-heading": 13.302550185326046, "agent_compute-ego0": 0.012722275636277529, "complete-iteration": 0.22438437634959607, "set_robot_commands": 0.0022613287567596055, "deviation-center-line": 4.267876940088551, "driven_lanedir_consec": 10.440601770726373, "sim_compute_sim_state": 0.01390935538908921, "sim_compute_performance-ego0": 0.002083873272339172}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.181819913690424, "get_ui_image": 0.03288278353990182, "step_physics": 0.13148628536766097, "survival_time": 16.850000000000104, "driven_lanedir": 0.7201510090122818, "get_state_dump": 0.005269947842028014, "get_robot_state": 0.003889398461968236, "sim_render-ego0": 0.004067702406256862, "get_duckie_state": 2.173982428375786e-06, "in-drivable-lane": 13.300000000000107, "deviation-heading": 0.7180751446763654, "agent_compute-ego0": 0.0145944053604758, "complete-iteration": 0.20753894472968648, "set_robot_commands": 0.0022886321389463528, "deviation-center-line": 0.22318893009184065, "driven_lanedir_consec": 0.7201510090122818, "sim_compute_sim_state": 0.010802462961546768, "sim_compute_performance-ego0": 0.002153192046125965}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.9277027778323197, "get_ui_image": 0.02769206788804796, "step_physics": 0.11145342508951823, "survival_time": 11.200000000000024, "driven_lanedir": 0.6919424124855156, "get_state_dump": 0.0049255879720052085, "get_robot_state": 0.003877159754435221, "sim_render-ego0": 0.003834352493286133, "get_duckie_state": 2.2602081298828126e-06, "in-drivable-lane": 7.700000000000029, "deviation-heading": 0.7983511123047587, "agent_compute-ego0": 0.01271107143825955, "complete-iteration": 0.17419232262505424, "set_robot_commands": 0.002375570933024089, "deviation-center-line": 0.143833280128752, "driven_lanedir_consec": 0.6919424124855156, "sim_compute_sim_state": 0.005228057437472873, "sim_compute_performance-ego0": 0.0020021735297309027}}
set_robot_commands_max0.002375570933024089
set_robot_commands_mean0.0022931793650964945
set_robot_commands_median0.002274980447852979
set_robot_commands_min0.002247185631655932
sim_compute_performance-ego0_max0.002153192046125965
sim_compute_performance-ego0_mean0.002069414536124701
sim_compute_performance-ego0_median0.0020611462843209676
sim_compute_performance-ego0_min0.0020021735297309027
sim_compute_sim_state_max0.01390935538908921
sim_compute_sim_state_mean0.009937012467250305
sim_compute_sim_state_median0.010305318521219568
sim_compute_sim_state_min0.005228057437472873
sim_render-ego0_max0.004067702406256862
sim_render-ego0_mean0.0038727912075275737
sim_render-ego0_median0.0038245342097413433
sim_render-ego0_min0.003774394004370747
simulation-passed1
step_physics_max0.14492907512197883
step_physics_mean0.1257856867987645
step_physics_median0.12338012349178044
step_physics_min0.11145342508951823
survival_time_max59.99999999999873
survival_time_mean37.01249999999939
survival_time_min11.200000000000024
No reset possible
5433111577Melisande Tengexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:28:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.912719441228248
survival_time_median59.99999999999873
deviation-center-line_median3.1733737563170763
in-drivable-lane_median18.124999999999503


other stats
agent_compute-ego0_max0.012431980469740997
agent_compute-ego0_mean0.01230759110934149
agent_compute-ego0_median0.012305467154560837
agent_compute-ego0_min0.012187449658503298
complete-iteration_max0.2541427670932207
complete-iteration_mean0.21143806985835975
complete-iteration_median0.2060260365745805
complete-iteration_min0.17955743919105752
deviation-center-line_max4.0577677360048146
deviation-center-line_mean2.7824219933008107
deviation-center-line_min0.7251727245642755
deviation-heading_max17.68359451068542
deviation-heading_mean11.450932260142586
deviation-heading_median12.390042511078708
deviation-heading_min3.340049507727509
driven_any_max7.92089938720502
driven_any_mean6.305882534258278
driven_any_median7.913819310633547
driven_any_min1.474992128560998
driven_lanedir_consec_max5.317016685487203
driven_lanedir_consec_mean3.5521841338379794
driven_lanedir_consec_min1.0662809674082188
driven_lanedir_max5.317016685487203
driven_lanedir_mean3.5521841338379794
driven_lanedir_median3.912719441228248
driven_lanedir_min1.0662809674082188
get_duckie_state_max1.383264495570098e-06
get_duckie_state_mean1.3606185381712009e-06
get_duckie_state_median1.3563654801926945e-06
get_duckie_state_min1.346478696729316e-06
get_robot_state_max0.003813884538178837
get_robot_state_mean0.003687734109526391
get_robot_state_median0.003686831948264492
get_robot_state_min0.0035633880033977424
get_state_dump_max0.004782773432184438
get_state_dump_mean0.004732816061061566
get_state_dump_median0.004744091399206309
get_state_dump_min0.0046603080136492095
get_ui_image_max0.03531180248885858
get_ui_image_mean0.02970553554890563
get_ui_image_median0.028566953740846505
get_ui_image_min0.026376432225070925
in-drivable-lane_max30.099999999999312
in-drivable-lane_mean17.287499999999582
in-drivable-lane_min2.8000000000000203
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.92089938720502, "get_ui_image": 0.026976396400267437, "step_physics": 0.115177717335913, "survival_time": 59.99999999999873, "driven_lanedir": 4.646535272674246, "get_state_dump": 0.0046603080136492095, "get_robot_state": 0.0035633880033977424, "sim_render-ego0": 0.003669108478949528, "get_duckie_state": 1.383264495570098e-06, "in-drivable-lane": 22.54999999999932, "deviation-heading": 9.569291313937654, "agent_compute-ego0": 0.012218933319866806, "complete-iteration": 0.17955743919105752, "set_robot_commands": 0.002134968696486245, "deviation-center-line": 3.2610253188856473, "driven_lanedir_consec": 4.646535272674246, "sim_compute_sim_state": 0.009128149502680365, "sim_compute_performance-ego0": 0.0019393521085766135}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.474992128560998, "get_ui_image": 0.03531180248885858, "step_physics": 0.17944063417247083, "survival_time": 12.150000000000038, "driven_lanedir": 1.0662809674082188, "get_state_dump": 0.004782773432184438, "get_robot_state": 0.003726683679174205, "sim_render-ego0": 0.0037708556065793896, "get_duckie_state": 1.346478696729316e-06, "in-drivable-lane": 2.8000000000000203, "deviation-heading": 3.340049507727509, "agent_compute-ego0": 0.012187449658503298, "complete-iteration": 0.2541427670932207, "set_robot_commands": 0.0022423208736982504, "deviation-center-line": 0.7251727245642755, "driven_lanedir_consec": 1.0662809674082188, "sim_compute_sim_state": 0.010555719743009472, "sim_compute_performance-ego0": 0.0020340778788582223}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.907319395978496, "get_ui_image": 0.030157511081425573, "step_physics": 0.1421729831473218, "survival_time": 59.99999999999873, "driven_lanedir": 5.317016685487203, "get_state_dump": 0.004738327466280236, "get_robot_state": 0.00364698021735478, "sim_render-ego0": 0.003717719863396104, "get_duckie_state": 1.3560677051147157e-06, "in-drivable-lane": 13.699999999999688, "deviation-heading": 17.68359451068542, "agent_compute-ego0": 0.012431980469740997, "complete-iteration": 0.21371936401062264, "set_robot_commands": 0.002214980264388949, "deviation-center-line": 4.0577677360048146, "driven_lanedir_consec": 5.317016685487203, "sim_compute_sim_state": 0.012506795664016253, "sim_compute_performance-ego0": 0.002034273671667145}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920319225288598, "get_ui_image": 0.026376432225070925, "step_physics": 0.13653139746457116, "survival_time": 59.99999999999873, "driven_lanedir": 3.1789036097822505, "get_state_dump": 0.004749855332132382, "get_robot_state": 0.003813884538178837, "sim_render-ego0": 0.0038312279513039063, "get_duckie_state": 1.3566632552706728e-06, "in-drivable-lane": 30.099999999999312, "deviation-heading": 15.210793708219764, "agent_compute-ego0": 0.012392000989254866, "complete-iteration": 0.19833270913853832, "set_robot_commands": 0.002315100186274114, "deviation-center-line": 3.0857221937485058, "driven_lanedir_consec": 3.1789036097822505, "sim_compute_sim_state": 0.006195838604243371, "sim_compute_performance-ego0": 0.002038840548779744}}
set_robot_commands_max0.002315100186274114
set_robot_commands_mean0.0022268425052118894
set_robot_commands_median0.0022286505690436
set_robot_commands_min0.002134968696486245
sim_compute_performance-ego0_max0.002038840548779744
sim_compute_performance-ego0_mean0.0020116360519704312
sim_compute_performance-ego0_median0.002034175775262684
sim_compute_performance-ego0_min0.0019393521085766135
sim_compute_sim_state_max0.012506795664016253
sim_compute_sim_state_mean0.009596625878487364
sim_compute_sim_state_median0.009841934622844918
sim_compute_sim_state_min0.006195838604243371
sim_render-ego0_max0.0038312279513039063
sim_render-ego0_mean0.003747227975057232
sim_render-ego0_median0.0037442877349877462
sim_render-ego0_min0.003669108478949528
simulation-passed1
step_physics_max0.17944063417247083
step_physics_mean0.14333068303006918
step_physics_median0.13935219030594648
step_physics_min0.115177717335913
survival_time_max59.99999999999873
survival_time_mean48.037499999999056
survival_time_min12.150000000000038
No reset possible
5431411584Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:04:36
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 269 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5423511626Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:25:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.014390613738776
survival_time_median41.59999999999975
deviation-center-line_median1.52457870795075
in-drivable-lane_median16.925000000000196


other stats
agent_compute-ego0_max0.012700338879663623
agent_compute-ego0_mean0.012320166385754536
agent_compute-ego0_median0.01242858767459264
agent_compute-ego0_min0.011723151314169242
complete-iteration_max0.22803951026442537
complete-iteration_mean0.19944595149968855
complete-iteration_median0.2002825417755684
complete-iteration_min0.16917921218319215
deviation-center-line_max3.680089861291731
deviation-center-line_mean1.7229895774238404
deviation-center-line_min0.16271103250213104
deviation-heading_max12.416340872097306
deviation-heading_mean6.137179231302505
deviation-heading_median5.60361572365449
deviation-heading_min0.9251446058037356
driven_any_max13.770558594556706
driven_any_mean8.394669481002957
driven_any_median7.933416408576774
driven_any_min3.941286512301576
driven_lanedir_consec_max12.924995648662843
driven_lanedir_consec_mean5.410087359968324
driven_lanedir_consec_min0.6865725637328997
driven_lanedir_max12.924995648662843
driven_lanedir_mean5.410087359968324
driven_lanedir_median4.014390613738776
driven_lanedir_min0.6865725637328997
get_duckie_state_max2.125699916679061e-06
get_duckie_state_mean2.111418897829052e-06
get_duckie_state_median2.114896571972881e-06
get_duckie_state_min2.0901825306913833e-06
get_robot_state_max0.00398745326575392
get_robot_state_mean0.0038145155308984898
get_robot_state_median0.003795991942215874
get_robot_state_min0.003678624973408289
get_state_dump_max0.004871039686795466
get_state_dump_mean0.004768484628957934
get_state_dump_median0.004779238260123534
get_state_dump_min0.004644422308789205
get_ui_image_max0.03724023166057992
get_ui_image_mean0.031712394420326175
get_ui_image_median0.03164527344795055
get_ui_image_min0.026318799124823676
in-drivable-lane_max28.049999999999
in-drivable-lane_mean16.33749999999983
in-drivable-lane_min3.449999999999928
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 13.770558594556706, "get_ui_image": 0.028668214042021967, "step_physics": 0.11061724576227472, "survival_time": 59.99999999999873, "driven_lanedir": 12.924995648662843, "get_state_dump": 0.004644422308789205, "get_robot_state": 0.003678624973408289, "sim_render-ego0": 0.003700574966989687, "get_duckie_state": 2.0901825306913833e-06, "in-drivable-lane": 3.449999999999928, "deviation-heading": 12.416340872097306, "agent_compute-ego0": 0.011723151314169242, "complete-iteration": 0.17672395328994991, "set_robot_commands": 0.002165702260801139, "deviation-center-line": 3.680089861291731, "driven_lanedir_consec": 12.924995648662843, "sim_compute_sim_state": 0.009479061749257412, "sim_compute_performance-ego0": 0.001963288658961567}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.154579764969393, "get_ui_image": 0.03724023166057992, "step_physics": 0.1450351266966758, "survival_time": 31.500000000000313, "driven_lanedir": 3.738932586946381, "get_state_dump": 0.004848202132574163, "get_robot_state": 0.003824394213983261, "sim_render-ego0": 0.003997061407509394, "get_duckie_state": 2.107982967999393e-06, "in-drivable-lane": 12.100000000000172, "deviation-heading": 5.469441106491474, "agent_compute-ego0": 0.012683459582683968, "complete-iteration": 0.22384113026118693, "set_robot_commands": 0.0024437930806880896, "deviation-center-line": 1.4377295705794413, "driven_lanedir_consec": 3.738932586946381, "sim_compute_sim_state": 0.011563985736925514, "sim_compute_performance-ego0": 0.0021152855288207816}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.941286512301576, "get_ui_image": 0.03462233285387915, "step_physics": 0.15178055514792402, "survival_time": 24.90000000000022, "driven_lanedir": 0.6865725637328997, "get_state_dump": 0.004871039686795466, "get_robot_state": 0.00398745326575392, "sim_render-ego0": 0.0040153095382965635, "get_duckie_state": 2.125699916679061e-06, "in-drivable-lane": 21.750000000000224, "deviation-heading": 0.9251446058037356, "agent_compute-ego0": 0.012700338879663623, "complete-iteration": 0.22803951026442537, "set_robot_commands": 0.002350078556007278, "deviation-center-line": 0.16271103250213104, "driven_lanedir_consec": 0.6865725637328997, "sim_compute_sim_state": 0.01144275302160718, "sim_compute_performance-ego0": 0.0021816618695765554}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.712253052184156, "get_ui_image": 0.026318799124823676, "step_physics": 0.10782336935328976, "survival_time": 51.6999999999992, "driven_lanedir": 4.289848640531172, "get_state_dump": 0.004710274387672904, "get_robot_state": 0.003767589670448487, "sim_render-ego0": 0.003818050559592132, "get_duckie_state": 2.121810175946369e-06, "in-drivable-lane": 28.049999999999, "deviation-heading": 5.737790340817505, "agent_compute-ego0": 0.012173715766501312, "complete-iteration": 0.16917921218319215, "set_robot_commands": 0.002265503786612248, "deviation-center-line": 1.6114278453220587, "driven_lanedir_consec": 4.289848640531172, "sim_compute_sim_state": 0.006227350926053697, "sim_compute_performance-ego0": 0.00199289045472076}}
set_robot_commands_max0.0024437930806880896
set_robot_commands_mean0.0023062694210271885
set_robot_commands_median0.0023077911713097633
set_robot_commands_min0.002165702260801139
sim_compute_performance-ego0_max0.0021816618695765554
sim_compute_performance-ego0_mean0.002063281628019916
sim_compute_performance-ego0_median0.002054087991770771
sim_compute_performance-ego0_min0.001963288658961567
sim_compute_sim_state_max0.011563985736925514
sim_compute_sim_state_mean0.00967828785846095
sim_compute_sim_state_median0.010460907385432296
sim_compute_sim_state_min0.006227350926053697
sim_render-ego0_max0.0040153095382965635
sim_render-ego0_mean0.003882749118096944
sim_render-ego0_median0.003907555983550763
sim_render-ego0_min0.003700574966989687
simulation-passed1
step_physics_max0.15178055514792402
step_physics_mean0.12881407424004107
step_physics_median0.12782618622947525
step_physics_min0.10782336935328976
survival_time_max59.99999999999873
survival_time_mean42.024999999999615
survival_time_min24.90000000000022
No reset possible
5418511641Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:21:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6761410228191065
survival_time_median34.199999999999356
deviation-center-line_median1.019140258654826
in-drivable-lane_median12.499999999999709


other stats
agent_compute-ego0_max0.013026897723858174
agent_compute-ego0_mean0.012820424533071206
agent_compute-ego0_median0.012799604857105986
agent_compute-ego0_min0.01265559069421468
complete-iteration_max0.27244251858104357
complete-iteration_mean0.24314786029698815
complete-iteration_median0.24743079419037825
complete-iteration_min0.20528733422615247
deviation-center-line_max2.9255843664416163
deviation-center-line_mean1.272324207742184
deviation-center-line_min0.1254319472174681
deviation-heading_max14.257610020134369
deviation-heading_mean6.429155658870712
deviation-heading_median5.274880030635971
deviation-heading_min0.909252554076538
driven_any_max15.840816583547744
driven_any_mean8.698077478429138
driven_any_median8.890292580562425
driven_any_min1.1709081690439591
driven_lanedir_consec_max9.802873318313884
driven_lanedir_consec_mean3.386015491108691
driven_lanedir_consec_min0.3889066004826672
driven_lanedir_max9.81053392363546
driven_lanedir_mean3.858564594586867
driven_lanedir_median2.6174089271146705
driven_lanedir_min0.3889066004826672
get_duckie_state_max1.6378933156030415e-06
get_duckie_state_mean1.4270605540515192e-06
get_duckie_state_median1.396862890797789e-06
get_duckie_state_min1.2766231190074574e-06
get_robot_state_max0.003938662229910405
get_robot_state_mean0.0037481680191220174
get_robot_state_median0.003765172902789342
get_robot_state_min0.003523664040998979
get_state_dump_max0.005008213618803306
get_state_dump_mean0.00477816150232847
get_state_dump_median0.004731276350950421
get_state_dump_min0.00464187968860973
get_ui_image_max0.03600705970417369
get_ui_image_mean0.03184852470830863
get_ui_image_median0.032127621622941055
get_ui_image_min0.02713179588317871
in-drivable-lane_max40.099999999998815
in-drivable-lane_mean16.674999999999557
in-drivable-lane_min1.5999999999999943
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 15.840816583547744, "get_ui_image": 0.029639110080804755, "step_physics": 0.15357495207869937, "survival_time": 59.99999999999873, "driven_lanedir": 9.81053392363546, "get_state_dump": 0.004765669570973672, "get_robot_state": 0.003808133508839476, "sim_render-ego0": 0.0038758551052071274, "get_duckie_state": 1.4217767389886685e-06, "in-drivable-lane": 18.79999999999943, "deviation-heading": 14.257610020134369, "agent_compute-ego0": 0.012907555855680366, "complete-iteration": 0.22291870200564523, "set_robot_commands": 0.00228631843833701, "deviation-center-line": 2.9255843664416163, "driven_lanedir_consec": 9.802873318313884, "sim_compute_sim_state": 0.009885730791052216, "sim_compute_performance-ego0": 0.0020818426448240765}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.1709081690439591, "get_ui_image": 0.03600705970417369, "step_physics": 0.19771209413355048, "survival_time": 5.449999999999989, "driven_lanedir": 0.8363139546507836, "get_state_dump": 0.00464187968860973, "get_robot_state": 0.003523664040998979, "sim_render-ego0": 0.003725494037974965, "get_duckie_state": 1.2766231190074574e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 1.408123170487498, "agent_compute-ego0": 0.012691653858531606, "complete-iteration": 0.27244251858104357, "set_robot_commands": 0.0022180925716053356, "deviation-center-line": 0.2886575193316046, "driven_lanedir_consec": 0.8363139546507836, "sim_compute_sim_state": 0.00985881198536266, "sim_compute_performance-ego0": 0.0019745111465454103}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.940838363993309, "get_ui_image": 0.03461613316507735, "step_physics": 0.19844709909879243, "survival_time": 8.399999999999984, "driven_lanedir": 0.3889066004826672, "get_state_dump": 0.005008213618803306, "get_robot_state": 0.003938662229910405, "sim_render-ego0": 0.004021066180347691, "get_duckie_state": 1.6378933156030415e-06, "in-drivable-lane": 6.199999999999984, "deviation-heading": 0.909252554076538, "agent_compute-ego0": 0.013026897723858174, "complete-iteration": 0.2719428863751112, "set_robot_commands": 0.0023161349211924176, "deviation-center-line": 0.1254319472174681, "driven_lanedir_consec": 0.3889066004826672, "sim_compute_sim_state": 0.008283725151648888, "sim_compute_performance-ego0": 0.002182379276794795}, "LF-norm-small_loop-000-ego0": {"driven_any": 15.839746797131545, "get_ui_image": 0.02713179588317871, "step_physics": 0.1425985148506895, "survival_time": 59.99999999999873, "driven_lanedir": 4.398503899578557, "get_state_dump": 0.004696883130927169, "get_robot_state": 0.003722212296739208, "sim_render-ego0": 0.003834458810899974, "get_duckie_state": 1.3719490426069097e-06, "in-drivable-lane": 40.099999999998815, "deviation-heading": 9.141636890784444, "agent_compute-ego0": 0.01265559069421468, "complete-iteration": 0.20528733422615247, "set_robot_commands": 0.002222935821888945, "deviation-center-line": 1.749622997978047, "driven_lanedir_consec": 2.515968090987429, "sim_compute_sim_state": 0.006345508100587462, "sim_compute_performance-ego0": 0.001989067841529052}}
set_robot_commands_max0.0023161349211924176
set_robot_commands_mean0.002260870438255927
set_robot_commands_median0.0022546271301129776
set_robot_commands_min0.0022180925716053356
sim_compute_performance-ego0_max0.002182379276794795
sim_compute_performance-ego0_mean0.0020569502274233337
sim_compute_performance-ego0_median0.002035455243176564
sim_compute_performance-ego0_min0.0019745111465454103
sim_compute_sim_state_max0.009885730791052216
sim_compute_sim_state_mean0.008593444007162807
sim_compute_sim_state_median0.009071268568505774
sim_compute_sim_state_min0.006345508100587462
sim_render-ego0_max0.004021066180347691
sim_render-ego0_mean0.003864218533607439
sim_render-ego0_median0.0038551569580535503
sim_render-ego0_min0.003725494037974965
simulation-passed1
step_physics_max0.19844709909879243
step_physics_mean0.17308316504043297
step_physics_median0.1756435231061249
step_physics_min0.1425985148506895
survival_time_max59.99999999999873
survival_time_mean33.46249999999936
survival_time_min5.449999999999989
No reset possible
5411411660Melisande Tengsim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:26:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.462632852289673
survival_time_median46.674999999999486
deviation-center-line_median1.406437834409202
in-drivable-lane_median7.499999999999954


other stats
agent_compute-ego0_max0.013252941791168944
agent_compute-ego0_mean0.012536009680167022
agent_compute-ego0_median0.01239117595122706
agent_compute-ego0_min0.012108745027045028
complete-iteration_max0.28189007288370377
complete-iteration_mean0.2465463281701278
complete-iteration_median0.24907766076292737
complete-iteration_min0.2061399182709528
deviation-center-line_max4.171105336114292
deviation-center-line_mean1.9089602616553676
deviation-center-line_min0.6518600416887742
deviation-heading_max15.24384047605773
deviation-heading_mean7.708868582132078
deviation-heading_median6.834410854896156
deviation-heading_min1.9228121426782745
driven_any_max11.561332583049484
driven_any_mean6.940168383335767
driven_any_median7.522267138686313
driven_any_min1.1548066729209543
driven_lanedir_consec_max9.681984778656537
driven_lanedir_consec_mean3.886004686628535
driven_lanedir_consec_min0.9367682632782564
driven_lanedir_max9.681984778656537
driven_lanedir_mean3.886004686628535
driven_lanedir_median2.462632852289673
driven_lanedir_min0.9367682632782564
get_duckie_state_max1.5130409827599158e-06
get_duckie_state_mean1.4645946966489365e-06
get_duckie_state_median1.4854040219432191e-06
get_duckie_state_min1.3745297599493911e-06
get_robot_state_max0.003998822080874871
get_robot_state_mean0.0038312476391491866
get_robot_state_median0.0037948597762522537
get_robot_state_min0.003736448923217367
get_state_dump_max0.00498575614597983
get_state_dump_mean0.004801647908028494
get_state_dump_median0.00476001810794906
get_state_dump_min0.004700799270236026
get_ui_image_max0.03685765388684395
get_ui_image_mean0.031522349161840366
get_ui_image_median0.03133380718378888
get_ui_image_min0.026564128392939763
in-drivable-lane_max53.29999999999872
in-drivable-lane_mean17.174999999999656
in-drivable-lane_min0.3999999999999986
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.561332583049484, "get_ui_image": 0.02857977940974684, "step_physics": 0.13901022888043835, "survival_time": 59.99999999999873, "driven_lanedir": 9.681984778656537, "get_state_dump": 0.0047577473642824095, "get_robot_state": 0.003736448923217367, "sim_render-ego0": 0.003694775698087694, "get_duckie_state": 1.47676587005539e-06, "in-drivable-lane": 6.1999999999999, "deviation-heading": 15.24384047605773, "agent_compute-ego0": 0.012466094376741102, "complete-iteration": 0.2061399182709528, "set_robot_commands": 0.00218493396495403, "deviation-center-line": 4.171105336114292, "driven_lanedir_consec": 9.681984778656537, "sim_compute_sim_state": 0.009639575022841174, "sim_compute_performance-ego0": 0.001981221071190878}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.1548066729209543, "get_ui_image": 0.03685765388684395, "step_physics": 0.2057581528639182, "survival_time": 7.7499999999999805, "driven_lanedir": 0.9367682632782564, "get_state_dump": 0.00476228885161571, "get_robot_state": 0.0037602369601909937, "sim_render-ego0": 0.003757628110738901, "get_duckie_state": 1.5130409827599158e-06, "in-drivable-lane": 0.3999999999999986, "deviation-heading": 2.9633186199788435, "agent_compute-ego0": 0.012316257525713015, "complete-iteration": 0.28189007288370377, "set_robot_commands": 0.0022017665398426545, "deviation-center-line": 0.7113358528079752, "driven_lanedir_consec": 0.9367682632782564, "sim_compute_sim_state": 0.010435208296164488, "sim_compute_performance-ego0": 0.0019550430469023874}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.781260112006403, "get_ui_image": 0.03408783495783092, "step_physics": 0.19107162417052032, "survival_time": 33.35000000000024, "driven_lanedir": 3.810894837972846, "get_state_dump": 0.00498575614597983, "get_robot_state": 0.003998822080874871, "sim_render-ego0": 0.003979027985098833, "get_duckie_state": 1.4940421738310488e-06, "in-drivable-lane": 8.800000000000008, "deviation-heading": 10.705503089813469, "agent_compute-ego0": 0.013252941791168944, "complete-iteration": 0.2693834144198252, "set_robot_commands": 0.002374994897556876, "deviation-center-line": 2.101539816010429, "driven_lanedir_consec": 3.810894837972846, "sim_compute_sim_state": 0.013336720580826262, "sim_compute_performance-ego0": 0.0022014118954093156}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.263274165366225, "get_ui_image": 0.026564128392939763, "step_physics": 0.16709510769871846, "survival_time": 59.99999999999873, "driven_lanedir": 1.1143708666065004, "get_state_dump": 0.004700799270236026, "get_robot_state": 0.003829482592313514, "sim_render-ego0": 0.0037906116291843385, "get_duckie_state": 1.3745297599493911e-06, "in-drivable-lane": 53.29999999999872, "deviation-heading": 1.9228121426782745, "agent_compute-ego0": 0.012108745027045028, "complete-iteration": 0.2287719071060295, "set_robot_commands": 0.002257417580368715, "deviation-center-line": 0.6518600416887742, "driven_lanedir_consec": 1.1143708666065004, "sim_compute_sim_state": 0.006338616394182725, "sim_compute_performance-ego0": 0.00200100504885506}}
set_robot_commands_max0.002374994897556876
set_robot_commands_mean0.0022547782456805686
set_robot_commands_median0.002229592060105685
set_robot_commands_min0.00218493396495403
sim_compute_performance-ego0_max0.0022014118954093156
sim_compute_performance-ego0_mean0.0020346702655894104
sim_compute_performance-ego0_median0.001991113060022969
sim_compute_performance-ego0_min0.0019550430469023874
sim_compute_sim_state_max0.013336720580826262
sim_compute_sim_state_mean0.009937530073503663
sim_compute_sim_state_median0.01003739165950283
sim_compute_sim_state_min0.006338616394182725
sim_render-ego0_max0.003979027985098833
sim_render-ego0_mean0.0038055108557774418
sim_render-ego0_median0.003774119869961619
sim_render-ego0_min0.003694775698087694
simulation-passed1
step_physics_max0.2057581528639182
step_physics_mean0.17573377840339885
step_physics_median0.1790833659346194
step_physics_min0.13901022888043835
survival_time_max59.99999999999873
survival_time_mean40.27499999999942
survival_time_min7.7499999999999805
No reset possible
5408911669Bhavya Patwa 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:07:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4288884574747443
survival_time_median8.399999999999988
deviation-center-line_median0.19454477536279877
in-drivable-lane_median6.074999999999989


other stats
agent_compute-ego0_max0.013531947699118786
agent_compute-ego0_mean0.012591558935849978
agent_compute-ego0_median0.012489029965553344
agent_compute-ego0_min0.011856228113174438
complete-iteration_max0.2245335691557156
complete-iteration_mean0.1960383388402208
complete-iteration_median0.2014362199330746
complete-iteration_min0.15674734633901846
deviation-center-line_max0.5222640658722739
deviation-center-line_mean0.26187278296792177
deviation-center-line_min0.13613751527381565
deviation-heading_max2.806773640250431
deviation-heading_mean1.4123064937371483
deviation-heading_median1.1440964519791024
deviation-heading_min0.5542594307399573
driven_any_max3.0628377090095684
driven_any_mean1.8102476159208485
driven_any_median1.5429593972432487
driven_any_min1.0922339601873277
driven_lanedir_consec_max0.8150472085367548
driven_lanedir_consec_mean0.5005398216742691
driven_lanedir_consec_min0.3293351632108332
driven_lanedir_max0.8150472085367548
driven_lanedir_mean0.5005398216742691
driven_lanedir_median0.4288884574747443
driven_lanedir_min0.3293351632108332
get_duckie_state_max1.6445250023068406e-06
get_duckie_state_mean1.433167344338664e-06
get_duckie_state_median1.4000323894313746e-06
get_duckie_state_min1.288079596185065e-06
get_robot_state_max0.004138848912997509
get_robot_state_mean0.003842566005975663
get_robot_state_median0.003772807092680037
get_robot_state_min0.00368580092554507
get_state_dump_max0.005169091262216643
get_state_dump_mean0.004920759683323559
get_state_dump_median0.004917093547748681
get_state_dump_min0.00467976037558023
get_ui_image_max0.03773179016714021
get_ui_image_mean0.03277686253760009
get_ui_image_median0.03345117838963138
get_ui_image_min0.02647330320399741
in-drivable-lane_max10.55000000000009
in-drivable-lane_mean6.525000000000014
in-drivable-lane_min3.399999999999988
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0628377090095684, "get_ui_image": 0.031330530810507996, "step_physics": 0.1270407377534611, "survival_time": 15.650000000000087, "driven_lanedir": 0.8150472085367548, "get_state_dump": 0.005072359066859932, "get_robot_state": 0.003847093339178972, "sim_render-ego0": 0.003979748981014179, "get_duckie_state": 1.465439037152916e-06, "in-drivable-lane": 10.55000000000009, "deviation-heading": 2.806773640250431, "agent_compute-ego0": 0.012876525806013946, "complete-iteration": 0.1990199210537467, "set_robot_commands": 0.002384662628173828, "deviation-center-line": 0.5222640658722739, "driven_lanedir_consec": 0.8150472085367548, "sim_compute_sim_state": 0.010262243307320175, "sim_compute_performance-ego0": 0.0021370178574969057}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.385727669811803, "get_ui_image": 0.03557182596875476, "step_physics": 0.12985939019686216, "survival_time": 7.649999999999981, "driven_lanedir": 0.35038858297587616, "get_state_dump": 0.00467976037558023, "get_robot_state": 0.0036985208461811016, "sim_render-ego0": 0.003784551248921977, "get_duckie_state": 1.288079596185065e-06, "in-drivable-lane": 4.999999999999982, "deviation-heading": 1.66255995016034, "agent_compute-ego0": 0.012101534125092742, "complete-iteration": 0.2038525188124025, "set_robot_commands": 0.002178091507453423, "deviation-center-line": 0.22004297870494569, "driven_lanedir_consec": 0.35038858297587616, "sim_compute_sim_state": 0.009911160964470403, "sim_compute_performance-ego0": 0.001986546949906782}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0922339601873277, "get_ui_image": 0.03773179016714021, "step_physics": 0.14561895310409426, "survival_time": 6.299999999999986, "driven_lanedir": 0.5073883319736125, "get_state_dump": 0.005169091262216643, "get_robot_state": 0.004138848912997509, "sim_render-ego0": 0.004264994869081992, "get_duckie_state": 1.6445250023068406e-06, "in-drivable-lane": 3.399999999999988, "deviation-heading": 0.6256329537978647, "agent_compute-ego0": 0.013531947699118786, "complete-iteration": 0.2245335691557156, "set_robot_commands": 0.002504958881167915, "deviation-center-line": 0.16904657202065185, "driven_lanedir_consec": 0.5073883319736125, "sim_compute_sim_state": 0.009246995129923182, "sim_compute_performance-ego0": 0.002228975296020508}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7001911246746944, "get_ui_image": 0.02647330320399741, "step_physics": 0.09691211062928903, "survival_time": 9.149999999999997, "driven_lanedir": 0.3293351632108332, "get_state_dump": 0.00476182802863743, "get_robot_state": 0.00368580092554507, "sim_render-ego0": 0.003708081400912741, "get_duckie_state": 1.3346257417098335e-06, "in-drivable-lane": 7.149999999999994, "deviation-heading": 0.5542594307399573, "agent_compute-ego0": 0.011856228113174438, "complete-iteration": 0.15674734633901846, "set_robot_commands": 0.0021940949170485787, "deviation-center-line": 0.13613751527381565, "driven_lanedir_consec": 0.3293351632108332, "sim_compute_sim_state": 0.005133356737053912, "sim_compute_performance-ego0": 0.0019415176433065665}}
set_robot_commands_max0.002504958881167915
set_robot_commands_mean0.002315451983460936
set_robot_commands_median0.002289378772611203
set_robot_commands_min0.002178091507453423
sim_compute_performance-ego0_max0.002228975296020508
sim_compute_performance-ego0_mean0.0020735144366826907
sim_compute_performance-ego0_median0.0020617824037018444
sim_compute_performance-ego0_min0.0019415176433065665
sim_compute_sim_state_max0.010262243307320175
sim_compute_sim_state_mean0.008638439034691919
sim_compute_sim_state_median0.009579078047196791
sim_compute_sim_state_min0.005133356737053912
sim_render-ego0_max0.004264994869081992
sim_render-ego0_mean0.003934344124982722
sim_render-ego0_median0.0038821501149680776
sim_render-ego0_min0.003708081400912741
simulation-passed1
step_physics_max0.14561895310409426
step_physics_mean0.12485779792092663
step_physics_median0.12845006397516162
step_physics_min0.09691211062928903
survival_time_max15.650000000000087
survival_time_mean9.687500000000012
survival_time_min6.299999999999986
No reset possible
5400511695Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerroryesnogpu-prod-080:25:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 577, in run_episode
    await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:

error in simulator |Exception while handling a message on topic "step".
                   |
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 73, in belongs
                   ||     self.SOn.belongs(R)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_orthogonal_group.py", line 39, in belongs
                   ||     assert_allclose(det, 1, err_msg="I expect the determinant to be +1.")
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 1527, in assert_allclose
                   ||     assert_array_compare(compare, actual, desired, err_msg=str(err_msg),
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 764, in assert_array_compare
                   ||     flagged = func_assert_same_pos(x, y, func=isnan, hasval='nan')
                   ||   File "/usr/local/lib/python3.8/site-packages/numpy/testing/_private/utils.py", line 740, in func_assert_same_pos
                   ||     raise AssertionError(msg)
                   || AssertionError:
                   || Not equal to tolerance rtol=1e-07, atol=0
                   || I expect the determinant to be +1.
                   || x and y nan location mismatch:
                   ||  x: array(nan)
                   ||  y: array(1)
                   ||
                   || During handling of the above exception, another exception occurred:
                   ||
                   || Traceback (most recent call last):
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
                   ||     handle_message_node(parsed, receiver0, context0)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
                   ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
                   ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
                   ||     f(**kwargs)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 510, in on_received_step
                   ||     self.update_physics_and_observations(until=data.until, context=context)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 560, in update_physics_and_observations
                   ||     pc.integrate(delta_time)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_simulator_gym/code.py", line 217, in integrate
                   ||     self.state = self.state.integrate(dt, self.last_commands.wheels)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/dynamics_delay.py", line 74, in integrate
                   ||     state2 = self.state.integrate(dt, use_commands)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/pwm_dynamics.py", line 199, in integrate
                   ||     s1 = GenericKinematicsSE2.integrate(self, dt, commands_se2)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 48, in integrate
                   ||     return GenericKinematicsSE2(c1, t1)
                   ||   File "/usr/local/lib/python3.8/site-packages/duckietown_world/world_duckietown/generic_kinematics.py", line 26, in __init__
                   ||     geo.SE2.belongs(q0)
                   ||   File "/usr/local/lib/python3.8/site-packages/geometry/manifolds/special_euclidean_group.py", line 76, in belongs
                   ||     raise ValueError(msg)
                   || ValueError: The rotation is not a rotation:
                   || [[nan nan]
                   ||  [nan nan]]
                   ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5388411576Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:53:39
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.1437909603001533
survival_time_median59.99999999999873
deviation-center-line_median1.2258068304677303
in-drivable-lane_median46.67499999999863


other stats
agent_compute-ego0_max0.1335890846982983
agent_compute-ego0_mean0.1101761651376602
agent_compute-ego0_median0.12048159332497728
agent_compute-ego0_min0.0661523892023879
complete-iteration_max0.503204750677231
complete-iteration_mean0.4112902456378064
complete-iteration_median0.3908893310656456
complete-iteration_min0.36017756974270304
deviation-center-line_max2.257853774645673
deviation-center-line_mean1.316408252363411
deviation-center-line_min0.5561655738725109
deviation-heading_max3.841895465273165
deviation-heading_mean2.790936109244121
deviation-heading_median3.0851610850194926
deviation-heading_min1.1515268016643334
driven_any_max5.583649117161323
driven_any_mean4.292981642358845
driven_any_median4.777769225618016
driven_any_min2.0327390010380255
driven_lanedir_consec_max4.7142372388402745
driven_lanedir_consec_mean2.927033267665281
driven_lanedir_consec_min0.7063139112205437
driven_lanedir_max4.7142372388402745
driven_lanedir_mean2.927033267665281
driven_lanedir_median3.1437909603001533
driven_lanedir_min0.7063139112205437
get_duckie_state_max1.4708103684958174e-06
get_duckie_state_mean1.3756216019019797e-06
get_duckie_state_median1.3776067690885036e-06
get_duckie_state_min1.2764625009350931e-06
get_robot_state_max0.004137746301122153
get_robot_state_mean0.004030096788986041
get_robot_state_median0.004077743828842582
get_robot_state_min0.0038271531971368466
get_state_dump_max0.005436766058281002
get_state_dump_mean0.005096245169341812
get_state_dump_median0.005081036108717334
get_state_dump_min0.004786142401651578
get_ui_image_max0.04155734853879498
get_ui_image_mean0.03491960457222944
get_ui_image_median0.03351670220730009
get_ui_image_min0.031087665335522603
in-drivable-lane_max55.74999999999871
in-drivable-lane_mean48.52499999999864
in-drivable-lane_min44.999999999998586
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.583649117161323, "get_ui_image": 0.033123437808415576, "step_physics": 0.22809633942666796, "survival_time": 59.99999999999873, "driven_lanedir": 4.7142372388402745, "get_state_dump": 0.005436766058281002, "get_robot_state": 0.004079593012076829, "sim_render-ego0": 0.004200797394650068, "get_duckie_state": 1.4708103684958174e-06, "in-drivable-lane": 46.299999999998654, "deviation-heading": 3.0542668868364298, "agent_compute-ego0": 0.1216405535816253, "complete-iteration": 0.4118257869193198, "set_robot_commands": 0.002538827535611803, "deviation-center-line": 1.130960102418779, "driven_lanedir_consec": 4.7142372388402745, "sim_compute_sim_state": 0.010352352874463644, "sim_compute_performance-ego0": 0.0022660977238917928}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.0327390010380255, "get_ui_image": 0.04155734853879498, "step_physics": 0.2981166551750367, "survival_time": 59.99999999999873, "driven_lanedir": 0.7063139112205437, "get_state_dump": 0.005050886282813638, "get_robot_state": 0.004075894645608335, "sim_render-ego0": 0.004198704432885315, "get_duckie_state": 1.375919376979958e-06, "in-drivable-lane": 55.74999999999871, "deviation-heading": 1.1515268016643334, "agent_compute-ego0": 0.1335890846982983, "complete-iteration": 0.503204750677231, "set_robot_commands": 0.0024747713519373505, "deviation-center-line": 0.5561655738725109, "driven_lanedir_consec": 0.7063139112205437, "sim_compute_sim_state": 0.011728413396830563, "sim_compute_performance-ego0": 0.002310519810024646}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.644606654931128, "get_ui_image": 0.0339099666061846, "step_physics": 0.22961988020300567, "survival_time": 59.99999999999873, "driven_lanedir": 3.284700845295121, "get_state_dump": 0.004786142401651578, "get_robot_state": 0.0038271531971368466, "sim_render-ego0": 0.003904669012852652, "get_duckie_state": 1.2764625009350931e-06, "in-drivable-lane": 47.04999999999862, "deviation-heading": 3.841895465273165, "agent_compute-ego0": 0.0661523892023879, "complete-iteration": 0.36017756974270304, "set_robot_commands": 0.002259417834825857, "deviation-center-line": 1.320653558516682, "driven_lanedir_consec": 3.284700845295121, "sim_compute_sim_state": 0.013557806300878723, "sim_compute_performance-ego0": 0.0020768543167177782}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.910931796304905, "get_ui_image": 0.031087665335522603, "step_physics": 0.19480579520740873, "survival_time": 59.99999999999873, "driven_lanedir": 3.0028810753051856, "get_state_dump": 0.0051111859346210315, "get_robot_state": 0.004137746301122153, "sim_render-ego0": 0.004166317224304047, "get_duckie_state": 1.3792941611970493e-06, "in-drivable-lane": 44.999999999998586, "deviation-heading": 3.116055283202555, "agent_compute-ego0": 0.11932263306832928, "complete-iteration": 0.3699528752119714, "set_robot_commands": 0.0025566616820653807, "deviation-center-line": 2.257853774645673, "driven_lanedir_consec": 3.0028810753051856, "sim_compute_sim_state": 0.0064047472760838135, "sim_compute_performance-ego0": 0.00226973673386141}}
set_robot_commands_max0.0025566616820653807
set_robot_commands_mean0.002457419601110098
set_robot_commands_median0.0025067994437745766
set_robot_commands_min0.002259417834825857
sim_compute_performance-ego0_max0.002310519810024646
sim_compute_performance-ego0_mean0.002230802146123907
sim_compute_performance-ego0_median0.002267917228876601
sim_compute_performance-ego0_min0.0020768543167177782
sim_compute_sim_state_max0.013557806300878723
sim_compute_sim_state_mean0.010510829962064185
sim_compute_sim_state_median0.011040383135647102
sim_compute_sim_state_min0.0064047472760838135
sim_render-ego0_max0.004200797394650068
sim_render-ego0_mean0.004117622016173021
sim_render-ego0_median0.004182510828594681
sim_render-ego0_min0.003904669012852652
simulation-passed1
step_physics_max0.2981166551750367
step_physics_mean0.23765966750302975
step_physics_median0.2288581098148368
step_physics_min0.19480579520740873
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5385011746Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:31:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.482434417566042
survival_time_median59.99999999999873
deviation-center-line_median3.344944998854153
in-drivable-lane_median8.199999999999996


other stats
agent_compute-ego0_max0.013297029516913672
agent_compute-ego0_mean0.012407851293282635
agent_compute-ego0_median0.01219092677971604
agent_compute-ego0_min0.011952522096784783
complete-iteration_max0.2363224679773504
complete-iteration_mean0.21115714284529272
complete-iteration_median0.21325049610757313
complete-iteration_min0.18180511118867415
deviation-center-line_max3.83603051008573
deviation-center-line_mean2.845414822386095
deviation-center-line_min0.8557387817503421
deviation-heading_max20.85322099864573
deviation-heading_mean14.504248146819249
deviation-heading_median16.99902675358112
deviation-heading_min3.165718081469029
driven_any_max12.044914170635504
driven_any_mean9.107619618138616
driven_any_median10.26886453429261
driven_any_min3.847835233333745
driven_lanedir_consec_max10.84493669384207
driven_lanedir_consec_mean5.972687494334165
driven_lanedir_consec_min2.080944448362506
driven_lanedir_max10.84493669384207
driven_lanedir_mean7.206351316849831
driven_lanedir_median7.949762062597374
driven_lanedir_min2.080944448362506
get_duckie_state_max1.5730207616632637e-06
get_duckie_state_mean1.4207777261607678e-06
get_duckie_state_median1.3994436081402705e-06
get_duckie_state_min1.3112029266992677e-06
get_robot_state_max0.004092259840531783
get_robot_state_mean0.003858651118494706
get_robot_state_median0.0037902415940207703
get_robot_state_min0.003761861445405501
get_state_dump_max0.004931764711033214
get_state_dump_mean0.004783983426423052
get_state_dump_median0.004744543322516321
get_state_dump_min0.004715082349626349
get_ui_image_max0.03561929342252428
get_ui_image_mean0.03105509061425254
get_ui_image_median0.031125841562098806
get_ui_image_min0.02634938591028828
in-drivable-lane_max16.19999999999996
in-drivable-lane_mean9.112499999999942
in-drivable-lane_min3.849999999999813
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.044914170635504, "get_ui_image": 0.028604926713598856, "step_physics": 0.12392671181697036, "survival_time": 59.99999999999873, "driven_lanedir": 10.84493669384207, "get_state_dump": 0.004715082349626349, "get_robot_state": 0.003776943753105119, "sim_render-ego0": 0.0038287314050501338, "get_duckie_state": 1.4517527635051843e-06, "in-drivable-lane": 3.849999999999813, "deviation-heading": 15.687103171331612, "agent_compute-ego0": 0.012001219836003971, "complete-iteration": 0.1907577115629833, "set_robot_commands": 0.0022675588069410745, "deviation-center-line": 3.83603051008573, "driven_lanedir_consec": 10.84493669384207, "sim_compute_sim_state": 0.009476409367379498, "sim_compute_performance-ego0": 0.0020621523670510985}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.470382751969831, "get_ui_image": 0.03561929342252428, "step_physics": 0.15461495675016304, "survival_time": 59.99999999999873, "driven_lanedir": 6.90397134216095, "get_state_dump": 0.004747885053699757, "get_robot_state": 0.003803539434936422, "sim_render-ego0": 0.003927528808555635, "get_duckie_state": 1.3471344527753564e-06, "in-drivable-lane": 16.19999999999996, "deviation-heading": 18.310950335830626, "agent_compute-ego0": 0.012380633723428108, "complete-iteration": 0.2357432806521629, "set_robot_commands": 0.0023427968418270623, "deviation-center-line": 3.045147929297831, "driven_lanedir_consec": 5.295499687108539, "sim_compute_sim_state": 0.016051775807643512, "sim_compute_performance-ego0": 0.002160629364572695}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.847835233333745, "get_ui_image": 0.033646756410598756, "step_physics": 0.1597672462463379, "survival_time": 21.950000000000177, "driven_lanedir": 2.080944448362506, "get_state_dump": 0.004931764711033214, "get_robot_state": 0.004092259840531783, "sim_render-ego0": 0.004192787950689143, "get_duckie_state": 1.5730207616632637e-06, "in-drivable-lane": 10.50000000000015, "deviation-heading": 3.165718081469029, "agent_compute-ego0": 0.013297029516913672, "complete-iteration": 0.2363224679773504, "set_robot_commands": 0.002508323842828924, "deviation-center-line": 0.8557387817503421, "driven_lanedir_consec": 2.080944448362506, "sim_compute_sim_state": 0.011446499824523924, "sim_compute_performance-ego0": 0.002332855354655873}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.06734631661539, "get_ui_image": 0.02634938591028828, "step_physics": 0.12057042856399068, "survival_time": 59.99999999999873, "driven_lanedir": 8.9955527830338, "get_state_dump": 0.004741201591332886, "get_robot_state": 0.003761861445405501, "sim_render-ego0": 0.00379499249613156, "get_duckie_state": 1.3112029266992677e-06, "in-drivable-lane": 5.899999999999844, "deviation-heading": 20.85322099864573, "agent_compute-ego0": 0.011952522096784783, "complete-iteration": 0.18180511118867415, "set_robot_commands": 0.0022513463435621683, "deviation-center-line": 3.644742068410475, "driven_lanedir_consec": 5.669369148023545, "sim_compute_sim_state": 0.006284961493982066, "sim_compute_performance-ego0": 0.002006696920212262}}
set_robot_commands_max0.002508323842828924
set_robot_commands_mean0.002342506458789807
set_robot_commands_median0.002305177824384068
set_robot_commands_min0.0022513463435621683
sim_compute_performance-ego0_max0.002332855354655873
sim_compute_performance-ego0_mean0.002140583501622982
sim_compute_performance-ego0_median0.0021113908658118965
sim_compute_performance-ego0_min0.002006696920212262
sim_compute_sim_state_max0.016051775807643512
sim_compute_sim_state_mean0.010814911623382252
sim_compute_sim_state_median0.010461454595951712
sim_compute_sim_state_min0.006284961493982066
sim_render-ego0_max0.004192787950689143
sim_render-ego0_mean0.003936010165106618
sim_render-ego0_median0.003878130106802884
sim_render-ego0_min0.00379499249613156
simulation-passed1
step_physics_max0.1597672462463379
step_physics_mean0.1397198358443655
step_physics_median0.1392708342835667
step_physics_min0.12057042856399068
survival_time_max59.99999999999873
survival_time_mean50.48749999999909
survival_time_min21.950000000000177
No reset possible
5383111753Étienne Boucher 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:21:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4658842836008973
survival_time_median36.69999999999939
deviation-center-line_median0.5488002134220176
in-drivable-lane_median28.224999999999486


other stats
agent_compute-ego0_max0.014657835165659586
agent_compute-ego0_mean0.013182426975565794
agent_compute-ego0_median0.012805955197590774
agent_compute-ego0_min0.01245996234142204
complete-iteration_max0.260923699537913
complete-iteration_mean0.22790542592014415
complete-iteration_median0.22880551718977435
complete-iteration_min0.193086969763115
deviation-center-line_max1.1268821619798044
deviation-center-line_mean0.5610773548135362
deviation-center-line_min0.019826830430305024
deviation-heading_max6.095750362212259
deviation-heading_mean3.378585766124591
deviation-heading_median3.3432236916993165
deviation-heading_min0.7321453188874715
driven_any_max7.920185250520746
driven_any_mean4.432047621905463
driven_any_median4.777216702498198
driven_any_min0.2535718321047075
driven_lanedir_consec_max1.226349429886726
driven_lanedir_consec_mean0.5467162515047534
driven_lanedir_consec_min0.028747008930493312
driven_lanedir_max1.226349429886726
driven_lanedir_mean0.5978290279611428
driven_lanedir_median0.5681098365136759
driven_lanedir_min0.028747008930493312
get_duckie_state_max1.5932951839043636e-06
get_duckie_state_mean1.530273557809495e-06
get_duckie_state_median1.522815106959452e-06
get_duckie_state_min1.4821688334147136e-06
get_robot_state_max0.0039062368978965687
get_robot_state_mean0.00375663877220568
get_robot_state_median0.0037766808354227927
get_robot_state_min0.0035669565200805663
get_state_dump_max0.004758768335766439
get_state_dump_mean0.004660574081185487
get_state_dump_median0.004695245064688356
get_state_dump_min0.004493037859598796
get_ui_image_max0.034570709864298506
get_ui_image_mean0.03077263524781271
get_ui_image_median0.030998944066138186
get_ui_image_min0.026521942994675966
in-drivable-lane_max52.8499999999988
in-drivable-lane_mean27.84999999999944
in-drivable-lane_min2.0999999999999974
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.920118835365665, "get_ui_image": 0.029250624773405075, "step_physics": 0.16140884622546856, "survival_time": 59.99999999999873, "driven_lanedir": 0.5278906918918778, "get_state_dump": 0.004751703919816473, "get_robot_state": 0.00376067868279577, "sim_render-ego0": 0.003839308772853371, "get_duckie_state": 1.5256009828438869e-06, "in-drivable-lane": 52.8499999999988, "deviation-heading": 6.095750362212259, "agent_compute-ego0": 0.012749759481908082, "complete-iteration": 0.22820535825750016, "set_robot_commands": 0.0022578235470583595, "deviation-center-line": 0.8394579522309236, "driven_lanedir_consec": 0.3234395860663205, "sim_compute_sim_state": 0.008040312823407557, "sim_compute_performance-ego0": 0.002050156001742932}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2535718321047075, "get_ui_image": 0.034570709864298506, "step_physics": 0.1863261580467224, "survival_time": 2.9499999999999975, "driven_lanedir": 0.028747008930493312, "get_state_dump": 0.004493037859598796, "get_robot_state": 0.0035669565200805663, "sim_render-ego0": 0.0036905288696289064, "get_duckie_state": 1.4821688334147136e-06, "in-drivable-lane": 2.0999999999999974, "deviation-heading": 0.7321453188874715, "agent_compute-ego0": 0.014657835165659586, "complete-iteration": 0.260923699537913, "set_robot_commands": 0.002193919817606608, "deviation-center-line": 0.019826830430305024, "driven_lanedir_consec": 0.028747008930493312, "sim_compute_sim_state": 0.009264938036600749, "sim_compute_performance-ego0": 0.002062543233235677}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.634314569630732, "get_ui_image": 0.03274726335887129, "step_physics": 0.15810576601985665, "survival_time": 13.400000000000055, "driven_lanedir": 0.6083289811354741, "get_state_dump": 0.004638786209560238, "get_robot_state": 0.003792682988049815, "sim_render-ego0": 0.0037975665805065058, "get_duckie_state": 1.5200292310750174e-06, "in-drivable-lane": 7.650000000000068, "deviation-heading": 2.0311080618705906, "agent_compute-ego0": 0.01245996234142204, "complete-iteration": 0.22940567612204857, "set_robot_commands": 0.0022740807231917256, "deviation-center-line": 0.2581424746131115, "driven_lanedir_consec": 0.6083289811354741, "sim_compute_sim_state": 0.00948135560329962, "sim_compute_performance-ego0": 0.002012116315196438}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920185250520746, "get_ui_image": 0.026521942994675966, "step_physics": 0.12996985533156066, "survival_time": 59.99999999999873, "driven_lanedir": 1.226349429886726, "get_state_dump": 0.004758768335766439, "get_robot_state": 0.0039062368978965687, "sim_render-ego0": 0.00401842961402658, "get_duckie_state": 1.5932951839043636e-06, "in-drivable-lane": 48.7999999999989, "deviation-heading": 4.655339321528043, "agent_compute-ego0": 0.012862150913273465, "complete-iteration": 0.193086969763115, "set_robot_commands": 0.0023236147668538342, "deviation-center-line": 1.1268821619798044, "driven_lanedir_consec": 1.226349429886726, "sim_compute_sim_state": 0.006478119849364625, "sim_compute_performance-ego0": 0.0021468630242010237}}
set_robot_commands_max0.0023236147668538342
set_robot_commands_mean0.002262359713677632
set_robot_commands_median0.0022659521351250426
set_robot_commands_min0.002193919817606608
sim_compute_performance-ego0_max0.0021468630242010237
sim_compute_performance-ego0_mean0.0020679196435940176
sim_compute_performance-ego0_median0.0020563496174893043
sim_compute_performance-ego0_min0.002012116315196438
sim_compute_sim_state_max0.00948135560329962
sim_compute_sim_state_mean0.008316181578168137
sim_compute_sim_state_median0.008652625430004153
sim_compute_sim_state_min0.006478119849364625
sim_render-ego0_max0.00401842961402658
sim_render-ego0_mean0.0038364584592538407
sim_render-ego0_median0.0038184376766799383
sim_render-ego0_min0.0036905288696289064
simulation-passed1
step_physics_max0.1863261580467224
step_physics_mean0.15895265640590206
step_physics_median0.1597573061226626
step_physics_min0.12996985533156066
survival_time_max59.99999999999873
survival_time_mean34.08749999999938
survival_time_min2.9499999999999975
No reset possible
5381311758Ayman Shams 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:11:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.48139117609008
survival_time_median12.025000000000036
deviation-center-line_median0.33341679985081285
in-drivable-lane_median7.375000000000044


other stats
agent_compute-ego0_max0.01329638006908646
agent_compute-ego0_mean0.012893042680903908
agent_compute-ego0_median0.0128046607522049
agent_compute-ego0_min0.012666469150119358
complete-iteration_max0.3530601973824658
complete-iteration_mean0.3175982317644521
complete-iteration_median0.32609456649542584
complete-iteration_min0.26514359668449117
deviation-center-line_max0.3802918528647258
deviation-center-line_mean0.30648278845958876
deviation-center-line_min0.1788057012720035
deviation-heading_max3.1613547925406413
deviation-heading_mean1.9743209707642528
deviation-heading_median1.9373262886277796
deviation-heading_min0.861276513260811
driven_any_max3.02194264698017
driven_any_mean1.750628901600749
driven_any_median1.458525482296814
driven_any_min1.0635219948291983
driven_lanedir_consec_max0.6434142474740878
driven_lanedir_consec_mean0.46863183426114313
driven_lanedir_consec_min0.26833073739032476
driven_lanedir_max0.6434142474740878
driven_lanedir_mean0.46863183426114313
driven_lanedir_median0.48139117609008
driven_lanedir_min0.26833073739032476
get_duckie_state_max2.051963180792136e-06
get_duckie_state_mean1.728265914728684e-06
get_duckie_state_median1.716413837808733e-06
get_duckie_state_min1.428272802505135e-06
get_robot_state_max0.004345131702110415
get_robot_state_mean0.004110180696005366
get_robot_state_median0.004072367770117034
get_robot_state_min0.003950855541676982
get_state_dump_max0.0054987245570115055
get_state_dump_mean0.005344134228736554
get_state_dump_median0.005344206029447218
get_state_dump_min0.005189400299040276
get_ui_image_max0.03631279278249248
get_ui_image_mean0.032840874006823874
get_ui_image_median0.03305108021898286
get_ui_image_min0.028948542806837292
in-drivable-lane_max20.200000000000177
in-drivable-lane_mean9.637500000000069
in-drivable-lane_min3.600000000000006
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.02194264698017, "get_ui_image": 0.03057302768875218, "step_physics": 0.23214087346314885, "survival_time": 23.800000000000203, "driven_lanedir": 0.26833073739032476, "get_state_dump": 0.005189400299040276, "get_robot_state": 0.004003987622211064, "sim_render-ego0": 0.004164707735649445, "get_duckie_state": 1.7638976219065284e-06, "in-drivable-lane": 20.200000000000177, "deviation-heading": 2.827433388230843, "agent_compute-ego0": 0.012932645949677602, "complete-iteration": 0.30511697333313886, "set_robot_commands": 0.002470025476419701, "deviation-center-line": 0.3802918528647258, "driven_lanedir_consec": 0.26833073739032476, "sim_compute_sim_state": 0.011258334733655118, "sim_compute_performance-ego0": 0.002277428748972511}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.269322131156784, "get_ui_image": 0.03631279278249248, "step_physics": 0.27478370644117184, "survival_time": 10.600000000000016, "driven_lanedir": 0.354565426251253, "get_state_dump": 0.005399011110475925, "get_robot_state": 0.003950855541676982, "sim_render-ego0": 0.004124048170349407, "get_duckie_state": 1.428272802505135e-06, "in-drivable-lane": 6.350000000000023, "deviation-heading": 3.1613547925406413, "agent_compute-ego0": 0.0126766755547322, "complete-iteration": 0.3530601973824658, "set_robot_commands": 0.0024314699038653306, "deviation-center-line": 0.3573313015008135, "driven_lanedir_consec": 0.354565426251253, "sim_compute_sim_state": 0.01101970112939396, "sim_compute_performance-ego0": 0.0022535760637740015}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0635219948291983, "get_ui_image": 0.03552913274921355, "step_physics": 0.26930665448715124, "survival_time": 9.099999999999994, "driven_lanedir": 0.6434142474740878, "get_state_dump": 0.0054987245570115055, "get_robot_state": 0.004345131702110415, "sim_render-ego0": 0.004356694351779959, "get_duckie_state": 2.051963180792136e-06, "in-drivable-lane": 3.600000000000006, "deviation-heading": 1.047219189024716, "agent_compute-ego0": 0.01329638006908646, "complete-iteration": 0.3470721596577128, "set_robot_commands": 0.0025702851717589333, "deviation-center-line": 0.1788057012720035, "driven_lanedir_consec": 0.6434142474740878, "sim_compute_sim_state": 0.00964011911486016, "sim_compute_performance-ego0": 0.002411416319550061}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.647728833436844, "get_ui_image": 0.028948542806837292, "step_physics": 0.19934638341267905, "survival_time": 13.450000000000056, "driven_lanedir": 0.608216925928907, "get_state_dump": 0.005289400948418511, "get_robot_state": 0.004140747918023003, "sim_render-ego0": 0.004125180067839446, "get_duckie_state": 1.6689300537109375e-06, "in-drivable-lane": 8.400000000000066, "deviation-heading": 0.861276513260811, "agent_compute-ego0": 0.012666469150119358, "complete-iteration": 0.26514359668449117, "set_robot_commands": 0.002453806665208605, "deviation-center-line": 0.30950229820081226, "driven_lanedir_consec": 0.608216925928907, "sim_compute_sim_state": 0.005828090950294777, "sim_compute_performance-ego0": 0.002234871299178512}}
set_robot_commands_max0.0025702851717589333
set_robot_commands_mean0.0024813968043131424
set_robot_commands_median0.002461916070814153
set_robot_commands_min0.0024314699038653306
sim_compute_performance-ego0_max0.002411416319550061
sim_compute_performance-ego0_mean0.0022943231078687712
sim_compute_performance-ego0_median0.002265502406373256
sim_compute_performance-ego0_min0.002234871299178512
sim_compute_sim_state_max0.011258334733655118
sim_compute_sim_state_mean0.009436561482051005
sim_compute_sim_state_median0.01032991012212706
sim_compute_sim_state_min0.005828090950294777
sim_render-ego0_max0.004356694351779959
sim_render-ego0_mean0.004192657581404564
sim_render-ego0_median0.0041449439017444455
sim_render-ego0_min0.004124048170349407
simulation-passed1
step_physics_max0.27478370644117184
step_physics_mean0.24389440445103777
step_physics_median0.25072376397515006
step_physics_min0.19934638341267905
survival_time_max23.800000000000203
survival_time_mean14.237500000000068
survival_time_min9.099999999999994
No reset possible
5379011769Ayman Shams 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:11:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4813896485211576
survival_time_median12.025000000000036
deviation-center-line_median0.33345674230216915
in-drivable-lane_median7.375000000000044


other stats
agent_compute-ego0_max0.013380967854150655
agent_compute-ego0_mean0.012953773687986775
agent_compute-ego0_median0.013095030206072111
agent_compute-ego0_min0.012244066485652218
complete-iteration_max0.39014121736159346
complete-iteration_mean0.31951455983748045
complete-iteration_median0.3193520601538853
complete-iteration_min0.24921290168055785
deviation-center-line_max0.38029146242275713
deviation-center-line_mean0.3065028213478454
deviation-center-line_min0.1788063383642862
deviation-heading_max3.1613539700664854
deviation-heading_mean1.9743507839922876
deviation-heading_median1.9373218621156865
deviation-heading_min0.8614054416712923
driven_any_max3.0219426596847785
driven_any_mean1.7506289089806195
driven_any_median1.4585254890415729
driven_any_min1.063521998154555
driven_lanedir_consec_max0.6434147319206773
driven_lanedir_consec_mean0.4686315178838807
driven_lanedir_consec_min0.2683320425725302
driven_lanedir_max0.6434147319206773
driven_lanedir_mean0.4686315178838807
driven_lanedir_median0.4813896485211576
driven_lanedir_min0.2683320425725302
get_duckie_state_max1.6194469523879718e-06
get_duckie_state_mean1.5845799555816049e-06
get_duckie_state_median1.6026782042653753e-06
get_duckie_state_min1.5135164614076967e-06
get_robot_state_max0.004345452199216749
get_robot_state_mean0.00417667600190782
get_robot_state_median0.004182837157055573
get_robot_state_min0.003995577494303386
get_state_dump_max0.005324491386205121
get_state_dump_mean0.005137391776519484
get_state_dump_median0.005137100448380871
get_state_dump_min0.004950874823111075
get_ui_image_max0.039100407434741094
get_ui_image_mean0.03254772003604188
get_ui_image_median0.032060053257015136
get_ui_image_min0.02697036619539614
in-drivable-lane_max20.200000000000177
in-drivable-lane_mean9.637500000000069
in-drivable-lane_min3.600000000000006
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.0219426596847785, "get_ui_image": 0.029632705312604923, "step_physics": 0.21938548547916692, "survival_time": 23.800000000000203, "driven_lanedir": 0.2683320425725302, "get_state_dump": 0.005131025234358366, "get_robot_state": 0.004118507013380903, "sim_render-ego0": 0.004107924627308076, "get_duckie_state": 1.6194469523879718e-06, "in-drivable-lane": 20.200000000000177, "deviation-heading": 2.827422992353983, "agent_compute-ego0": 0.013030000702640043, "complete-iteration": 0.2910355441975144, "set_robot_commands": 0.0024365798982184388, "deviation-center-line": 0.38029146242275713, "driven_lanedir_consec": 0.2683320425725302, "sim_compute_sim_state": 0.010814112937175505, "sim_compute_performance-ego0": 0.002259496372950652}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2693221366231002, "get_ui_image": 0.039100407434741094, "step_physics": 0.3077006183319808, "survival_time": 10.600000000000016, "driven_lanedir": 0.3545651496062199, "get_state_dump": 0.005143175662403375, "get_robot_state": 0.004247167300730244, "sim_render-ego0": 0.004139906923535844, "get_duckie_state": 1.5950538742710168e-06, "in-drivable-lane": 6.350000000000023, "deviation-heading": 3.1613539700664854, "agent_compute-ego0": 0.013160059709504176, "complete-iteration": 0.39014121736159346, "set_robot_commands": 0.002492873321676478, "deviation-center-line": 0.3573312701514442, "driven_lanedir_consec": 0.3545651496062199, "sim_compute_sim_state": 0.011670140593264584, "sim_compute_performance-ego0": 0.0023726420783101113}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.063521998154555, "get_ui_image": 0.034487401201425356, "step_physics": 0.271289709487248, "survival_time": 9.099999999999994, "driven_lanedir": 0.6434147319206773, "get_state_dump": 0.005324491386205121, "get_robot_state": 0.004345452199216749, "sim_render-ego0": 0.004308686230352016, "get_duckie_state": 1.6103025342597337e-06, "in-drivable-lane": 3.600000000000006, "deviation-heading": 1.0472207318773896, "agent_compute-ego0": 0.013380967854150655, "complete-iteration": 0.3476685761102562, "set_robot_commands": 0.0025187033773119982, "deviation-center-line": 0.1788063383642862, "driven_lanedir_consec": 0.6434147319206773, "sim_compute_sim_state": 0.009524426173642684, "sim_compute_performance-ego0": 0.0023677961422445995}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6477288414600455, "get_ui_image": 0.02697036619539614, "step_physics": 0.18698313236236572, "survival_time": 13.450000000000056, "driven_lanedir": 0.6082141474360954, "get_state_dump": 0.004950874823111075, "get_robot_state": 0.003995577494303386, "sim_render-ego0": 0.003953355330008047, "get_duckie_state": 1.5135164614076967e-06, "in-drivable-lane": 8.400000000000066, "deviation-heading": 0.8614054416712923, "agent_compute-ego0": 0.012244066485652218, "complete-iteration": 0.24921290168055785, "set_robot_commands": 0.002361938688490126, "deviation-center-line": 0.30958221445289413, "driven_lanedir_consec": 0.6082141474360954, "sim_compute_sim_state": 0.005463833279079861, "sim_compute_performance-ego0": 0.002169964048597548}}
set_robot_commands_max0.0025187033773119982
set_robot_commands_mean0.00245252382142426
set_robot_commands_median0.0024647266099474584
set_robot_commands_min0.002361938688490126
sim_compute_performance-ego0_max0.0023726420783101113
sim_compute_performance-ego0_mean0.0022924746605257275
sim_compute_performance-ego0_median0.0023136462575976255
sim_compute_performance-ego0_min0.002169964048597548
sim_compute_sim_state_max0.011670140593264584
sim_compute_sim_state_mean0.00936812824579066
sim_compute_sim_state_median0.010169269555409094
sim_compute_sim_state_min0.005463833279079861
sim_render-ego0_max0.004308686230352016
sim_render-ego0_mean0.004127468277800996
sim_render-ego0_median0.00412391577542196
sim_render-ego0_min0.003953355330008047
simulation-passed1
step_physics_max0.3077006183319808
step_physics_mean0.2463397364151904
step_physics_median0.24533759748320744
step_physics_min0.18698313236236572
survival_time_max23.800000000000203
survival_time_mean14.237500000000068
survival_time_min9.099999999999994
No reset possible
5376711771Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:22:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.7721757730729815
survival_time_median36.72499999999939
deviation-center-line_median2.0742024487829194
in-drivable-lane_median7.000000000000016


other stats
agent_compute-ego0_max0.012275446463782622
agent_compute-ego0_mean0.011947729672054153
agent_compute-ego0_median0.012024361357629184
agent_compute-ego0_min0.011466749509175618
complete-iteration_max0.2705229066081883
complete-iteration_mean0.2322310600640244
complete-iteration_median0.24125103013501575
complete-iteration_min0.1758992733778777
deviation-center-line_max4.1440006348752085
deviation-center-line_mean2.1314174338562872
deviation-center-line_min0.23326420298410008
deviation-heading_max20.248951221564095
deviation-heading_mean10.7781704644883
deviation-heading_median10.70349824900473
deviation-heading_min1.4567341383796486
driven_any_max16.869362317194454
driven_any_mean9.421180907979604
driven_any_median9.852009232151634
driven_any_min1.1113428504206917
driven_lanedir_consec_max12.98723886498197
driven_lanedir_consec_mean6.830027018645422
driven_lanedir_consec_min0.788517663453757
driven_lanedir_max12.98723886498197
driven_lanedir_mean6.830027018645422
driven_lanedir_median6.7721757730729815
driven_lanedir_min0.788517663453757
get_duckie_state_max1.4083901631463435e-06
get_duckie_state_mean1.3435084149144495e-06
get_duckie_state_median1.3558691883960631e-06
get_duckie_state_min1.2539051197193288e-06
get_robot_state_max0.0037962362033739177
get_robot_state_mean0.0036745798519735658
get_robot_state_median0.003693494894824282
get_robot_state_min0.003515093414871781
get_state_dump_max0.004858239107981609
get_state_dump_mean0.004697079892148607
get_state_dump_median0.004710567391798652
get_state_dump_min0.004508945677015517
get_ui_image_max0.03547185720856657
get_ui_image_mean0.030684053942017973
get_ui_image_median0.031114523059422527
get_ui_image_min0.025035312440660262
in-drivable-lane_max8.6999999999998
in-drivable-lane_mean5.824999999999957
in-drivable-lane_min0.5999999999999979
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 16.869362317194454, "get_ui_image": 0.029680067653163684, "step_physics": 0.16302571070382835, "survival_time": 59.99999999999873, "driven_lanedir": 12.98723886498197, "get_state_dump": 0.004858239107981609, "get_robot_state": 0.003751194943595588, "sim_render-ego0": 0.003817437987442715, "get_duckie_state": 1.3636113404235078e-06, "in-drivable-lane": 6.7499999999999725, "deviation-heading": 20.248951221564095, "agent_compute-ego0": 0.011969604261908106, "complete-iteration": 0.23148633181105843, "set_robot_commands": 0.00228579991266789, "deviation-center-line": 3.691426595589936, "driven_lanedir_consec": 12.98723886498197, "sim_compute_sim_state": 0.009951687772307764, "sim_compute_performance-ego0": 0.0020528588068673853}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.1113428504206917, "get_ui_image": 0.03547185720856657, "step_physics": 0.19678712382759017, "survival_time": 4.799999999999991, "driven_lanedir": 0.788517663453757, "get_state_dump": 0.004686478486995107, "get_robot_state": 0.003635794846052976, "sim_render-ego0": 0.003888852817496074, "get_duckie_state": 1.4083901631463435e-06, "in-drivable-lane": 0.5999999999999979, "deviation-heading": 1.4567341383796486, "agent_compute-ego0": 0.012079118453350263, "complete-iteration": 0.2705229066081883, "set_robot_commands": 0.0022879826653863966, "deviation-center-line": 0.23326420298410008, "driven_lanedir_consec": 0.788517663453757, "sim_compute_sim_state": 0.009573331813222357, "sim_compute_performance-ego0": 0.002021211938759715}, "LF-norm-techtrack-000-ego0": {"driven_any": 16.447300802384124, "get_ui_image": 0.03254897846568137, "step_physics": 0.17612009004788237, "survival_time": 59.99999999999873, "driven_lanedir": 12.424986562676434, "get_state_dump": 0.004734656296602197, "get_robot_state": 0.0037962362033739177, "sim_render-ego0": 0.003911076735497315, "get_duckie_state": 1.3481270363686189e-06, "in-drivable-lane": 8.6999999999998, "deviation-heading": 18.059901353269904, "agent_compute-ego0": 0.012275446463782622, "complete-iteration": 0.2510157284589731, "set_robot_commands": 0.0023080433139594566, "deviation-center-line": 4.1440006348752085, "driven_lanedir_consec": 12.424986562676434, "sim_compute_sim_state": 0.01305930342503531, "sim_compute_performance-ego0": 0.002171800297364704}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.256717661919146, "get_ui_image": 0.025035312440660262, "step_physics": 0.11771900653839112, "survival_time": 13.450000000000056, "driven_lanedir": 1.1193649834695285, "get_state_dump": 0.004508945677015517, "get_robot_state": 0.003515093414871781, "sim_render-ego0": 0.0036221919236359775, "get_duckie_state": 1.2539051197193288e-06, "in-drivable-lane": 7.250000000000059, "deviation-heading": 3.347095144739556, "agent_compute-ego0": 0.011466749509175618, "complete-iteration": 0.1758992733778777, "set_robot_commands": 0.00215452512105306, "deviation-center-line": 0.4569783019759025, "driven_lanedir_consec": 1.1193649834695285, "sim_compute_sim_state": 0.005867892724496347, "sim_compute_performance-ego0": 0.0019238101111518013}}
set_robot_commands_max0.0023080433139594566
set_robot_commands_mean0.0022590877532667007
set_robot_commands_median0.0022868912890271435
set_robot_commands_min0.00215452512105306
sim_compute_performance-ego0_max0.002171800297364704
sim_compute_performance-ego0_mean0.0020424202885359014
sim_compute_performance-ego0_median0.0020370353728135504
sim_compute_performance-ego0_min0.0019238101111518013
sim_compute_sim_state_max0.01305930342503531
sim_compute_sim_state_mean0.009613053933765443
sim_compute_sim_state_median0.00976250979276506
sim_compute_sim_state_min0.005867892724496347
sim_render-ego0_max0.003911076735497315
sim_render-ego0_mean0.00380988986601802
sim_render-ego0_median0.0038531454024693943
sim_render-ego0_min0.0036221919236359775
simulation-passed1
step_physics_max0.19678712382759017
step_physics_mean0.16341298277942298
step_physics_median0.16957290037585537
step_physics_min0.11771900653839112
survival_time_max59.99999999999873
survival_time_mean34.562499999999375
survival_time_min4.799999999999991
No reset possible
5374512020Ayman Shams 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:11:49
Uncaught exception w [...]
Uncaught exception while running Docker Compose:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 421, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 416, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 719, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 400, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 665, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 423, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 330, in _raise_timeout
    raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1176, in run_one
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 19, in wrapped
    return f(self, resource_id, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/container.py", line 758, in inspect_container
    self._get(self._url("/containers/{0}/json", container)), True
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 230, in _get
    return self.get(url, **self._set_request_timeout(kwargs))
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 543, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=60)
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5374312322Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:00:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5373812322Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:00:52
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5373212322Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5371212578Bea Baselines 🐤template-rosaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:04:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4097383865066355
survival_time_median6.399999999999985
deviation-center-line_median0.14344619658950863
in-drivable-lane_median4.474999999999985


other stats
agent_compute-ego0_max0.014044441428838992
agent_compute-ego0_mean0.012001558230580266
agent_compute-ego0_median0.01167093346778127
agent_compute-ego0_min0.010619924557919536
complete-iteration_max0.19485614346522911
complete-iteration_mean0.16489274380150293
complete-iteration_median0.1664303887933164
complete-iteration_min0.13185405415414975
deviation-center-line_max0.25961775491758254
deviation-center-line_mean0.16840958181799695
deviation-center-line_min0.127128179175388
deviation-heading_max2.056113373770041
deviation-heading_mean1.0734723579065713
deviation-heading_median0.9378474877120456
deviation-heading_min0.3620810824321524
driven_any_max2.7398456175529784
driven_any_mean1.7231512583503297
driven_any_median1.6002788763455815
driven_any_min0.952201663157176
driven_lanedir_consec_max0.6172317405014941
driven_lanedir_consec_mean0.4119276748801261
driven_lanedir_consec_min0.2110021860057394
driven_lanedir_max0.6172317405014941
driven_lanedir_mean0.4119276748801261
driven_lanedir_median0.4097383865066355
driven_lanedir_min0.2110021860057394
get_duckie_state_max1.132093517985565e-06
get_duckie_state_mean1.0625709082641823e-06
get_duckie_state_median1.0532911560771277e-06
get_duckie_state_min1.01160780291691e-06
get_robot_state_max0.005154614355049881
get_robot_state_mean0.003704293434298587
get_robot_state_median0.0032664753991891813
get_robot_state_min0.0031296085837661035
get_state_dump_max0.010179793133455165
get_state_dump_mean0.005701968263591347
get_state_dump_median0.004356130799563207
get_state_dump_min0.003915818321783811
get_ui_image_max0.0313828236916486
get_ui_image_mean0.027174241937294917
get_ui_image_median0.02743162822663302
get_ui_image_min0.022450887604265023
in-drivable-lane_max7.050000000000015
in-drivable-lane_mean4.7999999999999945
in-drivable-lane_min3.199999999999992
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 0.952201663157176, "get_ui_image": 0.0245590585001399, "step_physics": 0.09849940257126026, "survival_time": 4.399999999999992, "driven_lanedir": 0.2110021860057394, "get_state_dump": 0.004481176312050123, "get_robot_state": 0.003269002678688992, "sim_render-ego0": 0.0033367885632461375, "get_duckie_state": 1.0313612691472086e-06, "in-drivable-lane": 3.199999999999992, "deviation-heading": 0.4101370589291851, "agent_compute-ego0": 0.012064917703692833, "complete-iteration": 0.15669336747587398, "set_robot_commands": 0.0017860792995838637, "deviation-center-line": 0.13050257838121282, "driven_lanedir_consec": 0.2110021860057394, "sim_compute_sim_state": 0.006994820712657457, "sim_compute_performance-ego0": 0.0016322323445523725}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.256641299369375, "get_ui_image": 0.030304197953126145, "step_physics": 0.1108216013863822, "survival_time": 5.299999999999989, "driven_lanedir": 0.3032661857163681, "get_state_dump": 0.004231085287076291, "get_robot_state": 0.003263948119689371, "sim_render-ego0": 0.0034595850472138308, "get_duckie_state": 1.01160780291691e-06, "in-drivable-lane": 3.3999999999999915, "deviation-heading": 1.465557916494906, "agent_compute-ego0": 0.011276949231869709, "complete-iteration": 0.17616741011075884, "set_robot_commands": 0.0020065129360305927, "deviation-center-line": 0.15638981479780442, "driven_lanedir_consec": 0.3032661857163681, "sim_compute_sim_state": 0.008728845097194208, "sim_compute_performance-ego0": 0.0020037811493205135}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.7398456175529784, "get_ui_image": 0.0313828236916486, "step_physics": 0.11278104548360789, "survival_time": 10.15000000000001, "driven_lanedir": 0.6172317405014941, "get_state_dump": 0.010179793133455165, "get_robot_state": 0.005154614355049881, "sim_render-ego0": 0.004144215116313859, "get_duckie_state": 1.0752210430070466e-06, "in-drivable-lane": 7.050000000000015, "deviation-heading": 2.056113373770041, "agent_compute-ego0": 0.014044441428838992, "complete-iteration": 0.19485614346522911, "set_robot_commands": 0.002778164311951282, "deviation-center-line": 0.25961775491758254, "driven_lanedir_consec": 0.6172317405014941, "sim_compute_sim_state": 0.0114862089063607, "sim_compute_performance-ego0": 0.0028314076217950557}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.9439164533217888, "get_ui_image": 0.022450887604265023, "step_physics": 0.08081183686161673, "survival_time": 7.499999999999981, "driven_lanedir": 0.516210587296903, "get_state_dump": 0.003915818321783811, "get_robot_state": 0.0031296085837661035, "sim_render-ego0": 0.003163797176436873, "get_duckie_state": 1.132093517985565e-06, "in-drivable-lane": 5.54999999999998, "deviation-heading": 0.3620810824321524, "agent_compute-ego0": 0.010619924557919536, "complete-iteration": 0.13185405415414975, "set_robot_commands": 0.0017564628297919468, "deviation-center-line": 0.127128179175388, "driven_lanedir_consec": 0.516210587296903, "sim_compute_sim_state": 0.004329438241112311, "sim_compute_performance-ego0": 0.001607523848678892}}
set_robot_commands_max0.002778164311951282
set_robot_commands_mean0.0020818048443394213
set_robot_commands_median0.001896296117807228
set_robot_commands_min0.0017564628297919468
sim_compute_performance-ego0_max0.0028314076217950557
sim_compute_performance-ego0_mean0.0020187362410867085
sim_compute_performance-ego0_median0.0018180067469364429
sim_compute_performance-ego0_min0.001607523848678892
sim_compute_sim_state_max0.0114862089063607
sim_compute_sim_state_mean0.00788482823933117
sim_compute_sim_state_median0.007861832904925833
sim_compute_sim_state_min0.004329438241112311
sim_render-ego0_max0.004144215116313859
sim_render-ego0_mean0.0035260964758026753
sim_render-ego0_median0.0033981868052299843
sim_render-ego0_min0.003163797176436873
simulation-passed1
step_physics_max0.11278104548360789
step_physics_mean0.10072847157571677
step_physics_median0.10466050197882124
step_physics_min0.08081183686161673
survival_time_max10.15000000000001
survival_time_mean6.837499999999993
survival_time_min4.399999999999992
No reset possible
5369812716Bea Baselines 🐤template-randomaido5-LFP-sim-validationLFP-simsuccessnonogpu-prod-080:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.324999999999992
in-drivable-lane_median2.774999999999994
driven_lanedir_consec_median0.4321482075534334
deviation-center-line_median0.15954927868599478


other stats
agent_compute-ego0_max0.012180018013921278
agent_compute-ego0_mean0.0113138526575957
agent_compute-ego0_median0.01129253421510969
agent_compute-ego0_min0.010490324186242144
complete-iteration_max0.25474693118662073
complete-iteration_mean0.21520319175156805
complete-iteration_median0.2161487973773812
complete-iteration_min0.17376824106488908
deviation-center-line_max0.22312966499424747
deviation-center-line_mean0.16355048574709427
deviation-center-line_min0.11197372062214005
deviation-heading_max1.1731765577527429
deviation-heading_mean0.919352453519212
deviation-heading_median0.85924234065638
deviation-heading_min0.7857485750113451
driven_any_max2.100847232339913
driven_any_mean1.5514062152548211
driven_any_median1.5034346079602865
driven_any_min1.0979084127587997
driven_lanedir_consec_max0.9767221791082258
driven_lanedir_consec_mean0.5077475888170035
driven_lanedir_consec_min0.1899717610529219
driven_lanedir_max0.9767221791082258
driven_lanedir_mean0.5077475888170035
driven_lanedir_median0.4321482075534334
driven_lanedir_min0.1899717610529219
get_duckie_state_max0.024427714018986146
get_duckie_state_mean0.01765601119316304
get_duckie_state_median0.02092741700679866
get_duckie_state_min0.004341496740068708
get_robot_state_max0.003759380749293736
get_robot_state_mean0.0037178293860953542
get_robot_state_median0.003734358990908163
get_robot_state_min0.003643218813271358
get_state_dump_max0.008576119768208471
get_state_dump_mean0.007519886461044351
get_state_dump_median0.00796535256980122
get_state_dump_min0.00557272093636649
get_ui_image_max0.03647768610999698
get_ui_image_mean0.032825469542189685
get_ui_image_median0.03390758916892033
get_ui_image_min0.02700901372092111
in-drivable-lane_max4.19999999999999
in-drivable-lane_mean2.637499999999994
in-drivable-lane_min0.7999999999999972
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.100847232339913, "get_ui_image": 0.031361464796395136, "step_physics": 0.1125354581865771, "survival_time": 5.749999999999988, "driven_lanedir": 0.1899717610529219, "get_state_dump": 0.008576119768208471, "get_robot_state": 0.003643218813271358, "sim_render-ego0": 0.003703871677661764, "get_duckie_state": 0.024427714018986146, "in-drivable-lane": 4.19999999999999, "deviation-heading": 1.1731765577527429, "agent_compute-ego0": 0.012180018013921278, "complete-iteration": 0.20810069297922068, "set_robot_commands": 0.0020873567153667583, "deviation-center-line": 0.15862358643039717, "driven_lanedir_consec": 0.1899717610529219, "sim_compute_sim_state": 0.007586057843833134, "sim_compute_performance-ego0": 0.0019094286293819033}, "LFP-norm-zigzag-000-ego0": {"driven_any": 1.88168671303, "get_ui_image": 0.03647768610999698, "step_physics": 0.1252742540268671, "survival_time": 5.1999999999999895, "driven_lanedir": 0.5108322939725443, "get_state_dump": 0.007918945948282878, "get_robot_state": 0.003747681209019252, "sim_render-ego0": 0.003821064177013579, "get_duckie_state": 0.020884368533179872, "in-drivable-lane": 3.499999999999993, "deviation-heading": 0.8524889084427177, "agent_compute-ego0": 0.011955458777291436, "complete-iteration": 0.22419690177554177, "set_robot_commands": 0.002165767124720982, "deviation-center-line": 0.1604749709415924, "driven_lanedir_consec": 0.5108322939725443, "sim_compute_sim_state": 0.009864175887334917, "sim_compute_performance-ego0": 0.0019915035792759488}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.0979084127587997, "get_ui_image": 0.036453713541445526, "step_physics": 0.1544092565343, "survival_time": 3.399999999999996, "driven_lanedir": 0.9767221791082258, "get_state_dump": 0.008011759191319563, "get_robot_state": 0.0037210367727970738, "sim_render-ego0": 0.003909701886384383, "get_duckie_state": 0.02097046548041745, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 0.7857485750113451, "agent_compute-ego0": 0.010490324186242144, "complete-iteration": 0.25474693118662073, "set_robot_commands": 0.0022367532702459807, "deviation-center-line": 0.22312966499424747, "driven_lanedir_consec": 0.9767221791082258, "sim_compute_sim_state": 0.01238322603529778, "sim_compute_performance-ego0": 0.002064065656800201}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.1251825028905729, "get_ui_image": 0.02700901372092111, "step_physics": 0.10837440150124686, "survival_time": 3.4499999999999957, "driven_lanedir": 0.3534641211343226, "get_state_dump": 0.00557272093636649, "get_robot_state": 0.003759380749293736, "sim_render-ego0": 0.003869356427873884, "get_duckie_state": 0.004341496740068708, "in-drivable-lane": 2.049999999999996, "deviation-heading": 0.8659957728700425, "agent_compute-ego0": 0.010629609652927944, "complete-iteration": 0.17376824106488908, "set_robot_commands": 0.0023463283266339984, "deviation-center-line": 0.11197372062214005, "driven_lanedir_consec": 0.3534641211343226, "sim_compute_sim_state": 0.00573843206678118, "sim_compute_performance-ego0": 0.002036980220249721}}
set_robot_commands_max0.0023463283266339984
set_robot_commands_mean0.0022090513592419297
set_robot_commands_median0.0022012601974834814
set_robot_commands_min0.0020873567153667583
sim_compute_performance-ego0_max0.002064065656800201
sim_compute_performance-ego0_mean0.0020004945214269435
sim_compute_performance-ego0_median0.002014241899762835
sim_compute_performance-ego0_min0.0019094286293819033
sim_compute_sim_state_max0.01238322603529778
sim_compute_sim_state_mean0.008892972958311752
sim_compute_sim_state_median0.008725116865584024
sim_compute_sim_state_min0.00573843206678118
sim_render-ego0_max0.003909701886384383
sim_render-ego0_mean0.003825998542233402
sim_render-ego0_median0.003845210302443731
sim_render-ego0_min0.003703871677661764
simulation-passed1
step_physics_max0.1544092565343
step_physics_mean0.12514834256224777
step_physics_median0.1189048561067221
step_physics_min0.10837440150124686
survival_time_max5.749999999999988
survival_time_mean4.449999999999992
survival_time_min3.399999999999996
No reset possible
5364112583Bea Baselines 🐤template-rosaido5-LFV_multi-sim-validationLFVmultibodyv-simsuccessyesnogpu-prod-080:23:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8369148774919418
survival_time_median13.300000000000054
deviation-center-line_median0.2048401911335881
in-drivable-lane_median9.425000000000066


other stats
agent_compute-ego0_max0.012677533796217558
agent_compute-ego0_mean0.012134033358179622
agent_compute-ego0_median0.012241720754566
agent_compute-ego0_min0.01141919964238217
agent_compute-ego1_max0.01372360558099068
agent_compute-ego1_mean0.012484552589679771
agent_compute-ego1_median0.012319600701730786
agent_compute-ego1_min0.011543928949456463
complete-iteration_max1.064120906122615
complete-iteration_mean0.7948122942289999
complete-iteration_median0.8550636872001316
complete-iteration_min0.30210451036691666
deviation-center-line_max0.4470567309724928
deviation-center-line_mean0.2326240099413038
deviation-center-line_min0.08424806728230494
deviation-heading_max2.656336735058711
deviation-heading_mean1.1222289138881685
deviation-heading_median1.092818795567271
deviation-heading_min0.6840718667585405
driven_any_max4.298276896998029
driven_any_mean2.100270685418943
driven_any_median1.962017459343596
driven_any_min0.7623799576283259
driven_lanedir_consec_max1.284175333587667
driven_lanedir_consec_mean0.7998513449248306
driven_lanedir_consec_min0.24495012726670184
driven_lanedir_max1.284175333587667
driven_lanedir_mean0.7998513449248306
driven_lanedir_median0.8369148774919418
driven_lanedir_min0.24495012726670184
get_duckie_state_max1.5867783335710733e-06
get_duckie_state_mean1.4375107373873908e-06
get_duckie_state_median1.45363568462257e-06
get_duckie_state_min1.3188311928196956e-06
get_robot_state_max0.014564985639593577
get_robot_state_mean0.013049667171755472
get_robot_state_median0.013940427614294964
get_robot_state_min0.0069264695048332214
get_state_dump_max0.009763401545835344
get_state_dump_mean0.008899902731199111
get_state_dump_median0.009301842654429153
get_state_dump_min0.005971045792102813
get_ui_image_max0.04898125032916117
get_ui_image_mean0.04254722538841373
get_ui_image_median0.046153618601824015
get_ui_image_min0.02958541363477707
in-drivable-lane_max12.05000000000008
in-drivable-lane_mean8.582142857142895
in-drivable-lane_min4.400000000000009
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 1.1444821384980934, "get_ui_image": 0.038987713111074344, "step_physics": 0.5527324124386436, "survival_time": 9.45, "driven_lanedir": 1.0552688246209556, "get_state_dump": 0.009098892462880988, "get_robot_state": 0.013705187094838997, "sim_render-ego0": 0.0035581187198036597, "sim_render-ego1": 0.003509387217069927, "sim_render-ego2": 0.0034876459523251182, "sim_render-ego3": 0.003506872528477719, "get_duckie_state": 1.3188311928196956e-06, "in-drivable-lane": 5.050000000000007, "deviation-heading": 1.225662019088012, "agent_compute-ego0": 0.01141919964238217, "agent_compute-ego1": 0.011543928949456463, "agent_compute-ego2": 0.011663607547157688, "agent_compute-ego3": 0.01163410136574193, "complete-iteration": 0.7116061812952945, "set_robot_commands": 0.002090880745335629, "deviation-center-line": 0.4470567309724928, "driven_lanedir_consec": 1.0552688246209556, "sim_compute_sim_state": 0.02080960148259213, "sim_compute_performance-ego0": 0.0019472849996466383, "sim_compute_performance-ego1": 0.0018347589593184625, "sim_compute_performance-ego2": 0.0018214903379741468, "sim_compute_performance-ego3": 0.0018226523148386104}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 2.59576258488388, "get_ui_image": 0.038987713111074344, "step_physics": 0.5527324124386436, "survival_time": 9.45, "driven_lanedir": 0.35946613770605906, "get_state_dump": 0.009098892462880988, "get_robot_state": 0.013705187094838997, "sim_render-ego0": 0.0035581187198036597, "sim_render-ego1": 0.003509387217069927, "sim_render-ego2": 0.0034876459523251182, "sim_render-ego3": 0.003506872528477719, "get_duckie_state": 1.3188311928196956e-06, "in-drivable-lane": 7.300000000000002, "deviation-heading": 1.3977668398961285, "agent_compute-ego0": 0.01141919964238217, "agent_compute-ego1": 0.011543928949456463, "agent_compute-ego2": 0.011663607547157688, "agent_compute-ego3": 0.01163410136574193, "complete-iteration": 0.7116061812952945, "set_robot_commands": 0.002090880745335629, "deviation-center-line": 0.20305885603029755, "driven_lanedir_consec": 0.35946613770605906, "sim_compute_sim_state": 0.02080960148259213, "sim_compute_performance-ego0": 0.0019472849996466383, "sim_compute_performance-ego1": 0.0018347589593184625, "sim_compute_performance-ego2": 0.0018214903379741468, "sim_compute_performance-ego3": 0.0018226523148386104}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.615485162292976, "get_ui_image": 0.038987713111074344, "step_physics": 0.5527324124386436, "survival_time": 9.45, "driven_lanedir": 1.2816334483174558, "get_state_dump": 0.009098892462880988, "get_robot_state": 0.013705187094838997, "sim_render-ego0": 0.0035581187198036597, "sim_render-ego1": 0.003509387217069927, "sim_render-ego2": 0.0034876459523251182, "sim_render-ego3": 0.003506872528477719, "get_duckie_state": 1.3188311928196956e-06, "in-drivable-lane": 4.400000000000009, "deviation-heading": 1.1366843140884673, "agent_compute-ego0": 0.01141919964238217, "agent_compute-ego1": 0.011543928949456463, "agent_compute-ego2": 0.011663607547157688, "agent_compute-ego3": 0.01163410136574193, "complete-iteration": 0.7116061812952945, "set_robot_commands": 0.002090880745335629, "deviation-center-line": 0.2674797034968778, "driven_lanedir_consec": 1.2816334483174558, "sim_compute_sim_state": 0.02080960148259213, "sim_compute_performance-ego0": 0.0019472849996466383, "sim_compute_performance-ego1": 0.0018347589593184625, "sim_compute_performance-ego2": 0.0018214903379741468, "sim_compute_performance-ego3": 0.0018226523148386104}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.1884755815589605, "get_ui_image": 0.038987713111074344, "step_physics": 0.5527324124386436, "survival_time": 9.45, "driven_lanedir": 0.8273553454342821, "get_state_dump": 0.009098892462880988, "get_robot_state": 0.013705187094838997, "sim_render-ego0": 0.0035581187198036597, "sim_render-ego1": 0.003509387217069927, "sim_render-ego2": 0.0034876459523251182, "sim_render-ego3": 0.003506872528477719, "get_duckie_state": 1.3188311928196956e-06, "in-drivable-lane": 6.0000000000000036, "deviation-heading": 1.1288951373968863, "agent_compute-ego0": 0.01141919964238217, "agent_compute-ego1": 0.011543928949456463, "agent_compute-ego2": 0.011663607547157688, "agent_compute-ego3": 0.01163410136574193, "complete-iteration": 0.7116061812952945, "set_robot_commands": 0.002090880745335629, "deviation-center-line": 0.2658642918678029, "driven_lanedir_consec": 0.8273553454342821, "sim_compute_sim_state": 0.02080960148259213, "sim_compute_performance-ego0": 0.0019472849996466383, "sim_compute_performance-ego1": 0.0018347589593184625, "sim_compute_performance-ego2": 0.0018214903379741468, "sim_compute_performance-ego3": 0.0018226523148386104}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 2.8692806037128795, "get_ui_image": 0.04898125032916117, "step_physics": 0.6700825962334572, "survival_time": 14.900000000000077, "driven_lanedir": 0.7749470515626824, "get_state_dump": 0.009301842654429153, "get_robot_state": 0.013940427614294964, "sim_render-ego0": 0.003732245103970021, "sim_render-ego1": 0.0035867627249114888, "sim_render-ego2": 0.003492263647226187, "sim_render-ego3": 0.003657533173577044, "get_duckie_state": 1.45363568462257e-06, "in-drivable-lane": 11.60000000000008, "deviation-heading": 0.9606980798520228, "agent_compute-ego0": 0.012241720754566, "agent_compute-ego1": 0.012319600701730786, "agent_compute-ego2": 0.01187852473561979, "agent_compute-ego3": 0.012555763474276234, "complete-iteration": 0.8550636872001316, "set_robot_commands": 0.002131686162789131, "deviation-center-line": 0.23503341529710797, "driven_lanedir_consec": 0.7749470515626824, "sim_compute_sim_state": 0.032876164618144466, "sim_compute_performance-ego0": 0.0020277747342419064, "sim_compute_performance-ego1": 0.0018757593671613712, "sim_compute_performance-ego2": 0.001865934767451972, "sim_compute_performance-ego3": 0.0018762553415968264}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 4.298276896998029, "get_ui_image": 0.04898125032916117, "step_physics": 0.6700825962334572, "survival_time": 14.900000000000077, "driven_lanedir": 1.067450723119306, "get_state_dump": 0.009301842654429153, "get_robot_state": 0.013940427614294964, "sim_render-ego0": 0.003732245103970021, "sim_render-ego1": 0.0035867627249114888, "sim_render-ego2": 0.003492263647226187, "sim_render-ego3": 0.003657533173577044, "get_duckie_state": 1.45363568462257e-06, "in-drivable-lane": 10.050000000000072, "deviation-heading": 2.656336735058711, "agent_compute-ego0": 0.012241720754566, "agent_compute-ego1": 0.012319600701730786, "agent_compute-ego2": 0.01187852473561979, "agent_compute-ego3": 0.012555763474276234, "complete-iteration": 0.8550636872001316, "set_robot_commands": 0.002131686162789131, "deviation-center-line": 0.4189916839626824, "driven_lanedir_consec": 1.067450723119306, "sim_compute_sim_state": 0.032876164618144466, "sim_compute_performance-ego0": 0.0020277747342419064, "sim_compute_performance-ego1": 0.0018757593671613712, "sim_compute_performance-ego2": 0.001865934767451972, "sim_compute_performance-ego3": 0.0018762553415968264}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 1.9201466171790689, "get_ui_image": 0.04898125032916117, "step_physics": 0.6700825962334572, "survival_time": 14.900000000000077, "driven_lanedir": 0.859257141855911, "get_state_dump": 0.009301842654429153, "get_robot_state": 0.013940427614294964, "sim_render-ego0": 0.003732245103970021, "sim_render-ego1": 0.0035867627249114888, "sim_render-ego2": 0.003492263647226187, "sim_render-ego3": 0.003657533173577044, "get_duckie_state": 1.45363568462257e-06, "in-drivable-lane": 11.65000000000008, "deviation-heading": 0.6840718667585405, "agent_compute-ego0": 0.012241720754566, "agent_compute-ego1": 0.012319600701730786, "agent_compute-ego2": 0.01187852473561979, "agent_compute-ego3": 0.012555763474276234, "complete-iteration": 0.8550636872001316, "set_robot_commands": 0.002131686162789131, "deviation-center-line": 0.16881305364978355, "driven_lanedir_consec": 0.859257141855911, "sim_compute_sim_state": 0.032876164618144466, "sim_compute_performance-ego0": 0.0020277747342419064, "sim_compute_performance-ego1": 0.0018757593671613712, "sim_compute_performance-ego2": 0.001865934767451972, "sim_compute_performance-ego3": 0.0018762553415968264}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.64657316742837, "get_ui_image": 0.04898125032916117, "step_physics": 0.6700825962334572, "survival_time": 14.900000000000077, "driven_lanedir": 0.6557541160148739, "get_state_dump": 0.009301842654429153, "get_robot_state": 0.013940427614294964, "sim_render-ego0": 0.003732245103970021, "sim_render-ego1": 0.0035867627249114888, "sim_render-ego2": 0.003492263647226187, "sim_render-ego3": 0.003657533173577044, "get_duckie_state": 1.45363568462257e-06, "in-drivable-lane": 12.05000000000008, "deviation-heading": 0.7290485491734946, "agent_compute-ego0": 0.012241720754566, "agent_compute-ego1": 0.012319600701730786, "agent_compute-ego2": 0.01187852473561979, "agent_compute-ego3": 0.012555763474276234, "complete-iteration": 0.8550636872001316, "set_robot_commands": 0.002131686162789131, "deviation-center-line": 0.09913272537287664, "driven_lanedir_consec": 0.6557541160148739, "sim_compute_sim_state": 0.032876164618144466, "sim_compute_performance-ego0": 0.0020277747342419064, "sim_compute_performance-ego1": 0.0018757593671613712, "sim_compute_performance-ego2": 0.001865934767451972, "sim_compute_performance-ego3": 0.0018762553415968264}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.7623799576283259, "get_ui_image": 0.046153618601824015, "step_physics": 0.8873312080397588, "survival_time": 13.300000000000054, "driven_lanedir": 0.24495012726670184, "get_state_dump": 0.009763401545835344, "get_robot_state": 0.014564985639593577, "sim_render-ego0": 0.003802754012832927, "sim_render-ego1": 0.00382236952192328, "sim_render-ego2": 0.003793055645089024, "sim_render-ego3": 0.003759928856896104, "get_duckie_state": 1.5867783335710733e-06, "in-drivable-lane": 11.950000000000053, "deviation-heading": 0.7410606106994201, "agent_compute-ego0": 0.012677533796217558, "agent_compute-ego1": 0.01372360558099068, "agent_compute-ego2": 0.013559127121828916, "agent_compute-ego3": 0.012700334470370288, "complete-iteration": 1.064120906122615, "set_robot_commands": 0.0021622377388486255, "deviation-center-line": 0.08424806728230494, "driven_lanedir_consec": 0.24495012726670184, "sim_compute_sim_state": 0.021111649966864997, "sim_compute_performance-ego0": 0.0021382708674513, "sim_compute_performance-ego1": 0.0019434194886282588, "sim_compute_performance-ego2": 0.0019672434874688197, "sim_compute_performance-ego3": 0.00198262282525109}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.562649497566128, "get_ui_image": 0.046153618601824015, "step_physics": 0.8873312080397588, "survival_time": 13.300000000000054, "driven_lanedir": 1.284175333587667, "get_state_dump": 0.009763401545835344, "get_robot_state": 0.014564985639593577, "sim_render-ego0": 0.003802754012832927, "sim_render-ego1": 0.00382236952192328, "sim_render-ego2": 0.003793055645089024, "sim_render-ego3": 0.003759928856896104, "get_duckie_state": 1.5867783335710733e-06, "in-drivable-lane": 8.800000000000061, "deviation-heading": 1.1202782105500786, "agent_compute-ego0": 0.012677533796217558, "agent_compute-ego1": 0.01372360558099068, "agent_compute-ego2": 0.013559127121828916, "agent_compute-ego3": 0.012700334470370288, "complete-iteration": 1.064120906122615, "set_robot_commands": 0.0021622377388486255, "deviation-center-line": 0.3270186500188133, "driven_lanedir_consec": 1.284175333587667, "sim_compute_sim_state": 0.021111649966864997, "sim_compute_performance-ego0": 0.0021382708674513, "sim_compute_performance-ego1": 0.0019434194886282588, "sim_compute_performance-ego2": 0.0019672434874688197, "sim_compute_performance-ego3": 0.00198262282525109}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 0.802168275048214, "get_ui_image": 0.046153618601824015, "step_physics": 0.8873312080397588, "survival_time": 13.300000000000054, "driven_lanedir": 0.6978339346860436, "get_state_dump": 0.009763401545835344, "get_robot_state": 0.014564985639593577, "sim_render-ego0": 0.003802754012832927, "sim_render-ego1": 0.00382236952192328, "sim_render-ego2": 0.003793055645089024, "sim_render-ego3": 0.003759928856896104, "get_duckie_state": 1.5867783335710733e-06, "in-drivable-lane": 10.600000000000056, "deviation-heading": 0.7004773763186914, "agent_compute-ego0": 0.012677533796217558, "agent_compute-ego1": 0.01372360558099068, "agent_compute-ego2": 0.013559127121828916, "agent_compute-ego3": 0.012700334470370288, "complete-iteration": 1.064120906122615, "set_robot_commands": 0.0021622377388486255, "deviation-center-line": 0.1767500596015691, "driven_lanedir_consec": 0.6978339346860436, "sim_compute_sim_state": 0.021111649966864997, "sim_compute_performance-ego0": 0.0021382708674513, "sim_compute_performance-ego1": 0.0019434194886282588, "sim_compute_performance-ego2": 0.0019672434874688197, "sim_compute_performance-ego3": 0.00198262282525109}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 3.5780684405045866, "get_ui_image": 0.046153618601824015, "step_physics": 0.8873312080397588, "survival_time": 13.300000000000054, "driven_lanedir": 0.8464744095496015, "get_state_dump": 0.009763401545835344, "get_robot_state": 0.014564985639593577, "sim_render-ego0": 0.003802754012832927, "sim_render-ego1": 0.00382236952192328, "sim_render-ego2": 0.003793055645089024, "sim_render-ego3": 0.003759928856896104, "get_duckie_state": 1.5867783335710733e-06, "in-drivable-lane": 10.250000000000057, "deviation-heading": 0.7181319019191525, "agent_compute-ego0": 0.012677533796217558, "agent_compute-ego1": 0.01372360558099068, "agent_compute-ego2": 0.013559127121828916, "agent_compute-ego3": 0.012700334470370288, "complete-iteration": 1.064120906122615, "set_robot_commands": 0.0021622377388486255, "deviation-center-line": 0.1895411034952118, "driven_lanedir_consec": 0.8464744095496015, "sim_compute_sim_state": 0.021111649966864997, "sim_compute_performance-ego0": 0.0021382708674513, "sim_compute_performance-ego1": 0.0019434194886282588, "sim_compute_performance-ego2": 0.0019672434874688197, "sim_compute_performance-ego3": 0.00198262282525109}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.4161523710575676, "get_ui_image": 0.02958541363477707, "step_physics": 0.21262244135141373, "survival_time": 7.94999999999998, "driven_lanedir": 0.9133909580336328, "get_state_dump": 0.005971045792102813, "get_robot_state": 0.0069264695048332214, "sim_render-ego0": 0.003598910570144653, "sim_render-ego1": 0.003598615527153015, "get_duckie_state": 1.3440847396850586e-06, "in-drivable-lane": 4.499999999999984, "deviation-heading": 1.0653593805844634, "agent_compute-ego0": 0.012261325120925905, "agent_compute-ego1": 0.012217597663402555, "complete-iteration": 0.30210451036691666, "set_robot_commands": 0.0020465061068534853, "deviation-center-line": 0.2066215262368786, "driven_lanedir_consec": 0.9133909580336328, "sim_compute_sim_state": 0.007325181365013122, "sim_compute_performance-ego0": 0.0018923714756965636, "sim_compute_performance-ego1": 0.0018469080328941344}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 2.0038883015081232, "get_ui_image": 0.02958541363477707, "step_physics": 0.21262244135141373, "survival_time": 7.94999999999998, "driven_lanedir": 0.3299612771924556, "get_state_dump": 0.005971045792102813, "get_robot_state": 0.0069264695048332214, "sim_render-ego0": 0.003598910570144653, "sim_render-ego1": 0.003598615527153015, "get_duckie_state": 1.3440847396850586e-06, "in-drivable-lane": 5.949999999999983, "deviation-heading": 1.446733773050285, "agent_compute-ego0": 0.012261325120925905, "agent_compute-ego1": 0.012217597663402555, "complete-iteration": 0.30210451036691666, "set_robot_commands": 0.0020465061068534853, "deviation-center-line": 0.16712627189355356, "driven_lanedir_consec": 0.3299612771924556, "sim_compute_sim_state": 0.007325181365013122, "sim_compute_performance-ego0": 0.0018923714756965636, "sim_compute_performance-ego1": 0.0018469080328941344}}
set_robot_commands_max0.0021622377388486255
set_robot_commands_mean0.0021165879144000367
set_robot_commands_median0.002131686162789131
set_robot_commands_min0.0020465061068534853
sim_compute_performance-ego0_max0.0021382708674513
sim_compute_performance-ego0_mean0.002017004668339464
sim_compute_performance-ego0_median0.0020277747342419064
sim_compute_performance-ego0_min0.0018923714756965636
sim_compute_performance-ego1_max0.0019434194886282588
sim_compute_performance-ego1_mean0.00187925480901576
sim_compute_performance-ego1_median0.0018757593671613712
sim_compute_performance-ego1_min0.0018347589593184625
sim_compute_sim_state_max0.032876164618144466
sim_compute_sim_state_mean0.022417144785745195
sim_compute_sim_state_median0.021111649966864997
sim_compute_sim_state_min0.007325181365013122
sim_render-ego0_max0.003802754012832927
sim_render-ego0_mean0.003683592320479695
sim_render-ego0_median0.003732245103970021
sim_render-ego0_min0.0035581187198036597
sim_render-ego1_max0.00382236952192328
sim_render-ego1_mean0.0036336649221374866
sim_render-ego1_median0.0035867627249114888
sim_render-ego1_min0.003509387217069927
simulation-passed1
step_physics_max0.8873312080397588
step_physics_mean0.6332735535393048
step_physics_median0.6700825962334572
step_physics_min0.21262244135141373
survival_time_max14.900000000000077
survival_time_mean11.892857142857178
survival_time_min7.94999999999998
No reset possible
5362912688Bea Baselines 🐤template-randomaido5-LFV_multi-sim-validationLFVmultibodyv-simabortedyesnogpu-prod-080:00:36
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5359912592Bea Baselines 🐤template-rosaido5-LFVI_multi-sim-validationLFVIv-simsuccessyesnogpu-prod-080:09:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.34771476648757627
survival_time_median6.474999999999985
deviation-center-line_median0.11681981016966436
in-drivable-lane_median4.499999999999986


other stats
agent_compute-ego0_max0.014279536115444772
agent_compute-ego0_mean0.013321467699959068
agent_compute-ego0_median0.013321467699959068
agent_compute-ego0_min0.012363399284473364
agent_compute-ego1_max0.01254661296441303
agent_compute-ego1_mean0.012363598514420692
agent_compute-ego1_median0.012363598514420692
agent_compute-ego1_min0.012180584064428356
agent_compute-ego2_max0.01272542302201434
agent_compute-ego2_mean0.01231504125028754
agent_compute-ego2_median0.01231504125028754
agent_compute-ego2_min0.011904659478560738
agent_compute-ego3_max0.013601469799755066
agent_compute-ego3_mean0.012864469175584831
agent_compute-ego3_median0.012864469175584831
agent_compute-ego3_min0.0121274685514146
complete-iteration_max1.1962318090888542
complete-iteration_mean1.0461163952098629
complete-iteration_median1.0461163952098629
complete-iteration_min0.8960009813308716
deviation-center-line_max0.5602291561052376
deviation-center-line_mean0.1807220965001034
deviation-center-line_min0.07201599844442215
deviation-heading_max4.871448104385203
deviation-heading_mean1.366512235649041
deviation-heading_median0.6786103116857072
deviation-heading_min0.4101536711904785
driven_any_max1.7947019090619127
driven_any_mean1.1820105100413187
driven_any_median1.1536045728913609
driven_any_min0.39365958309081694
driven_lanedir_consec_max0.6507754468226339
driven_lanedir_consec_mean0.4044518776631787
driven_lanedir_consec_min0.16474465670829996
driven_lanedir_max0.6507754468226339
driven_lanedir_mean0.4044518776631787
driven_lanedir_median0.34771476648757627
driven_lanedir_min0.16474465670829996
get_duckie_state_max1.5894571940104167e-06
get_duckie_state_mean1.5022098154261494e-06
get_duckie_state_median1.5022098154261494e-06
get_duckie_state_min1.4149624368418818e-06
get_robot_state_max0.014834301258490338
get_robot_state_mean0.014510306358843063
get_robot_state_median0.014510306358843063
get_robot_state_min0.014186311459195787
get_state_dump_max0.01020469181779502
get_state_dump_mean0.010104654576088183
get_state_dump_median0.010104654576088183
get_state_dump_min0.010004617334381353
get_ui_image_max0.053709462406189463
get_ui_image_mean0.053544182876851205
get_ui_image_median0.053544182876851205
get_ui_image_min0.05337890334751295
in-drivable-lane_max4.999999999999986
in-drivable-lane_mean4.118749999999987
in-drivable-lane_min1.5999999999999963
per-episodes
details{"LFVI_multi-norm-4way-000-ego0": {"driven_any": 1.7947019090619127, "get_ui_image": 0.05337890334751295, "step_physics": 0.706765447837719, "survival_time": 6.849999999999984, "driven_lanedir": 0.6507754468226339, "get_state_dump": 0.01020469181779502, "get_robot_state": 0.014186311459195787, "sim_render-ego0": 0.0037462072096009183, "sim_render-ego1": 0.0037516355514526367, "sim_render-ego2": 0.00360214883002682, "sim_render-ego3": 0.0035991979681927223, "get_duckie_state": 1.4149624368418818e-06, "in-drivable-lane": 4.249999999999985, "deviation-heading": 0.4986915140743071, "agent_compute-ego0": 0.012363399284473364, "agent_compute-ego1": 0.012180584064428356, "agent_compute-ego2": 0.011904659478560738, "agent_compute-ego3": 0.0121274685514146, "complete-iteration": 0.8960009813308716, "set_robot_commands": 0.002232829729715983, "deviation-center-line": 0.12866023335927002, "driven_lanedir_consec": 0.6507754468226339, "sim_compute_sim_state": 0.03133397344229878, "sim_compute_performance-ego0": 0.0020520773486814637, "sim_compute_performance-ego1": 0.0018901755844337351, "sim_compute_performance-ego2": 0.0018840285315029864, "sim_compute_performance-ego3": 0.0019448511842368305}, "LFVI_multi-norm-4way-000-ego1": {"driven_any": 1.20914116652865, "get_ui_image": 0.05337890334751295, "step_physics": 0.706765447837719, "survival_time": 6.849999999999984, "driven_lanedir": 0.25853917004708826, "get_state_dump": 0.01020469181779502, "get_robot_state": 0.014186311459195787, "sim_render-ego0": 0.0037462072096009183, "sim_render-ego1": 0.0037516355514526367, "sim_render-ego2": 0.00360214883002682, "sim_render-ego3": 0.0035991979681927223, "get_duckie_state": 1.4149624368418818e-06, "in-drivable-lane": 4.749999999999987, "deviation-heading": 1.684960236647266, "agent_compute-ego0": 0.012363399284473364, "agent_compute-ego1": 0.012180584064428356, "agent_compute-ego2": 0.011904659478560738, "agent_compute-ego3": 0.0121274685514146, "complete-iteration": 0.8960009813308716, "set_robot_commands": 0.002232829729715983, "deviation-center-line": 0.14209026115492115, "driven_lanedir_consec": 0.25853917004708826, "sim_compute_sim_state": 0.03133397344229878, "sim_compute_performance-ego0": 0.0020520773486814637, "sim_compute_performance-ego1": 0.0018901755844337351, "sim_compute_performance-ego2": 0.0018840285315029864, "sim_compute_performance-ego3": 0.0019448511842368305}, "LFVI_multi-norm-4way-000-ego2": {"driven_any": 1.701439969923149, "get_ui_image": 0.05337890334751295, "step_physics": 0.706765447837719, "survival_time": 6.849999999999984, "driven_lanedir": 0.6271322732404546, "get_state_dump": 0.01020469181779502, "get_robot_state": 0.014186311459195787, "sim_render-ego0": 0.0037462072096009183, "sim_render-ego1": 0.0037516355514526367, "sim_render-ego2": 0.00360214883002682, "sim_render-ego3": 0.0035991979681927223, "get_duckie_state": 1.4149624368418818e-06, "in-drivable-lane": 3.949999999999986, "deviation-heading": 1.50076389675061, "agent_compute-ego0": 0.012363399284473364, "agent_compute-ego1": 0.012180584064428356, "agent_compute-ego2": 0.011904659478560738, "agent_compute-ego3": 0.0121274685514146, "complete-iteration": 0.8960009813308716, "set_robot_commands": 0.002232829729715983, "deviation-center-line": 0.26764675068567245, "driven_lanedir_consec": 0.6271322732404546, "sim_compute_sim_state": 0.03133397344229878, "sim_compute_performance-ego0": 0.0020520773486814637, "sim_compute_performance-ego1": 0.0018901755844337351, "sim_compute_performance-ego2": 0.0018840285315029864, "sim_compute_performance-ego3": 0.0019448511842368305}, "LFVI_multi-norm-4way-000-ego3": {"driven_any": 1.0980679792540715, "get_ui_image": 0.05337890334751295, "step_physics": 0.706765447837719, "survival_time": 6.849999999999984, "driven_lanedir": 0.4146748872228423, "get_state_dump": 0.01020469181779502, "get_robot_state": 0.014186311459195787, "sim_render-ego0": 0.0037462072096009183, "sim_render-ego1": 0.0037516355514526367, "sim_render-ego2": 0.00360214883002682, "sim_render-ego3": 0.0035991979681927223, "get_duckie_state": 1.4149624368418818e-06, "in-drivable-lane": 1.5999999999999963, "deviation-heading": 4.871448104385203, "agent_compute-ego0": 0.012363399284473364, "agent_compute-ego1": 0.012180584064428356, "agent_compute-ego2": 0.011904659478560738, "agent_compute-ego3": 0.0121274685514146, "complete-iteration": 0.8960009813308716, "set_robot_commands": 0.002232829729715983, "deviation-center-line": 0.5602291561052376, "driven_lanedir_consec": 0.4146748872228423, "sim_compute_sim_state": 0.03133397344229878, "sim_compute_performance-ego0": 0.0020520773486814637, "sim_compute_performance-ego1": 0.0018901755844337351, "sim_compute_performance-ego2": 0.0018840285315029864, "sim_compute_performance-ego3": 0.0019448511842368305}, "LFVI_multi-norm-udem1-000-ego0": {"driven_any": 0.8426358060924353, "get_ui_image": 0.053709462406189463, "step_physics": 1.00517648603858, "survival_time": 6.099999999999986, "driven_lanedir": 0.2102889439457201, "get_state_dump": 0.010004617334381353, "get_robot_state": 0.014834301258490338, "sim_render-ego0": 0.004003850425161966, "sim_render-ego1": 0.0038313497372759065, "sim_render-ego2": 0.004070049378930069, "sim_render-ego3": 0.00389032635262342, "get_duckie_state": 1.5894571940104167e-06, "in-drivable-lane": 4.799999999999986, "deviation-heading": 0.6324589654149725, "agent_compute-ego0": 0.014279536115444772, "agent_compute-ego1": 0.01254661296441303, "agent_compute-ego2": 0.01272542302201434, "agent_compute-ego3": 0.013601469799755066, "complete-iteration": 1.1962318090888542, "set_robot_commands": 0.0024321389392139466, "deviation-center-line": 0.07713517689558541, "driven_lanedir_consec": 0.2102889439457201, "sim_compute_sim_state": 0.0253216212357932, "sim_compute_performance-ego0": 0.002186216959139196, "sim_compute_performance-ego1": 0.0020225144983307135, "sim_compute_performance-ego2": 0.0020710646621580047, "sim_compute_performance-ego3": 0.002048465294566581}, "LFVI_multi-norm-udem1-000-ego1": {"driven_any": 1.7143265011785107, "get_ui_image": 0.053709462406189463, "step_physics": 1.00517648603858, "survival_time": 6.099999999999986, "driven_lanedir": 0.6287049975660808, "get_state_dump": 0.010004617334381353, "get_robot_state": 0.014834301258490338, "sim_render-ego0": 0.004003850425161966, "sim_render-ego1": 0.0038313497372759065, "sim_render-ego2": 0.004070049378930069, "sim_render-ego3": 0.00389032635262342, "get_duckie_state": 1.5894571940104167e-06, "in-drivable-lane": 3.8499999999999863, "deviation-heading": 0.4101536711904785, "agent_compute-ego0": 0.014279536115444772, "agent_compute-ego1": 0.01254661296441303, "agent_compute-ego2": 0.01272542302201434, "agent_compute-ego3": 0.013601469799755066, "complete-iteration": 1.1962318090888542, "set_robot_commands": 0.0024321389392139466, "deviation-center-line": 0.10497938698005872, "driven_lanedir_consec": 0.6287049975660808, "sim_compute_sim_state": 0.0253216212357932, "sim_compute_performance-ego0": 0.002186216959139196, "sim_compute_performance-ego1": 0.0020225144983307135, "sim_compute_performance-ego2": 0.0020710646621580047, "sim_compute_performance-ego3": 0.002048465294566581}, "LFVI_multi-norm-udem1-000-ego2": {"driven_any": 0.7021111652010029, "get_ui_image": 0.053709462406189463, "step_physics": 1.00517648603858, "survival_time": 6.099999999999986, "driven_lanedir": 0.16474465670829996, "get_state_dump": 0.010004617334381353, "get_robot_state": 0.014834301258490338, "sim_render-ego0": 0.004003850425161966, "sim_render-ego1": 0.0038313497372759065, "sim_render-ego2": 0.004070049378930069, "sim_render-ego3": 0.00389032635262342, "get_duckie_state": 1.5894571940104167e-06, "in-drivable-lane": 4.999999999999986, "deviation-heading": 0.7247616579564419, "agent_compute-ego0": 0.014279536115444772, "agent_compute-ego1": 0.01254661296441303, "agent_compute-ego2": 0.01272542302201434, "agent_compute-ego3": 0.013601469799755066, "complete-iteration": 1.1962318090888542, "set_robot_commands": 0.0024321389392139466, "deviation-center-line": 0.07201599844442215, "driven_lanedir_consec": 0.16474465670829996, "sim_compute_sim_state": 0.0253216212357932, "sim_compute_performance-ego0": 0.002186216959139196, "sim_compute_performance-ego1": 0.0020225144983307135, "sim_compute_performance-ego2": 0.0020710646621580047, "sim_compute_performance-ego3": 0.002048465294566581}, "LFVI_multi-norm-udem1-000-ego3": {"driven_any": 0.39365958309081694, "get_ui_image": 0.053709462406189463, "step_physics": 1.00517648603858, "survival_time": 6.099999999999986, "driven_lanedir": 0.28075464575231024, "get_state_dump": 0.010004617334381353, "get_robot_state": 0.014834301258490338, "sim_render-ego0": 0.004003850425161966, "sim_render-ego1": 0.0038313497372759065, "sim_render-ego2": 0.004070049378930069, "sim_render-ego3": 0.00389032635262342, "get_duckie_state": 1.5894571940104167e-06, "in-drivable-lane": 4.749999999999986, "deviation-heading": 0.6088598387730487, "agent_compute-ego0": 0.014279536115444772, "agent_compute-ego1": 0.01254661296441303, "agent_compute-ego2": 0.01272542302201434, "agent_compute-ego3": 0.013601469799755066, "complete-iteration": 1.1962318090888542, "set_robot_commands": 0.0024321389392139466, "deviation-center-line": 0.09301980837565985, "driven_lanedir_consec": 0.28075464575231024, "sim_compute_sim_state": 0.0253216212357932, "sim_compute_performance-ego0": 0.002186216959139196, "sim_compute_performance-ego1": 0.0020225144983307135, "sim_compute_performance-ego2": 0.0020710646621580047, "sim_compute_performance-ego3": 0.002048465294566581}}
set_robot_commands_max0.0024321389392139466
set_robot_commands_mean0.0023324843344649645
set_robot_commands_median0.0023324843344649645
set_robot_commands_min0.002232829729715983
sim_compute_performance-ego0_max0.002186216959139196
sim_compute_performance-ego0_mean0.00211914715391033
sim_compute_performance-ego0_median0.00211914715391033
sim_compute_performance-ego0_min0.0020520773486814637
sim_compute_performance-ego1_max0.0020225144983307135
sim_compute_performance-ego1_mean0.0019563450413822244
sim_compute_performance-ego1_median0.0019563450413822244
sim_compute_performance-ego1_min0.0018901755844337351
sim_compute_performance-ego2_max0.0020710646621580047
sim_compute_performance-ego2_mean0.0019775465968304953
sim_compute_performance-ego2_median0.0019775465968304953
sim_compute_performance-ego2_min0.0018840285315029864
sim_compute_performance-ego3_max0.002048465294566581
sim_compute_performance-ego3_mean0.0019966582394017056
sim_compute_performance-ego3_median0.0019966582394017056
sim_compute_performance-ego3_min0.0019448511842368305
sim_compute_sim_state_max0.03133397344229878
sim_compute_sim_state_mean0.02832779733904599
sim_compute_sim_state_median0.02832779733904599
sim_compute_sim_state_min0.0253216212357932
sim_render-ego0_max0.004003850425161966
sim_render-ego0_mean0.0038750288173814425
sim_render-ego0_median0.0038750288173814425
sim_render-ego0_min0.0037462072096009183
sim_render-ego1_max0.0038313497372759065
sim_render-ego1_mean0.003791492644364272
sim_render-ego1_median0.003791492644364272
sim_render-ego1_min0.0037516355514526367
sim_render-ego2_max0.004070049378930069
sim_render-ego2_mean0.003836099104478445
sim_render-ego2_median0.003836099104478445
sim_render-ego2_min0.00360214883002682
sim_render-ego3_max0.00389032635262342
sim_render-ego3_mean0.003744762160408071
sim_render-ego3_median0.003744762160408071
sim_render-ego3_min0.0035991979681927223
simulation-passed1
step_physics_max1.00517648603858
step_physics_mean0.8559709669381496
step_physics_median0.8559709669381496
step_physics_min0.706765447837719
survival_time_max6.849999999999984
survival_time_mean6.474999999999985
survival_time_min6.099999999999986
No reset possible
5359012594Bea Baselines 🐤template-randomaido5-LFV-sim-validationLFVv-simabortedyesnogpu-prod-080:00:32
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5358512594Bea Baselines 🐤template-randomaido5-LFV-sim-validationLFVv-simhost-erroryesnogpu-prod-080:01:33
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 803, in get_cr
    uploaded = upload_files(wd, aws_config, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 45, in upload_files
    uploaded = upload(aws_config, toupload, copy_to_machine_cache=copy_to_machine_cache)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/uploading.py", line 265, in upload
    shutil.copy(realfile0, realfile)
  File "/usr/lib/python3.8/shutil.py", line 415, in copy
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/usr/lib/python3.8/shutil.py", line 261, in copyfile
    with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/aido5-LFV-sim-validation/submission12594/LFVv-sim-nogpu-prod-08_d45f05e64dc1-job53585-a-wd/challenge-evaluation-output/episodes/LFV-norm-small_loop-000/ego0/camera.mp4.palette.tmp.png'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5357712595Bea Baselines 🐤template-randomaido5-LFI-full-sim-testingLFVIv-simsuccessyesnogpu-prod-080:02:48
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6587966891077274
survival_time_median4.82499999999999
deviation-center-line_median0.18372681341530445
in-drivable-lane_median2.6749999999999927


other stats
agent_compute-ego0_max0.01154637336730957
agent_compute-ego0_mean0.01120761428216491
agent_compute-ego0_median0.01120761428216491
agent_compute-ego0_min0.010868855197020253
complete-iteration_max0.20545810461044312
complete-iteration_mean0.20186727125235276
complete-iteration_median0.20186727125235276
complete-iteration_min0.19827643789426244
deviation-center-line_max0.22270545771576217
deviation-center-line_mean0.18372681341530445
deviation-center-line_min0.14474816911484673
deviation-heading_max0.9254423888501632
deviation-heading_mean0.9131948861321344
deviation-heading_median0.9131948861321344
deviation-heading_min0.9009473834141052
driven_any_max1.7167609354270057
driven_any_mean1.6960945672591825
driven_any_median1.6960945672591825
driven_any_min1.6754281990913595
driven_lanedir_consec_max0.8731138199226813
driven_lanedir_consec_mean0.6587966891077274
driven_lanedir_consec_min0.4444795582927734
driven_lanedir_max0.8919331054681621
driven_lanedir_mean0.6682063318804677
driven_lanedir_median0.6682063318804677
driven_lanedir_min0.4444795582927734
get_duckie_state_max1.3361374537150066e-06
get_duckie_state_mean1.2424407583294492e-06
get_duckie_state_median1.2424407583294492e-06
get_duckie_state_min1.148744062943892e-06
get_robot_state_max0.003752663731575012
get_robot_state_mean0.003684522452378514
get_robot_state_median0.003684522452378514
get_robot_state_min0.0036163811731820153
get_state_dump_max0.005136216680208842
get_state_dump_mean0.00490314257566375
get_state_dump_median0.00490314257566375
get_state_dump_min0.004670068471118657
get_ui_image_max0.03682373960812887
get_ui_image_mean0.03525382807158461
get_ui_image_median0.03525382807158461
get_ui_image_min0.03368391653504035
in-drivable-lane_max3.249999999999993
in-drivable-lane_mean2.6749999999999927
in-drivable-lane_min2.0999999999999925
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 1.6754281990913595, "get_ui_image": 0.03682373960812887, "step_physics": 0.12918313344319662, "survival_time": 4.749999999999991, "driven_lanedir": 0.8919331054681621, "get_state_dump": 0.005136216680208842, "get_robot_state": 0.003752663731575012, "sim_render-ego0": 0.003908033172289531, "get_duckie_state": 1.3361374537150066e-06, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 0.9009473834141052, "agent_compute-ego0": 0.01154637336730957, "complete-iteration": 0.20545810461044312, "set_robot_commands": 0.0023211886485417685, "deviation-center-line": 0.22270545771576217, "driven_lanedir_consec": 0.8731138199226813, "sim_compute_sim_state": 0.0105667511622111, "sim_compute_performance-ego0": 0.002120820184548696}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7167609354270057, "get_ui_image": 0.03368391653504035, "step_physics": 0.1288683462624598, "survival_time": 4.899999999999991, "driven_lanedir": 0.4444795582927734, "get_state_dump": 0.004670068471118657, "get_robot_state": 0.0036163811731820153, "sim_render-ego0": 0.0035965852063111585, "get_duckie_state": 1.148744062943892e-06, "in-drivable-lane": 3.249999999999993, "deviation-heading": 0.9254423888501632, "agent_compute-ego0": 0.010868855197020253, "complete-iteration": 0.19827643789426244, "set_robot_commands": 0.00214177430278123, "deviation-center-line": 0.14474816911484673, "driven_lanedir_consec": 0.4444795582927734, "sim_compute_sim_state": 0.008817653463344382, "sim_compute_performance-ego0": 0.0019312723718508328}}
set_robot_commands_max0.0023211886485417685
set_robot_commands_mean0.0022314814756614993
set_robot_commands_median0.0022314814756614993
set_robot_commands_min0.00214177430278123
sim_compute_performance-ego0_max0.002120820184548696
sim_compute_performance-ego0_mean0.0020260462781997645
sim_compute_performance-ego0_median0.0020260462781997645
sim_compute_performance-ego0_min0.0019312723718508328
sim_compute_sim_state_max0.0105667511622111
sim_compute_sim_state_mean0.009692202312777742
sim_compute_sim_state_median0.009692202312777742
sim_compute_sim_state_min0.008817653463344382
sim_render-ego0_max0.003908033172289531
sim_render-ego0_mean0.0037523091893003446
sim_render-ego0_median0.0037523091893003446
sim_render-ego0_min0.0035965852063111585
simulation-passed1
step_physics_max0.12918313344319662
step_physics_mean0.12902573985282825
step_physics_median0.12902573985282825
step_physics_min0.1288683462624598
survival_time_max4.899999999999991
survival_time_mean4.82499999999999
survival_time_min4.749999999999991
No reset possible
5357312596Bea Baselines 🐤template-randomaido5-LFP-sim-validationLFP-simsuccessnonogpu-prod-080:03:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.324999999999992
in-drivable-lane_median2.774999999999994
driven_lanedir_consec_median0.4321482075534334
deviation-center-line_median0.15954927868599478


other stats
agent_compute-ego0_max0.012451460247948055
agent_compute-ego0_mean0.011324933619360312
agent_compute-ego0_median0.011323365114005328
agent_compute-ego0_min0.010201544001482534
complete-iteration_max0.2404076085574385
complete-iteration_mean0.2130511324168392
complete-iteration_median0.2242704530067632
complete-iteration_min0.16325601509639195
deviation-center-line_max0.22312966499424747
deviation-center-line_mean0.16355048574709427
deviation-center-line_min0.11197372062214005
deviation-heading_max1.1731765577527429
deviation-heading_mean0.919352453519212
deviation-heading_median0.85924234065638
deviation-heading_min0.7857485750113451
driven_any_max2.100847232339913
driven_any_mean1.5514062152548211
driven_any_median1.5034346079602865
driven_any_min1.0979084127587997
driven_lanedir_consec_max0.9767221791082258
driven_lanedir_consec_mean0.5077475888170035
driven_lanedir_consec_min0.1899717610529219
driven_lanedir_max0.9767221791082258
driven_lanedir_mean0.5077475888170035
driven_lanedir_median0.4321482075534334
driven_lanedir_min0.1899717610529219
get_duckie_state_max0.024418584231672615
get_duckie_state_mean0.01761915465872574
get_duckie_state_median0.020933345139150048
get_duckie_state_min0.0041913441249302455
get_robot_state_max0.0038776329585484097
get_robot_state_mean0.0037169991057766937
get_robot_state_median0.003734479258502501
get_robot_state_min0.0035214049475533623
get_state_dump_max0.00862411589458071
get_state_dump_mean0.00750613464480712
get_state_dump_median0.008056580156519793
get_state_dump_min0.00528726237160819
get_ui_image_max0.038634059542701354
get_ui_image_mean0.03238072843348911
get_ui_image_median0.03303245293802169
get_ui_image_min0.024823948315211702
in-drivable-lane_max4.19999999999999
in-drivable-lane_mean2.637499999999994
in-drivable-lane_min0.7999999999999972
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.100847232339913, "get_ui_image": 0.03227574455327001, "step_physics": 0.11738261888767113, "survival_time": 5.749999999999988, "driven_lanedir": 0.1899717610529219, "get_state_dump": 0.00862411589458071, "get_robot_state": 0.0037409868733636266, "sim_render-ego0": 0.0037457716876062854, "get_duckie_state": 0.024418584231672615, "in-drivable-lane": 4.19999999999999, "deviation-heading": 1.1731765577527429, "agent_compute-ego0": 0.012148489212167674, "complete-iteration": 0.21439107533158927, "set_robot_commands": 0.0022013762901569233, "deviation-center-line": 0.15862358643039717, "driven_lanedir_consec": 0.1899717610529219, "sim_compute_sim_state": 0.00787838574113517, "sim_compute_performance-ego0": 0.0018819878841268608}, "LFP-norm-zigzag-000-ego0": {"driven_any": 1.88168671303, "get_ui_image": 0.038634059542701354, "step_physics": 0.13129506565275648, "survival_time": 5.1999999999999895, "driven_lanedir": 0.5108322939725443, "get_state_dump": 0.008213202158610025, "get_robot_state": 0.0038776329585484097, "sim_render-ego0": 0.003934045065016973, "get_duckie_state": 0.02136439595903669, "in-drivable-lane": 3.499999999999993, "deviation-heading": 0.8524889084427177, "agent_compute-ego0": 0.012451460247948055, "complete-iteration": 0.2341498306819371, "set_robot_commands": 0.00220513797941662, "deviation-center-line": 0.1604749709415924, "driven_lanedir_consec": 0.5108322939725443, "sim_compute_sim_state": 0.010011246090843563, "sim_compute_performance-ego0": 0.0020697570982433503}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.0979084127587997, "get_ui_image": 0.03378916132277337, "step_physics": 0.14498932465263034, "survival_time": 3.399999999999996, "driven_lanedir": 0.9767221791082258, "get_state_dump": 0.00789995815442956, "get_robot_state": 0.003727971643641375, "sim_render-ego0": 0.0035608644070832625, "get_duckie_state": 0.020502294319263405, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 0.7857485750113451, "agent_compute-ego0": 0.010201544001482534, "complete-iteration": 0.2404076085574385, "set_robot_commands": 0.0020417925240336986, "deviation-center-line": 0.22312966499424747, "driven_lanedir_consec": 0.9767221791082258, "sim_compute_sim_state": 0.01171563328176305, "sim_compute_performance-ego0": 0.001886253771574601}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.1251825028905729, "get_ui_image": 0.024823948315211702, "step_physics": 0.1017315149307251, "survival_time": 3.4499999999999957, "driven_lanedir": 0.3534641211343226, "get_state_dump": 0.00528726237160819, "get_robot_state": 0.0035214049475533623, "sim_render-ego0": 0.003635808399745396, "get_duckie_state": 0.0041913441249302455, "in-drivable-lane": 2.049999999999996, "deviation-heading": 0.8659957728700425, "agent_compute-ego0": 0.010498241015842983, "complete-iteration": 0.16325601509639195, "set_robot_commands": 0.0021162407738821846, "deviation-center-line": 0.11197372062214005, "driven_lanedir_consec": 0.3534641211343226, "sim_compute_sim_state": 0.00542212894984654, "sim_compute_performance-ego0": 0.0019367899213518416}}
set_robot_commands_max0.00220513797941662
set_robot_commands_mean0.0021411368918723564
set_robot_commands_median0.002158808532019554
set_robot_commands_min0.0020417925240336986
sim_compute_performance-ego0_max0.0020697570982433503
sim_compute_performance-ego0_mean0.0019436971688241635
sim_compute_performance-ego0_median0.0019115218464632216
sim_compute_performance-ego0_min0.0018819878841268608
sim_compute_sim_state_max0.01171563328176305
sim_compute_sim_state_mean0.00875684851589708
sim_compute_sim_state_median0.008944815915989366
sim_compute_sim_state_min0.00542212894984654
sim_render-ego0_max0.003934045065016973
sim_render-ego0_mean0.003719122389862979
sim_render-ego0_median0.003690790043675841
sim_render-ego0_min0.0035608644070832625
simulation-passed1
step_physics_max0.14498932465263034
step_physics_mean0.12384963103094576
step_physics_median0.1243388422702138
step_physics_min0.1017315149307251
survival_time_max5.749999999999988
survival_time_mean4.449999999999992
survival_time_min3.399999999999996
No reset possible
5355912597Bea Baselines 🐤template-randomaido5-LFP-sim-testingLFP-simsuccessyesnogpu-prod-080:04:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4012977349482021
survival_time_median4.499999999999992
deviation-center-line_median0.1385293223550657
in-drivable-lane_median2.7749999999999937


other stats
agent_compute-ego0_max0.012113713166292976
agent_compute-ego0_mean0.011412263118316729
agent_compute-ego0_median0.011475050994252148
agent_compute-ego0_min0.010585237318469632
complete-iteration_max0.26830116907755536
complete-iteration_mean0.22696681803275895
complete-iteration_median0.22520121428726747
complete-iteration_min0.18916367447894553
deviation-center-line_max0.18027339903737324
deviation-center-line_mean0.1285451587987956
deviation-center-line_min0.056848591447677815
deviation-heading_max1.7649200470050517
deviation-heading_mean0.7368137764399135
deviation-heading_median0.48008699517634235
deviation-heading_min0.22216106840191804
driven_any_max3.0249186308586435
driven_any_mean1.6335412217500125
driven_any_median1.5621944647828574
driven_any_min0.38485732657569066
driven_lanedir_consec_max0.7467792340807347
driven_lanedir_consec_mean0.4327941126790024
driven_lanedir_consec_min0.18180174673887084
driven_lanedir_max0.7467792340807347
driven_lanedir_mean0.4327941126790024
driven_lanedir_median0.4012977349482021
driven_lanedir_min0.18180174673887084
get_duckie_state_max0.026535700529049605
get_duckie_state_mean0.018517350620857125
get_duckie_state_median0.021549788835605137
get_duckie_state_min0.004434124283168627
get_robot_state_max0.004018239485911834
get_robot_state_mean0.003899083370459661
get_robot_state_median0.00391033089831662
get_robot_state_min0.003757432199293567
get_state_dump_max0.009267800893539038
get_state_dump_mean0.007894672396263111
get_state_dump_median0.00817841780027357
get_state_dump_min0.005954053090966266
get_ui_image_max0.03872533054912791
get_ui_image_mean0.03354079266309019
get_ui_image_median0.03413881028950756
get_ui_image_min0.02716021952421769
in-drivable-lane_max6.349999999999983
in-drivable-lane_mean2.9749999999999925
in-drivable-lane_min0.0
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 0.38485732657569066, "get_ui_image": 0.03330658643673628, "step_physics": 0.1687906522017259, "survival_time": 1.900000000000001, "driven_lanedir": 0.3799549493870889, "get_state_dump": 0.009267800893539038, "get_robot_state": 0.004018239485911834, "sim_render-ego0": 0.003915921235695863, "get_duckie_state": 0.026535700529049605, "in-drivable-lane": 0.0, "deviation-heading": 0.22216106840191804, "agent_compute-ego0": 0.01189577273833446, "complete-iteration": 0.26830116907755536, "set_robot_commands": 0.002509221052512144, "deviation-center-line": 0.13386765529050942, "driven_lanedir_consec": 0.3799549493870889, "sim_compute_sim_state": 0.005791554084190955, "sim_compute_performance-ego0": 0.002168600375835712}, "LFP-norm-zigzag-000-ego0": {"driven_any": 2.5553912208152347, "get_ui_image": 0.03872533054912791, "step_physics": 0.12702330070383408, "survival_time": 6.749999999999984, "driven_lanedir": 0.7467792340807347, "get_state_dump": 0.008298319928786334, "get_robot_state": 0.0039656355100519515, "sim_render-ego0": 0.0040070414543151855, "get_duckie_state": 0.022447175839368033, "in-drivable-lane": 4.049999999999987, "deviation-heading": 1.7649200470050517, "agent_compute-ego0": 0.012113713166292976, "complete-iteration": 0.2348330862381879, "set_robot_commands": 0.002228500211940092, "deviation-center-line": 0.18027339903737324, "driven_lanedir_consec": 0.7467792340807347, "sim_compute_sim_state": 0.013793365043752332, "sim_compute_performance-ego0": 0.002129433786167818}, "LFP-norm-techtrack-000-ego0": {"driven_any": 3.0249186308586435, "get_ui_image": 0.03497103414227885, "step_physics": 0.11829628944396972, "survival_time": 7.699999999999981, "driven_lanedir": 0.4226405205093153, "get_state_dump": 0.008058515671760805, "get_robot_state": 0.003757432199293567, "sim_render-ego0": 0.0036798692518664943, "get_duckie_state": 0.02065240183184224, "in-drivable-lane": 6.349999999999983, "deviation-heading": 0.5966178261082585, "agent_compute-ego0": 0.010585237318469632, "complete-iteration": 0.21556934233634703, "set_robot_commands": 0.0022012818244195754, "deviation-center-line": 0.14319098941962197, "driven_lanedir_consec": 0.4226405205093153, "sim_compute_sim_state": 0.011357618147327051, "sim_compute_performance-ego0": 0.001917574482579385}, "LFP-norm-small_loop-000-ego0": {"driven_any": 0.5689977087504798, "get_ui_image": 0.02716021952421769, "step_physics": 0.122793171716773, "survival_time": 2.25, "driven_lanedir": 0.18180174673887084, "get_state_dump": 0.005954053090966266, "get_robot_state": 0.003855026286581288, "sim_render-ego0": 0.003831915233446204, "get_duckie_state": 0.004434124283168627, "in-drivable-lane": 1.5, "deviation-heading": 0.3635561642444261, "agent_compute-ego0": 0.011054329250169836, "complete-iteration": 0.18916367447894553, "set_robot_commands": 0.002365552860757579, "deviation-center-line": 0.056848591447677815, "driven_lanedir_consec": 0.18180174673887084, "sim_compute_sim_state": 0.005645726038062055, "sim_compute_performance-ego0": 0.001979729403620181}}
set_robot_commands_max0.002509221052512144
set_robot_commands_mean0.002326138987407348
set_robot_commands_median0.002297026536348836
set_robot_commands_min0.0022012818244195754
sim_compute_performance-ego0_max0.002168600375835712
sim_compute_performance-ego0_mean0.002048834512050774
sim_compute_performance-ego0_median0.0020545815948939993
sim_compute_performance-ego0_min0.001917574482579385
sim_compute_sim_state_max0.013793365043752332
sim_compute_sim_state_mean0.0091470658283331
sim_compute_sim_state_median0.008574586115759005
sim_compute_sim_state_min0.005645726038062055
sim_render-ego0_max0.0040070414543151855
sim_render-ego0_mean0.003858686793830937
sim_render-ego0_median0.0038739182345710337
sim_render-ego0_min0.0036798692518664943
simulation-passed1
step_physics_max0.1687906522017259
step_physics_mean0.13422585351657568
step_physics_median0.12490823621030352
step_physics_min0.11829628944396972
survival_time_max7.699999999999981
survival_time_mean4.6499999999999915
survival_time_min1.900000000000001
No reset possible
5354312602Bea Baselines 🐤template-randomaido5-LFI-full-sim-validationLFVIv-simsuccessyesnogpu-prod-080:02:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6587966891077274
survival_time_median4.82499999999999
deviation-center-line_median0.18372681341530445
in-drivable-lane_median2.6749999999999927


other stats
agent_compute-ego0_max0.011567884021335175
agent_compute-ego0_mean0.011282943603065278
agent_compute-ego0_median0.011282943603065278
agent_compute-ego0_min0.01099800318479538
complete-iteration_max0.20911755164464316
complete-iteration_mean0.20754533915808707
complete-iteration_median0.20754533915808707
complete-iteration_min0.20597312667153095
deviation-center-line_max0.22270545771576217
deviation-center-line_mean0.18372681341530445
deviation-center-line_min0.14474816911484673
deviation-heading_max0.9254423888501632
deviation-heading_mean0.9131948861321344
deviation-heading_median0.9131948861321344
deviation-heading_min0.9009473834141052
driven_any_max1.7167609354270057
driven_any_mean1.6960945672591825
driven_any_median1.6960945672591825
driven_any_min1.6754281990913595
driven_lanedir_consec_max0.8731138199226813
driven_lanedir_consec_mean0.6587966891077274
driven_lanedir_consec_min0.4444795582927734
driven_lanedir_max0.8919331054681621
driven_lanedir_mean0.6682063318804677
driven_lanedir_median0.6682063318804677
driven_lanedir_min0.4444795582927734
get_duckie_state_max2.2131987292357163e-06
get_duckie_state_mean1.9907349287861524e-06
get_duckie_state_median1.9907349287861524e-06
get_duckie_state_min1.7682711283365886e-06
get_robot_state_max0.003606570263703664
get_robot_state_mean0.0036040028613625154
get_robot_state_median0.0036040028613625154
get_robot_state_min0.003601435459021366
get_state_dump_max0.0048572848541568025
get_state_dump_mean0.00478356730456304
get_state_dump_median0.00478356730456304
get_state_dump_min0.004709849754969279
get_ui_image_max0.03629638999700546
get_ui_image_mean0.03621640744985956
get_ui_image_median0.03621640744985956
get_ui_image_min0.03613642490271366
in-drivable-lane_max3.249999999999993
in-drivable-lane_mean2.6749999999999927
in-drivable-lane_min2.0999999999999925
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 1.6754281990913595, "get_ui_image": 0.03629638999700546, "step_physics": 0.1349810560544332, "survival_time": 4.749999999999991, "driven_lanedir": 0.8919331054681621, "get_state_dump": 0.004709849754969279, "get_robot_state": 0.003606570263703664, "sim_render-ego0": 0.003652940193812052, "get_duckie_state": 1.7682711283365886e-06, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 0.9009473834141052, "agent_compute-ego0": 0.01099800318479538, "complete-iteration": 0.20911755164464316, "set_robot_commands": 0.002146579325199127, "deviation-center-line": 0.22270545771576217, "driven_lanedir_consec": 0.8731138199226813, "sim_compute_sim_state": 0.010671302676200868, "sim_compute_performance-ego0": 0.0019653141498565674}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7167609354270057, "get_ui_image": 0.03613642490271366, "step_physics": 0.1321505970425076, "survival_time": 4.899999999999991, "driven_lanedir": 0.4444795582927734, "get_state_dump": 0.0048572848541568025, "get_robot_state": 0.003601435459021366, "sim_render-ego0": 0.003803351912835632, "get_duckie_state": 2.2131987292357163e-06, "in-drivable-lane": 3.249999999999993, "deviation-heading": 0.9254423888501632, "agent_compute-ego0": 0.011567884021335175, "complete-iteration": 0.20597312667153095, "set_robot_commands": 0.002216659411035403, "deviation-center-line": 0.14474816911484673, "driven_lanedir_consec": 0.4444795582927734, "sim_compute_sim_state": 0.009530852539370758, "sim_compute_performance-ego0": 0.002010576652758049}}
set_robot_commands_max0.002216659411035403
set_robot_commands_mean0.002181619368117265
set_robot_commands_median0.002181619368117265
set_robot_commands_min0.002146579325199127
sim_compute_performance-ego0_max0.002010576652758049
sim_compute_performance-ego0_mean0.001987945401307308
sim_compute_performance-ego0_median0.001987945401307308
sim_compute_performance-ego0_min0.0019653141498565674
sim_compute_sim_state_max0.010671302676200868
sim_compute_sim_state_mean0.010101077607785811
sim_compute_sim_state_median0.010101077607785811
sim_compute_sim_state_min0.009530852539370758
sim_render-ego0_max0.003803351912835632
sim_render-ego0_mean0.0037281460533238418
sim_render-ego0_median0.0037281460533238418
sim_render-ego0_min0.003652940193812052
simulation-passed1
step_physics_max0.1349810560544332
step_physics_mean0.13356582654847038
step_physics_median0.13356582654847038
step_physics_min0.1321505970425076
survival_time_max4.899999999999991
survival_time_mean4.82499999999999
survival_time_min4.749999999999991
No reset possible
5352912605Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-080:02:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.2999735197577017
survival_time_median1.7750000000000008
deviation-center-line_median0.16116976962533835
in-drivable-lane_median0.37500000000000033


other stats
agent_compute-ego0_max0.012164247035980224
agent_compute-ego0_mean0.012067206520022768
agent_compute-ego0_median0.012067206520022768
agent_compute-ego0_min0.011970166004065311
agent_compute-npc0_max0.04998180270195007
agent_compute-npc0_mean0.040894995584632415
agent_compute-npc0_median0.040894995584632415
agent_compute-npc0_min0.03180818846731475
agent_compute-npc1_max0.05314846038818359
agent_compute-npc1_mean0.04262386813308253
agent_compute-npc1_median0.04262386813308253
agent_compute-npc1_min0.032099275877981476
agent_compute-npc2_max0.04691334366798401
agent_compute-npc2_mean0.03864466141570698
agent_compute-npc2_median0.03864466141570698
agent_compute-npc2_min0.03037597916342995
complete-iteration_max0.8867537617683411
complete-iteration_mean0.8435102414001119
complete-iteration_median0.8435102414001119
complete-iteration_min0.8002667210318826
deviation-center-line_max0.2029614423431128
deviation-center-line_mean0.16116976962533835
deviation-center-line_min0.1193780969075639
deviation-heading_max0.42290029630167686
deviation-heading_mean0.33090990458760183
deviation-heading_median0.33090990458760183
deviation-heading_min0.2389195128735269
driven_any_max0.3866220460800679
driven_any_mean0.31982841800446105
driven_any_median0.31982841800446105
driven_any_min0.2530347899288541
driven_lanedir_consec_max0.3549885974886773
driven_lanedir_consec_mean0.2999735197577017
driven_lanedir_consec_min0.24495844202672612
driven_lanedir_max0.3549885974886773
driven_lanedir_mean0.2999735197577017
driven_lanedir_median0.2999735197577017
driven_lanedir_min0.24495844202672612
get_duckie_state_max1.4666355017459751e-06
get_duckie_state_mean1.4128107013124408e-06
get_duckie_state_median1.4128107013124408e-06
get_duckie_state_min1.3589859008789065e-06
get_robot_state_max0.01416824460029602
get_robot_state_mean0.01413419580820835
get_robot_state_median0.01413419580820835
get_robot_state_min0.01410014701612068
get_state_dump_max0.010133707523345949
get_state_dump_mean0.00965680516127384
get_state_dump_median0.00965680516127384
get_state_dump_min0.009179902799201736
get_ui_image_max0.05018138163017504
get_ui_image_mean0.04886729952060815
get_ui_image_median0.04886729952060815
get_ui_image_min0.04755321741104126
in-drivable-lane_max0.7500000000000007
in-drivable-lane_mean0.37500000000000033
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 0.2530347899288541, "get_ui_image": 0.05018138163017504, "step_physics": 0.5497295278491396, "survival_time": 1.6000000000000008, "driven_lanedir": 0.24495844202672612, "get_state_dump": 0.009179902799201736, "get_robot_state": 0.01410014701612068, "sim_render-ego0": 0.003816387870094993, "sim_render-npc0": 0.003708442052205404, "sim_render-npc1": 0.003883123397827149, "sim_render-npc2": 0.0038986133806633225, "get_duckie_state": 1.4666355017459751e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.42290029630167686, "agent_compute-ego0": 0.011970166004065311, "agent_compute-npc0": 0.03180818846731475, "agent_compute-npc1": 0.032099275877981476, "agent_compute-npc2": 0.03037597916342995, "complete-iteration": 0.8002667210318826, "set_robot_commands": 0.0021853302464340672, "deviation-center-line": 0.2029614423431128, "driven_lanedir_consec": 0.24495844202672612, "sim_compute_sim_state": 0.03819760409268466, "sim_compute_performance-ego0": 0.002077225482825077, "sim_compute_performance-npc0": 0.001914985252149177, "sim_compute_performance-npc1": 0.002009492931943951, "sim_compute_performance-npc2": 0.0020417300137606535}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.3866220460800679, "get_ui_image": 0.04755321741104126, "step_physics": 0.5818588197231293, "survival_time": 1.950000000000001, "driven_lanedir": 0.3549885974886773, "get_state_dump": 0.010133707523345949, "get_robot_state": 0.01416824460029602, "sim_render-ego0": 0.0038134932518005377, "sim_render-npc0": 0.003670966625213623, "sim_render-npc1": 0.003837430477142334, "sim_render-npc2": 0.003761285543441773, "get_duckie_state": 1.3589859008789065e-06, "in-drivable-lane": 0.7500000000000007, "deviation-heading": 0.2389195128735269, "agent_compute-ego0": 0.012164247035980224, "agent_compute-npc0": 0.04998180270195007, "agent_compute-npc1": 0.05314846038818359, "agent_compute-npc2": 0.04691334366798401, "complete-iteration": 0.8867537617683411, "set_robot_commands": 0.0022633016109466554, "deviation-center-line": 0.1193780969075639, "driven_lanedir_consec": 0.3549885974886773, "sim_compute_sim_state": 0.03844697475433349, "sim_compute_performance-ego0": 0.00208359956741333, "sim_compute_performance-npc0": 0.001855891942977905, "sim_compute_performance-npc1": 0.0019919812679290772, "sim_compute_performance-npc2": 0.001978933811187744}}
set_robot_commands_max0.0022633016109466554
set_robot_commands_mean0.0022243159286903613
set_robot_commands_median0.0022243159286903613
set_robot_commands_min0.0021853302464340672
sim_compute_performance-ego0_max0.00208359956741333
sim_compute_performance-ego0_mean0.0020804125251192036
sim_compute_performance-ego0_median0.0020804125251192036
sim_compute_performance-ego0_min0.002077225482825077
sim_compute_performance-npc0_max0.001914985252149177
sim_compute_performance-npc0_mean0.001885438597563541
sim_compute_performance-npc0_median0.001885438597563541
sim_compute_performance-npc0_min0.001855891942977905
sim_compute_performance-npc1_max0.002009492931943951
sim_compute_performance-npc1_mean0.002000737099936514
sim_compute_performance-npc1_median0.002000737099936514
sim_compute_performance-npc1_min0.0019919812679290772
sim_compute_performance-npc2_max0.0020417300137606535
sim_compute_performance-npc2_mean0.002010331912474199
sim_compute_performance-npc2_median0.002010331912474199
sim_compute_performance-npc2_min0.001978933811187744
sim_compute_sim_state_max0.03844697475433349
sim_compute_sim_state_mean0.03832228942350908
sim_compute_sim_state_median0.03832228942350908
sim_compute_sim_state_min0.03819760409268466
sim_render-ego0_max0.003816387870094993
sim_render-ego0_mean0.003814940560947765
sim_render-ego0_median0.003814940560947765
sim_render-ego0_min0.0038134932518005377
sim_render-npc0_max0.003708442052205404
sim_render-npc0_mean0.003689704338709514
sim_render-npc0_median0.003689704338709514
sim_render-npc0_min0.003670966625213623
sim_render-npc1_max0.003883123397827149
sim_render-npc1_mean0.003860276937484741
sim_render-npc1_median0.003860276937484741
sim_render-npc1_min0.003837430477142334
sim_render-npc2_max0.0038986133806633225
sim_render-npc2_mean0.0038299494620525473
sim_render-npc2_median0.0038299494620525473
sim_render-npc2_min0.003761285543441773
simulation-passed1
step_physics_max0.5818588197231293
step_physics_mean0.5657941737861345
step_physics_median0.5657941737861345
step_physics_min0.5497295278491396
survival_time_max1.950000000000001
survival_time_mean1.7750000000000008
survival_time_min1.6000000000000008
No reset possible
5348612679Bea Baselines 🐤baseline-duckietownaido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-080:36:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.2317568405154056
survival_time_median12.875000000000048
deviation-center-line_median0.94813228164883
in-drivable-lane_median2.424999999999997


other stats
agent_compute-ego0_max0.013574494255913628
agent_compute-ego0_mean0.01308402931696246
agent_compute-ego0_median0.013118520906158122
agent_compute-ego0_min0.012524581199619958
agent_compute-npc0_max0.02726673184808204
agent_compute-npc0_mean0.024968649279095985
agent_compute-npc0_median0.025253189982415915
agent_compute-npc0_min0.022101485303470066
agent_compute-npc1_max0.03316169870751245
agent_compute-npc1_mean0.03058378033831286
agent_compute-npc1_median0.031098519518075744
agent_compute-npc1_min0.027491122789350387
agent_compute-npc2_max0.036851116589137485
agent_compute-npc2_mean0.033275885854623065
agent_compute-npc2_median0.03226082398216065
agent_compute-npc2_min0.030715716992571057
agent_compute-npc3_max0.04672141286700252
agent_compute-npc3_mean0.04561080743091188
agent_compute-npc3_median0.04561080743091188
agent_compute-npc3_min0.04450020199482124
complete-iteration_max1.571728687685913
complete-iteration_mean1.0978403547240136
complete-iteration_median1.2179204084066313
complete-iteration_min0.3837919143968792
deviation-center-line_max1.2083672716617049
deviation-center-line_mean0.8827300441978134
deviation-center-line_min0.4262883418318888
deviation-heading_max7.170277770783281
deviation-heading_mean4.374280086393723
deviation-heading_median4.421828767825236
deviation-heading_min1.48318503914114
driven_any_max3.499518737636027
driven_any_mean1.969484058551672
driven_any_median1.571173248928285
driven_any_min1.236070998714092
driven_lanedir_consec_max2.2634948167123508
driven_lanedir_consec_mean1.3969093131776953
driven_lanedir_consec_min0.8606287549676184
driven_lanedir_max2.2634948167123508
driven_lanedir_mean1.3969093131776953
driven_lanedir_median1.2317568405154056
driven_lanedir_min0.8606287549676184
get_duckie_state_max1.7476933343069897e-06
get_duckie_state_mean1.6048967753398516e-06
get_duckie_state_median1.5864683836710576e-06
get_duckie_state_min1.498956999710302e-06
get_robot_state_max0.020331929507368465
get_robot_state_mean0.01554005233800622
get_robot_state_median0.016949003955566377
get_robot_state_min0.007930271933523662
get_state_dump_max0.012510779559720844
get_state_dump_mean0.010290569904764816
get_state_dump_median0.010936931088050942
get_state_dump_min0.006777637883236534
get_ui_image_max0.05659547355874206
get_ui_image_mean0.047823287984459534
get_ui_image_median0.05087520536861729
get_ui_image_min0.032947267641861476
in-drivable-lane_max7.250000000000054
in-drivable-lane_mean3.025000000000012
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 1.3422992681840389, "get_ui_image": 0.04668223112821579, "step_physics": 0.8209925804819379, "survival_time": 11.150000000000023, "driven_lanedir": 1.3063819082360435, "get_state_dump": 0.010626937661852156, "get_robot_state": 0.016108420278344835, "sim_render-ego0": 0.0041900670954159325, "sim_render-npc0": 0.004131141517843519, "sim_render-npc1": 0.004130109080246517, "sim_render-npc2": 0.004255183041095734, "get_duckie_state": 1.7476933343069897e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.447417986033939, "agent_compute-ego0": 0.013366762016500746, "agent_compute-npc0": 0.022101485303470066, "agent_compute-npc1": 0.03316169870751245, "agent_compute-npc2": 0.036851116589137485, "complete-iteration": 1.0732955836824007, "set_robot_commands": 0.0026272439530917575, "deviation-center-line": 0.4262883418318888, "driven_lanedir_consec": 1.3063819082360435, "sim_compute_sim_state": 0.036793431001050134, "sim_compute_performance-ego0": 0.002466055963720594, "sim_compute_performance-npc0": 0.0022512206009456088, "sim_compute_performance-npc1": 0.0022423011916024344, "sim_compute_performance-npc2": 0.002297566405364445}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.8000472296725312, "get_ui_image": 0.05506817960901879, "step_physics": 1.0300351881736782, "survival_time": 14.600000000000072, "driven_lanedir": 1.157131772794768, "get_state_dump": 0.01124692451424973, "get_robot_state": 0.01778958763278792, "sim_render-ego0": 0.00377388456168842, "sim_render-npc0": 0.003889337741474243, "sim_render-npc1": 0.0038870064471768846, "sim_render-npc2": 0.003800960124149257, "sim_render-npc3": 0.00374716377909273, "get_duckie_state": 1.5192064408963045e-06, "in-drivable-lane": 2.5000000000000027, "deviation-heading": 6.396239549616533, "agent_compute-ego0": 0.012524581199619958, "agent_compute-npc0": 0.02726673184808204, "agent_compute-npc1": 0.027491122789350387, "agent_compute-npc2": 0.03226082398216065, "agent_compute-npc3": 0.04672141286700252, "complete-iteration": 1.3625452331308618, "set_robot_commands": 0.002383450192396144, "deviation-center-line": 1.1838631721736468, "driven_lanedir_consec": 1.157131772794768, "sim_compute_sim_state": 0.06118902981077852, "sim_compute_performance-ego0": 0.002122165400013582, "sim_compute_performance-npc0": 0.001978573131886766, "sim_compute_performance-npc1": 0.0019872465231312825, "sim_compute_performance-npc2": 0.0019739943559666136, "sim_compute_performance-npc3": 0.0020566718977059113}, "LFV-norm-techtrack-000-ego0": {"driven_any": 3.499518737636027, "get_ui_image": 0.05659547355874206, "step_physics": 1.2330780142209137, "survival_time": 27.400000000000254, "driven_lanedir": 2.2634948167123508, "get_state_dump": 0.012510779559720844, "get_robot_state": 0.020331929507368465, "sim_render-ego0": 0.00434856336624896, "sim_render-npc0": 0.0044084055610476075, "sim_render-npc1": 0.004301569718046483, "sim_render-npc2": 0.004273473673613779, "sim_render-npc3": 0.004350492428777865, "get_duckie_state": 1.6537303264458106e-06, "in-drivable-lane": 7.250000000000054, "deviation-heading": 7.170277770783281, "agent_compute-ego0": 0.013574494255913628, "agent_compute-npc0": 0.023715223770975416, "agent_compute-npc1": 0.031098519518075744, "agent_compute-npc2": 0.030715716992571057, "agent_compute-npc3": 0.04450020199482124, "complete-iteration": 1.571728687685913, "set_robot_commands": 0.0027156983568368716, "deviation-center-line": 1.2083672716617049, "driven_lanedir_consec": 2.2634948167123508, "sim_compute_sim_state": 0.058180581025087115, "sim_compute_performance-ego0": 0.0025725308228928753, "sim_compute_performance-npc0": 0.0024069749592431906, "sim_compute_performance-npc1": 0.0023855937200382977, "sim_compute_performance-npc2": 0.002437083013287876, "sim_compute_performance-npc3": 0.002416537324804643}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.236070998714092, "get_ui_image": 0.032947267641861476, "step_physics": 0.26811236171631153, "survival_time": 10.400000000000013, "driven_lanedir": 0.8606287549676184, "get_state_dump": 0.006777637883236534, "get_robot_state": 0.007930271933523662, "sim_render-ego0": 0.003937766882791473, "sim_render-npc0": 0.004074521041943125, "get_duckie_state": 1.498956999710302e-06, "in-drivable-lane": 2.3499999999999917, "deviation-heading": 1.48318503914114, "agent_compute-ego0": 0.0128702797958155, "agent_compute-npc0": 0.026791156193856417, "complete-iteration": 0.3837919143968792, "set_robot_commands": 0.002317207281669361, "deviation-center-line": 0.7124013911240132, "driven_lanedir_consec": 0.8606287549676184, "sim_compute_sim_state": 0.011273511859218467, "sim_compute_performance-ego0": 0.0021055451990885025, "sim_compute_performance-npc0": 0.0020759128497548083}}
set_robot_commands_max0.0027156983568368716
set_robot_commands_mean0.0025108999459985334
set_robot_commands_median0.002505347072743951
set_robot_commands_min0.002317207281669361
sim_compute_performance-ego0_max0.0025725308228928753
sim_compute_performance-ego0_mean0.002316574346428888
sim_compute_performance-ego0_median0.002294110681867088
sim_compute_performance-ego0_min0.0021055451990885025
sim_compute_performance-npc0_max0.0024069749592431906
sim_compute_performance-npc0_mean0.002178170385457593
sim_compute_performance-npc0_median0.0021635667253502083
sim_compute_performance-npc0_min0.001978573131886766
sim_compute_performance-npc1_max0.0023855937200382977
sim_compute_performance-npc1_mean0.002205047144924005
sim_compute_performance-npc1_median0.0022423011916024344
sim_compute_performance-npc1_min0.0019872465231312825
sim_compute_performance-npc2_max0.002437083013287876
sim_compute_performance-npc2_mean0.002236214591539645
sim_compute_performance-npc2_median0.002297566405364445
sim_compute_performance-npc2_min0.0019739943559666136
sim_compute_performance-npc3_max0.002416537324804643
sim_compute_performance-npc3_mean0.002236604611255277
sim_compute_performance-npc3_median0.002236604611255277
sim_compute_performance-npc3_min0.0020566718977059113
sim_compute_sim_state_max0.06118902981077852
sim_compute_sim_state_mean0.04185913842403356
sim_compute_sim_state_median0.04748700601306863
sim_compute_sim_state_min0.011273511859218467
sim_render-ego0_max0.00434856336624896
sim_render-ego0_mean0.0040625704765361965
sim_render-ego0_median0.0040639169891037025
sim_render-ego0_min0.00377388456168842
sim_render-npc0_max0.0044084055610476075
sim_render-npc0_mean0.0041258514655771236
sim_render-npc0_median0.0041028312798933216
sim_render-npc0_min0.003889337741474243
sim_render-npc1_max0.004301569718046483
sim_render-npc1_mean0.004106228415156628
sim_render-npc1_median0.004130109080246517
sim_render-npc1_min0.0038870064471768846
sim_render-npc2_max0.004273473673613779
sim_render-npc2_mean0.00410987227961959
sim_render-npc2_median0.004255183041095734
sim_render-npc2_min0.003800960124149257
sim_render-npc3_max0.004350492428777865
sim_render-npc3_mean0.004048828103935297
sim_render-npc3_median0.004048828103935297
sim_render-npc3_min0.00374716377909273
simulation-passed1
step_physics_max1.2330780142209137
step_physics_mean0.8380545361482103
step_physics_median0.925513884327808
step_physics_min0.26811236171631153
survival_time_max27.400000000000254
survival_time_mean15.88750000000009
survival_time_min10.400000000000013
No reset possible
5344512574Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-080:21:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6193714958383224
survival_time_median9.6
deviation-center-line_median0.26371422989698395
in-drivable-lane_median4.575000000000011


other stats
agent_compute-ego0_max0.01061035506427288
agent_compute-ego0_mean0.010496309826192865
agent_compute-ego0_median0.01050659463581462
agent_compute-ego0_min0.010361694968869331
agent_compute-npc0_max0.025682058034990934
agent_compute-npc0_mean0.022495963689012563
agent_compute-npc0_median0.021719702440817265
agent_compute-npc0_min0.02086239183942477
agent_compute-npc1_max0.03213862261157826
agent_compute-npc1_mean0.028567449466129796
agent_compute-npc1_median0.02729446378846963
agent_compute-npc1_min0.026269261998341495
agent_compute-npc2_max0.03290772079525137
agent_compute-npc2_mean0.030727493971920053
agent_compute-npc2_median0.03184417274100649
agent_compute-npc2_min0.027430588379502296
agent_compute-npc3_max0.04290228858029932
agent_compute-npc3_mean0.04229550044703528
agent_compute-npc3_median0.04229550044703528
agent_compute-npc3_min0.04168871231377125
complete-iteration_max1.234556430329879
complete-iteration_mean0.920478716526034
complete-iteration_median1.066004377674191
complete-iteration_min0.31534968042587486
deviation-center-line_max0.5600236295347618
deviation-center-line_mean0.3253905152177584
deviation-center-line_min0.21410997154230388
deviation-heading_max1.908871012683688
deviation-heading_mean1.0766142147862303
deviation-heading_median0.8482219769421233
deviation-heading_min0.7011418925769862
driven_any_max2.984498978515761
driven_any_mean1.6846091701953825
driven_any_median1.4167591311847954
driven_any_min0.920419439896177
driven_lanedir_consec_max1.058934844763729
driven_lanedir_consec_mean0.6924950861139013
driven_lanedir_consec_min0.4723025080152312
driven_lanedir_max1.058934844763729
driven_lanedir_mean0.6924950861139013
driven_lanedir_median0.6193714958383224
driven_lanedir_min0.4723025080152312
get_duckie_state_max1.5124221520921203e-06
get_duckie_state_mean1.408460981111212e-06
get_duckie_state_median1.3951702337515985e-06
get_duckie_state_min1.3310813048495306e-06
get_robot_state_max0.018178111628482214
get_robot_state_mean0.014360374824190293
get_robot_state_median0.01597578441133772
get_robot_state_min0.007311818845603498
get_state_dump_max0.012248123498787558
get_state_dump_mean0.00987640929592143
get_state_dump_median0.01042341363020165
get_state_dump_min0.006410686424494859
get_ui_image_max0.052974154178361245
get_ui_image_mean0.043762556258690744
get_ui_image_median0.04586627181992696
get_ui_image_min0.03034352721654781
in-drivable-lane_max14.850000000000144
in-drivable-lane_mean6.33750000000004
in-drivable-lane_min1.349999999999996
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 1.1741327645678017, "get_ui_image": 0.04290832771114045, "step_physics": 0.7678777308551812, "survival_time": 8.09999999999998, "driven_lanedir": 1.058934844763729, "get_state_dump": 0.009681473480411831, "get_robot_state": 0.014410214921448127, "sim_render-ego0": 0.003852532685168682, "sim_render-npc0": 0.003693307104286241, "sim_render-npc1": 0.003770794605184918, "sim_render-npc2": 0.0038174017806726, "get_duckie_state": 1.5124221520921203e-06, "in-drivable-lane": 1.349999999999996, "deviation-heading": 0.7421302334609048, "agent_compute-ego0": 0.010581989229822453, "agent_compute-npc0": 0.021009212622613262, "agent_compute-npc1": 0.03213862261157826, "agent_compute-npc2": 0.03184417274100649, "complete-iteration": 0.996184085775738, "set_robot_commands": 0.0023121716786015985, "deviation-center-line": 0.5600236295347618, "driven_lanedir_consec": 1.058934844763729, "sim_compute_sim_state": 0.03324230609495947, "sim_compute_performance-ego0": 0.0021143091236886804, "sim_compute_performance-npc0": 0.0019258896997369872, "sim_compute_performance-npc1": 0.0019749044640663942, "sim_compute_performance-npc2": 0.0020274340740742127}, "LFV-norm-zigzag-000-ego0": {"driven_any": 0.920419439896177, "get_ui_image": 0.052974154178361245, "step_physics": 0.819039167318129, "survival_time": 6.5999999999999845, "driven_lanedir": 0.4723025080152312, "get_state_dump": 0.012248123498787558, "get_robot_state": 0.018178111628482214, "sim_render-ego0": 0.0036981249214115, "sim_render-npc0": 0.0035142181511212114, "sim_render-npc1": 0.003627429331155648, "sim_render-npc2": 0.003617643413687111, "sim_render-npc3": 0.003903804865098538, "get_duckie_state": 1.380318089535362e-06, "in-drivable-lane": 2.249999999999992, "deviation-heading": 1.908871012683688, "agent_compute-ego0": 0.010431200041806789, "agent_compute-npc0": 0.02243019225902127, "agent_compute-npc1": 0.026269261998341495, "agent_compute-npc2": 0.03290772079525137, "agent_compute-npc3": 0.04290228858029932, "complete-iteration": 1.1358246695726435, "set_robot_commands": 0.0021516488010721994, "deviation-center-line": 0.3113567499237792, "driven_lanedir_consec": 0.4723025080152312, "sim_compute_sim_state": 0.05873279643238039, "sim_compute_performance-ego0": 0.002128651267603824, "sim_compute_performance-npc0": 0.0018469659905684624, "sim_compute_performance-npc1": 0.0018355523733268107, "sim_compute_performance-npc2": 0.0018838742621859216, "sim_compute_performance-npc3": 0.0019146714891706191}, "LFV-norm-techtrack-000-ego0": {"driven_any": 2.984498978515761, "get_ui_image": 0.04882421592871348, "step_physics": 0.9373630806803704, "survival_time": 19.150000000000137, "driven_lanedir": 0.6255010756848516, "get_state_dump": 0.011165353779991468, "get_robot_state": 0.017541353901227314, "sim_render-ego0": 0.0037827901542186737, "sim_render-npc0": 0.003559888650973638, "sim_render-npc1": 0.003725017110506694, "sim_render-npc2": 0.003671324501434962, "sim_render-npc3": 0.003665369004011154, "get_duckie_state": 1.4100223779678345e-06, "in-drivable-lane": 14.850000000000144, "deviation-heading": 0.7011418925769862, "agent_compute-ego0": 0.01061035506427288, "agent_compute-npc0": 0.02086239183942477, "agent_compute-npc1": 0.02729446378846963, "agent_compute-npc2": 0.027430588379502296, "agent_compute-npc3": 0.04168871231377125, "complete-iteration": 1.234556430329879, "set_robot_commands": 0.0022287902732690177, "deviation-center-line": 0.21410997154230388, "driven_lanedir_consec": 0.6255010756848516, "sim_compute_sim_state": 0.05262060587604841, "sim_compute_performance-ego0": 0.0020576311896244683, "sim_compute_performance-npc0": 0.001829632247487704, "sim_compute_performance-npc1": 0.001985978956023852, "sim_compute_performance-npc2": 0.0019107523063818617, "sim_compute_performance-npc3": 0.0019145775586366651}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.6593854978017892, "get_ui_image": 0.03034352721654781, "step_physics": 0.20766742026324764, "survival_time": 11.100000000000025, "driven_lanedir": 0.6132419159917932, "get_state_dump": 0.006410686424494859, "get_robot_state": 0.007311818845603498, "sim_render-ego0": 0.0038063857587463655, "sim_render-npc0": 0.0036966255427476, "get_duckie_state": 1.3310813048495306e-06, "in-drivable-lane": 6.90000000000003, "deviation-heading": 0.9543137204233418, "agent_compute-ego0": 0.010361694968869331, "agent_compute-npc0": 0.025682058034990934, "complete-iteration": 0.31534968042587486, "set_robot_commands": 0.002345399471676403, "deviation-center-line": 0.21607170987018873, "driven_lanedir_consec": 0.6132419159917932, "sim_compute_sim_state": 0.01135866524392714, "sim_compute_performance-ego0": 0.002058520979945435, "sim_compute_performance-npc0": 0.0019423715736833925}}
set_robot_commands_max0.002345399471676403
set_robot_commands_mean0.0022595025561548045
set_robot_commands_median0.0022704809759353083
set_robot_commands_min0.0021516488010721994
sim_compute_performance-ego0_max0.002128651267603824
sim_compute_performance-ego0_mean0.0020897781402156018
sim_compute_performance-ego0_median0.002086415051817058
sim_compute_performance-ego0_min0.0020576311896244683
sim_compute_performance-npc0_max0.0019423715736833925
sim_compute_performance-npc0_mean0.0018862148778691363
sim_compute_performance-npc0_median0.0018864278451527247
sim_compute_performance-npc0_min0.001829632247487704
sim_compute_performance-npc1_max0.001985978956023852
sim_compute_performance-npc1_mean0.0019321452644723524
sim_compute_performance-npc1_median0.0019749044640663942
sim_compute_performance-npc1_min0.0018355523733268107
sim_compute_performance-npc2_max0.0020274340740742127
sim_compute_performance-npc2_mean0.0019406868808806651
sim_compute_performance-npc2_median0.0019107523063818617
sim_compute_performance-npc2_min0.0018838742621859216
sim_compute_performance-npc3_max0.0019146714891706191
sim_compute_performance-npc3_mean0.0019146245239036424
sim_compute_performance-npc3_median0.0019146245239036424
sim_compute_performance-npc3_min0.0019145775586366651
sim_compute_sim_state_max0.05873279643238039
sim_compute_sim_state_mean0.03898859341182885
sim_compute_sim_state_median0.042931455985503936
sim_compute_sim_state_min0.01135866524392714
sim_render-ego0_max0.003852532685168682
sim_render-ego0_mean0.0037849583798863057
sim_render-ego0_median0.0037945879564825194
sim_render-ego0_min0.0036981249214115
sim_render-npc0_max0.0036966255427476
sim_render-npc0_mean0.0036160098622821726
sim_render-npc0_median0.0036265978776299393
sim_render-npc0_min0.0035142181511212114
sim_render-npc1_max0.003770794605184918
sim_render-npc1_mean0.003707747015615753
sim_render-npc1_median0.003725017110506694
sim_render-npc1_min0.003627429331155648
sim_render-npc2_max0.0038174017806726
sim_render-npc2_mean0.0037021232319315576
sim_render-npc2_median0.003671324501434962
sim_render-npc2_min0.003617643413687111
sim_render-npc3_max0.003903804865098538
sim_render-npc3_mean0.0037845869345548458
sim_render-npc3_median0.0037845869345548458
sim_render-npc3_min0.003665369004011154
simulation-passed1
step_physics_max0.9373630806803704
step_physics_mean0.682986849779232
step_physics_median0.7934584490866551
step_physics_min0.20766742026324764
survival_time_max19.150000000000137
survival_time_mean11.237500000000033
survival_time_min6.5999999999999845
No reset possible
5343812576Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-080:11:52
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.57719292024425
survival_time_median11.15000000000006
deviation-center-line_median0.49998082892113976
in-drivable-lane_median6.2000000000000535


other stats
agent_compute-ego0_max0.011100501899259636
agent_compute-ego0_mean0.010723599350320604
agent_compute-ego0_median0.010723599350320604
agent_compute-ego0_min0.010346696801381568
agent_compute-npc0_max0.04416920714182397
agent_compute-npc0_mean0.04304464297397712
agent_compute-npc0_median0.04304464297397712
agent_compute-npc0_min0.04192007880613028
agent_compute-npc1_max0.044356920632971336
agent_compute-npc1_mean0.04181566549264317
agent_compute-npc1_median0.04181566549264317
agent_compute-npc1_min0.039274410352314985
agent_compute-npc2_max0.042763942695525754
agent_compute-npc2_mean0.03777479805515867
agent_compute-npc2_median0.03777479805515867
agent_compute-npc2_min0.032785653414791574
complete-iteration_max1.049093234969909
complete-iteration_mean1.022638841984905
complete-iteration_median1.022638841984905
complete-iteration_min0.9961844489999012
deviation-center-line_max0.880854907567805
deviation-center-line_mean0.49998082892113976
deviation-center-line_min0.11910675027447444
deviation-heading_max2.497198994678309
deviation-heading_mean1.7143984686681213
deviation-heading_median1.7143984686681213
deviation-heading_min0.9315979426579334
driven_any_max2.836260992045463
driven_any_mean1.67123286605405
driven_any_median1.67123286605405
driven_any_min0.5062047400626375
driven_lanedir_consec_max0.980436367760506
driven_lanedir_consec_mean0.57719292024425
driven_lanedir_consec_min0.17394947272799377
driven_lanedir_max1.160056111801557
driven_lanedir_mean0.6670027922647754
driven_lanedir_median0.6670027922647754
driven_lanedir_min0.17394947272799377
get_duckie_state_max2.163002289921404e-06
get_duckie_state_mean1.98716514475335e-06
get_duckie_state_median1.98716514475335e-06
get_duckie_state_min1.8113279995852957e-06
get_robot_state_max0.01473517590258495
get_robot_state_mean0.014633120784548608
get_robot_state_median0.014633120784548608
get_robot_state_min0.014531065666512268
get_state_dump_max0.009925891117877271
get_state_dump_mean0.00982714214032191
get_state_dump_median0.00982714214032191
get_state_dump_min0.009728393162766549
get_ui_image_max0.0531045528307353
get_ui_image_mean0.052232623076671064
get_ui_image_median0.052232623076671064
get_ui_image_min0.05136069332260683
in-drivable-lane_max9.900000000000114
in-drivable-lane_mean6.2000000000000535
in-drivable-lane_min2.499999999999993
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 2.836260992045463, "get_ui_image": 0.0531045528307353, "step_physics": 0.7188889882335924, "survival_time": 18.200000000000124, "driven_lanedir": 1.160056111801557, "get_state_dump": 0.009728393162766549, "get_robot_state": 0.014531065666512268, "sim_render-ego0": 0.003914509080860713, "sim_render-npc0": 0.0037835957252815976, "sim_render-npc1": 0.003894012921477017, "sim_render-npc2": 0.003924875390039731, "get_duckie_state": 1.8113279995852957e-06, "in-drivable-lane": 9.900000000000114, "deviation-heading": 2.497198994678309, "agent_compute-ego0": 0.010346696801381568, "agent_compute-npc0": 0.04416920714182397, "agent_compute-npc1": 0.039274410352314985, "agent_compute-npc2": 0.032785653414791574, "complete-iteration": 0.9961844489999012, "set_robot_commands": 0.002291063413228074, "deviation-center-line": 0.880854907567805, "driven_lanedir_consec": 0.980436367760506, "sim_compute_sim_state": 0.04008358406693968, "sim_compute_performance-ego0": 0.002180397347228168, "sim_compute_performance-npc0": 0.0019295006582181749, "sim_compute_performance-npc1": 0.00208412719099489, "sim_compute_performance-npc2": 0.00208975125665534}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.5062047400626375, "get_ui_image": 0.05136069332260683, "step_physics": 0.7557580959366028, "survival_time": 4.099999999999993, "driven_lanedir": 0.17394947272799377, "get_state_dump": 0.009925891117877271, "get_robot_state": 0.01473517590258495, "sim_render-ego0": 0.004159551068960902, "sim_render-npc0": 0.0038581009370734897, "sim_render-npc1": 0.003864592816456254, "sim_render-npc2": 0.0037585511265030825, "get_duckie_state": 2.163002289921404e-06, "in-drivable-lane": 2.499999999999993, "deviation-heading": 0.9315979426579334, "agent_compute-ego0": 0.011100501899259636, "agent_compute-npc0": 0.04192007880613028, "agent_compute-npc1": 0.044356920632971336, "agent_compute-npc2": 0.042763942695525754, "complete-iteration": 1.049093234969909, "set_robot_commands": 0.0023002710687108786, "deviation-center-line": 0.11910675027447444, "driven_lanedir_consec": 0.17394947272799377, "sim_compute_sim_state": 0.04363676438848656, "sim_compute_performance-ego0": 0.002251145351363952, "sim_compute_performance-npc0": 0.0020476651478962726, "sim_compute_performance-npc1": 0.002086616424192865, "sim_compute_performance-npc2": 0.0020108424037335866}}
set_robot_commands_max0.0023002710687108786
set_robot_commands_mean0.0022956672409694765
set_robot_commands_median0.0022956672409694765
set_robot_commands_min0.002291063413228074
sim_compute_performance-ego0_max0.002251145351363952
sim_compute_performance-ego0_mean0.00221577134929606
sim_compute_performance-ego0_median0.00221577134929606
sim_compute_performance-ego0_min0.002180397347228168
sim_compute_performance-npc0_max0.0020476651478962726
sim_compute_performance-npc0_mean0.0019885829030572236
sim_compute_performance-npc0_median0.0019885829030572236
sim_compute_performance-npc0_min0.0019295006582181749
sim_compute_performance-npc1_max0.002086616424192865
sim_compute_performance-npc1_mean0.0020853718075938775
sim_compute_performance-npc1_median0.0020853718075938775
sim_compute_performance-npc1_min0.00208412719099489
sim_compute_performance-npc2_max0.00208975125665534
sim_compute_performance-npc2_mean0.0020502968301944636
sim_compute_performance-npc2_median0.0020502968301944636
sim_compute_performance-npc2_min0.0020108424037335866
sim_compute_sim_state_max0.04363676438848656
sim_compute_sim_state_mean0.041860174227713126
sim_compute_sim_state_median0.041860174227713126
sim_compute_sim_state_min0.04008358406693968
sim_render-ego0_max0.004159551068960902
sim_render-ego0_mean0.004037030074910807
sim_render-ego0_median0.004037030074910807
sim_render-ego0_min0.003914509080860713
sim_render-npc0_max0.0038581009370734897
sim_render-npc0_mean0.003820848331177544
sim_render-npc0_median0.003820848331177544
sim_render-npc0_min0.0037835957252815976
sim_render-npc1_max0.003894012921477017
sim_render-npc1_mean0.003879302868966636
sim_render-npc1_median0.003879302868966636
sim_render-npc1_min0.003864592816456254
sim_render-npc2_max0.003924875390039731
sim_render-npc2_mean0.003841713258271407
sim_render-npc2_median0.003841713258271407
sim_render-npc2_min0.0037585511265030825
simulation-passed1
step_physics_max0.7557580959366028
step_physics_mean0.7373235420850976
step_physics_median0.7373235420850976
step_physics_min0.7188889882335924
survival_time_max18.200000000000124
survival_time_mean11.15000000000006
survival_time_min4.099999999999993
No reset possible
5340812565Bea Baselines 🐤straightaido5-LFI-full-sim-testingLFVIv-simsuccessyesnogpu-prod-080:04:30
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.621882608807794
survival_time_median11.375000000000028
deviation-center-line_median0.49572588831599385
in-drivable-lane_median6.400000000000036


other stats
agent_compute-ego0_max0.011112185624929575
agent_compute-ego0_mean0.010705349835168496
agent_compute-ego0_median0.010705349835168496
agent_compute-ego0_min0.01029851404540742
complete-iteration_max0.21724083892300597
complete-iteration_mean0.2043088571286312
complete-iteration_median0.2043088571286312
complete-iteration_min0.19137687533425643
deviation-center-line_max0.6702797201467701
deviation-center-line_mean0.49572588831599385
deviation-center-line_min0.3211720564852176
deviation-heading_max2.537022110462463
deviation-heading_mean2.4150494970903633
deviation-heading_median2.4150494970903633
deviation-heading_min2.293076883718264
driven_any_max1.7598441791834574
driven_any_mean1.7096148384926255
driven_any_median1.7096148384926255
driven_any_min1.6593854978017943
driven_lanedir_consec_max0.8696473510010638
driven_lanedir_consec_mean0.621882608807794
driven_lanedir_consec_min0.3741178666145242
driven_lanedir_max0.8790926140769271
driven_lanedir_mean0.6266052403457256
driven_lanedir_median0.6266052403457256
driven_lanedir_min0.3741178666145242
get_duckie_state_max2.54109374478332e-06
get_duckie_state_mean2.185732090826357e-06
get_duckie_state_median2.185732090826357e-06
get_duckie_state_min1.8303704368693944e-06
get_robot_state_max0.003920841420817579
get_robot_state_mean0.0037341186233690983
get_robot_state_median0.0037341186233690983
get_robot_state_min0.003547395825920618
get_state_dump_max0.005239015970474634
get_state_dump_mean0.004909654753063141
get_state_dump_median0.004909654753063141
get_state_dump_min0.004580293535651647
get_ui_image_max0.03843996565566104
get_ui_image_mean0.03692512612770309
get_ui_image_median0.03692512612770309
get_ui_image_min0.03541028659974513
in-drivable-lane_max8.200000000000035
in-drivable-lane_mean6.400000000000036
in-drivable-lane_min4.600000000000038
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 1.6593854978017943, "get_ui_image": 0.03541028659974513, "step_physics": 0.11909085645803956, "survival_time": 11.100000000000025, "driven_lanedir": 0.8790926140769271, "get_state_dump": 0.004580293535651647, "get_robot_state": 0.003547395825920618, "sim_render-ego0": 0.0035862377406235767, "get_duckie_state": 1.8303704368693944e-06, "in-drivable-lane": 4.600000000000038, "deviation-heading": 2.537022110462463, "agent_compute-ego0": 0.01029851404540742, "complete-iteration": 0.19137687533425643, "set_robot_commands": 0.0021068675635641464, "deviation-center-line": 0.6702797201467701, "driven_lanedir_consec": 0.8696473510010638, "sim_compute_sim_state": 0.010725022431446298, "sim_compute_performance-ego0": 0.0019411452682563544}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7598441791834574, "get_ui_image": 0.03843996565566104, "step_physics": 0.13927926467015192, "survival_time": 11.65000000000003, "driven_lanedir": 0.3741178666145242, "get_state_dump": 0.005239015970474634, "get_robot_state": 0.003920841420817579, "sim_render-ego0": 0.004006650712754991, "get_duckie_state": 2.54109374478332e-06, "in-drivable-lane": 8.200000000000035, "deviation-heading": 2.293076883718264, "agent_compute-ego0": 0.011112185624929575, "complete-iteration": 0.21724083892300597, "set_robot_commands": 0.002368650884709806, "deviation-center-line": 0.3211720564852176, "driven_lanedir_consec": 0.3741178666145242, "sim_compute_sim_state": 0.010525722788949298, "sim_compute_performance-ego0": 0.0022461210560594867}}
set_robot_commands_max0.002368650884709806
set_robot_commands_mean0.0022377592241369765
set_robot_commands_median0.0022377592241369765
set_robot_commands_min0.0021068675635641464
sim_compute_performance-ego0_max0.0022461210560594867
sim_compute_performance-ego0_mean0.0020936331621579205
sim_compute_performance-ego0_median0.0020936331621579205
sim_compute_performance-ego0_min0.0019411452682563544
sim_compute_sim_state_max0.010725022431446298
sim_compute_sim_state_mean0.010625372610197798
sim_compute_sim_state_median0.010625372610197798
sim_compute_sim_state_min0.010525722788949298
sim_render-ego0_max0.004006650712754991
sim_render-ego0_mean0.003796444226689284
sim_render-ego0_median0.003796444226689284
sim_render-ego0_min0.0035862377406235767
simulation-passed1
step_physics_max0.13927926467015192
step_physics_mean0.12918506056409573
step_physics_median0.12918506056409573
step_physics_min0.11909085645803956
survival_time_max11.65000000000003
survival_time_mean11.375000000000028
survival_time_min11.100000000000025
No reset possible
5339912568Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simabortednonogpu-prod-080:00:42
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5338312571Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simabortednonogpu-prod-080:45:15
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5333712576Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simabortednonogpu-prod-080:10:05
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5332312545Bea Baselines 🐤template-rosaido5-LFVI-sim-validationLFVIv-simabortednonogpu-prod-080:09:17
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5329112483Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simabortednonogpu-prod-080:19:51
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5327612547Bea Baselines 🐤template-rosaido5-LFVI_multi-sim-validationLFVIv-simabortednonogpu-prod-080:00:52
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5326112544Bea Baselines 🐤template-rosaido5-LFV-sim-testingLFVv-simabortednonogpu-prod-080:00:52
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5325112547Bea Baselines 🐤template-rosaido5-LFVI_multi-sim-validationLFVIv-simabortednonogpu-prod-080:01:50
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5324112477Bea Baselines 🐤straightaido5-LFP-sim-testingLFP-simerrornonogpu-prod-080:04:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140227908565984
- M:video_aido:cmdline(in:/;out:/) 140227908565408
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5322312482Bea Baselines 🐤straightaido5-LFI-full-sim-validationLFVIv-simerrornonogpu-prod-080:02:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140181505158928
- M:video_aido:cmdline(in:/;out:/) 140181505501936
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5320012482Bea Baselines 🐤straightaido5-LFI-full-sim-validationLFVIv-simerrornonogpu-prod-080:02:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140487642911312
- M:video_aido:cmdline(in:/;out:/) 140487642911696
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5317211764Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-080:11:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139951400480048
- M:video_aido:cmdline(in:/;out:/) 139951400496048
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5313311868Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-080:09:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139991881345536
- M:video_aido:cmdline(in:/;out:/) 139991881304144
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5311911775Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-080:04:23
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139965527695216
- M:video_aido:cmdline(in:/;out:/) 139965527694736
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5309712339Bea Baselines 🐤template-rosaido5-LFV-sim-validationLFVv-simerrornonogpu-prod-080:02:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139878756338320
- M:video_aido:cmdline(in:/;out:/) 139878756492480
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5307912346Bea Baselines 🐤template-rosaido5-LFI-sim-testingLFVIv-simerrornonogpu-prod-080:02:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139919932640368
- M:video_aido:cmdline(in:/;out:/) 139919932641136
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5306112347Bea Baselines 🐤template-rosaido5-LFI-full-sim-validationLFVIv-simhost-errornonogpu-prod-080:01:53
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5304312383Bea Baselines 🐤baseline-duckietownaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:09:16
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140596145984080
- M:video_aido:cmdline(in:/;out:/) 140595812458256
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5303412385Bea Baselines 🐤baseline-duckietownaido5-LFI-full-sim-testingLFVIv-simerrornonogpu-prod-080:06:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139922902072480
- M:video_aido:cmdline(in:/;out:/) 139922902072000
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5303012387Bea Baselines 🐤baseline-duckietownaido5-LFP-sim-testingLFP-simerrornonogpu-prod-080:08:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140245507364128
- M:video_aido:cmdline(in:/;out:/) 140244396054896
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5301012391Bea Baselines 🐤baseline-duckietownaido5-LFI-sim-testingLFVIv-simerrornonogpu-prod-080:10:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139959835068400
- M:video_aido:cmdline(in:/;out:/) 139959835066720
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5298812395Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-validationLFVIv-simerrornonogpu-prod-080:07:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140532387250384
- M:video_aido:cmdline(in:/;out:/) 140532387251056
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5297512401Bea Baselines 🐤template-randomaido5-LFI-full-sim-testingLFVIv-simerrornonogpu-prod-080:01:34
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140344610919760
- M:video_aido:cmdline(in:/;out:/) 140344610919664
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5296012406Bea Baselines 🐤template-randomaido5-LFI-sim-validationLFVIv-simerrornonogpu-prod-080:01:38
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140063607162624
- M:video_aido:cmdline(in:/;out:/) 140063607177856
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5294912408Bea Baselines 🐤template-randomaido5-LFI-full-sim-validationLFVIv-simhost-errornonogpu-prod-080:01:33
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5293112410Bea Baselines 🐤template-randomaido5-LFV-sim-testingLFVv-simerrornonogpu-prod-080:01:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139931877169088
- M:video_aido:cmdline(in:/;out:/) 139931876924576
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5291312413Bea Baselines 🐤template-randomaido5-LFVI_multi-sim-validationLFVIv-simerrornonogpu-prod-080:03:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140672366027968
- M:video_aido:cmdline(in:/;out:/) 140672366029504
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5289912441Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-080:02:01
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139861614505744
- M:video_aido:cmdline(in:/;out:/) 139861615006048
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5288612441Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-080:02:07
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140272229580752
- M:video_aido:cmdline(in:/;out:/) 140272230305504
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5287612437Bea Baselines 🐤straightaido5-LFI-full-sim-validationLFVIv-simerrornonogpu-prod-080:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139752806261328
- M:video_aido:cmdline(in:/;out:/) 139752806261520
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5286112438Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simerrornonogpu-prod-080:00:58
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139831263650096
- M:video_aido:cmdline(in:/;out:/) 139831263740640
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5284512429Bea Baselines 🐤straightaido5-LFV-sim-validationLFVv-simabortednonogpu-prod-080:00:36
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5283212438Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simabortednonogpu-prod-080:00:52
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5281512439Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simerrornonogpu-prod-080:01:41
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140278215356768
- M:video_aido:cmdline(in:/;out:/) 140278215633216
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5279412411Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simhost-errornonogpu-prod-080:01:06
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5277912221Bea Baselines 🐤straightaido5-LFV_multi-sim-validationLFVmultibodyv-simabortednonogpu-prod-080:02:09
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5275012336Bea Baselines 🐤template-randomaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-080:03:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139688914798192
- M:video_aido:cmdline(in:/;out:/) 139688914799104
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5267411772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednonogpu-prod-080:00:23
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5267211772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednonogpu-prod-080:00:26
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
526486800Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simfailednonogpu-prod-080:00:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 39, in on_received_observations
              ||     jpg_data = data['camera']['jpg_data']
              || TypeError: 'Duckiebot1Observations' object is not subscriptable
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 474, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
              ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
              || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method ROSBaselineAgent.on_received_observations of <__main__.ROSBaselineAgent object at 0x7f5ea0ae53d0>>.
              || │       f: <bound method ROSBaselineAgent.on_received_observations of <__main__.ROSBaselineAgent object at 0x7f5ea0ae53d0>>
              || │    args: dict[2]
              || │          │ data:
              || │          │ Duckiebot1Observations
              || │          │ │ camera: JPGImage(jpg_data=72685 bytes b'\xff\xd8\xff\xe0\x00\x10JFIF')
              || │          │ context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f5e8422afa0>
              || │ argspec: <class 'inspect.FullArgSpec'>[7]
              || │          #0 [self, context, data]
              || │          #1 None
              || │          #2 None
              || │          #3 None
              || │          #4 []
              || │          #5 None
              || │          #6 dict[2]
              || │             │ context: <class 'zuper_nodes_wrapper.interface.Context'>
              || │             │ data:
              || │             │ dataclass aido_schemas.schemas.Duckiebot1Observations
              || │             │  field  camera : dataclass aido_schemas.protocol_simulator.JPGImage
              || │             │                   field jpg_data : bytes
              || │             │                          __doc__
              || │             │                                            An image in JPG format.
              || │             │
              || │             │                                            jpg_data
              || │             │        __doc__   Duckiebot1Observations(camera: aido_schemas.protoc
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525626813Anthony Courchesne 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:10:17
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140093720848032
- M:video_aido:cmdline(in:/;out:/) 140093721313088
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524946834Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:11:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140637363468608
- M:video_aido:cmdline(in:/;out:/) 140637363493616
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524199315Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:10:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140407002982576
- M:video_aido:cmdline(in:/;out:/) 140407002983536
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
523779272Liam Paull 🇨🇦template-rosaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:02:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139665676225840
- M:video_aido:cmdline(in:/;out:/) 139665676223200
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
522549362Philippe Reddy 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:11:11
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139863040808176
- M:video_aido:cmdline(in:/;out:/) 139863040809328
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
521759379Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:06:20
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139987403331040
- M:video_aido:cmdline(in:/;out:/) 139987403330848
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5211510014Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-080:08:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139724604575696
- M:video_aido:cmdline(in:/;out:/) 139724604612912
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5206210028Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-080:09:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140269657694512
- M:video_aido:cmdline(in:/;out:/) 140269657698016
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5196110052Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:11:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139672687170512
- M:video_aido:cmdline(in:/;out:/) 139672687171808
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5191210069Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:03:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140590858337536
- M:video_aido:cmdline(in:/;out:/) 140590858338256
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5182710773Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:06:04
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140110079737968
- M:video_aido:cmdline(in:/;out:/) 140110079739792
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5176110754Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-080:04:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 33 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5171010788Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-080:05:04
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 357 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5166310790Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-080:03:50
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5161810818Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:03:22
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139953721846368
- M:video_aido:cmdline(in:/;out:/) 139953721844496
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5156910829Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-080:04:27
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 25 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5153410860Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-080:02:17
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5149010864Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:04:18
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140595104545280
- M:video_aido:cmdline(in:/;out:/) 140595104545808
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5143310865Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-080:05:01
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 58 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5139110879Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-080:04:00
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140368505662384
- M:video_aido:cmdline(in:/;out:/) 140368505661520
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5123610914Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simtimeoutnonogpu-prod-080:16:23
Timeout because eval [...]
Timeout because evaluator contacted us
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5122410933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednonogpu-prod-080:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5120710922Moustafa Elarabichallenge-aido_LF-template-pytorchaido5-LF-sim-validationLFv-simfailednonogpu-prod-080:02:02
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.