Duckietown Challenges Home Challenges Submissions

Evaluator 4769

ID4769
evaluatornogpu-prod-08
ownerI don't have one 😀
machinenogpu-prod_d45f05e64dc1
processnogpu-prod-08_d45f05e64dc1
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success48 53408
# timeout4 50033
# failed23 48735
# error81 47664
# aborted26 47302
# host-error49 47781
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5785410794Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:44:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013908347122675175
agent_compute-ego0_mean0.012964559286262074
agent_compute-ego0_median0.013117351400961388
agent_compute-ego0_min0.011715187220450346
complete-iteration_max0.35813440589682444
complete-iteration_mean0.3045175008035321
complete-iteration_median0.30358592933858064
complete-iteration_min0.25276373864014284
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max2.5255296946961515e-06
get_duckie_state_mean2.3874116876937267e-06
get_duckie_state_median2.385476149686866e-06
get_duckie_state_min2.2531647567050244e-06
get_robot_state_max0.00420236885299492
get_robot_state_mean0.004085590896955834
get_robot_state_median0.004081335889608239
get_robot_state_min0.003977322955611941
get_state_dump_max0.005219134561822972
get_state_dump_mean0.005085202130945795
get_state_dump_median0.005098878394356378
get_state_dump_min0.004923917173247453
get_ui_image_max0.03613139032622757
get_ui_image_mean0.03101805559701467
get_ui_image_median0.03055465400070076
get_ui_image_min0.02683152406042958
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02808477062666843, "step_physics": 0.2095268830768671, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004923917173247453, "get_robot_state": 0.003977322955611941, "sim_render-ego0": 0.004086050760934593, "get_duckie_state": 2.3153004896432335e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.011715187220450346, "complete-iteration": 0.27573012491745513, "set_robot_commands": 0.0023854878621732663, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00871142042765113, "sim_compute_performance-ego0": 0.002219599549915272}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03613139032622757, "step_physics": 0.27819473777186565, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.005018645778087454, "get_robot_state": 0.003981375475906512, "sim_render-ego0": 0.0041777855351405975, "get_duckie_state": 2.2531647567050244e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.013908347122675175, "complete-iteration": 0.35813440589682444, "set_robot_commands": 0.0023264126614865217, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012099291859419518, "sim_compute_performance-ego0": 0.002197409152587586}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03302453737473309, "step_physics": 0.2572600795863372, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005219134561822972, "get_robot_state": 0.004181296303309966, "sim_render-ego0": 0.004252097291017353, "get_duckie_state": 2.5255296946961515e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.012855546460560616, "complete-iteration": 0.33144173375970615, "set_robot_commands": 0.002364673781255997, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009817986762295356, "sim_compute_performance-ego0": 0.002354263763046582}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02683152406042958, "step_physics": 0.18735174195752552, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.005179111010625301, "get_robot_state": 0.00420236885299492, "sim_render-ego0": 0.004237835651432644, "get_duckie_state": 2.455651809730498e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.01337915634136216, "complete-iteration": 0.25276373864014284, "set_robot_commands": 0.0025348766558771826, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006639568930760112, "sim_compute_performance-ego0": 0.0023029773658161654}}
set_robot_commands_max0.0025348766558771826
set_robot_commands_mean0.0024028627401982416
set_robot_commands_median0.0023750808217146316
set_robot_commands_min0.0023264126614865217
sim_compute_performance-ego0_max0.002354263763046582
sim_compute_performance-ego0_mean0.0022685624578414015
sim_compute_performance-ego0_median0.0022612884578657186
sim_compute_performance-ego0_min0.002197409152587586
sim_compute_sim_state_max0.012099291859419518
sim_compute_sim_state_mean0.00931706699503153
sim_compute_sim_state_median0.009264703594973243
sim_compute_sim_state_min0.006639568930760112
sim_render-ego0_max0.004252097291017353
sim_render-ego0_mean0.004188442309631297
sim_render-ego0_median0.0042078105932866205
sim_render-ego0_min0.004086050760934593
simulation-passed1
step_physics_max0.27819473777186565
step_physics_mean0.23308336059814888
step_physics_median0.23339348133160215
step_physics_min0.18735174195752552
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5784510796Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:03:38
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 40 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5781310820Raphael Jeanexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:18:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9694829458007383
survival_time_median23.925000000000203
deviation-center-line_median0.5410031314447561
in-drivable-lane_median10.57500000000015


other stats
agent_compute-ego0_max0.015054659718855544
agent_compute-ego0_mean0.013504151719826324
agent_compute-ego0_median0.01305526522634852
agent_compute-ego0_min0.012851416707752708
complete-iteration_max0.22127805129932396
complete-iteration_mean0.19638832903655673
complete-iteration_median0.1974337989043477
complete-iteration_min0.16940766703820753
deviation-center-line_max0.7554140148617973
deviation-center-line_mean0.5741356077533533
deviation-center-line_min0.45912215326210354
deviation-heading_max4.037753436258284
deviation-heading_mean2.968381009323913
deviation-heading_median2.903509508417738
deviation-heading_min2.0287515842018915
driven_any_max9.26725018069169
driven_any_mean5.070231000926355
driven_any_median3.819036468650274
driven_any_min3.3756008857131827
driven_lanedir_consec_max2.421514165143505
driven_lanedir_consec_mean2.025677831263189
driven_lanedir_consec_min1.7422312683077736
driven_lanedir_max2.4219667095443707
driven_lanedir_mean2.0257909673634056
driven_lanedir_median1.9694829458007383
driven_lanedir_min1.7422312683077736
get_duckie_state_max1.7470815119437537e-06
get_duckie_state_mean1.43376444049083e-06
get_duckie_state_median1.3513511470602658e-06
get_duckie_state_min1.2852739558990345e-06
get_robot_state_max0.004447004291054189
get_robot_state_mean0.003947648911186745
get_robot_state_median0.003841250361791048
get_robot_state_min0.003661090630110695
get_state_dump_max0.005451836665282623
get_state_dump_mean0.004934872836666597
get_state_dump_median0.004797406427928445
get_state_dump_min0.004692841825526875
get_ui_image_max0.03614976004013823
get_ui_image_mean0.03180328537305438
get_ui_image_median0.03243910149044833
get_ui_image_min0.026185178471182635
in-drivable-lane_max38.74999999999919
in-drivable-lane_mean17.212499999999903
in-drivable-lane_min8.950000000000127
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.26725018069169, "get_ui_image": 0.02878517983481288, "step_physics": 0.1084380156826228, "survival_time": 51.14999999999923, "driven_lanedir": 2.060902918476801, "get_state_dump": 0.004884242312982678, "get_robot_state": 0.00398256559856236, "sim_render-ego0": 0.004178374772891402, "get_duckie_state": 1.3478565961122513e-06, "in-drivable-lane": 38.74999999999919, "deviation-heading": 2.0287515842018915, "agent_compute-ego0": 0.01308295875787735, "complete-iteration": 0.17742721596732736, "set_robot_commands": 0.00233777635730803, "deviation-center-line": 0.46200895121803787, "driven_lanedir_consec": 2.060902918476801, "sim_compute_sim_state": 0.009388593025505544, "sim_compute_performance-ego0": 0.002255102386698127}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.3756008857131827, "get_ui_image": 0.03609302314608378, "step_physics": 0.14006482721936755, "survival_time": 22.85000000000019, "driven_lanedir": 1.8780629731246763, "get_state_dump": 0.004692841825526875, "get_robot_state": 0.003661090630110695, "sim_render-ego0": 0.0038539863569767713, "get_duckie_state": 1.2852739558990345e-06, "in-drivable-lane": 8.950000000000127, "deviation-heading": 3.4536283244492516, "agent_compute-ego0": 0.013027571694819688, "complete-iteration": 0.217440381841368, "set_robot_commands": 0.0021674445622873097, "deviation-center-line": 0.7554140148617973, "driven_lanedir_consec": 1.8780629731246763, "sim_compute_sim_state": 0.011805603597882531, "sim_compute_performance-ego0": 0.001984732119797619}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.645523685866236, "get_ui_image": 0.03614976004013823, "step_physics": 0.1377480896521634, "survival_time": 21.000000000000163, "driven_lanedir": 1.7422312683077736, "get_state_dump": 0.005451836665282623, "get_robot_state": 0.004447004291054189, "sim_render-ego0": 0.004645771765085977, "get_duckie_state": 1.7470815119437537e-06, "in-drivable-lane": 11.100000000000158, "deviation-heading": 2.3533906923862244, "agent_compute-ego0": 0.015054659718855544, "complete-iteration": 0.22127805129932396, "set_robot_commands": 0.0026293769301824503, "deviation-center-line": 0.45912215326210354, "driven_lanedir_consec": 1.7422312683077736, "sim_compute_sim_state": 0.012575145005613495, "sim_compute_performance-ego0": 0.002462054091791076}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.9925492514343106, "get_ui_image": 0.026185178471182635, "step_physics": 0.10734708247308485, "survival_time": 25.00000000000022, "driven_lanedir": 2.4219667095443707, "get_state_dump": 0.0047105705428742125, "get_robot_state": 0.003699935125019736, "sim_render-ego0": 0.003893436785943494, "get_duckie_state": 1.3548456980082805e-06, "in-drivable-lane": 10.050000000000145, "deviation-heading": 4.037753436258284, "agent_compute-ego0": 0.012851416707752708, "complete-iteration": 0.16940766703820753, "set_robot_commands": 0.0022283547414753014, "deviation-center-line": 0.6199973116714743, "driven_lanedir_consec": 2.421514165143505, "sim_compute_sim_state": 0.006393719576076119, "sim_compute_performance-ego0": 0.002006650684836382}}
set_robot_commands_max0.0026293769301824503
set_robot_commands_mean0.002340738147813273
set_robot_commands_median0.0022830655493916658
set_robot_commands_min0.0021674445622873097
sim_compute_performance-ego0_max0.002462054091791076
sim_compute_performance-ego0_mean0.0021771348207808012
sim_compute_performance-ego0_median0.002130876535767254
sim_compute_performance-ego0_min0.001984732119797619
sim_compute_sim_state_max0.012575145005613495
sim_compute_sim_state_mean0.01004076530126942
sim_compute_sim_state_median0.010597098311694038
sim_compute_sim_state_min0.006393719576076119
sim_render-ego0_max0.004645771765085977
sim_render-ego0_mean0.004142892420224411
sim_render-ego0_median0.004035905779417448
sim_render-ego0_min0.0038539863569767713
simulation-passed1
step_physics_max0.14006482721936755
step_physics_mean0.12339950375680964
step_physics_median0.1230930526673931
step_physics_min0.10734708247308485
survival_time_max51.14999999999923
survival_time_mean29.99999999999995
survival_time_min21.000000000000163
No reset possible
5779610823Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:03:20
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 16 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5778710826Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:03:16
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 20 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5778310829Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:03:16
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5778010833Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:03:23
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5776810840Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:09:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.36273150777360785
survival_time_median14.275000000000068
deviation-center-line_median0.22488843822646104
in-drivable-lane_median11.875000000000057


other stats
agent_compute-ego0_max0.04983267301245581
agent_compute-ego0_mean0.03703559257585698
agent_compute-ego0_median0.04257616738897463
agent_compute-ego0_min0.013157362513022849
complete-iteration_max0.2411623997024343
complete-iteration_mean0.2030641813011888
complete-iteration_median0.1915104001580043
complete-iteration_min0.1880735251863124
deviation-center-line_max0.36308775180279845
deviation-center-line_mean0.22500020119176192
deviation-center-line_min0.08713617651132724
deviation-heading_max3.24705292501494
deviation-heading_mean1.5833854437979724
deviation-heading_median1.2552508491492804
deviation-heading_min0.5759871518783894
driven_any_max5.054445952561518
driven_any_mean2.8008087789706595
driven_any_median2.7746060208417713
driven_any_min0.5995771216375776
driven_lanedir_consec_max0.550223023910506
driven_lanedir_consec_mean0.36109689134607575
driven_lanedir_consec_min0.1687015259265814
driven_lanedir_max0.5550844804145785
driven_lanedir_mean0.3623122554720939
driven_lanedir_median0.36273150777360785
driven_lanedir_min0.1687015259265814
get_duckie_state_max2.158514343866027e-06
get_duckie_state_mean2.0646011760107405e-06
get_duckie_state_median2.096270863682217e-06
get_duckie_state_min1.9073486328125e-06
get_robot_state_max0.003950077472346844
get_robot_state_mean0.00372098370866921
get_robot_state_median0.0036990820787371897
get_robot_state_min0.003535693204855617
get_state_dump_max0.005064948938660703
get_state_dump_mean0.004812387418507537
get_state_dump_median0.004761775909382713
get_state_dump_min0.004661048916604021
get_ui_image_max0.03390090375006953
get_ui_image_mean0.03034885036988772
get_ui_image_median0.030703479892796648
get_ui_image_min0.026087537943888052
in-drivable-lane_max20.650000000000187
in-drivable-lane_mean11.737500000000074
in-drivable-lane_min2.5499999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.863722906810014, "get_ui_image": 0.02890063786910752, "step_physics": 0.09530105752460027, "survival_time": 14.700000000000074, "driven_lanedir": 0.4422579313867307, "get_state_dump": 0.005064948938660703, "get_robot_state": 0.003751620599779032, "sim_render-ego0": 0.003954477633460093, "get_duckie_state": 2.095658900374073e-06, "in-drivable-lane": 11.700000000000047, "deviation-heading": 1.7033728894623843, "agent_compute-ego0": 0.03636052487260205, "complete-iteration": 0.1880735251863124, "set_robot_commands": 0.0022919759912005924, "deviation-center-line": 0.32678326213046266, "driven_lanedir_consec": 0.4422579313867307, "sim_compute_sim_state": 0.010263340351945262, "sim_compute_performance-ego0": 0.0020931704569671114}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.5995771216375776, "get_ui_image": 0.03390090375006953, "step_physics": 0.13164374194567716, "survival_time": 3.899999999999994, "driven_lanedir": 0.1687015259265814, "get_state_dump": 0.004724064959755427, "get_robot_state": 0.003535693204855617, "sim_render-ego0": 0.0037121621868278407, "get_duckie_state": 1.9073486328125e-06, "in-drivable-lane": 2.5499999999999936, "deviation-heading": 0.8071288088361763, "agent_compute-ego0": 0.04983267301245581, "complete-iteration": 0.2411623997024343, "set_robot_commands": 0.002263714995565294, "deviation-center-line": 0.08713617651132724, "driven_lanedir_consec": 0.1687015259265814, "sim_compute_sim_state": 0.00953490522843373, "sim_compute_performance-ego0": 0.0019278013253513772}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.054445952561518, "get_ui_image": 0.032506321916485774, "step_physics": 0.113553788874409, "survival_time": 25.200000000000223, "driven_lanedir": 0.5550844804145785, "get_state_dump": 0.004799486859009998, "get_robot_state": 0.003950077472346844, "sim_render-ego0": 0.004067738221423461, "get_duckie_state": 2.158514343866027e-06, "in-drivable-lane": 20.650000000000187, "deviation-heading": 3.24705292501494, "agent_compute-ego0": 0.013157362513022849, "complete-iteration": 0.18872085373000344, "set_robot_commands": 0.0023933382317571357, "deviation-center-line": 0.36308775180279845, "driven_lanedir_consec": 0.550223023910506, "sim_compute_sim_state": 0.012074356267947962, "sim_compute_performance-ego0": 0.0021216996825567567}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.685489134873529, "get_ui_image": 0.026087537943888052, "step_physics": 0.0972849928217826, "survival_time": 13.850000000000062, "driven_lanedir": 0.28320508416048495, "get_state_dump": 0.004661048916604021, "get_robot_state": 0.003646543557695348, "sim_render-ego0": 0.003884589929374859, "get_duckie_state": 2.096882826990361e-06, "in-drivable-lane": 12.05000000000006, "deviation-heading": 0.5759871518783894, "agent_compute-ego0": 0.048791809905347205, "complete-iteration": 0.1942999465860051, "set_robot_commands": 0.002309417553085217, "deviation-center-line": 0.1229936143224594, "driven_lanedir_consec": 0.28320508416048495, "sim_compute_sim_state": 0.005566269373722213, "sim_compute_performance-ego0": 0.001978236136676596}}
set_robot_commands_max0.0023933382317571357
set_robot_commands_mean0.00231461169290206
set_robot_commands_median0.002300696772142905
set_robot_commands_min0.002263714995565294
sim_compute_performance-ego0_max0.0021216996825567567
sim_compute_performance-ego0_mean0.0020302269003879604
sim_compute_performance-ego0_median0.002035703296821854
sim_compute_performance-ego0_min0.0019278013253513772
sim_compute_sim_state_max0.012074356267947962
sim_compute_sim_state_mean0.00935971780551229
sim_compute_sim_state_median0.009899122790189495
sim_compute_sim_state_min0.005566269373722213
sim_render-ego0_max0.004067738221423461
sim_render-ego0_mean0.003904741992771563
sim_render-ego0_median0.003919533781417476
sim_render-ego0_min0.0037121621868278407
simulation-passed1
step_physics_max0.13164374194567716
step_physics_mean0.10944589529161725
step_physics_median0.1054193908480958
step_physics_min0.09530105752460027
survival_time_max25.200000000000223
survival_time_mean14.412500000000088
survival_time_min3.899999999999994
No reset possible
5773910854Dishank Bansal 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:18:54
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5194537691895438
survival_time_median33.55000000000022
deviation-center-line_median0.5943697216524126
in-drivable-lane_median15.500000000000089


other stats
agent_compute-ego0_max0.013868615325068084
agent_compute-ego0_mean0.013307605717005276
agent_compute-ego0_median0.01317758689220405
agent_compute-ego0_min0.01300663375854492
complete-iteration_max0.22514106591542565
complete-iteration_mean0.19550263054938477
complete-iteration_median0.20159220593356192
complete-iteration_min0.1536850444149896
deviation-center-line_max1.6876447165363646
deviation-center-line_mean0.7706330936869933
deviation-center-line_min0.20614821490678303
deviation-heading_max6.622767671305553
deviation-heading_mean3.8008193095731624
deviation-heading_median3.882856406141939
deviation-heading_min0.8147967547032164
driven_any_max6.360687891500069
driven_any_mean5.061462327612774
driven_any_median5.6751350322758025
driven_any_min2.53489135439942
driven_lanedir_consec_max5.640548854749638
driven_lanedir_consec_mean2.3476974540243996
driven_lanedir_consec_min0.7113334229688717
driven_lanedir_max5.640548854749638
driven_lanedir_mean2.365151128352417
driven_lanedir_median1.5543611178455796
driven_lanedir_min0.7113334229688717
get_duckie_state_max1.762708028157552e-06
get_duckie_state_mean1.636105626178633e-06
get_duckie_state_median1.63043629127076e-06
get_duckie_state_min1.52084189401546e-06
get_robot_state_max0.00406731216000839
get_robot_state_mean0.003936390326915401
get_robot_state_median0.0039708314614418224
get_robot_state_min0.003736586224769568
get_state_dump_max0.005272598602832892
get_state_dump_mean0.0051280476745716175
get_state_dump_median0.005156455100422175
get_state_dump_min0.004926681894609228
get_ui_image_max0.03591840839385986
get_ui_image_mean0.03107013319969467
get_ui_image_median0.03164054070861386
get_ui_image_min0.02508104298769111
in-drivable-lane_max27.650000000000087
in-drivable-lane_mean15.100000000000072
in-drivable-lane_min1.7500000000000249
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.53489135439942, "get_ui_image": 0.029632798372170865, "step_physics": 0.12139778488721605, "survival_time": 15.550000000000086, "driven_lanedir": 2.294322651815086, "get_state_dump": 0.005272598602832892, "get_robot_state": 0.004060233250642434, "sim_render-ego0": 0.00419653608248784, "get_duckie_state": 1.723185563698793e-06, "in-drivable-lane": 1.7500000000000249, "deviation-heading": 2.469157109886499, "agent_compute-ego0": 0.013231379099381275, "complete-iteration": 0.1931807299455007, "set_robot_commands": 0.0024162171742854975, "deviation-center-line": 0.6546034593058261, "driven_lanedir_consec": 2.294322651815086, "sim_compute_sim_state": 0.01057974344644791, "sim_compute_performance-ego0": 0.002283356892756927}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.360687891500069, "get_ui_image": 0.03591840839385986, "step_physics": 0.1463206040064494, "survival_time": 37.45000000000001, "driven_lanedir": 5.640548854749638, "get_state_dump": 0.0050588598251342775, "get_robot_state": 0.003881429672241211, "sim_render-ego0": 0.004124044418334961, "get_duckie_state": 1.762708028157552e-06, "in-drivable-lane": 3.899999999999853, "deviation-heading": 6.622767671305553, "agent_compute-ego0": 0.01300663375854492, "complete-iteration": 0.22514106591542565, "set_robot_commands": 0.0023411070505777996, "deviation-center-line": 1.6876447165363646, "driven_lanedir_consec": 5.640548854749638, "sim_compute_sim_state": 0.012197839736938476, "sim_compute_performance-ego0": 0.002181396802266439}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.002676161280174, "get_ui_image": 0.03364828304505684, "step_physics": 0.1333158362079674, "survival_time": 35.450000000000124, "driven_lanedir": 0.814399583876073, "get_state_dump": 0.005254050375710071, "get_robot_state": 0.00406731216000839, "sim_render-ego0": 0.0043405898859803105, "get_duckie_state": 1.52084189401546e-06, "in-drivable-lane": 27.650000000000087, "deviation-heading": 5.29655570239738, "agent_compute-ego0": 0.013868615325068084, "complete-iteration": 0.2100036819216231, "set_robot_commands": 0.0024648622727729903, "deviation-center-line": 0.5341359839989991, "driven_lanedir_consec": 0.7445848865640013, "sim_compute_sim_state": 0.010651876892842038, "sim_compute_performance-ego0": 0.002286855603607607}, "LF-norm-small_loop-000-ego0": {"driven_any": 5.347593903271432, "get_ui_image": 0.02508104298769111, "step_physics": 0.09202215912214214, "survival_time": 31.650000000000315, "driven_lanedir": 0.7113334229688717, "get_state_dump": 0.004926681894609228, "get_robot_state": 0.003736586224769568, "sim_render-ego0": 0.003979855155343137, "get_duckie_state": 1.5376870188427273e-06, "in-drivable-lane": 27.10000000000032, "deviation-heading": 0.8147967547032164, "agent_compute-ego0": 0.013123794685026825, "complete-iteration": 0.1536850444149896, "set_robot_commands": 0.0022718315996958253, "deviation-center-line": 0.20614821490678303, "driven_lanedir_consec": 0.7113334229688717, "sim_compute_sim_state": 0.006350917018926482, "sim_compute_performance-ego0": 0.0020877604228841016}}
set_robot_commands_max0.0024648622727729903
set_robot_commands_mean0.002373504524333028
set_robot_commands_median0.0023786621124316483
set_robot_commands_min0.0022718315996958253
sim_compute_performance-ego0_max0.002286855603607607
sim_compute_performance-ego0_mean0.0022098424303787687
sim_compute_performance-ego0_median0.0022323768475116827
sim_compute_performance-ego0_min0.0020877604228841016
sim_compute_sim_state_max0.012197839736938476
sim_compute_sim_state_mean0.009945094273788728
sim_compute_sim_state_median0.010615810169644977
sim_compute_sim_state_min0.006350917018926482
sim_render-ego0_max0.0043405898859803105
sim_render-ego0_mean0.004160256385536562
sim_render-ego0_median0.0041602902504114005
sim_render-ego0_min0.003979855155343137
simulation-passed1
step_physics_max0.1463206040064494
step_physics_mean0.12326409605594375
step_physics_median0.12735681054759174
step_physics_min0.09202215912214214
survival_time_max37.45000000000001
survival_time_mean30.025000000000137
survival_time_min15.550000000000086
No reset possible
5772810859Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:13:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.5273948526900347
survival_time_median20.22500000000015
deviation-center-line_median0.3540010305085299
in-drivable-lane_median11.300000000000132


other stats
agent_compute-ego0_max0.05099265037044402
agent_compute-ego0_mean0.040300344203314006
agent_compute-ego0_median0.04830845983773074
agent_compute-ego0_min0.013591806767350535
complete-iteration_max0.2659061339593703
complete-iteration_mean0.2183188115898484
complete-iteration_median0.2040651084020878
complete-iteration_min0.1992388955958478
deviation-center-line_max1.5197923101395143
deviation-center-line_mean0.5838416668685458
deviation-center-line_min0.1075722963176089
deviation-heading_max5.73307750193262
deviation-heading_mean2.280114743833894
deviation-heading_median1.2572644224193672
deviation-heading_min0.8728526285642216
driven_any_max6.760613260394322
driven_any_mean3.5947169020619874
driven_any_median3.485720612781348
driven_any_min0.6468131222909315
driven_lanedir_consec_max3.451713185689859
driven_lanedir_consec_mean1.6716721842130693
driven_lanedir_consec_min0.1801858457823489
driven_lanedir_max3.451713185689859
driven_lanedir_mean1.6716721842130693
driven_lanedir_median1.5273948526900347
driven_lanedir_min0.1801858457823489
get_duckie_state_max1.6476003597555293e-06
get_duckie_state_mean1.567993756678287e-06
get_duckie_state_median1.5632048480222051e-06
get_duckie_state_min1.4979649709132068e-06
get_robot_state_max0.004090809915336201
get_robot_state_mean0.003931552550015731
get_robot_state_median0.003890250168970686
get_robot_state_min0.003854899946785353
get_state_dump_max0.005268017658198828
get_state_dump_mean0.00505675273843698
get_state_dump_median0.005019408599112088
get_state_dump_min0.004920176097324916
get_ui_image_max0.038653094281432446
get_ui_image_mean0.032739310586380424
get_ui_image_median0.031939045752826814
get_ui_image_min0.028426056558435612
in-drivable-lane_max17.299999999999798
in-drivable-lane_mean10.737500000000011
in-drivable-lane_min3.049999999999991
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.371470659509529, "get_ui_image": 0.029501196404337647, "step_physics": 0.09963103791117432, "survival_time": 25.10000000000022, "driven_lanedir": 2.2873882889245527, "get_state_dump": 0.005106795616225741, "get_robot_state": 0.003854899946785353, "sim_render-ego0": 0.004042625427246094, "get_duckie_state": 1.6476003597555293e-06, "in-drivable-lane": 12.00000000000017, "deviation-heading": 1.6155546557209632, "agent_compute-ego0": 0.0506573131022823, "complete-iteration": 0.20884557841549337, "set_robot_commands": 0.0027435261970959884, "deviation-center-line": 0.556389447991766, "driven_lanedir_consec": 2.2873882889245527, "sim_compute_sim_state": 0.01112922949061005, "sim_compute_performance-ego0": 0.002081678591476046}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6468131222909315, "get_ui_image": 0.038653094281432446, "step_physics": 0.14778996283008206, "survival_time": 4.599999999999992, "driven_lanedir": 0.1801858457823489, "get_state_dump": 0.0049320215819984355, "get_robot_state": 0.003924603103309549, "sim_render-ego0": 0.004024244123889554, "get_duckie_state": 1.5689480689264114e-06, "in-drivable-lane": 3.049999999999991, "deviation-heading": 0.8989741891177712, "agent_compute-ego0": 0.05099265037044402, "complete-iteration": 0.2659061339593703, "set_robot_commands": 0.0024667375831193823, "deviation-center-line": 0.1075722963176089, "driven_lanedir_consec": 0.1801858457823489, "sim_compute_sim_state": 0.010983403011034894, "sim_compute_performance-ego0": 0.0020446751707343643}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.760613260394322, "get_ui_image": 0.034376895101315974, "step_physics": 0.11873406537042291, "survival_time": 38.29999999999996, "driven_lanedir": 3.451713185689859, "get_state_dump": 0.005268017658198828, "get_robot_state": 0.004090809915336201, "sim_render-ego0": 0.004350536338975253, "get_duckie_state": 1.4979649709132068e-06, "in-drivable-lane": 17.299999999999798, "deviation-heading": 5.73307750193262, "agent_compute-ego0": 0.013591806767350535, "complete-iteration": 0.1992846383886822, "set_robot_commands": 0.00238995228783559, "deviation-center-line": 1.5197923101395143, "driven_lanedir_consec": 3.451713185689859, "sim_compute_sim_state": 0.014070993296636906, "sim_compute_performance-ego0": 0.002311806946099193}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.5999705660531665, "get_ui_image": 0.028426056558435612, "step_physics": 0.10169636196904368, "survival_time": 15.350000000000083, "driven_lanedir": 0.7674014164555167, "get_state_dump": 0.004920176097324916, "get_robot_state": 0.003855897234631823, "sim_render-ego0": 0.004018873363346248, "get_duckie_state": 1.5574616271179993e-06, "in-drivable-lane": 10.600000000000092, "deviation-heading": 0.8728526285642216, "agent_compute-ego0": 0.04595960657317917, "complete-iteration": 0.1992388955958478, "set_robot_commands": 0.0023439836192440675, "deviation-center-line": 0.1516126130252937, "driven_lanedir_consec": 0.7674014164555167, "sim_compute_sim_state": 0.005849222084144493, "sim_compute_performance-ego0": 0.0020731912030802144}}
set_robot_commands_max0.0027435261970959884
set_robot_commands_mean0.002486049921823757
set_robot_commands_median0.002428344935477486
set_robot_commands_min0.0023439836192440675
sim_compute_performance-ego0_max0.002311806946099193
sim_compute_performance-ego0_mean0.0021278379778474545
sim_compute_performance-ego0_median0.0020774348972781302
sim_compute_performance-ego0_min0.0020446751707343643
sim_compute_sim_state_max0.014070993296636906
sim_compute_sim_state_mean0.010508211970606586
sim_compute_sim_state_median0.011056316250822472
sim_compute_sim_state_min0.005849222084144493
sim_render-ego0_max0.004350536338975253
sim_render-ego0_mean0.004109069813364287
sim_render-ego0_median0.004033434775567824
sim_render-ego0_min0.004018873363346248
simulation-passed1
step_physics_max0.14778996283008206
step_physics_mean0.11696285702018074
step_physics_median0.1102152136697333
step_physics_min0.09963103791117432
survival_time_max38.29999999999996
survival_time_mean20.837500000000063
survival_time_min4.599999999999992
No reset possible
5770710872Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:06:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3880299303451338
survival_time_median8.349999999999993
deviation-center-line_median0.10717137130859086
in-drivable-lane_median6.224999999999994


other stats
agent_compute-ego0_max0.014044863278748558
agent_compute-ego0_mean0.012917936995437952
agent_compute-ego0_median0.01271332127354394
agent_compute-ego0_min0.012200242155915374
complete-iteration_max0.2295367956161499
complete-iteration_mean0.18858472816248664
complete-iteration_median0.17982775053920858
complete-iteration_min0.16514661595537947
deviation-center-line_max0.2590211685140501
deviation-center-line_mean0.13832437135092346
deviation-center-line_min0.07993357427246195
deviation-heading_max1.2178910040494402
deviation-heading_mean0.6876609288295099
deviation-heading_median0.5581353710374076
deviation-heading_min0.4164819691937842
driven_any_max3.0915348222982515
driven_any_mean1.962951903258524
driven_any_median2.043315260341421
driven_any_min0.6736422700530028
driven_lanedir_consec_max0.52293605867608
driven_lanedir_consec_mean0.3796816215794572
driven_lanedir_consec_min0.21973056695148108
driven_lanedir_max0.52293605867608
driven_lanedir_mean0.3796816215794572
driven_lanedir_median0.3880299303451338
driven_lanedir_min0.21973056695148108
get_duckie_state_max2.279182789856906e-06
get_duckie_state_mean2.128637648323151e-06
get_duckie_state_median2.103988124838478e-06
get_duckie_state_min2.0273915537587412e-06
get_robot_state_max0.004061370315947064
get_robot_state_mean0.0038958305811568105
get_robot_state_median0.003951038390989084
get_robot_state_min0.003619875226702009
get_state_dump_max0.00510765685409796
get_state_dump_mean0.004977064487879554
get_state_dump_median0.004981491271039404
get_state_dump_min0.004837618555341448
get_ui_image_max0.0347438028880528
get_ui_image_mean0.031116970231322143
get_ui_image_median0.0313964394383733
get_ui_image_min0.02693119916048917
in-drivable-lane_max10.250000000000036
in-drivable-lane_mean6.225000000000005
in-drivable-lane_min2.1999999999999953
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.3927253969986526, "get_ui_image": 0.029495908806361062, "step_physics": 0.10871572321560716, "survival_time": 9.6, "driven_lanedir": 0.52293605867608, "get_state_dump": 0.005053290431363595, "get_robot_state": 0.004061370315947064, "sim_render-ego0": 0.004023445702587385, "get_duckie_state": 2.279182789856906e-06, "in-drivable-lane": 7.100000000000006, "deviation-heading": 1.2178910040494402, "agent_compute-ego0": 0.012443211412182744, "complete-iteration": 0.17846080676261625, "set_robot_commands": 0.002278009226902779, "deviation-center-line": 0.2590211685140501, "driven_lanedir_consec": 0.52293605867608, "sim_compute_sim_state": 0.010014815651691022, "sim_compute_performance-ego0": 0.00226828100767778}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6736422700530028, "get_ui_image": 0.0347438028880528, "step_physics": 0.15528500420706612, "survival_time": 3.4499999999999957, "driven_lanedir": 0.21973056695148108, "get_state_dump": 0.004837618555341448, "get_robot_state": 0.003619875226702009, "sim_render-ego0": 0.004013170514787947, "get_duckie_state": 2.029963902064732e-06, "in-drivable-lane": 2.1999999999999953, "deviation-heading": 0.631039348248356, "agent_compute-ego0": 0.012983431134905134, "complete-iteration": 0.2295367956161499, "set_robot_commands": 0.00217914240700858, "deviation-center-line": 0.07993357427246195, "driven_lanedir_consec": 0.21973056695148108, "sim_compute_sim_state": 0.009735373088291713, "sim_compute_performance-ego0": 0.002044112341744559}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.0915348222982515, "get_ui_image": 0.03329697007038554, "step_physics": 0.1073791286984428, "survival_time": 12.150000000000038, "driven_lanedir": 0.3986522318721164, "get_state_dump": 0.00510765685409796, "get_robot_state": 0.003947086021548412, "sim_render-ego0": 0.00415185631298628, "get_duckie_state": 2.178012347612225e-06, "in-drivable-lane": 10.250000000000036, "deviation-heading": 0.4852313938264593, "agent_compute-ego0": 0.014044863278748558, "complete-iteration": 0.1811946943158009, "set_robot_commands": 0.0023178731808896924, "deviation-center-line": 0.10515342805588686, "driven_lanedir_consec": 0.3986522318721164, "sim_compute_sim_state": 0.008739217382962586, "sim_compute_performance-ego0": 0.002106225881420198}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.693905123684189, "get_ui_image": 0.02693119916048917, "step_physics": 0.10345064176546112, "survival_time": 7.099999999999983, "driven_lanedir": 0.3774076288181511, "get_state_dump": 0.004909692110715212, "get_robot_state": 0.003954990760429756, "sim_render-ego0": 0.003886076120229868, "get_duckie_state": 2.0273915537587412e-06, "in-drivable-lane": 5.349999999999982, "deviation-heading": 0.4164819691937842, "agent_compute-ego0": 0.012200242155915374, "complete-iteration": 0.16514661595537947, "set_robot_commands": 0.0022134964282696065, "deviation-center-line": 0.10918931456129488, "driven_lanedir_consec": 0.3774076288181511, "sim_compute_sim_state": 0.005440158443851071, "sim_compute_performance-ego0": 0.00206477492005675}}
set_robot_commands_max0.0023178731808896924
set_robot_commands_mean0.002247130310767664
set_robot_commands_median0.0022457528275861924
set_robot_commands_min0.00217914240700858
sim_compute_performance-ego0_max0.00226828100767778
sim_compute_performance-ego0_mean0.0021208485377248215
sim_compute_performance-ego0_median0.002085500400738474
sim_compute_performance-ego0_min0.002044112341744559
sim_compute_sim_state_max0.010014815651691022
sim_compute_sim_state_mean0.0084823911416991
sim_compute_sim_state_median0.00923729523562715
sim_compute_sim_state_min0.005440158443851071
sim_render-ego0_max0.00415185631298628
sim_render-ego0_mean0.004018637162647869
sim_render-ego0_median0.004018308108687666
sim_render-ego0_min0.003886076120229868
simulation-passed1
step_physics_max0.15528500420706612
step_physics_mean0.1187076244716443
step_physics_median0.108047425957025
step_physics_min0.10345064176546112
survival_time_max12.150000000000038
survival_time_mean8.075000000000005
survival_time_min3.4499999999999957
No reset possible
5768710875Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:07:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.780953312212118
survival_time_median9.5
deviation-center-line_median0.20970093177283936
in-drivable-lane_median3.949999999999986


other stats
agent_compute-ego0_max0.047272043463624555
agent_compute-ego0_mean0.03433211757394099
agent_compute-ego0_median0.03824612535146009
agent_compute-ego0_min0.013564176129219228
complete-iteration_max0.2416533679324012
complete-iteration_mean0.20243953331070805
complete-iteration_median0.1932943201624981
complete-iteration_min0.1815161249854348
deviation-center-line_max0.46741883944372525
deviation-center-line_mean0.2469353430283508
deviation-center-line_min0.10092066912399922
deviation-heading_max1.633991146363377
deviation-heading_mean0.980940488772625
deviation-heading_median0.8853301330639434
deviation-heading_min0.5191105425992363
driven_any_max3.0229875997518953
driven_any_mean2.1272450026883423
driven_any_median2.0691747350438714
driven_any_min1.3476429409137318
driven_lanedir_consec_max2.0270456792841967
driven_lanedir_consec_mean1.0739791721567769
driven_lanedir_consec_min0.7069643849186755
driven_lanedir_max2.0270456792841967
driven_lanedir_mean1.0739791721567769
driven_lanedir_median0.780953312212118
driven_lanedir_min0.7069643849186755
get_duckie_state_max1.4627786507283834e-06
get_duckie_state_mean1.409655434260312e-06
get_duckie_state_median1.4057192906817345e-06
get_duckie_state_min1.3644045049493965e-06
get_robot_state_max0.003910600917489998
get_robot_state_mean0.003786794105199394
get_robot_state_median0.003790810968421533
get_robot_state_min0.003654953566464511
get_state_dump_max0.005122112961949912
get_state_dump_mean0.004913274307139094
get_state_dump_median0.004937902036222654
get_state_dump_min0.004655180194161155
get_ui_image_max0.0361712563879871
get_ui_image_mean0.030629021448857343
get_ui_image_median0.02999913255726729
get_ui_image_min0.026346564292907715
in-drivable-lane_max9.250000000000064
in-drivable-lane_mean4.837500000000016
in-drivable-lane_min2.2000000000000313
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4238219389770435, "get_ui_image": 0.02709234411066229, "step_physics": 0.09643963792107324, "survival_time": 10.95000000000002, "driven_lanedir": 2.0270456792841967, "get_state_dump": 0.004655180194161155, "get_robot_state": 0.003654953566464511, "sim_render-ego0": 0.0038722742687572137, "get_duckie_state": 1.3644045049493965e-06, "in-drivable-lane": 2.2000000000000313, "deviation-heading": 1.2106981015772045, "agent_compute-ego0": 0.03213148984042081, "complete-iteration": 0.1815161249854348, "set_robot_commands": 0.002290349656885321, "deviation-center-line": 0.46741883944372525, "driven_lanedir_consec": 2.0270456792841967, "sim_compute_sim_state": 0.00930829806761308, "sim_compute_performance-ego0": 0.0019841692664406517}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.0229875997518953, "get_ui_image": 0.0361712563879871, "step_physics": 0.13205463824218977, "survival_time": 13.400000000000055, "driven_lanedir": 0.8482957103711357, "get_state_dump": 0.005122112961949912, "get_robot_state": 0.003910600917489998, "sim_render-ego0": 0.004104353681372887, "get_duckie_state": 1.3941725833708468e-06, "in-drivable-lane": 9.250000000000064, "deviation-heading": 1.633991146363377, "agent_compute-ego0": 0.04436076086249936, "complete-iteration": 0.2416533679324012, "set_robot_commands": 0.0024270683416203497, "deviation-center-line": 0.2804358978221607, "driven_lanedir_consec": 0.8482957103711357, "sim_compute_sim_state": 0.01123858916272018, "sim_compute_performance-ego0": 0.0021672807218416916}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.3476429409137318, "get_ui_image": 0.03290592100387229, "step_physics": 0.12623182992289836, "survival_time": 6.5999999999999845, "driven_lanedir": 0.7069643849186755, "get_state_dump": 0.004968282871676567, "get_robot_state": 0.003793598117684959, "sim_render-ego0": 0.004076495206445679, "get_duckie_state": 1.4627786507283834e-06, "in-drivable-lane": 3.1999999999999886, "deviation-heading": 0.5599621645506823, "agent_compute-ego0": 0.013564176129219228, "complete-iteration": 0.19861936927738047, "set_robot_commands": 0.0022620401884380138, "deviation-center-line": 0.10092066912399922, "driven_lanedir_consec": 0.7069643849186755, "sim_compute_sim_state": 0.008640655001303307, "sim_compute_performance-ego0": 0.0020870355735147805}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7145275311106989, "get_ui_image": 0.026346564292907715, "step_physics": 0.09184457784817544, "survival_time": 8.04999999999998, "driven_lanedir": 0.7136109140531002, "get_state_dump": 0.004907521200768742, "get_robot_state": 0.0037880238191581065, "sim_render-ego0": 0.0039766717840124055, "get_duckie_state": 1.4172659979926216e-06, "in-drivable-lane": 4.699999999999983, "deviation-heading": 0.5191105425992363, "agent_compute-ego0": 0.047272043463624555, "complete-iteration": 0.1879692710476157, "set_robot_commands": 0.0023395043832284434, "deviation-center-line": 0.13896596572351808, "driven_lanedir_consec": 0.7136109140531002, "sim_compute_sim_state": 0.005361740971788948, "sim_compute_performance-ego0": 0.002040247858306508}}
set_robot_commands_max0.0024270683416203497
set_robot_commands_mean0.0023297406425430317
set_robot_commands_median0.002314927020056882
set_robot_commands_min0.0022620401884380138
sim_compute_performance-ego0_max0.0021672807218416916
sim_compute_performance-ego0_mean0.0020696833550259077
sim_compute_performance-ego0_median0.0020636417159106443
sim_compute_performance-ego0_min0.0019841692664406517
sim_compute_sim_state_max0.01123858916272018
sim_compute_sim_state_mean0.008637320800856378
sim_compute_sim_state_median0.008974476534458195
sim_compute_sim_state_min0.005361740971788948
sim_render-ego0_max0.004104353681372887
sim_render-ego0_mean0.004007448735147046
sim_render-ego0_median0.004026583495229042
sim_render-ego0_min0.0038722742687572137
simulation-passed1
step_physics_max0.13205463824218977
step_physics_mean0.1116426709835842
step_physics_median0.1113357339219858
step_physics_min0.09184457784817544
survival_time_max13.400000000000055
survival_time_mean9.75000000000001
survival_time_min6.5999999999999845
No reset possible
5763810900Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:29:33
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.843168880330584
survival_time_median59.99999999999873
deviation-center-line_median3.1214469802729594
in-drivable-lane_median3.1749999999999567


other stats
agent_compute-ego0_max0.033931988462818155
agent_compute-ego0_mean0.02063924256489979
agent_compute-ego0_median0.01800341756376091
agent_compute-ego0_min0.012618146669259178
complete-iteration_max0.20363806606232376
complete-iteration_mean0.1794782663797011
complete-iteration_median0.17483819751914198
complete-iteration_min0.16459860441819676
deviation-center-line_max3.768746474379085
deviation-center-line_mean2.528392674061533
deviation-center-line_min0.10193026132112556
deviation-heading_max19.175089177656275
deviation-heading_mean11.80233490199574
deviation-heading_median13.789006918899709
deviation-heading_min0.4562365925272608
driven_any_max9.006500056781215
driven_any_mean7.128892101158408
driven_any_median8.370358522564915
driven_any_min2.7683513027225897
driven_lanedir_consec_max6.234729361970917
driven_lanedir_consec_mean4.0181055044631435
driven_lanedir_consec_min0.15135489522048928
driven_lanedir_max8.320973240073235
driven_lanedir_mean5.904959341231086
driven_lanedir_median7.573754614815311
driven_lanedir_min0.15135489522048928
get_duckie_state_max2.0224883296309066e-06
get_duckie_state_mean1.914672994544479e-06
get_duckie_state_median1.8826910459832776e-06
get_duckie_state_min1.870821556580454e-06
get_robot_state_max0.003710086101497043
get_robot_state_mean0.0036445066490990575
get_robot_state_median0.0036277469244438737
get_robot_state_min0.0036124466460114414
get_state_dump_max0.0046874041561282345
get_state_dump_mean0.004630415451210825
get_state_dump_median0.004646447746465493
get_state_dump_min0.004541362155784079
get_ui_image_max0.03531216999374758
get_ui_image_mean0.03012093964216924
get_ui_image_median0.029535585111827564
get_ui_image_min0.02610041835127425
in-drivable-lane_max14.80000000000009
in-drivable-lane_mean5.687499999999988
in-drivable-lane_min1.5999999999999464
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.7683513027225897, "get_ui_image": 0.02751120006513296, "step_physics": 0.0981023536538178, "survival_time": 15.85000000000009, "driven_lanedir": 0.15135489522048928, "get_state_dump": 0.004631406106289078, "get_robot_state": 0.003624761629404512, "sim_render-ego0": 0.003921819183061707, "get_duckie_state": 1.888605033826528e-06, "in-drivable-lane": 14.80000000000009, "deviation-heading": 0.4562365925272608, "agent_compute-ego0": 0.013125131715018794, "complete-iteration": 0.16459860441819676, "set_robot_commands": 0.002129152885772897, "deviation-center-line": 0.10193026132112556, "driven_lanedir_consec": 0.15135489522048928, "sim_compute_sim_state": 0.009485438184918095, "sim_compute_performance-ego0": 0.00198142408574902}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.129801460960026, "get_ui_image": 0.03531216999374758, "step_physics": 0.1178447890539749, "survival_time": 59.99999999999873, "driven_lanedir": 7.217269273798594, "get_state_dump": 0.004541362155784079, "get_robot_state": 0.0036124466460114414, "sim_render-ego0": 0.003775502720244421, "get_duckie_state": 1.8767770581400264e-06, "in-drivable-lane": 3.4499999999999273, "deviation-heading": 19.175089177656275, "agent_compute-ego0": 0.022881703412503028, "complete-iteration": 0.20363806606232376, "set_robot_commands": 0.002171984322362895, "deviation-center-line": 3.768746474379085, "driven_lanedir_consec": 3.646313174083749, "sim_compute_sim_state": 0.011429205028143256, "sim_compute_performance-ego0": 0.0019771290460692953}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.006500056781215, "get_ui_image": 0.031559970158522174, "step_physics": 0.10374001301297736, "survival_time": 59.99999999999873, "driven_lanedir": 8.320973240073235, "get_state_dump": 0.00466148938664191, "get_robot_state": 0.003630732219483235, "sim_render-ego0": 0.003830802529975834, "get_duckie_state": 1.870821556580454e-06, "in-drivable-lane": 2.899999999999986, "deviation-heading": 12.214565523149396, "agent_compute-ego0": 0.012618146669259178, "complete-iteration": 0.17563200036651586, "set_robot_commands": 0.0021585741209844862, "deviation-center-line": 2.8642076819711866, "driven_lanedir_consec": 6.040024586577419, "sim_compute_sim_state": 0.011366976587897436, "sim_compute_performance-ego0": 0.001977234259930181}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.610915584169804, "get_ui_image": 0.02610041835127425, "step_physics": 0.0912550170653865, "survival_time": 59.99999999999873, "driven_lanedir": 7.930239955832027, "get_state_dump": 0.0046874041561282345, "get_robot_state": 0.003710086101497043, "sim_render-ego0": 0.003903587890802871, "get_duckie_state": 2.0224883296309066e-06, "in-drivable-lane": 1.5999999999999464, "deviation-heading": 15.363448314650022, "agent_compute-ego0": 0.033931988462818155, "complete-iteration": 0.17404439467176808, "set_robot_commands": 0.0023580286326158255, "deviation-center-line": 3.3786862785747327, "driven_lanedir_consec": 6.234729361970917, "sim_compute_sim_state": 0.005970190208619282, "sim_compute_performance-ego0": 0.002039066262288852}}
set_robot_commands_max0.0023580286326158255
set_robot_commands_mean0.002204434990434026
set_robot_commands_median0.0021652792216736907
set_robot_commands_min0.002129152885772897
sim_compute_performance-ego0_max0.002039066262288852
sim_compute_performance-ego0_mean0.0019937134135093373
sim_compute_performance-ego0_median0.0019793291728396004
sim_compute_performance-ego0_min0.0019771290460692953
sim_compute_sim_state_max0.011429205028143256
sim_compute_sim_state_mean0.009562952502394518
sim_compute_sim_state_median0.010426207386407768
sim_compute_sim_state_min0.005970190208619282
sim_render-ego0_max0.003921819183061707
sim_render-ego0_mean0.003857928081021209
sim_render-ego0_median0.003867195210389353
sim_render-ego0_min0.003775502720244421
simulation-passed1
step_physics_max0.1178447890539749
step_physics_mean0.10273554319653912
step_physics_median0.10092118333339758
step_physics_min0.0912550170653865
survival_time_max59.99999999999873
survival_time_mean48.96249999999907
survival_time_min15.85000000000009
No reset possible
5763411426Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-testingLFP-simhost-erroryesnogpu-prod-080:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5759110887Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:29:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.4166391314411095
survival_time_median48.424999999999386
deviation-center-line_median1.4848404473899186
in-drivable-lane_median21.6499999999998


other stats
agent_compute-ego0_max0.04920014356955504
agent_compute-ego0_mean0.037011546171209046
agent_compute-ego0_median0.04102707214760639
agent_compute-ego0_min0.01679189682006836
complete-iteration_max0.2161442886164159
complete-iteration_mean0.19640686770045385
complete-iteration_median0.19681122393895076
complete-iteration_min0.17586073430749796
deviation-center-line_max3.4656612903398663
deviation-center-line_mean1.841699372692139
deviation-center-line_min0.9314553056488512
deviation-heading_max11.215007060483195
deviation-heading_mean6.757828264329937
deviation-heading_median5.9950228733581445
deviation-heading_min3.8262602501202623
driven_any_max7.864796492241269
driven_any_mean6.425870645679611
driven_any_median6.3193770778699925
driven_any_min5.199931934737188
driven_lanedir_consec_max7.682166675716279
driven_lanedir_consec_mean4.2945763205798775
driven_lanedir_consec_min2.662860343721012
driven_lanedir_max7.682166675716279
driven_lanedir_mean4.2945763205798775
driven_lanedir_median3.4166391314411095
driven_lanedir_min2.662860343721012
get_duckie_state_max1.4101492392050254e-06
get_duckie_state_mean1.2999811512939418e-06
get_duckie_state_median1.2684681772776435e-06
get_duckie_state_min1.2528390114154545e-06
get_robot_state_max0.003906090195114548
get_robot_state_mean0.003751656886650841
get_robot_state_median0.003706868615349744
get_robot_state_min0.003686800120789328
get_state_dump_max0.004873257096264384
get_state_dump_mean0.004722195340215951
get_state_dump_median0.004713215987319739
get_state_dump_min0.004589092289959943
get_ui_image_max0.035015518577010546
get_ui_image_mean0.030337516199618435
get_ui_image_median0.030235325704347133
get_ui_image_min0.02586389481276894
in-drivable-lane_max24.749999999999815
in-drivable-lane_mean17.012499999999854
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.888367926538822, "get_ui_image": 0.028498298787976627, "step_physics": 0.09793499353134186, "survival_time": 50.64999999999926, "driven_lanedir": 4.029411176300184, "get_state_dump": 0.004741073360104532, "get_robot_state": 0.003694411565566204, "sim_render-ego0": 0.003976240901081755, "get_duckie_state": 1.280970827362241e-06, "in-drivable-lane": 24.749999999999815, "deviation-heading": 3.8262602501202623, "agent_compute-ego0": 0.04920014356955504, "complete-iteration": 0.2034696754384088, "set_robot_commands": 0.0023075669004602073, "deviation-center-line": 0.9314553056488512, "driven_lanedir_consec": 4.029411176300184, "sim_compute_sim_state": 0.010960954180835971, "sim_compute_performance-ego0": 0.0020660507608447555}, "LF-norm-zigzag-000-ego0": {"driven_any": 5.199931934737188, "get_ui_image": 0.035015518577010546, "step_physics": 0.10851422003757806, "survival_time": 40.44999999999984, "driven_lanedir": 2.662860343721012, "get_state_dump": 0.004589092289959943, "get_robot_state": 0.003686800120789328, "sim_render-ego0": 0.003910663098464777, "get_duckie_state": 1.255965527193046e-06, "in-drivable-lane": 18.79999999999978, "deviation-heading": 6.316140143783819, "agent_compute-ego0": 0.04371218534163487, "complete-iteration": 0.2161442886164159, "set_robot_commands": 0.002293060149675534, "deviation-center-line": 1.4524962049117016, "driven_lanedir_consec": 2.662860343721012, "sim_compute_sim_state": 0.012290706752259054, "sim_compute_performance-ego0": 0.002043379677666558}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.750386229201163, "get_ui_image": 0.03197235262071764, "step_physics": 0.11261032439566948, "survival_time": 46.19999999999951, "driven_lanedir": 2.8038670865820348, "get_state_dump": 0.004685358614534945, "get_robot_state": 0.003906090195114548, "sim_render-ego0": 0.0041485353418298666, "get_duckie_state": 1.4101492392050254e-06, "in-drivable-lane": 24.499999999999815, "deviation-heading": 5.67390560293247, "agent_compute-ego0": 0.01679189682006836, "complete-iteration": 0.19015277243949272, "set_robot_commands": 0.002344953176137563, "deviation-center-line": 1.5171846898681354, "driven_lanedir_consec": 2.8038670865820348, "sim_compute_sim_state": 0.011436546686533336, "sim_compute_performance-ego0": 0.002161379891472894}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.864796492241269, "get_ui_image": 0.02586389481276894, "step_physics": 0.08853073997561084, "survival_time": 59.99999999999873, "driven_lanedir": 7.682166675716279, "get_state_dump": 0.004873257096264384, "get_robot_state": 0.0037193256651332834, "sim_render-ego0": 0.0038520799489144384, "get_duckie_state": 1.2528390114154545e-06, "in-drivable-lane": 0.0, "deviation-heading": 11.215007060483195, "agent_compute-ego0": 0.03834195895357791, "complete-iteration": 0.17586073430749796, "set_robot_commands": 0.0022867607335861676, "deviation-center-line": 3.4656612903398663, "driven_lanedir_consec": 7.682166675716279, "sim_compute_sim_state": 0.006251548748032239, "sim_compute_performance-ego0": 0.0020552163914181014}}
set_robot_commands_max0.002344953176137563
set_robot_commands_mean0.002308085239964868
set_robot_commands_median0.0023003135250678707
set_robot_commands_min0.0022867607335861676
sim_compute_performance-ego0_max0.002161379891472894
sim_compute_performance-ego0_mean0.0020815066803505774
sim_compute_performance-ego0_median0.002060633576131428
sim_compute_performance-ego0_min0.002043379677666558
sim_compute_sim_state_max0.012290706752259054
sim_compute_sim_state_mean0.01023493909191515
sim_compute_sim_state_median0.011198750433684656
sim_compute_sim_state_min0.006251548748032239
sim_render-ego0_max0.0041485353418298666
sim_render-ego0_mean0.003971879822572709
sim_render-ego0_median0.0039434519997732665
sim_render-ego0_min0.0038520799489144384
simulation-passed1
step_physics_max0.11261032439566948
step_physics_mean0.10189756948505004
step_physics_median0.10322460678445997
step_physics_min0.08853073997561084
survival_time_max59.99999999999873
survival_time_mean49.324999999999335
survival_time_min40.44999999999984
No reset possible
5740810939Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:46:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01372744161620128
agent_compute-ego0_mean0.01197754239956604
agent_compute-ego0_median0.011623790321699488
agent_compute-ego0_min0.010935147338663909
complete-iteration_max0.3431875916146716
complete-iteration_mean0.2819384545906696
complete-iteration_median0.2773478630678937
complete-iteration_min0.2298705006122192
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max2.3567904838415903e-06
get_duckie_state_mean2.1411516982053935e-06
get_duckie_state_median2.1546012058940955e-06
get_duckie_state_min1.8986138971917933e-06
get_robot_state_max0.0037630503620335104
get_robot_state_mean0.003623916644240101
get_robot_state_median0.003598380446136246
get_robot_state_min0.0035358553226544
get_state_dump_max0.0047575617511504695
get_state_dump_mean0.004563366245171311
get_state_dump_median0.004581871278875575
get_state_dump_min0.004332160671783625
get_ui_image_max0.035143668804438685
get_ui_image_mean0.029520571132583683
get_ui_image_median0.02867869681660877
get_ui_image_min0.025581222092678504
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02726738935307003, "step_physics": 0.20304327007138065, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004689367486475707, "get_robot_state": 0.003605052890825232, "sim_render-ego0": 0.003775285344437497, "get_duckie_state": 2.169390701433701e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.011138775465788196, "complete-iteration": 0.2661885770532511, "set_robot_commands": 0.0021651672582443707, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008454847693145523, "sim_compute_performance-ego0": 0.0019675702675494623}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.035143668804438685, "step_physics": 0.26571058810104636, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.0047575617511504695, "get_robot_state": 0.0037630503620335104, "sim_render-ego0": 0.003997087677154414, "get_duckie_state": 2.3567904838415903e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.01372744161620128, "complete-iteration": 0.3431875916146716, "set_robot_commands": 0.002290023554373939, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011625096760224938, "sim_compute_performance-ego0": 0.002080904057778288}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.030090004280147502, "step_physics": 0.22349725853493568, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004332160671783625, "get_robot_state": 0.0035358553226544, "sim_render-ego0": 0.003697358202080643, "get_duckie_state": 1.8986138971917933e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.010935147338663909, "complete-iteration": 0.2885071490825364, "set_robot_commands": 0.00211318168513086, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008334739122859246, "sim_compute_performance-ego0": 0.0018936825433837484}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.025581222092678504, "step_physics": 0.17027820774557986, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004474375071275443, "get_robot_state": 0.0035917080014472597, "sim_render-ego0": 0.0037628937323424937, "get_duckie_state": 2.13981171035449e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.01210880517761078, "complete-iteration": 0.2298705006122192, "set_robot_commands": 0.0021718765277846668, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.005897629171684323, "sim_compute_performance-ego0": 0.001922623501729211}}
set_robot_commands_max0.002290023554373939
set_robot_commands_mean0.002185062256383459
set_robot_commands_median0.0021685218930145187
set_robot_commands_min0.00211318168513086
sim_compute_performance-ego0_max0.002080904057778288
sim_compute_performance-ego0_mean0.0019661950926101773
sim_compute_performance-ego0_median0.0019450968846393365
sim_compute_performance-ego0_min0.0018936825433837484
sim_compute_sim_state_max0.011625096760224938
sim_compute_sim_state_mean0.008578078186978507
sim_compute_sim_state_median0.008394793408002385
sim_compute_sim_state_min0.005897629171684323
sim_render-ego0_max0.003997087677154414
sim_render-ego0_mean0.003808156239003762
sim_render-ego0_median0.003769089538389995
sim_render-ego0_min0.003697358202080643
simulation-passed1
step_physics_max0.26571058810104636
step_physics_mean0.21563233111323565
step_physics_median0.21327026430315815
step_physics_min0.17027820774557986
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5731510963Himanshu Arora 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:20:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.907163730460652
survival_time_median38.849999999999795
deviation-center-line_median1.2060585384482845
in-drivable-lane_median10.999999999999815


other stats
agent_compute-ego0_max0.013060460909448488
agent_compute-ego0_mean0.01226931632706915
agent_compute-ego0_median0.012131619169097066
agent_compute-ego0_min0.01175356606063398
complete-iteration_max0.21159451802571613
complete-iteration_mean0.17897678179181953
complete-iteration_median0.17566759297271828
complete-iteration_min0.15297742319612537
deviation-center-line_max3.0659195904610113
deviation-center-line_mean1.417364958738819
deviation-center-line_min0.1914231675976956
deviation-heading_max12.629613778997404
deviation-heading_mean6.990340676488913
deviation-heading_median7.126335248161704
deviation-heading_min1.0790784306348389
driven_any_max10.980568696938027
driven_any_mean6.250207853072632
driven_any_median6.58804766334865
driven_any_min0.8441673886551984
driven_lanedir_consec_max8.113450746013758
driven_lanedir_consec_mean3.100439366696336
driven_lanedir_consec_min0.47397925985028255
driven_lanedir_max8.154394033480369
driven_lanedir_mean3.4730888514704565
driven_lanedir_median2.631991056275587
driven_lanedir_min0.47397925985028255
get_duckie_state_max2.0015119302152384e-06
get_duckie_state_mean1.908232343931776e-06
get_duckie_state_median1.8835734703234704e-06
get_duckie_state_min1.864270504864924e-06
get_robot_state_max0.003691785263292717
get_robot_state_mean0.0035198767053964187
get_robot_state_median0.003508064645760472
get_robot_state_min0.003371592266772014
get_state_dump_max0.005141361020900336
get_state_dump_mean0.0046336376572665705
get_state_dump_median0.004543943627916202
get_state_dump_min0.004305302352333546
get_ui_image_max0.03324825366338094
get_ui_image_mean0.02931404282259728
get_ui_image_median0.02941798482113953
get_ui_image_min0.02517194798472913
in-drivable-lane_max34.899999999999366
in-drivable-lane_mean14.862499999999748
in-drivable-lane_min2.549999999999991
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.980568696938027, "get_ui_image": 0.026162483809294052, "step_physics": 0.0945819716568692, "survival_time": 59.99999999999873, "driven_lanedir": 8.154394033480369, "get_state_dump": 0.004305302352333546, "get_robot_state": 0.003371592266772014, "sim_render-ego0": 0.0035980680800794464, "get_duckie_state": 1.864270504864924e-06, "in-drivable-lane": 14.099999999999564, "deviation-heading": 12.629613778997404, "agent_compute-ego0": 0.01175356606063398, "complete-iteration": 0.15689001829796886, "set_robot_commands": 0.002004846347360984, "deviation-center-line": 3.0659195904610113, "driven_lanedir_consec": 8.113450746013758, "sim_compute_sim_state": 0.009234120704847809, "sim_compute_performance-ego0": 0.0017971275847321446}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.8441673886551984, "get_ui_image": 0.03324825366338094, "step_physics": 0.14119286934534708, "survival_time": 5.949999999999987, "driven_lanedir": 0.47397925985028255, "get_state_dump": 0.004467195272445679, "get_robot_state": 0.003469228744506836, "sim_render-ego0": 0.0035765846570332844, "get_duckie_state": 1.8854935963948567e-06, "in-drivable-lane": 2.549999999999991, "deviation-heading": 1.0790784306348389, "agent_compute-ego0": 0.011971515417099, "complete-iteration": 0.21159451802571613, "set_robot_commands": 0.002160880963007609, "deviation-center-line": 0.1914231675976956, "driven_lanedir_consec": 0.47397925985028255, "sim_compute_sim_state": 0.009607509771982829, "sim_compute_performance-ego0": 0.001817484696706136}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.404751249516611, "get_ui_image": 0.032673485832985, "step_physics": 0.12018656778817224, "survival_time": 49.44999999999933, "driven_lanedir": 1.980046732695704, "get_state_dump": 0.004620691983386723, "get_robot_state": 0.003691785263292717, "sim_render-ego0": 0.004021681197965988, "get_duckie_state": 2.0015119302152384e-06, "in-drivable-lane": 34.899999999999366, "deviation-heading": 7.552274597637076, "agent_compute-ego0": 0.013060460909448488, "complete-iteration": 0.19444516764746772, "set_robot_commands": 0.0022314721887761895, "deviation-center-line": 1.1422696604476965, "driven_lanedir_consec": 1.9767815320485005, "sim_compute_sim_state": 0.011841689456592908, "sim_compute_performance-ego0": 0.0020260933673743047}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.7713440771806885, "get_ui_image": 0.02517194798472913, "step_physics": 0.0936280821742944, "survival_time": 28.250000000000263, "driven_lanedir": 3.2839353798554702, "get_state_dump": 0.005141361020900336, "get_robot_state": 0.0035469005470141085, "sim_render-ego0": 0.003767943213769488, "get_duckie_state": 1.8816533442520845e-06, "in-drivable-lane": 7.900000000000065, "deviation-heading": 6.700395898686332, "agent_compute-ego0": 0.01229172292109513, "complete-iteration": 0.15297742319612537, "set_robot_commands": 0.0020703869236652927, "deviation-center-line": 1.269847416448872, "driven_lanedir_consec": 1.8375459288728035, "sim_compute_sim_state": 0.0054342211767136, "sim_compute_performance-ego0": 0.0018424431763773672}}
set_robot_commands_max0.0022314721887761895
set_robot_commands_mean0.002116896605702519
set_robot_commands_median0.002115633943336451
set_robot_commands_min0.002004846347360984
sim_compute_performance-ego0_max0.0020260933673743047
sim_compute_performance-ego0_mean0.0018707872062974885
sim_compute_performance-ego0_median0.0018299639365417517
sim_compute_performance-ego0_min0.0017971275847321446
sim_compute_sim_state_max0.011841689456592908
sim_compute_sim_state_mean0.009029385277534286
sim_compute_sim_state_median0.009420815238415318
sim_compute_sim_state_min0.0054342211767136
sim_render-ego0_max0.004021681197965988
sim_render-ego0_mean0.003741069287212051
sim_render-ego0_median0.003683005646924467
sim_render-ego0_min0.0035765846570332844
simulation-passed1
step_physics_max0.14119286934534708
step_physics_mean0.11239737274117072
step_physics_median0.10738426972252071
step_physics_min0.0936280821742944
survival_time_max59.99999999999873
survival_time_mean35.912499999999575
survival_time_min5.949999999999987
No reset possible
5723210987Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:15:11
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5008219613069828
survival_time_median24.5750000000002
deviation-center-line_median0.3846654861523663
in-drivable-lane_median19.550000000000068


other stats
agent_compute-ego0_max0.01334709279677447
agent_compute-ego0_mean0.012947748750170813
agent_compute-ego0_median0.01296359257358944
agent_compute-ego0_min0.0125167170567299
complete-iteration_max0.1990322517898847
complete-iteration_mean0.1828328416010067
complete-iteration_median0.17902157071225888
complete-iteration_min0.17425597318962438
deviation-center-line_max0.4480489643034822
deviation-center-line_mean0.3811775882638106
deviation-center-line_min0.3073304164470277
deviation-heading_max3.042138348952368
deviation-heading_mean2.311358484477011
deviation-heading_median2.798936735894708
deviation-heading_min0.6054221171662615
driven_any_max6.584810833123453
driven_any_mean4.4339710913812
driven_any_median4.56331370776409
driven_any_min2.0244461168731673
driven_lanedir_consec_max0.977180437930188
driven_lanedir_consec_mean0.5736183338176724
driven_lanedir_consec_min0.3156489747265361
driven_lanedir_max0.977180437930188
driven_lanedir_mean0.5736183338176724
driven_lanedir_median0.5008219613069828
driven_lanedir_min0.3156489747265361
get_duckie_state_max1.7004193000073702e-06
get_duckie_state_mean1.6048655843347978e-06
get_duckie_state_median1.6018498505024083e-06
get_duckie_state_min1.515343336327004e-06
get_robot_state_max0.003969361888828562
get_robot_state_mean0.0039095088145280985
get_robot_state_median0.003933344797402923
get_robot_state_min0.003801983774477987
get_state_dump_max0.005049624371884474
get_state_dump_mean0.004916328888223112
get_state_dump_median0.0049012063791859135
get_state_dump_min0.004813278422636145
get_ui_image_max0.03490012726693783
get_ui_image_mean0.03066080932144889
get_ui_image_median0.030624421974502665
get_ui_image_min0.02649426606985239
in-drivable-lane_max29.550000000000285
in-drivable-lane_mean19.48750000000012
in-drivable-lane_min9.300000000000058
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.8610465046159046, "get_ui_image": 0.028528363669096533, "step_physics": 0.10519293600053928, "survival_time": 16.700000000000102, "driven_lanedir": 0.495878773169077, "get_state_dump": 0.005049624371884474, "get_robot_state": 0.003969361888828562, "sim_render-ego0": 0.004030776379713372, "get_duckie_state": 1.6183995488864273e-06, "in-drivable-lane": 11.80000000000005, "deviation-heading": 3.042138348952368, "agent_compute-ego0": 0.0125167170567299, "complete-iteration": 0.17425597318962438, "set_robot_commands": 0.0022149235454957876, "deviation-center-line": 0.435566367148998, "driven_lanedir_consec": 0.495878773169077, "sim_compute_sim_state": 0.010449474961010376, "sim_compute_performance-ego0": 0.002199109632577469}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.0244461168731673, "get_ui_image": 0.03490012726693783, "step_physics": 0.12261389426465304, "survival_time": 13.200000000000053, "driven_lanedir": 0.3156489747265361, "get_state_dump": 0.004867975666837872, "get_robot_state": 0.0039149482295198264, "sim_render-ego0": 0.004036829606542047, "get_duckie_state": 1.7004193000073702e-06, "in-drivable-lane": 9.300000000000058, "deviation-heading": 2.941510305865754, "agent_compute-ego0": 0.013328263444720576, "complete-iteration": 0.1990322517898847, "set_robot_commands": 0.002214394875292508, "deviation-center-line": 0.33376460515573453, "driven_lanedir_consec": 0.3156489747265361, "sim_compute_sim_state": 0.010856454777267745, "sim_compute_performance-ego0": 0.0021881337435740345}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.584810833123453, "get_ui_image": 0.0327204802799088, "step_physics": 0.10942414022415577, "survival_time": 34.80000000000016, "driven_lanedir": 0.977180437930188, "get_state_dump": 0.004813278422636145, "get_robot_state": 0.003801983774477987, "sim_render-ego0": 0.0040379897764799754, "get_duckie_state": 1.515343336327004e-06, "in-drivable-lane": 27.30000000000008, "deviation-heading": 2.656363165923662, "agent_compute-ego0": 0.01334709279677447, "complete-iteration": 0.18301905894724163, "set_robot_commands": 0.002358086653043071, "deviation-center-line": 0.4480489643034822, "driven_lanedir_consec": 0.977180437930188, "sim_compute_sim_state": 0.010340730976340076, "sim_compute_performance-ego0": 0.002072957530083239}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.265580910912274, "get_ui_image": 0.02649426606985239, "step_physics": 0.11214235709263728, "survival_time": 32.450000000000294, "driven_lanedir": 0.5057651494448885, "get_state_dump": 0.004934437091533955, "get_robot_state": 0.00395174136528602, "sim_render-ego0": 0.003979254869314341, "get_duckie_state": 1.5853001521183894e-06, "in-drivable-lane": 29.550000000000285, "deviation-heading": 0.6054221171662615, "agent_compute-ego0": 0.012598921702458308, "complete-iteration": 0.17502408247727613, "set_robot_commands": 0.0022844332915086013, "deviation-center-line": 0.3073304164470277, "driven_lanedir_consec": 0.5057651494448885, "sim_compute_sim_state": 0.0063754129409790035, "sim_compute_performance-ego0": 0.0021607758448674128}}
set_robot_commands_max0.002358086653043071
set_robot_commands_mean0.002267959591334992
set_robot_commands_median0.0022496784185021945
set_robot_commands_min0.002214394875292508
sim_compute_performance-ego0_max0.002199109632577469
sim_compute_performance-ego0_mean0.0021552441877755388
sim_compute_performance-ego0_median0.0021744547942207236
sim_compute_performance-ego0_min0.002072957530083239
sim_compute_sim_state_max0.010856454777267745
sim_compute_sim_state_mean0.0095055184138993
sim_compute_sim_state_median0.010395102968675228
sim_compute_sim_state_min0.0063754129409790035
sim_render-ego0_max0.0040379897764799754
sim_render-ego0_mean0.004021212658012434
sim_render-ego0_median0.00403380299312771
sim_render-ego0_min0.003979254869314341
simulation-passed1
step_physics_max0.12261389426465304
step_physics_mean0.11234333189549636
step_physics_median0.11078324865839652
step_physics_min0.10519293600053928
survival_time_max34.80000000000016
survival_time_mean24.28750000000015
survival_time_min13.200000000000053
No reset possible
5710511018Olga (Ge Ya) Xu 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:33:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.821182641104963
survival_time_median59.99999999999873
deviation-center-line_median4.015458440025259
in-drivable-lane_median8.29999999999974


other stats
agent_compute-ego0_max0.013148894602918673
agent_compute-ego0_mean0.012874079878956987
agent_compute-ego0_median0.012931029167302342
agent_compute-ego0_min0.012485366578304598
complete-iteration_max0.200455980237378
complete-iteration_mean0.17641832344663716
complete-iteration_median0.17627908624730612
complete-iteration_min0.1526591410545584
deviation-center-line_max4.430745394382918
deviation-center-line_mean3.8390069959439383
deviation-center-line_min2.8943657093423183
deviation-heading_max18.10465164932552
deviation-heading_mean14.763295216153072
deviation-heading_median13.705678382118212
deviation-heading_min13.53717245105035
driven_any_max9.459738457758643
driven_any_mean7.082075247793877
driven_any_median6.862902068250334
driven_any_min5.1427583969161965
driven_lanedir_consec_max8.692790577152854
driven_lanedir_consec_mean5.9782472275460385
driven_lanedir_consec_min3.5778330508213747
driven_lanedir_max8.692790577152854
driven_lanedir_mean5.984491223019331
driven_lanedir_median5.821182641104963
driven_lanedir_min3.6028090327145477
get_duckie_state_max1.3570602887079775e-06
get_duckie_state_mean1.321703671447261e-06
get_duckie_state_median1.3265466897136606e-06
get_duckie_state_min1.2766610176537457e-06
get_robot_state_max0.003824319370978083
get_robot_state_mean0.0037462663364852536
get_robot_state_median0.003760138354473257
get_robot_state_min0.003640469266016418
get_state_dump_max0.004770158640927779
get_state_dump_mean0.0047374530029833765
get_state_dump_median0.004731615913797675
get_state_dump_min0.0047164215434103785
get_ui_image_max0.03604175863813897
get_ui_image_mean0.03050493081112651
get_ui_image_median0.03023722872083659
get_ui_image_min0.025503507164693892
in-drivable-lane_max14.599999999999415
in-drivable-lane_mean9.124999999999648
in-drivable-lane_min5.299999999999699
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.459738457758643, "get_ui_image": 0.028262561405826662, "step_physics": 0.09798473223956997, "survival_time": 59.99999999999873, "driven_lanedir": 8.692790577152854, "get_state_dump": 0.004732255832440252, "get_robot_state": 0.003722513645118123, "sim_render-ego0": 0.003888047009483166, "get_duckie_state": 1.354876604802801e-06, "in-drivable-lane": 5.299999999999699, "deviation-heading": 13.573941263432914, "agent_compute-ego0": 0.012778357006330275, "complete-iteration": 0.16473702506955518, "set_robot_commands": 0.0022139783505099103, "deviation-center-line": 3.9246438190069832, "driven_lanedir_consec": 8.692790577152854, "sim_compute_sim_state": 0.009075291051554938, "sim_compute_performance-ego0": 0.0019946231333838214}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.796734594696745, "get_ui_image": 0.03604175863813897, "step_physics": 0.12217413217797068, "survival_time": 59.99999999999873, "driven_lanedir": 5.533063227058496, "get_state_dump": 0.004730975995155099, "get_robot_state": 0.003824319370978083, "sim_render-ego0": 0.004070726461354938, "get_duckie_state": 1.3570602887079775e-06, "in-drivable-lane": 9.999999999999538, "deviation-heading": 18.10465164932552, "agent_compute-ego0": 0.01308370132827441, "complete-iteration": 0.200455980237378, "set_robot_commands": 0.0023002695977737465, "deviation-center-line": 4.106273061043534, "driven_lanedir_consec": 5.533063227058496, "sim_compute_sim_state": 0.011992656420311464, "sim_compute_performance-ego0": 0.002148538108273013}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.1427583969161965, "get_ui_image": 0.03221189603584651, "step_physics": 0.11334031970359287, "survival_time": 49.59999999999932, "driven_lanedir": 3.6028090327145477, "get_state_dump": 0.004770158640927779, "get_robot_state": 0.0037977630638283905, "sim_render-ego0": 0.0039823912421742234, "get_duckie_state": 1.29821677462452e-06, "in-drivable-lane": 14.599999999999415, "deviation-heading": 13.53717245105035, "agent_compute-ego0": 0.013148894602918673, "complete-iteration": 0.18782114742505707, "set_robot_commands": 0.0022819632850024636, "deviation-center-line": 2.8943657093423183, "driven_lanedir_consec": 3.5778330508213747, "sim_compute_sim_state": 0.012127714694926866, "sim_compute_performance-ego0": 0.002071811113232692}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.929069541803924, "get_ui_image": 0.025503507164693892, "step_physics": 0.09224697811021892, "survival_time": 59.99999999999873, "driven_lanedir": 6.10930205515143, "get_state_dump": 0.0047164215434103785, "get_robot_state": 0.003640469266016418, "sim_render-ego0": 0.003791806898347345, "get_duckie_state": 1.2766610176537457e-06, "in-drivable-lane": 6.599999999999941, "deviation-heading": 13.837415500803507, "agent_compute-ego0": 0.012485366578304598, "complete-iteration": 0.1526591410545584, "set_robot_commands": 0.002153562963455543, "deviation-center-line": 4.430745394382918, "driven_lanedir_consec": 6.10930205515143, "sim_compute_sim_state": 0.006101877663554399, "sim_compute_performance-ego0": 0.0019360871041049369}}
set_robot_commands_max0.0023002695977737465
set_robot_commands_mean0.002237443549185415
set_robot_commands_median0.0022479708177561867
set_robot_commands_min0.002153562963455543
sim_compute_performance-ego0_max0.002148538108273013
sim_compute_performance-ego0_mean0.0020377648647486157
sim_compute_performance-ego0_median0.0020332171233082568
sim_compute_performance-ego0_min0.0019360871041049369
sim_compute_sim_state_max0.012127714694926866
sim_compute_sim_state_mean0.009824384957586916
sim_compute_sim_state_median0.010533973735933202
sim_compute_sim_state_min0.006101877663554399
sim_render-ego0_max0.004070726461354938
sim_render-ego0_mean0.003933242902839918
sim_render-ego0_median0.003935219125828695
sim_render-ego0_min0.003791806898347345
simulation-passed1
step_physics_max0.12217413217797068
step_physics_mean0.1064365405578381
step_physics_median0.1056625259715814
step_physics_min0.09224697811021892
survival_time_max59.99999999999873
survival_time_mean57.39999999999888
survival_time_min49.59999999999932
No reset possible
5709011024Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:00:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "get_commands".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 66, in on_received_get_commands
              ||     velocity, omega = self.compute_action(self.current_image)
              ||   File "solution.py", line 62, in compute_action
              ||     action = self.model.predict(observation)
              ||   File "/workspace/model.py", line 118, in predict
              ||     output = self.model(images)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/site-packages/torchvision/models/squeezenet.py", line 100, in forward
              ||     x = self.features(x)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/container.py", line 117, in forward
              ||     input = module(input)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl
              ||     result = self.forward(*input, **kwargs)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/conv.py", line 423, in forward
              ||     return self._conv_forward(input, self.weight)
              ||   File "/usr/local/lib/python3.8/site-packages/torch/nn/modules/conv.py", line 419, in _conv_forward
              ||     return F.conv2d(input, weight, self.bias, self.stride,
              || TypeError: conv2d(): argument 'input' (position 1) must be Tensor, not numpy.ndarray
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 331, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 486, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 24, in call_if_fun_exists
              ||     raise ZTypeError(msg, f=f, args=kwargs, argspec=a) from e
              || zuper_commons.types.exceptions.ZTypeError: Cannot call function <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7f52beb828e0>>.
              || │       f: <bound method PytorchRLTemplateAgent.on_received_get_commands of <__main__.PytorchRLTemplateAgent object at 0x7f52beb828e0>>
              || │    args: {context: <zuper_nodes_wrapper.wrapper.ConcreteContext object at 0x7f52b5eb33a0>}
              || │ argspec: ([self, context], None, None, None, [], None, {context: <class 'zuper_nodes_wrapper.interface.Context'>} )
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5702911033Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:11:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 1287 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5700211312Moustafa Elarabitemplate-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-080:02:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5696111313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-080:08:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5687311064Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:20:47
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.5340788903083244
survival_time_median33.34999999999994
deviation-center-line_median1.2589088136783315
in-drivable-lane_median8.37499999999996


other stats
agent_compute-ego0_max0.03766069073362399
agent_compute-ego0_mean0.03128691562793475
agent_compute-ego0_median0.03487148455826557
agent_compute-ego0_min0.01774400266158388
complete-iteration_max0.2434007720744356
complete-iteration_mean0.2029826578412803
complete-iteration_median0.19350479977154453
complete-iteration_min0.1815202597475965
deviation-center-line_max2.050895098393646
deviation-center-line_mean1.177028263524785
deviation-center-line_min0.13940032834883098
deviation-heading_max10.017511770698883
deviation-heading_mean6.232751276261876
deviation-heading_median7.053207641782653
deviation-heading_min0.8070780507833191
driven_any_max11.522718669475076
driven_any_mean6.30946626866957
driven_any_median6.060924090455951
driven_any_min1.5932982242912994
driven_lanedir_consec_max8.187459647952615
driven_lanedir_consec_mean3.990713314191413
driven_lanedir_consec_min0.7072358281963844
driven_lanedir_max8.200762693293337
driven_lanedir_mean4.395661784097202
driven_lanedir_median4.337324307449543
driven_lanedir_min0.7072358281963844
get_duckie_state_max2.148187705102911e-06
get_duckie_state_mean2.0313941184430374e-06
get_duckie_state_median2.092689174696899e-06
get_duckie_state_min1.792010419275441e-06
get_robot_state_max0.003863021077515071
get_robot_state_mean0.0036918212122423622
get_robot_state_median0.0036868380449647095
get_robot_state_min0.003530587681524958
get_state_dump_max0.004812161586576466
get_state_dump_mean0.0046873367800114515
get_state_dump_median0.004759883248454513
get_state_dump_min0.004417419036560313
get_ui_image_max0.03643636602036496
get_ui_image_mean0.0309042994022401
get_ui_image_median0.030169304234807043
get_ui_image_min0.02684222311898135
in-drivable-lane_max15.599999999999266
in-drivable-lane_mean9.4499999999998
in-drivable-lane_min5.450000000000012
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.522718669475076, "get_ui_image": 0.02684222311898135, "step_physics": 0.09546332395046976, "survival_time": 59.99999999999873, "driven_lanedir": 8.200762693293337, "get_state_dump": 0.004417419036560313, "get_robot_state": 0.003530587681524958, "sim_render-ego0": 0.003748645194861216, "get_duckie_state": 1.792010419275441e-06, "in-drivable-lane": 15.599999999999266, "deviation-heading": 10.017511770698883, "agent_compute-ego0": 0.03359532038635457, "complete-iteration": 0.1815202597475965, "set_robot_commands": 0.0021510624468673973, "deviation-center-line": 2.050895098393646, "driven_lanedir_consec": 8.187459647952615, "sim_compute_sim_state": 0.009760716872648038, "sim_compute_performance-ego0": 0.001926097742822347}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.056606363530191, "get_ui_image": 0.03643636602036496, "step_physics": 0.14237297950906955, "survival_time": 23.4500000000002, "driven_lanedir": 2.0956780717542225, "get_state_dump": 0.004719081330806651, "get_robot_state": 0.0036727032762892704, "sim_render-ego0": 0.003948690536174368, "get_duckie_state": 2.076778006046376e-06, "in-drivable-lane": 9.950000000000085, "deviation-heading": 5.865843628110143, "agent_compute-ego0": 0.03614764873017656, "complete-iteration": 0.2434007720744356, "set_robot_commands": 0.0022719271639560132, "deviation-center-line": 0.8469048877252254, "driven_lanedir_consec": 1.3207093173291418, "sim_compute_sim_state": 0.01171970063067497, "sim_compute_performance-ego0": 0.00201781709143456}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.065241817381711, "get_ui_image": 0.03315188675499403, "step_physics": 0.12061006257495484, "survival_time": 43.24999999999968, "driven_lanedir": 6.578970543144863, "get_state_dump": 0.004812161586576466, "get_robot_state": 0.003863021077515071, "sim_render-ego0": 0.004061628434179011, "get_duckie_state": 2.1086003433474217e-06, "in-drivable-lane": 6.799999999999835, "deviation-heading": 8.240571655455163, "agent_compute-ego0": 0.01774400266158388, "complete-iteration": 0.2005125889877249, "set_robot_commands": 0.002370628693913202, "deviation-center-line": 1.6709127396314385, "driven_lanedir_consec": 5.747448463287507, "sim_compute_sim_state": 0.011652198454524296, "sim_compute_performance-ego0": 0.0021519790345471673}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.5932982242912994, "get_ui_image": 0.027186721714620055, "step_physics": 0.09960972476126578, "survival_time": 9.800000000000004, "driven_lanedir": 0.7072358281963844, "get_state_dump": 0.004800685166102376, "get_robot_state": 0.003700972813640149, "sim_render-ego0": 0.003943273863816625, "get_duckie_state": 2.148187705102911e-06, "in-drivable-lane": 5.450000000000012, "deviation-heading": 0.8070780507833191, "agent_compute-ego0": 0.03766069073362399, "complete-iteration": 0.18649701055536416, "set_robot_commands": 0.002277000301380448, "deviation-center-line": 0.13940032834883098, "driven_lanedir_consec": 0.7072358281963844, "sim_compute_sim_state": 0.005241899926045219, "sim_compute_performance-ego0": 0.001984084318131965}}
set_robot_commands_max0.002370628693913202
set_robot_commands_mean0.002267654651529265
set_robot_commands_median0.0022744637326682308
set_robot_commands_min0.0021510624468673973
sim_compute_performance-ego0_max0.0021519790345471673
sim_compute_performance-ego0_mean0.0020199945467340094
sim_compute_performance-ego0_median0.0020009507047832626
sim_compute_performance-ego0_min0.001926097742822347
sim_compute_sim_state_max0.01171970063067497
sim_compute_sim_state_mean0.009593628970973132
sim_compute_sim_state_median0.010706457663586168
sim_compute_sim_state_min0.005241899926045219
sim_render-ego0_max0.004061628434179011
sim_render-ego0_mean0.0039255595072578055
sim_render-ego0_median0.0039459821999954965
sim_render-ego0_min0.003748645194861216
simulation-passed1
step_physics_max0.14237297950906955
step_physics_mean0.11451402269893998
step_physics_median0.1101098936681103
step_physics_min0.09546332395046976
survival_time_max59.99999999999873
survival_time_mean34.12499999999965
survival_time_min9.800000000000004
No reset possible
5681511079Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:06:57
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5656941015845567
survival_time_median5.524999999999988
deviation-center-line_median0.14843715359454046
in-drivable-lane_median3.049999999999989


other stats
agent_compute-ego0_max0.014155477285385132
agent_compute-ego0_mean0.013146339599682928
agent_compute-ego0_median0.013389433016010545
agent_compute-ego0_min0.0116510150813255
complete-iteration_max0.20969956408264817
complete-iteration_mean0.18410843931988805
complete-iteration_median0.18892036133658305
complete-iteration_min0.14889347052373805
deviation-center-line_max0.20841425658109217
deviation-center-line_mean0.14465774709223966
deviation-center-line_min0.07334242459878557
deviation-heading_max1.685762571620015
deviation-heading_mean0.9391998110779252
deviation-heading_median0.8219095688745973
deviation-heading_min0.4272175349424907
driven_any_max3.759594763265387
driven_any_mean2.0300398410571896
driven_any_median1.5583442442885769
driven_any_min1.2438761123862176
driven_lanedir_consec_max0.6908539380889679
driven_lanedir_consec_mean0.561672825353186
driven_lanedir_consec_min0.4244491601546625
driven_lanedir_max0.6908539380889679
driven_lanedir_mean0.561672825353186
driven_lanedir_median0.5656941015845567
driven_lanedir_min0.4244491601546625
get_duckie_state_max1.9113725750758177e-06
get_duckie_state_mean1.5597868040484817e-06
get_duckie_state_median1.5306680835903885e-06
get_duckie_state_min1.266438473937332e-06
get_robot_state_max0.004084055240337665
get_robot_state_mean0.00379302710189884
get_robot_state_median0.003806386899993552
get_robot_state_min0.0034752793672705898
get_state_dump_max0.00498886750294612
get_state_dump_mean0.004771108747749749
get_state_dump_median0.004854254679110678
get_state_dump_min0.004387058129831522
get_ui_image_max0.035011419685938024
get_ui_image_mean0.0307158871382636
get_ui_image_median0.031138703328609005
get_ui_image_min0.025574722209898364
in-drivable-lane_max9.95000000000002
in-drivable-lane_mean4.5749999999999975
in-drivable-lane_min2.249999999999994
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.759594763265387, "get_ui_image": 0.02950994576079936, "step_physics": 0.10671003659566244, "survival_time": 11.800000000000033, "driven_lanedir": 0.4244491601546625, "get_state_dump": 0.004980261315776326, "get_robot_state": 0.004005439170805211, "sim_render-ego0": 0.0042077519219635914, "get_duckie_state": 1.9113725750758177e-06, "in-drivable-lane": 9.95000000000002, "deviation-heading": 1.042391190542748, "agent_compute-ego0": 0.01342387239641278, "complete-iteration": 0.1786236209708427, "set_robot_commands": 0.002385611272562405, "deviation-center-line": 0.18924505204096648, "driven_lanedir_consec": 0.4244491601546625, "sim_compute_sim_state": 0.011006034376249032, "sim_compute_performance-ego0": 0.0022893354359558365}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2438761123862176, "get_ui_image": 0.035011419685938024, "step_physics": 0.13498293968939012, "survival_time": 4.599999999999992, "driven_lanedir": 0.450771250019423, "get_state_dump": 0.004728248042445029, "get_robot_state": 0.0036073346291818926, "sim_render-ego0": 0.003991914051835255, "get_duckie_state": 1.266438473937332e-06, "in-drivable-lane": 2.249999999999994, "deviation-heading": 1.685762571620015, "agent_compute-ego0": 0.013354993635608305, "complete-iteration": 0.20969956408264817, "set_robot_commands": 0.0022161365837179204, "deviation-center-line": 0.20841425658109217, "driven_lanedir_consec": 0.450771250019423, "sim_compute_sim_state": 0.009729672503727738, "sim_compute_performance-ego0": 0.0019950071970621743}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.4185824788955408, "get_ui_image": 0.032767460896418646, "step_physics": 0.1250136150763585, "survival_time": 5.14999999999999, "driven_lanedir": 0.6908539380889679, "get_state_dump": 0.00498886750294612, "get_robot_state": 0.004084055240337665, "sim_render-ego0": 0.004255709739831777, "get_duckie_state": 1.636835244985727e-06, "in-drivable-lane": 2.5999999999999908, "deviation-heading": 0.6014279472064468, "agent_compute-ego0": 0.014155477285385132, "complete-iteration": 0.19921710170232332, "set_robot_commands": 0.0023503143053788403, "deviation-center-line": 0.10762925514811442, "driven_lanedir_consec": 0.6908539380889679, "sim_compute_sim_state": 0.009171632620004509, "sim_compute_performance-ego0": 0.0023248172723329985}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.698106009681613, "get_ui_image": 0.025574722209898364, "step_physics": 0.09114512074895266, "survival_time": 5.899999999999987, "driven_lanedir": 0.6806169531496904, "get_state_dump": 0.004387058129831522, "get_robot_state": 0.0034752793672705898, "sim_render-ego0": 0.003693422349561162, "get_duckie_state": 1.42450092219505e-06, "in-drivable-lane": 3.4999999999999876, "deviation-heading": 0.4272175349424907, "agent_compute-ego0": 0.0116510150813255, "complete-iteration": 0.14889347052373805, "set_robot_commands": 0.002128759352098994, "deviation-center-line": 0.07334242459878557, "driven_lanedir_consec": 0.6806169531496904, "sim_compute_sim_state": 0.004886543049531824, "sim_compute_performance-ego0": 0.0018713995188224216}}
set_robot_commands_max0.002385611272562405
set_robot_commands_mean0.00227020537843954
set_robot_commands_median0.0022832254445483806
set_robot_commands_min0.002128759352098994
sim_compute_performance-ego0_max0.0023248172723329985
sim_compute_performance-ego0_mean0.0021201398560433578
sim_compute_performance-ego0_median0.0021421713165090056
sim_compute_performance-ego0_min0.0018713995188224216
sim_compute_sim_state_max0.011006034376249032
sim_compute_sim_state_mean0.008698470637378275
sim_compute_sim_state_median0.009450652561866123
sim_compute_sim_state_min0.004886543049531824
sim_render-ego0_max0.004255709739831777
sim_render-ego0_mean0.004037199515797947
sim_render-ego0_median0.004099832986899423
sim_render-ego0_min0.003693422349561162
simulation-passed1
step_physics_max0.13498293968939012
step_physics_mean0.11446292802759092
step_physics_median0.11586182583601046
step_physics_min0.09114512074895266
survival_time_max11.800000000000033
survival_time_mean6.862500000000001
survival_time_min4.599999999999992
No reset possible
5680611425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-080:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5678511427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-080:00:50
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5655411107Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-080:36:24
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.982038558168971
survival_time_median59.99999999999873
deviation-center-line_median1.8815147483746024
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01207488899326245
agent_compute-ego0_mean0.011868459944125515
agent_compute-ego0_median0.011955183511173396
agent_compute-ego0_min0.01148858376089282
complete-iteration_max0.1859413644455553
complete-iteration_mean0.1708863838626185
complete-iteration_median0.16855259094508265
complete-iteration_min0.1604989891147534
deviation-center-line_max2.8486548793347946
deviation-center-line_mean2.072639054086614
deviation-center-line_min1.678871840262458
deviation-heading_max5.96031837842016
deviation-heading_mean4.2833300302687105
deviation-heading_median4.292728493410808
deviation-heading_min2.587544755833066
driven_any_max4.002342205615914
driven_any_mean4.001496412096653
driven_any_median4.002332859056294
driven_any_min3.9989777246581113
driven_lanedir_consec_max3.9952040725269575
driven_lanedir_consec_mean3.9814764546686785
driven_lanedir_consec_min3.966624629809815
driven_lanedir_max3.9952040725269575
driven_lanedir_mean3.9814764546686785
driven_lanedir_median3.982038558168971
driven_lanedir_min3.966624629809815
get_duckie_state_max1.2002320809725618e-06
get_duckie_state_mean1.1456399833431449e-06
get_duckie_state_median1.1431585243599897e-06
get_duckie_state_min1.0960108036800388e-06
get_robot_state_max0.0035859156806304195
get_robot_state_mean0.00346855636838076
get_robot_state_median0.0034689300761036237
get_robot_state_min0.0033504496406853747
get_state_dump_max0.00447606960998586
get_state_dump_mean0.004383786830378015
get_state_dump_median0.0043618317746202916
get_state_dump_min0.00433541416228562
get_ui_image_max0.03277504195976416
get_ui_image_mean0.028656423786696944
get_ui_image_median0.028269762699054145
get_ui_image_min0.025311127788915325
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.002342205615914, "get_ui_image": 0.02587879587470443, "step_physics": 0.10551343452523491, "survival_time": 59.99999999999873, "driven_lanedir": 3.9863557899508857, "get_state_dump": 0.00433541416228562, "get_robot_state": 0.0033504496406853747, "sim_render-ego0": 0.003470482377585126, "get_duckie_state": 1.1091129071110988e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.663337511845712, "agent_compute-ego0": 0.01148858376089282, "complete-iteration": 0.16739883371237216, "set_robot_commands": 0.001984958346936228, "deviation-center-line": 2.8486548793347946, "driven_lanedir_consec": 3.9863557899508857, "sim_compute_sim_state": 0.009532415698112596, "sim_compute_performance-ego0": 0.0017637287349526233}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.0023319718820725, "get_ui_image": 0.03277504195976416, "step_physics": 0.11508508705278916, "survival_time": 59.99999999999873, "driven_lanedir": 3.977721326387055, "get_state_dump": 0.004387062654010858, "get_robot_state": 0.003404910518763762, "sim_render-ego0": 0.0036381430471072486, "get_duckie_state": 1.1772041416088803e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.9221194749759025, "agent_compute-ego0": 0.01207488899326245, "complete-iteration": 0.1859413644455553, "set_robot_commands": 0.002047387884618043, "deviation-center-line": 2.045753331408925, "driven_lanedir_consec": 3.977721326387055, "sim_compute_sim_state": 0.010547091422926674, "sim_compute_performance-ego0": 0.0019009504389703323}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.9989777246581113, "get_ui_image": 0.030660729523403856, "step_physics": 0.1004241711888881, "survival_time": 59.99999999999873, "driven_lanedir": 3.966624629809815, "get_state_dump": 0.004336600895229724, "get_robot_state": 0.0035859156806304195, "sim_render-ego0": 0.0037489842614166742, "get_duckie_state": 1.0960108036800388e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.96031837842016, "agent_compute-ego0": 0.011979349447626754, "complete-iteration": 0.16970634817779312, "set_robot_commands": 0.0021287910547185, "deviation-center-line": 1.678871840262458, "driven_lanedir_consec": 3.966624629809815, "sim_compute_sim_state": 0.010823062218595404, "sim_compute_performance-ego0": 0.0019350149153074953}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.002333746230515, "get_ui_image": 0.025311127788915325, "step_physics": 0.10148427726624908, "survival_time": 59.99999999999873, "driven_lanedir": 3.9952040725269575, "get_state_dump": 0.00447606960998586, "get_robot_state": 0.003532949633443485, "sim_render-ego0": 0.003712334303335782, "get_duckie_state": 1.2002320809725618e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.587544755833066, "agent_compute-ego0": 0.01193101757472004, "complete-iteration": 0.1604989891147534, "set_robot_commands": 0.0021154036827627366, "deviation-center-line": 1.7172761653402793, "driven_lanedir_consec": 3.9952040725269575, "sim_compute_sim_state": 0.00597602858531485, "sim_compute_performance-ego0": 0.0018720614920051568}}
set_robot_commands_max0.0021287910547185
set_robot_commands_mean0.002069135242258877
set_robot_commands_median0.0020813957836903897
set_robot_commands_min0.001984958346936228
sim_compute_performance-ego0_max0.0019350149153074953
sim_compute_performance-ego0_mean0.001867938895308902
sim_compute_performance-ego0_median0.0018865059654877448
sim_compute_performance-ego0_min0.0017637287349526233
sim_compute_sim_state_max0.010823062218595404
sim_compute_sim_state_mean0.00921964948123738
sim_compute_sim_state_median0.010039753560519636
sim_compute_sim_state_min0.00597602858531485
sim_render-ego0_max0.0037489842614166742
sim_render-ego0_mean0.003642485997361207
sim_render-ego0_median0.0036752386752215154
sim_render-ego0_min0.003470482377585126
simulation-passed1
step_physics_max0.11508508705278916
step_physics_mean0.10562674250829032
step_physics_median0.103498855895742
step_physics_min0.1004241711888881
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5651011115Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:03:03
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5646411289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:39
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5640711133Mo Kleit 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:03:28
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5634311278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:01:58
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5632611278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:00:41
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5629711282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:02:08
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5622611308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:02:03
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5614811281Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-080:03:49
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5577411419Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-080:34:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.1253887402315756
survival_time_median11.575000000000053
deviation-center-line_median0.5267204178062265
in-drivable-lane_median0.8000000000000012


other stats
agent_compute-ego0_max0.043883819999934744
agent_compute-ego0_mean0.04273736779047232
agent_compute-ego0_median0.04323831749367646
agent_compute-ego0_min0.040589016174601616
agent_compute-npc0_max0.02210882222541025
agent_compute-npc0_mean0.02160748706368629
agent_compute-npc0_median0.021897853271095728
agent_compute-npc0_min0.020525419487143464
agent_compute-npc1_max0.029873334136898914
agent_compute-npc1_mean0.027423852855011477
agent_compute-npc1_median0.02760997845160725
agent_compute-npc1_min0.024788245976528275
agent_compute-npc2_max0.03374728755416157
agent_compute-npc2_mean0.0312877554061051
agent_compute-npc2_median0.03163755614802523
agent_compute-npc2_min0.028478422516128497
agent_compute-npc3_max0.04218088938899486
agent_compute-npc3_mean0.04188351388333735
agent_compute-npc3_median0.04188351388333735
agent_compute-npc3_min0.04158613837767984
complete-iteration_max1.352332867576448
complete-iteration_mean0.9192278884678876
complete-iteration_median0.9855886787294666
complete-iteration_min0.35340132883616854
deviation-center-line_max1.9105102008993984
deviation-center-line_mean0.8061948659048513
deviation-center-line_min0.26082842710755383
deviation-heading_max6.290265571629366
deviation-heading_mean3.407731937881018
deviation-heading_median2.90307150625943
deviation-heading_min1.5345191673758465
driven_any_max11.398827339954666
driven_any_mean4.398329620314531
driven_any_median2.576347834505067
driven_any_min1.041795472293323
driven_lanedir_consec_max11.089455557538962
driven_lanedir_consec_mean4.025870838815462
driven_lanedir_consec_min0.7632503172597338
driven_lanedir_max11.089455557538962
driven_lanedir_mean4.025870838815462
driven_lanedir_median2.1253887402315756
driven_lanedir_min0.7632503172597338
get_duckie_state_max2.615174895980878e-06
get_duckie_state_mean2.182030065325248e-06
get_duckie_state_median2.270968614012945e-06
get_duckie_state_min1.5710081372942244e-06
get_robot_state_max0.017806519867678203
get_robot_state_mean0.01364276884122608
get_robot_state_median0.015143310261822814
get_robot_state_min0.006477934973580497
get_state_dump_max0.011290908197505617
get_state_dump_mean0.0091276965195641
get_state_dump_median0.009846118394361425
get_state_dump_min0.005527641092027936
get_ui_image_max0.05221961369024259
get_ui_image_mean0.04365338724017463
get_ui_image_median0.04714887876109228
get_ui_image_min0.028096177748271396
in-drivable-lane_max2.3000000000000096
in-drivable-lane_mean0.975000000000003
in-drivable-lane_min0.0
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 11.398827339954666, "get_ui_image": 0.042888795304848217, "step_physics": 0.5823145852398822, "survival_time": 47.64999999999943, "driven_lanedir": 11.089455557538962, "get_state_dump": 0.009332898277906504, "get_robot_state": 0.0138195818075344, "sim_render-ego0": 0.0038291060949521495, "sim_render-npc0": 0.003740154722201749, "sim_render-npc1": 0.0037345388900308983, "sim_render-npc2": 0.0037737397527794663, "get_duckie_state": 2.262477354933381e-06, "in-drivable-lane": 0.4500000000000064, "deviation-heading": 6.290265571629366, "agent_compute-ego0": 0.043883819999934744, "agent_compute-npc0": 0.020525419487143464, "agent_compute-npc1": 0.029873334136898914, "agent_compute-npc2": 0.03163755614802523, "complete-iteration": 0.8395478280585267, "set_robot_commands": 0.0021920446579811207, "deviation-center-line": 1.9105102008993984, "driven_lanedir_consec": 11.089455557538962, "sim_compute_sim_state": 0.03363484081732152, "sim_compute_performance-ego0": 0.0020221871649944057, "sim_compute_performance-npc0": 0.0019015876002281716, "sim_compute_performance-npc1": 0.001891946642653747, "sim_compute_performance-npc2": 0.0018894374995361584}, "LFV-norm-zigzag-000-ego0": {"driven_any": 1.041795472293323, "get_ui_image": 0.05221961369024259, "step_physics": 0.7939599763567202, "survival_time": 5.299999999999989, "driven_lanedir": 0.9676818382990876, "get_state_dump": 0.010359338510816342, "get_robot_state": 0.01646703871611123, "sim_render-ego0": 0.0038063748974666418, "sim_render-npc0": 0.003709775265132155, "sim_render-npc1": 0.00362079834269586, "sim_render-npc2": 0.00362551546542444, "sim_render-npc3": 0.003695381021945276, "get_duckie_state": 2.2794598730925087e-06, "in-drivable-lane": 0.0, "deviation-heading": 2.039777560201971, "agent_compute-ego0": 0.040589016174601616, "agent_compute-npc0": 0.02210882222541025, "agent_compute-npc1": 0.024788245976528275, "agent_compute-npc2": 0.03374728755416157, "agent_compute-npc3": 0.04158613837767984, "complete-iteration": 1.1316295294004066, "set_robot_commands": 0.0021722071638731197, "deviation-center-line": 0.3565211169349438, "driven_lanedir_consec": 0.9676818382990876, "sim_compute_sim_state": 0.056861904179938486, "sim_compute_performance-ego0": 0.002055116903002017, "sim_compute_performance-npc0": 0.0019109516500312592, "sim_compute_performance-npc1": 0.0018320573824588385, "sim_compute_performance-npc2": 0.0018301589466701044, "sim_compute_performance-npc3": 0.0019617303509578527}, "LFV-norm-techtrack-000-ego0": {"driven_any": 4.049784571756448, "get_ui_image": 0.05140896221733634, "step_physics": 1.015251423752004, "survival_time": 17.600000000000115, "driven_lanedir": 3.283095642164064, "get_state_dump": 0.011290908197505617, "get_robot_state": 0.017806519867678203, "sim_render-ego0": 0.003894986917209355, "sim_render-npc0": 0.003840803762333251, "sim_render-npc1": 0.0038953266467994063, "sim_render-npc2": 0.003934173340837949, "sim_render-npc3": 0.003939650889496628, "get_duckie_state": 2.615174895980878e-06, "in-drivable-lane": 2.3000000000000096, "deviation-heading": 3.7663654523168897, "agent_compute-ego0": 0.042685460098742085, "agent_compute-npc0": 0.021727303945309043, "agent_compute-npc1": 0.02760997845160725, "agent_compute-npc2": 0.028478422516128497, "agent_compute-npc3": 0.04218088938899486, "complete-iteration": 1.352332867576448, "set_robot_commands": 0.0022535607767510345, "deviation-center-line": 0.6969197186775091, "driven_lanedir_consec": 3.283095642164064, "sim_compute_sim_state": 0.05288074306995943, "sim_compute_performance-ego0": 0.0021729800248618844, "sim_compute_performance-npc0": 0.001956629685572119, "sim_compute_performance-npc1": 0.0019890242190266465, "sim_compute_performance-npc2": 0.0019843875517588498, "sim_compute_performance-npc3": 0.0019537727150633383}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.1029110972536864, "get_ui_image": 0.028096177748271396, "step_physics": 0.2242213977234704, "survival_time": 5.549999999999988, "driven_lanedir": 0.7632503172597338, "get_state_dump": 0.005527641092027936, "get_robot_state": 0.006477934973580497, "sim_render-ego0": 0.003393222178731646, "sim_render-npc0": 0.0034653437989098685, "get_duckie_state": 1.5710081372942244e-06, "in-drivable-lane": 1.149999999999996, "deviation-heading": 1.5345191673758465, "agent_compute-ego0": 0.04379117488861084, "agent_compute-npc0": 0.022068402596882412, "complete-iteration": 0.35340132883616854, "set_robot_commands": 0.001863283770424979, "deviation-center-line": 0.26082842710755383, "driven_lanedir_consec": 0.7632503172597338, "sim_compute_sim_state": 0.009093499609402249, "sim_compute_performance-ego0": 0.001711313213620867, "sim_compute_performance-npc0": 0.0016706330435616629}}
set_robot_commands_max0.0022535607767510345
set_robot_commands_mean0.0021202740922575637
set_robot_commands_median0.00218212591092712
set_robot_commands_min0.001863283770424979
sim_compute_performance-ego0_max0.0021729800248618844
sim_compute_performance-ego0_mean0.001990399326619793
sim_compute_performance-ego0_median0.0020386520339982115
sim_compute_performance-ego0_min0.001711313213620867
sim_compute_performance-npc0_max0.001956629685572119
sim_compute_performance-npc0_mean0.0018599504948483031
sim_compute_performance-npc0_median0.0019062696251297153
sim_compute_performance-npc0_min0.0016706330435616629
sim_compute_performance-npc1_max0.0019890242190266465
sim_compute_performance-npc1_mean0.0019043427480464105
sim_compute_performance-npc1_median0.001891946642653747
sim_compute_performance-npc1_min0.0018320573824588385
sim_compute_performance-npc2_max0.0019843875517588498
sim_compute_performance-npc2_mean0.001901327999321704
sim_compute_performance-npc2_median0.0018894374995361584
sim_compute_performance-npc2_min0.0018301589466701044
sim_compute_performance-npc3_max0.0019617303509578527
sim_compute_performance-npc3_mean0.0019577515330105955
sim_compute_performance-npc3_median0.0019577515330105955
sim_compute_performance-npc3_min0.0019537727150633383
sim_compute_sim_state_max0.056861904179938486
sim_compute_sim_state_mean0.038117746919155426
sim_compute_sim_state_median0.043257791943640475
sim_compute_sim_state_min0.009093499609402249
sim_render-ego0_max0.003894986917209355
sim_render-ego0_mean0.003730922522089948
sim_render-ego0_median0.003817740496209395
sim_render-ego0_min0.003393222178731646
sim_render-npc0_max0.003840803762333251
sim_render-npc0_mean0.003689019387144256
sim_render-npc0_median0.003724964993666952
sim_render-npc0_min0.0034653437989098685
sim_render-npc1_max0.0038953266467994063
sim_render-npc1_mean0.003750221293175388
sim_render-npc1_median0.0037345388900308983
sim_render-npc1_min0.00362079834269586
sim_render-npc2_max0.003934173340837949
sim_render-npc2_mean0.0037778095196806184
sim_render-npc2_median0.0037737397527794663
sim_render-npc2_min0.00362551546542444
sim_render-npc3_max0.003939650889496628
sim_render-npc3_mean0.003817515955720952
sim_render-npc3_median0.003817515955720952
sim_render-npc3_min0.003695381021945276
simulation-passed1
step_physics_max1.015251423752004
step_physics_mean0.6539368457680192
step_physics_median0.6881372807983013
step_physics_min0.2242213977234704
survival_time_max47.64999999999943
survival_time_mean19.02499999999988
survival_time_min5.299999999999989
No reset possible
5570711162Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-080:02:57
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>