Duckietown Challenges Home Challenges Submissions

Evaluator 4745

ID4745
evaluatornogpu-prod-02
ownerI don't have one 😀
machinenogpu-prod_075f5a14ffe3
processnogpu-prod-02_075f5a14ffe3
version6.2.5
first heard
last heard
statusinactive
# evaluating
# success45 53426
# timeout2 49744
# failed28 50197
# error76 47627
# aborted28 47284
# host-error46 47925
arm
x86_64
Mac
gpu available
Number of processors
Processor frequency (MHz)
Free % of processors
RAM total (MB)
RAM free (MB)
Disk (MB)
Disk available (MB)
Docker Hub
P1
P2
Cloud simulations
PI Camera
# Duckiebots
Map 3x3 avaiable
Number of duckies
gpu cores
AIDO 2 Map LF public
AIDO 2 Map LF private
AIDO 2 Map LFV public
AIDO 2 Map LFV private
AIDO 2 Map LFVI public
AIDO 2 Map LFVI private
AIDO 3 Map LF public
AIDO 3 Map LF private
AIDO 3 Map LFV public
AIDO 3 Map LFV private
AIDO 3 Map LFVI public
AIDO 3 Map LFVI private
AIDO 5 Map large loop
ETU track
for 2021, map is ETH_small_inter
IPFS mountpoint /ipfs available
IPNS mountpoint /ipns available

Evaluator jobs

Job IDsubmissionuseruser labelchallengestepstatusup to dateevaluatordate starteddate completeddurationmessage
5785010794Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:23:22
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5784010797Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:04:44
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 55 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5782110807Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:10:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.4039025592862069
survival_time_median15.02500000000008
deviation-center-line_median0.3072705874142866
in-drivable-lane_median5.675000000000053


other stats
agent_compute-ego0_max0.014334356784820555
agent_compute-ego0_mean0.01385436465630668
agent_compute-ego0_median0.013779865023784848
agent_compute-ego0_min0.013523371792836473
complete-iteration_max0.24335964918136596
complete-iteration_mean0.19247388614094135
complete-iteration_median0.1839561343336896
complete-iteration_min0.15862362671502028
deviation-center-line_max0.854872187408884
deviation-center-line_mean0.4007394047974269
deviation-center-line_min0.1335442569522504
deviation-heading_max2.5093119534034285
deviation-heading_mean1.347424366211384
deviation-heading_median1.064517375224355
deviation-heading_min0.7513507609933974
driven_any_max4.462254618962112
driven_any_mean2.5636332602538623
driven_any_median2.540937708925337
driven_any_min0.7104030042026618
driven_lanedir_consec_max3.034192284073479
driven_lanedir_consec_mean1.5216661110569754
driven_lanedir_consec_min0.2446670415820087
driven_lanedir_max3.034192284073479
driven_lanedir_mean1.5216661110569754
driven_lanedir_median1.4039025592862069
driven_lanedir_min0.2446670415820087
get_duckie_state_max1.5957446037968502e-06
get_duckie_state_mean1.4709026200213223e-06
get_duckie_state_median1.4502760965072692e-06
get_duckie_state_min1.3873136832739002e-06
get_robot_state_max0.00398458480834961
get_robot_state_mean0.003902284216856789
get_robot_state_median0.0039019830027232855
get_robot_state_min0.0038205860536309737
get_state_dump_max0.004902513027191162
get_state_dump_mean0.004793895616425167
get_state_dump_median0.004785530607638835
get_state_dump_min0.004702008223231835
get_ui_image_max0.03888112545013428
get_ui_image_mean0.032180037446262376
get_ui_image_median0.031579264207427335
get_ui_image_min0.02668049592006056
in-drivable-lane_max11.050000000000097
in-drivable-lane_mean6.25000000000006
in-drivable-lane_min2.600000000000037
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4092172857659713, "get_ui_image": 0.02988680148373913, "step_physics": 0.09983299916629591, "survival_time": 14.300000000000068, "driven_lanedir": 2.041566394168614, "get_state_dump": 0.004766176801940705, "get_robot_state": 0.0038697171294315353, "sim_render-ego0": 0.004137991197433206, "get_duckie_state": 1.3873136832739002e-06, "in-drivable-lane": 2.600000000000037, "deviation-heading": 1.2651074157625612, "agent_compute-ego0": 0.013523371792836473, "complete-iteration": 0.17051954801074304, "set_robot_commands": 0.002373700357895695, "deviation-center-line": 0.46228276347476216, "driven_lanedir_consec": 2.041566394168614, "sim_compute_sim_state": 0.0099160496781512, "sim_compute_performance-ego0": 0.0021169567772735703}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7104030042026618, "get_ui_image": 0.03888112545013428, "step_physics": 0.16116376876831054, "survival_time": 4.94999999999999, "driven_lanedir": 0.2446670415820087, "get_state_dump": 0.004902513027191162, "get_robot_state": 0.00398458480834961, "sim_render-ego0": 0.004454164505004883, "get_duckie_state": 1.4853477478027345e-06, "in-drivable-lane": 3.0999999999999894, "deviation-heading": 0.863927334686149, "agent_compute-ego0": 0.014334356784820555, "complete-iteration": 0.24335964918136596, "set_robot_commands": 0.002418205738067627, "deviation-center-line": 0.1335442569522504, "driven_lanedir_consec": 0.2446670415820087, "sim_compute_sim_state": 0.010886170864105224, "sim_compute_performance-ego0": 0.002225744724273682}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.462254618962112, "get_ui_image": 0.03327172693111553, "step_physics": 0.12075940458691074, "survival_time": 25.65000000000023, "driven_lanedir": 3.034192284073479, "get_state_dump": 0.004804884413336965, "get_robot_state": 0.003934248876015036, "sim_render-ego0": 0.004117872928367051, "get_duckie_state": 1.415204445211804e-06, "in-drivable-lane": 8.250000000000117, "deviation-heading": 2.5093119534034285, "agent_compute-ego0": 0.01391365555937652, "complete-iteration": 0.19739272065663616, "set_robot_commands": 0.0024538388048164577, "deviation-center-line": 0.854872187408884, "driven_lanedir_consec": 3.034192284073479, "sim_compute_sim_state": 0.0118257656171628, "sim_compute_performance-ego0": 0.0022101991371421964}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.672658132084703, "get_ui_image": 0.02668049592006056, "step_physics": 0.09564926805375498, "survival_time": 15.750000000000089, "driven_lanedir": 0.7662387244037985, "get_state_dump": 0.004702008223231835, "get_robot_state": 0.0038205860536309737, "sim_render-ego0": 0.003908339180523837, "get_duckie_state": 1.5957446037968502e-06, "in-drivable-lane": 11.050000000000097, "deviation-heading": 0.7513507609933974, "agent_compute-ego0": 0.013646074488193174, "complete-iteration": 0.15862362671502028, "set_robot_commands": 0.0023075651518906217, "deviation-center-line": 0.15225841135381105, "driven_lanedir_consec": 0.7662387244037985, "sim_compute_sim_state": 0.005740420727790157, "sim_compute_performance-ego0": 0.002068447915813591}}
set_robot_commands_max0.0024538388048164577
set_robot_commands_mean0.0023883275131676004
set_robot_commands_median0.0023959530479816613
set_robot_commands_min0.0023075651518906217
sim_compute_performance-ego0_max0.002225744724273682
sim_compute_performance-ego0_mean0.0021553371386257595
sim_compute_performance-ego0_median0.002163577957207883
sim_compute_performance-ego0_min0.002068447915813591
sim_compute_sim_state_max0.0118257656171628
sim_compute_sim_state_mean0.009592101721802346
sim_compute_sim_state_median0.010401110271128212
sim_compute_sim_state_min0.005740420727790157
sim_render-ego0_max0.004454164505004883
sim_render-ego0_mean0.004154591952832244
sim_render-ego0_median0.004127932062900129
sim_render-ego0_min0.003908339180523837
simulation-passed1
step_physics_max0.16116376876831054
step_physics_mean0.11935136014381804
step_physics_median0.11029620187660331
step_physics_min0.09564926805375498
survival_time_max25.65000000000023
survival_time_mean15.162500000000094
survival_time_min4.94999999999999
No reset possible
5781210812Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:03:12
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 29 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5780310823Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:03:50
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 33 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5777210838Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:22:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.2096477831588084
survival_time_median41.57499999999946
deviation-center-line_median0.911697008597632
in-drivable-lane_median8.075000000000085


other stats
agent_compute-ego0_max0.05234811583469654
agent_compute-ego0_mean0.03916068353066286
agent_compute-ego0_median0.04451155056376089
agent_compute-ego0_min0.015271517160433118
complete-iteration_max0.24726713772477776
complete-iteration_mean0.2045888943077263
complete-iteration_median0.19829214760061553
complete-iteration_min0.17450414430489647
deviation-center-line_max4.816379036637384
deviation-center-line_mean1.7359573718731378
deviation-center-line_min0.3040564336599029
deviation-heading_max16.115993746586902
deviation-heading_mean6.482774755029695
deviation-heading_median4.139600082348597
deviation-heading_min1.5359051088346836
driven_any_max8.26636436334625
driven_any_mean5.070502892645536
driven_any_median5.739088947259072
driven_any_min0.5374693127177504
driven_lanedir_consec_max7.856263518523555
driven_lanedir_consec_mean3.140959311426358
driven_lanedir_consec_min0.28827816086426017
driven_lanedir_max7.856263518523555
driven_lanedir_mean3.1543621547155904
driven_lanedir_median2.2364534697372735
driven_lanedir_min0.28827816086426017
get_duckie_state_max2.4320283202108595e-06
get_duckie_state_mean2.223861956289016e-06
get_duckie_state_median2.2419053932716105e-06
get_duckie_state_min1.979608718401983e-06
get_robot_state_max0.0040357333238079185
get_robot_state_mean0.00384427626926125
get_robot_state_median0.00380584016956132
get_robot_state_min0.0037296914141144383
get_state_dump_max0.005056605350961296
get_state_dump_mean0.004865352055365125
get_state_dump_median0.004809591482425558
get_state_dump_min0.004785619905648085
get_ui_image_max0.03520295702177903
get_ui_image_mean0.03059850620546696
get_ui_image_median0.03054208522933395
get_ui_image_min0.026106897341420902
in-drivable-lane_max42.99999999999898
in-drivable-lane_mean15.074999999999786
in-drivable-lane_min1.149999999999996
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.332354880949151, "get_ui_image": 0.02828595504678529, "step_physics": 0.1024980611842254, "survival_time": 23.15000000000019, "driven_lanedir": 1.979437664991644, "get_state_dump": 0.004795055964897419, "get_robot_state": 0.0038488070512640066, "sim_render-ego0": 0.004110912824499196, "get_duckie_state": 2.1719727022894498e-06, "in-drivable-lane": 12.70000000000018, "deviation-heading": 1.5359051088346836, "agent_compute-ego0": 0.05234811583469654, "complete-iteration": 0.21097776910354352, "set_robot_commands": 0.0023425791797966793, "deviation-center-line": 0.5132520993345515, "driven_lanedir_consec": 1.979437664991644, "sim_compute_sim_state": 0.010548488847140608, "sim_compute_performance-ego0": 0.0021116918530957453}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.5374693127177504, "get_ui_image": 0.03520295702177903, "step_physics": 0.1332652371505211, "survival_time": 7.199999999999982, "driven_lanedir": 0.28827816086426017, "get_state_dump": 0.004824126999953698, "get_robot_state": 0.003762873287858634, "sim_render-ego0": 0.003990995472875135, "get_duckie_state": 2.3118380842537716e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 1.5547404549318082, "agent_compute-ego0": 0.05071087541251347, "complete-iteration": 0.24726713772477776, "set_robot_commands": 0.002257294490419585, "deviation-center-line": 0.3040564336599029, "driven_lanedir_consec": 0.28827816086426017, "sim_compute_sim_state": 0.011125982218775256, "sim_compute_performance-ego0": 0.0020393486680655645}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.145823013568993, "get_ui_image": 0.03279821541188262, "step_physics": 0.10770985546159705, "survival_time": 59.99999999999873, "driven_lanedir": 2.4934692744829032, "get_state_dump": 0.005056605350961296, "get_robot_state": 0.0040357333238079185, "sim_render-ego0": 0.004287268895094441, "get_duckie_state": 2.4320283202108595e-06, "in-drivable-lane": 42.99999999999898, "deviation-heading": 6.7244597097653855, "agent_compute-ego0": 0.015271517160433118, "complete-iteration": 0.18560652609768755, "set_robot_commands": 0.002397631725403391, "deviation-center-line": 1.3101419178607123, "driven_lanedir_consec": 2.439857901325973, "sim_compute_sim_state": 0.011739786022608724, "sim_compute_performance-ego0": 0.002209059106221703}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.26636436334625, "get_ui_image": 0.026106897341420902, "step_physics": 0.08727252771217162, "survival_time": 59.99999999999873, "driven_lanedir": 7.856263518523555, "get_state_dump": 0.004785619905648085, "get_robot_state": 0.0037296914141144383, "sim_render-ego0": 0.0038409441535816303, "get_duckie_state": 1.979608718401983e-06, "in-drivable-lane": 1.149999999999996, "deviation-heading": 16.115993746586902, "agent_compute-ego0": 0.03831222571500831, "complete-iteration": 0.17450414430489647, "set_robot_commands": 0.002260236319256861, "deviation-center-line": 4.816379036637384, "driven_lanedir_consec": 7.856263518523555, "sim_compute_sim_state": 0.006150786029012078, "sim_compute_performance-ego0": 0.0019592776286611944}}
set_robot_commands_max0.002397631725403391
set_robot_commands_mean0.002314435428719129
set_robot_commands_median0.00230140774952677
set_robot_commands_min0.002257294490419585
sim_compute_performance-ego0_max0.002209059106221703
sim_compute_performance-ego0_mean0.002079844314011052
sim_compute_performance-ego0_median0.002075520260580655
sim_compute_performance-ego0_min0.0019592776286611944
sim_compute_sim_state_max0.011739786022608724
sim_compute_sim_state_mean0.009891260779384166
sim_compute_sim_state_median0.010837235532957932
sim_compute_sim_state_min0.006150786029012078
sim_render-ego0_max0.004287268895094441
sim_render-ego0_mean0.0040575303365126
sim_render-ego0_median0.004050954148687166
sim_render-ego0_min0.0038409441535816303
simulation-passed1
step_physics_max0.1332652371505211
step_physics_mean0.1076864203771288
step_physics_median0.10510395832291122
step_physics_min0.08727252771217162
survival_time_max59.99999999999873
survival_time_mean37.58749999999941
survival_time_min7.199999999999982
No reset possible
5770810870Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:45:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.01374921215066902
agent_compute-ego0_mean0.01258272190673663
agent_compute-ego0_median0.01251868751027205
agent_compute-ego0_min0.0115443004557334
complete-iteration_max0.3757265995781586
complete-iteration_mean0.3126942751111833
complete-iteration_median0.31056019209703734
complete-iteration_min0.2539301166725
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.604809153586204e-06
get_duckie_state_mean1.408575377198282e-06
get_duckie_state_median1.4047043011845597e-06
get_duckie_state_min1.2200837528378044e-06
get_robot_state_max0.003933507139537853
get_robot_state_mean0.0038380210941578326
get_robot_state_median0.003850980067034745
get_robot_state_min0.0037166171030239897
get_state_dump_max0.004981113016158715
get_state_dump_mean0.0048384169158490874
get_state_dump_median0.004872042372462949
get_state_dump_min0.004628469902311734
get_ui_image_max0.03772065184892564
get_ui_image_mean0.0318730975269378
get_ui_image_median0.03121544081999995
get_ui_image_min0.02734085661882564
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.029876957527306753, "step_physics": 0.2353321090526724, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004921745003311957, "get_robot_state": 0.003933507139537853, "sim_render-ego0": 0.004156508910268868, "get_duckie_state": 1.604809153586204e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012742812786372276, "complete-iteration": 0.3047135249462652, "set_robot_commands": 0.0024323247056718075, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009024668097198258, "sim_compute_performance-ego0": 0.002200772422834995}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03772065184892564, "step_physics": 0.2940703170881184, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004981113016158715, "get_robot_state": 0.003926448083539291, "sim_render-ego0": 0.004218170783799653, "get_duckie_state": 1.4606860158445436e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.01374921215066902, "complete-iteration": 0.3757265995781586, "set_robot_commands": 0.0024051318855507985, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.012350052024402983, "sim_compute_performance-ego0": 0.002213290291563061}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03255392411269316, "step_physics": 0.24593092202147676, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004628469902311734, "get_robot_state": 0.0037166171030239897, "sim_render-ego0": 0.003957548506750255, "get_duckie_state": 1.2200837528378044e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.01229456223417182, "complete-iteration": 0.31640685924780954, "set_robot_commands": 0.0022629421021320936, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.00896252938650927, "sim_compute_performance-ego0": 0.002017284412368152}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02734085661882564, "step_physics": 0.1917518465644017, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004822339741613942, "get_robot_state": 0.0037755120505301976, "sim_render-ego0": 0.0039587143954389, "get_duckie_state": 1.3487225865245758e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.0115443004557334, "complete-iteration": 0.2539301166725, "set_robot_commands": 0.0023156463057671262, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006281047141323677, "sim_compute_performance-ego0": 0.0020553196201118003}}
set_robot_commands_max0.0024323247056718075
set_robot_commands_mean0.0023540112497804563
set_robot_commands_median0.0023603890956589626
set_robot_commands_min0.0022629421021320936
sim_compute_performance-ego0_max0.002213290291563061
sim_compute_performance-ego0_mean0.0021216666867195024
sim_compute_performance-ego0_median0.0021280460214733975
sim_compute_performance-ego0_min0.002017284412368152
sim_compute_sim_state_max0.012350052024402983
sim_compute_sim_state_mean0.009154574162358547
sim_compute_sim_state_median0.008993598741853764
sim_compute_sim_state_min0.006281047141323677
sim_render-ego0_max0.004218170783799653
sim_render-ego0_mean0.004072735649064419
sim_render-ego0_median0.004057611652853884
sim_render-ego0_min0.003957548506750255
simulation-passed1
step_physics_max0.2940703170881184
step_physics_mean0.2417712986816673
step_physics_median0.24063151553707457
step_physics_min0.1917518465644017
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5769110873Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:06:21
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3300188584344118
survival_time_median8.699999999999989
deviation-center-line_median0.124823468988985
in-drivable-lane_median6.649999999999988


other stats
agent_compute-ego0_max0.01380993371986481
agent_compute-ego0_mean0.013284408716773902
agent_compute-ego0_median0.013196208036464194
agent_compute-ego0_min0.0129352850743024
complete-iteration_max0.23334931433200837
complete-iteration_mean0.1936159392613834
complete-iteration_median0.18815676010285007
complete-iteration_min0.1648009225078251
deviation-center-line_max0.38336045171840505
deviation-center-line_mean0.17880749738270815
deviation-center-line_min0.08222259983445758
deviation-heading_max1.583679014938772
deviation-heading_mean0.8914311768232281
deviation-heading_median0.7066701749288555
deviation-heading_min0.5687053424964293
driven_any_max2.4025091231516305
driven_any_mean1.5534472154835166
driven_any_median1.6006122442811292
driven_any_min0.610055250220177
driven_lanedir_consec_max0.6345047595348737
driven_lanedir_consec_mean0.36618712043864937
driven_lanedir_consec_min0.17020600535090002
driven_lanedir_max0.6345047595348737
driven_lanedir_mean0.36618712043864937
driven_lanedir_median0.3300188584344118
driven_lanedir_min0.17020600535090002
get_duckie_state_max1.5986393172427478e-06
get_duckie_state_mean1.423477322565567e-06
get_duckie_state_median1.39772891998291e-06
get_duckie_state_min1.2998121330536992e-06
get_robot_state_max0.003903908558575756
get_robot_state_mean0.0038245842665073576
get_robot_state_median0.003813991857611614
get_robot_state_min0.003766444792230445
get_state_dump_max0.0049707315054284525
get_state_dump_mean0.004826290095275376
get_state_dump_median0.00484626768481147
get_state_dump_min0.00464189350605011
get_ui_image_max0.03684936165809631
get_ui_image_mean0.03236783446279009
get_ui_image_median0.032851330899118784
get_ui_image_min0.026919314394826473
in-drivable-lane_max8.800000000000011
in-drivable-lane_mean6.174999999999995
in-drivable-lane_min2.5999999999999934
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.4025091231516305, "get_ui_image": 0.0306624340346135, "step_physics": 0.10285973073951751, "survival_time": 12.500000000000044, "driven_lanedir": 0.6345047595348737, "get_state_dump": 0.004947175067734433, "get_robot_state": 0.003903908558575756, "sim_render-ego0": 0.004049694395635232, "get_duckie_state": 1.5986393172427478e-06, "in-drivable-lane": 8.800000000000011, "deviation-heading": 1.583679014938772, "agent_compute-ego0": 0.0129352850743024, "complete-iteration": 0.17415571687705964, "set_robot_commands": 0.00239167080457467, "deviation-center-line": 0.38336045171840505, "driven_lanedir_consec": 0.6345047595348737, "sim_compute_sim_state": 0.010201217643768188, "sim_compute_performance-ego0": 0.00210191339135645}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.610055250220177, "get_ui_image": 0.03684936165809631, "step_physics": 0.1562669903039932, "survival_time": 3.949999999999994, "driven_lanedir": 0.17020600535090002, "get_state_dump": 0.00464189350605011, "get_robot_state": 0.00379834771156311, "sim_render-ego0": 0.00399150550365448, "get_duckie_state": 1.3947486877441403e-06, "in-drivable-lane": 2.5999999999999934, "deviation-heading": 0.7865031360011873, "agent_compute-ego0": 0.01327509880065918, "complete-iteration": 0.23334931433200837, "set_robot_commands": 0.0022441893815994263, "deviation-center-line": 0.08222259983445758, "driven_lanedir_consec": 0.17020600535090002, "sim_compute_sim_state": 0.01015208065509796, "sim_compute_performance-ego0": 0.0020344018936157226}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.5010333069277078, "get_ui_image": 0.035040227763624074, "step_physics": 0.12702901822974882, "survival_time": 8.249999999999982, "driven_lanedir": 0.36577924568435183, "get_state_dump": 0.0049707315054284525, "get_robot_state": 0.003766444792230445, "sim_render-ego0": 0.0040627014206116455, "get_duckie_state": 1.2998121330536992e-06, "in-drivable-lane": 5.999999999999982, "deviation-heading": 0.6268372138565239, "agent_compute-ego0": 0.01380993371986481, "complete-iteration": 0.2021578033286405, "set_robot_commands": 0.002306504421923534, "deviation-center-line": 0.12683954016957638, "driven_lanedir_consec": 0.36577924568435183, "sim_compute_sim_state": 0.008993211998996964, "sim_compute_performance-ego0": 0.0020852447992347808}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7001911816345507, "get_ui_image": 0.026919314394826473, "step_physics": 0.1022731143495311, "survival_time": 9.149999999999997, "driven_lanedir": 0.2942584711844718, "get_state_dump": 0.004745360301888507, "get_robot_state": 0.003829636003660119, "sim_render-ego0": 0.004016836052355559, "get_duckie_state": 1.4007091522216797e-06, "in-drivable-lane": 7.299999999999995, "deviation-heading": 0.5687053424964293, "agent_compute-ego0": 0.013117317272269209, "complete-iteration": 0.1648009225078251, "set_robot_commands": 0.0022763583971106486, "deviation-center-line": 0.12280739780839364, "driven_lanedir_consec": 0.2942584711844718, "sim_compute_sim_state": 0.005402234585388847, "sim_compute_performance-ego0": 0.0021254472110582433}}
set_robot_commands_max0.00239167080457467
set_robot_commands_mean0.00230468075130207
set_robot_commands_median0.0022914314095170913
set_robot_commands_min0.0022441893815994263
sim_compute_performance-ego0_max0.0021254472110582433
sim_compute_performance-ego0_mean0.002086751823816299
sim_compute_performance-ego0_median0.002093579095295615
sim_compute_performance-ego0_min0.0020344018936157226
sim_compute_sim_state_max0.010201217643768188
sim_compute_sim_state_mean0.00868718622081299
sim_compute_sim_state_median0.009572646327047464
sim_compute_sim_state_min0.005402234585388847
sim_render-ego0_max0.0040627014206116455
sim_render-ego0_mean0.004030184343064229
sim_render-ego0_median0.004033265223995396
sim_render-ego0_min0.00399150550365448
simulation-passed1
step_physics_max0.1562669903039932
step_physics_mean0.12210721340569766
step_physics_median0.11494437448463315
step_physics_min0.1022731143495311
survival_time_max12.500000000000044
survival_time_mean8.462500000000002
survival_time_min3.949999999999994
No reset possible
5765110889Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:25:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.90837115192834
survival_time_median53.64999999999909
deviation-center-line_median0.8906545855714834
in-drivable-lane_median14.19999999999981


other stats
agent_compute-ego0_max0.014278497464301845
agent_compute-ego0_mean0.013570294442560513
agent_compute-ego0_median0.013425283172300255
agent_compute-ego0_min0.013152113961339692
complete-iteration_max0.240299287964316
complete-iteration_mean0.19622814480189155
complete-iteration_median0.19019858156250977
complete-iteration_min0.16421612811823075
deviation-center-line_max1.309013801529915
deviation-center-line_mean0.8188836946178241
deviation-center-line_min0.18521180579841437
deviation-heading_max5.418176445166056
deviation-heading_mean3.5855123318800866
deviation-heading_median3.4097049908079486
deviation-heading_min2.1044629007383926
driven_any_max6.804885165214906
driven_any_mean4.435136651302222
driven_any_median5.324575231852295
driven_any_min0.2865109762893948
driven_lanedir_consec_max6.248487178119438
driven_lanedir_consec_mean2.54468640357284
driven_lanedir_consec_min0.11351613231524248
driven_lanedir_max6.248487178119438
driven_lanedir_mean2.6390958498202535
driven_lanedir_median2.097190044423167
driven_lanedir_min0.11351613231524248
get_duckie_state_max1.5123003626941742e-06
get_duckie_state_mean1.477221788113094e-06
get_duckie_state_median1.4780747396081026e-06
get_duckie_state_min1.4404373105419963e-06
get_robot_state_max0.004162547958438474
get_robot_state_mean0.003958971351069445
get_robot_state_median0.003911276244799561
get_robot_state_min0.0038507849562401863
get_state_dump_max0.005305963181895464
get_state_dump_mean0.005070575199122279
get_state_dump_median0.005040260539210804
get_state_dump_min0.004895816536172046
get_ui_image_max0.036798834800720215
get_ui_image_mean0.03237968911005096
get_ui_image_median0.03262904168692153
get_ui_image_min0.02746183826564055
in-drivable-lane_max41.6999999999986
in-drivable-lane_mean17.524999999999558
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.804885165214906, "get_ui_image": 0.03000583855139028, "step_physics": 0.10709751376899256, "survival_time": 59.99999999999873, "driven_lanedir": 2.071330445547987, "get_state_dump": 0.005121068692425705, "get_robot_state": 0.003905575837223457, "sim_render-ego0": 0.004165688124822637, "get_duckie_state": 1.4404373105419963e-06, "in-drivable-lane": 41.6999999999986, "deviation-heading": 2.2168133299357695, "agent_compute-ego0": 0.013337590315260555, "complete-iteration": 0.177925982145743, "set_robot_commands": 0.002315210958603121, "deviation-center-line": 0.8093630939894975, "driven_lanedir_consec": 2.071330445547987, "sim_compute_sim_state": 0.009720197029653734, "sim_compute_performance-ego0": 0.0021568267768269076}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2865109762893948, "get_ui_image": 0.036798834800720215, "step_physics": 0.1615204834470562, "survival_time": 5.04999999999999, "driven_lanedir": 0.11351613231524248, "get_state_dump": 0.004959452385995902, "get_robot_state": 0.0038507849562401863, "sim_render-ego0": 0.004188369302188649, "get_duckie_state": 1.453885845109528e-06, "in-drivable-lane": 2.3499999999999917, "deviation-heading": 2.1044629007383926, "agent_compute-ego0": 0.01351297602933996, "complete-iteration": 0.240299287964316, "set_robot_commands": 0.002331352701374129, "deviation-center-line": 0.18521180579841437, "driven_lanedir_consec": 0.11351613231524248, "sim_compute_sim_state": 0.010979287764605354, "sim_compute_performance-ego0": 0.0020630850511438705}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.364046553364432, "get_ui_image": 0.03525224482245279, "step_physics": 0.1227566035269684, "survival_time": 47.29999999999945, "driven_lanedir": 2.123049643298347, "get_state_dump": 0.005305963181895464, "get_robot_state": 0.004162547958438474, "sim_render-ego0": 0.004480108414179672, "get_duckie_state": 1.5022636341066772e-06, "in-drivable-lane": 26.049999999999628, "deviation-heading": 4.602596651680128, "agent_compute-ego0": 0.014278497464301845, "complete-iteration": 0.20247118097927652, "set_robot_commands": 0.00255605185044479, "deviation-center-line": 0.9719460771534694, "driven_lanedir_consec": 1.7454118583086928, "sim_compute_sim_state": 0.011216198126642858, "sim_compute_performance-ego0": 0.002355706981268201}, "LF-norm-small_loop-000-ego0": {"driven_any": 6.285103910340157, "get_ui_image": 0.02746183826564055, "step_physics": 0.09957843795604848, "survival_time": 59.99999999999873, "driven_lanedir": 6.248487178119438, "get_state_dump": 0.004895816536172046, "get_robot_state": 0.003916976652375665, "sim_render-ego0": 0.0040719401925727785, "get_duckie_state": 1.5123003626941742e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.418176445166056, "agent_compute-ego0": 0.013152113961339692, "complete-iteration": 0.16421612811823075, "set_robot_commands": 0.002366532096259302, "deviation-center-line": 1.309013801529915, "driven_lanedir_consec": 6.248487178119438, "sim_compute_sim_state": 0.006579517821884473, "sim_compute_performance-ego0": 0.002099589642438166}}
set_robot_commands_max0.00255605185044479
set_robot_commands_mean0.0023922869016703356
set_robot_commands_median0.0023489423988167155
set_robot_commands_min0.002315210958603121
sim_compute_performance-ego0_max0.002355706981268201
sim_compute_performance-ego0_mean0.002168802112919286
sim_compute_performance-ego0_median0.0021282082096325365
sim_compute_performance-ego0_min0.0020630850511438705
sim_compute_sim_state_max0.011216198126642858
sim_compute_sim_state_mean0.009623800185696604
sim_compute_sim_state_median0.010349742397129545
sim_compute_sim_state_min0.006579517821884473
sim_render-ego0_max0.004480108414179672
sim_render-ego0_mean0.004226526508440935
sim_render-ego0_median0.004177028713505643
sim_render-ego0_min0.0040719401925727785
simulation-passed1
step_physics_max0.1615204834470562
step_physics_mean0.1227382596747664
step_physics_median0.11492705864798047
step_physics_min0.09957843795604848
survival_time_max59.99999999999873
survival_time_mean43.087499999999224
survival_time_min5.04999999999999
No reset possible
5764511428Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-testingLFVmultibodyv-simhost-erroryesnogpu-prod-020:02:42
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5761010912Dishank Bansal 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:24:15
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.3531918388068849
survival_time_median37.34999999999978
deviation-center-line_median0.4330701323601547
in-drivable-lane_median17.4000000000002


other stats
agent_compute-ego0_max0.05779353894439398
agent_compute-ego0_mean0.04039503248300461
agent_compute-ego0_median0.04492304991967419
agent_compute-ego0_min0.013940491148276096
complete-iteration_max0.2394512192470821
complete-iteration_mean0.2138682808275884
complete-iteration_median0.20867764122942056
complete-iteration_min0.1986666216044303
deviation-center-line_max1.5266157252517392
deviation-center-line_mean0.6609977905046128
deviation-center-line_min0.25123517204640267
deviation-heading_max4.111228319781198
deviation-heading_mean2.1091922296085532
deviation-heading_median1.6877418060963238
deviation-heading_min0.9500569864603684
driven_any_max9.171529853328751
driven_any_mean5.82712174890083
driven_any_median5.585745463827233
driven_any_min2.9654662146201005
driven_lanedir_consec_max6.150149492560527
driven_lanedir_consec_mean2.394844280714057
driven_lanedir_consec_min0.7228439526819312
driven_lanedir_max6.150149492560527
driven_lanedir_mean2.394844280714057
driven_lanedir_median1.3531918388068849
driven_lanedir_min0.7228439526819312
get_duckie_state_max1.567251542035271e-06
get_duckie_state_mean1.5132688641908415e-06
get_duckie_state_median1.5079444477714352e-06
get_duckie_state_min1.4699350191852238e-06
get_robot_state_max0.003912046489667932
get_robot_state_mean0.003860257017398216
get_robot_state_median0.0038617638637596175
get_robot_state_min0.0038054538524056984
get_state_dump_max0.0049159497606988045
get_state_dump_mean0.004818301692068982
get_state_dump_median0.004815226899338905
get_state_dump_min0.00472680320889931
get_ui_image_max0.03769894425324568
get_ui_image_mean0.03297925203746464
get_ui_image_median0.032758968872100155
get_ui_image_min0.028700126152412565
in-drivable-lane_max46.799999999998676
in-drivable-lane_mean23.137499999999612
in-drivable-lane_min10.949999999999378
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 7.641666948206565, "get_ui_image": 0.03035088903025577, "step_physics": 0.1083726993939172, "survival_time": 49.34999999999933, "driven_lanedir": 6.150149492560527, "get_state_dump": 0.004829309488597669, "get_robot_state": 0.003835821199996269, "sim_render-ego0": 0.00413983408738727, "get_duckie_state": 1.531380873460036e-06, "in-drivable-lane": 10.949999999999378, "deviation-heading": 4.111228319781198, "agent_compute-ego0": 0.04159422972906939, "complete-iteration": 0.20806490071871983, "set_robot_commands": 0.002429739907685562, "deviation-center-line": 1.5266157252517392, "driven_lanedir_consec": 6.150149492560527, "sim_compute_sim_state": 0.010298753556934928, "sim_compute_performance-ego0": 0.0021157904192503647}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.5298239794479005, "get_ui_image": 0.03769894425324568, "step_physics": 0.1254145033716217, "survival_time": 25.350000000000225, "driven_lanedir": 0.7228439526819312, "get_state_dump": 0.00472680320889931, "get_robot_state": 0.0038054538524056984, "sim_render-ego0": 0.004133510308002863, "get_duckie_state": 1.4699350191852238e-06, "in-drivable-lane": 19.55000000000024, "deviation-heading": 1.5568572379215206, "agent_compute-ego0": 0.048251870110279, "complete-iteration": 0.2394512192470821, "set_robot_commands": 0.0023477964513883816, "deviation-center-line": 0.2795023437270318, "driven_lanedir_consec": 0.7228439526819312, "sim_compute_sim_state": 0.010900185333462212, "sim_compute_performance-ego0": 0.0020732903105067455}, "LF-norm-techtrack-000-ego0": {"driven_any": 9.171529853328751, "get_ui_image": 0.035167048713944535, "step_physics": 0.1196523760875794, "survival_time": 59.99999999999873, "driven_lanedir": 1.9540597168941336, "get_state_dump": 0.0048011443100801415, "get_robot_state": 0.003912046489667932, "sim_render-ego0": 0.004211000756955365, "get_duckie_state": 1.4845080220828343e-06, "in-drivable-lane": 46.799999999998676, "deviation-heading": 1.818626374271127, "agent_compute-ego0": 0.013940491148276096, "complete-iteration": 0.1986666216044303, "set_robot_commands": 0.00234814468371084, "deviation-center-line": 0.5866379209932775, "driven_lanedir_consec": 1.9540597168941336, "sim_compute_sim_state": 0.012412103784769203, "sim_compute_performance-ego0": 0.0021246726268733373}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.9654662146201005, "get_ui_image": 0.028700126152412565, "step_physics": 0.09912721900378955, "survival_time": 20.35000000000015, "driven_lanedir": 0.7523239607196357, "get_state_dump": 0.0049159497606988045, "get_robot_state": 0.003887706527522966, "sim_render-ego0": 0.004227939774008358, "get_duckie_state": 1.567251542035271e-06, "in-drivable-lane": 15.250000000000163, "deviation-heading": 0.9500569864603684, "agent_compute-ego0": 0.05779353894439398, "complete-iteration": 0.20929038174012127, "set_robot_commands": 0.002450339350045896, "deviation-center-line": 0.25123517204640267, "driven_lanedir_consec": 0.7523239607196357, "sim_compute_sim_state": 0.005971296160828834, "sim_compute_performance-ego0": 0.002118478218714396}}
set_robot_commands_max0.002450339350045896
set_robot_commands_mean0.0023940050982076697
set_robot_commands_median0.002388942295698201
set_robot_commands_min0.0023477964513883816
sim_compute_performance-ego0_max0.0021246726268733373
sim_compute_performance-ego0_mean0.0021080578938362108
sim_compute_performance-ego0_median0.00211713431898238
sim_compute_performance-ego0_min0.0020732903105067455
sim_compute_sim_state_max0.012412103784769203
sim_compute_sim_state_mean0.009895584708998796
sim_compute_sim_state_median0.01059946944519857
sim_compute_sim_state_min0.005971296160828834
sim_render-ego0_max0.004227939774008358
sim_render-ego0_mean0.004178071231588464
sim_render-ego0_median0.004175417422171318
sim_render-ego0_min0.004133510308002863
simulation-passed1
step_physics_max0.1254145033716217
step_physics_mean0.11314169946422696
step_physics_median0.1140125377407483
step_physics_min0.09912721900378955
survival_time_max59.99999999999873
survival_time_mean38.76249999999961
survival_time_min20.35000000000015
No reset possible
5755410896Dishank Bansal 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:21:38
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.288922167900587
survival_time_median39.89999999999965
deviation-center-line_median0.8138059974872266
in-drivable-lane_median20.699999999999505


other stats
agent_compute-ego0_max0.014542906955607886
agent_compute-ego0_mean0.013547314304723447
agent_compute-ego0_median0.013359600773863323
agent_compute-ego0_min0.01292714871555926
complete-iteration_max0.21425391493491755
complete-iteration_mean0.1900556426593683
complete-iteration_median0.18929586752982772
complete-iteration_min0.16737692064290044
deviation-center-line_max1.6375771507941683
deviation-center-line_mean0.8818947359075111
deviation-center-line_min0.262389797861423
deviation-heading_max4.922665208093831
deviation-heading_mean3.2239086904403926
deviation-heading_median3.241604134270365
deviation-heading_min1.489761285127009
driven_any_max10.422623888978114
driven_any_mean6.312768829061833
driven_any_median6.784430820655794
driven_any_min1.2595897859576306
driven_lanedir_consec_max3.777689908581664
driven_lanedir_consec_mean2.261128618503394
driven_lanedir_consec_min0.6889802296307384
driven_lanedir_max3.777689908581664
driven_lanedir_mean2.261128618503394
driven_lanedir_median2.288922167900587
driven_lanedir_min0.6889802296307384
get_duckie_state_max1.5971730056318264e-06
get_duckie_state_mean1.426300868885634e-06
get_duckie_state_median1.386874090421163e-06
get_duckie_state_min1.334282289068383e-06
get_robot_state_max0.004248394549471661
get_robot_state_mean0.003948346871019746
get_robot_state_median0.003914306585737602
get_robot_state_min0.0037163797631321184
get_state_dump_max0.005292186922240026
get_state_dump_mean0.004912446422659288
get_state_dump_median0.00479018380680373
get_state_dump_min0.004777231154789664
get_ui_image_max0.03681270185723362
get_ui_image_mean0.03140220086227979
get_ui_image_median0.03126954043349905
get_ui_image_min0.026257020724887444
in-drivable-lane_max47.39999999999869
in-drivable-lane_mean23.124999999999417
in-drivable-lane_min3.6999999999999904
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.422623888978114, "get_ui_image": 0.02792083234413776, "step_physics": 0.09963307869027398, "survival_time": 59.99999999999873, "driven_lanedir": 2.108072918360004, "get_state_dump": 0.004778213842425319, "get_robot_state": 0.003863524636261469, "sim_render-ego0": 0.004088430182324361, "get_duckie_state": 1.3465389026193992e-06, "in-drivable-lane": 47.39999999999869, "deviation-heading": 1.6436190426775614, "agent_compute-ego0": 0.013454880543692128, "complete-iteration": 0.16737692064290044, "set_robot_commands": 0.002322144949068932, "deviation-center-line": 0.7041824247034676, "driven_lanedir_consec": 2.108072918360004, "sim_compute_sim_state": 0.009120726168503075, "sim_compute_performance-ego0": 0.002103095249172849}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2595897859576306, "get_ui_image": 0.03681270185723362, "step_physics": 0.13450942556542086, "survival_time": 8.249999999999982, "driven_lanedir": 0.6889802296307384, "get_state_dump": 0.004802153771182141, "get_robot_state": 0.0037163797631321184, "sim_render-ego0": 0.0038875901555440514, "get_duckie_state": 1.334282289068383e-06, "in-drivable-lane": 3.6999999999999904, "deviation-heading": 1.489761285127009, "agent_compute-ego0": 0.01292714871555926, "complete-iteration": 0.2112013704805489, "set_robot_commands": 0.002174210835652179, "deviation-center-line": 0.262389797861423, "driven_lanedir_consec": 0.6889802296307384, "sim_compute_sim_state": 0.010284102106668865, "sim_compute_performance-ego0": 0.001998960253704025}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.299348227963633, "get_ui_image": 0.034618248522860336, "step_physics": 0.13414941482173587, "survival_time": 25.70000000000023, "driven_lanedir": 2.4697714174411702, "get_state_dump": 0.005292186922240026, "get_robot_state": 0.004248394549471661, "sim_render-ego0": 0.004430764855690373, "get_duckie_state": 1.5971730056318264e-06, "in-drivable-lane": 10.050000000000145, "deviation-heading": 4.922665208093831, "agent_compute-ego0": 0.014542906955607886, "complete-iteration": 0.21425391493491755, "set_robot_commands": 0.002489236720557352, "deviation-center-line": 0.9234295702709856, "driven_lanedir_consec": 2.4697714174411702, "sim_compute_sim_state": 0.012037885073319222, "sim_compute_performance-ego0": 0.0023368682676148645}, "LF-norm-small_loop-000-ego0": {"driven_any": 9.269513413347957, "get_ui_image": 0.026257020724887444, "step_physics": 0.10370716802081024, "survival_time": 54.09999999999906, "driven_lanedir": 3.777689908581664, "get_state_dump": 0.004777231154789664, "get_robot_state": 0.003965088535213735, "sim_render-ego0": 0.004128368937738054, "get_duckie_state": 1.4272092782229269e-06, "in-drivable-lane": 31.34999999999886, "deviation-heading": 4.839589225863169, "agent_compute-ego0": 0.01326432100403452, "complete-iteration": 0.16739036457910653, "set_robot_commands": 0.002377207369465357, "deviation-center-line": 1.6375771507941683, "driven_lanedir_consec": 3.777689908581664, "sim_compute_sim_state": 0.006640753697600501, "sim_compute_performance-ego0": 0.00217868394578703}}
set_robot_commands_max0.002489236720557352
set_robot_commands_mean0.0023406999686859547
set_robot_commands_median0.0023496761592671444
set_robot_commands_min0.002174210835652179
sim_compute_performance-ego0_max0.0023368682676148645
sim_compute_performance-ego0_mean0.002154401929069692
sim_compute_performance-ego0_median0.0021408895974799396
sim_compute_performance-ego0_min0.001998960253704025
sim_compute_sim_state_max0.012037885073319222
sim_compute_sim_state_mean0.009520866761522915
sim_compute_sim_state_median0.00970241413758597
sim_compute_sim_state_min0.006640753697600501
sim_render-ego0_max0.004430764855690373
sim_render-ego0_mean0.0041337885328242095
sim_render-ego0_median0.004108399560031208
sim_render-ego0_min0.0038875901555440514
simulation-passed1
step_physics_max0.13450942556542086
step_physics_mean0.11799977177456024
step_physics_median0.11892829142127304
step_physics_min0.09963307869027398
survival_time_max59.99999999999873
survival_time_mean37.012499999999505
survival_time_min8.249999999999982
No reset possible
5754011313Moustafa Elarabitemplate-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-020:02:38
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5740710931Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:36:08
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.009278116783561
survival_time_median59.99999999999873
deviation-center-line_median1.2766452253152436
in-drivable-lane_median15.274999999999222


other stats
agent_compute-ego0_max0.04911403790997228
agent_compute-ego0_mean0.0380165204715967
agent_compute-ego0_median0.040701506735383225
agent_compute-ego0_min0.021549030505648065
complete-iteration_max0.2222801662305313
complete-iteration_mean0.20020298899262276
complete-iteration_median0.1959986681743625
complete-iteration_min0.18653445339123473
deviation-center-line_max2.703965477861179
deviation-center-line_mean1.4475825377679412
deviation-center-line_min0.5330742225800983
deviation-heading_max10.239805832874453
deviation-heading_mean5.942806256709256
deviation-heading_median5.753878315367835
deviation-heading_min2.0236625632269
driven_any_max8.126009877813281
driven_any_mean7.225065236874509
driven_any_median7.080495627571432
driven_any_min6.613259814541894
driven_lanedir_consec_max7.348429343220604
driven_lanedir_consec_mean4.8512152579430525
driven_lanedir_consec_min2.037875454984482
driven_lanedir_max7.348429343220604
driven_lanedir_mean4.8512152579430525
driven_lanedir_median5.009278116783561
driven_lanedir_min2.037875454984482
get_duckie_state_max1.365596507610032e-06
get_duckie_state_mean1.2631122516057176e-06
get_duckie_state_median1.253434561571412e-06
get_duckie_state_min1.1799833756700146e-06
get_robot_state_max0.003751207450148863
get_robot_state_mean0.0036929872609693538
get_robot_state_median0.003697307282542309
get_robot_state_min0.003626127028643936
get_state_dump_max0.004859600734154847
get_state_dump_mean0.00465777702474475
get_state_dump_median0.004627498560007367
get_state_dump_min0.00451651024480942
get_ui_image_max0.035582093573132724
get_ui_image_mean0.03104515486613202
get_ui_image_median0.03066477777558898
get_ui_image_min0.027268970340217386
in-drivable-lane_max44.99999999999865
in-drivable-lane_mean18.887499999999275
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.126009877813281, "get_ui_image": 0.02878536213248298, "step_physics": 0.09360512150614386, "survival_time": 59.99999999999873, "driven_lanedir": 2.037875454984482, "get_state_dump": 0.004623474030570126, "get_robot_state": 0.00370266495100366, "sim_render-ego0": 0.003993963818069699, "get_duckie_state": 1.365596507610032e-06, "in-drivable-lane": 44.99999999999865, "deviation-heading": 2.0236625632269, "agent_compute-ego0": 0.04911403790997228, "complete-iteration": 0.19741857220588577, "set_robot_commands": 0.0022930822999749356, "deviation-center-line": 0.5330742225800983, "driven_lanedir_consec": 2.037875454984482, "sim_compute_sim_state": 0.009187115122138411, "sim_compute_performance-ego0": 0.002023327062767213}, "LF-norm-zigzag-000-ego0": {"driven_any": 6.613259814541894, "get_ui_image": 0.035582093573132724, "step_physics": 0.11672391859716816, "survival_time": 59.99999999999873, "driven_lanedir": 3.3926359681626903, "get_state_dump": 0.004631523089444607, "get_robot_state": 0.003626127028643936, "sim_render-ego0": 0.003932989209418888, "get_duckie_state": 1.2365606404859556e-06, "in-drivable-lane": 30.549999999998445, "deviation-heading": 5.443894859314437, "agent_compute-ego0": 0.04175185045532938, "complete-iteration": 0.2222801662305313, "set_robot_commands": 0.002258530465093481, "deviation-center-line": 1.3408542086195088, "driven_lanedir_consec": 3.3926359681626903, "sim_compute_sim_state": 0.011685994542905632, "sim_compute_performance-ego0": 0.0019981535547083365}, "LF-norm-techtrack-000-ego0": {"driven_any": 6.761508136366983, "get_ui_image": 0.032544193418694974, "step_physics": 0.11128257037598724, "survival_time": 59.99999999999873, "driven_lanedir": 6.625920265404432, "get_state_dump": 0.00451651024480942, "get_robot_state": 0.003691949614080958, "sim_render-ego0": 0.0039034112109232705, "get_duckie_state": 1.1799833756700146e-06, "in-drivable-lane": 0.0, "deviation-heading": 10.239805832874453, "agent_compute-ego0": 0.021549030505648065, "complete-iteration": 0.19457876414283923, "set_robot_commands": 0.0022651748196667776, "deviation-center-line": 2.703965477861179, "driven_lanedir_consec": 6.625920265404432, "sim_compute_sim_state": 0.012709704366552143, "sim_compute_performance-ego0": 0.0020296059480614708}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.399483118775881, "get_ui_image": 0.027268970340217386, "step_physics": 0.0960880953703792, "survival_time": 59.99999999999873, "driven_lanedir": 7.348429343220604, "get_state_dump": 0.004859600734154847, "get_robot_state": 0.003751207450148863, "sim_render-ego0": 0.003994097419821352, "get_duckie_state": 1.270308482656868e-06, "in-drivable-lane": 0.0, "deviation-heading": 6.063861771421233, "agent_compute-ego0": 0.039651163015437065, "complete-iteration": 0.18653445339123473, "set_robot_commands": 0.0023535070173150794, "deviation-center-line": 1.2124362420109789, "driven_lanedir_consec": 7.348429343220604, "sim_compute_sim_state": 0.006441130229178118, "sim_compute_performance-ego0": 0.002034975031234144}}
set_robot_commands_max0.0023535070173150794
set_robot_commands_mean0.0022925736505125683
set_robot_commands_median0.0022791285598208564
set_robot_commands_min0.002258530465093481
sim_compute_performance-ego0_max0.002034975031234144
sim_compute_performance-ego0_mean0.002021515399192791
sim_compute_performance-ego0_median0.0020264665054143417
sim_compute_performance-ego0_min0.0019981535547083365
sim_compute_sim_state_max0.012709704366552143
sim_compute_sim_state_mean0.010005986065193576
sim_compute_sim_state_median0.01043655483252202
sim_compute_sim_state_min0.006441130229178118
sim_render-ego0_max0.003994097419821352
sim_render-ego0_mean0.003956115414558302
sim_render-ego0_median0.003963476513744294
sim_render-ego0_min0.0039034112109232705
simulation-passed1
step_physics_max0.11672391859716816
step_physics_mean0.10442492646241962
step_physics_median0.10368533287318324
step_physics_min0.09360512150614386
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5736310954Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:09:29
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.38655358965023856
survival_time_median11.775000000000032
deviation-center-line_median0.22552612640705863
in-drivable-lane_median9.30000000000002


other stats
agent_compute-ego0_max0.01333665791011992
agent_compute-ego0_mean0.01314722273093732
agent_compute-ego0_median0.013234171768029532
agent_compute-ego0_min0.01278388947757031
complete-iteration_max0.21872880756855012
complete-iteration_mean0.184203936126715
complete-iteration_median0.17853922437107753
complete-iteration_min0.1610084881961549
deviation-center-line_max0.3780318412864651
deviation-center-line_mean0.2275168611651499
deviation-center-line_min0.08098335056001725
deviation-heading_max3.0293798771978677
deviation-heading_mean1.5119020289295593
deviation-heading_median1.2255649631127474
deviation-heading_min0.5670983122948748
driven_any_max4.163470735353031
driven_any_mean2.318634239473083
driven_any_median2.250504860405421
driven_any_min0.6100565017284592
driven_lanedir_consec_max0.7097685032230868
driven_lanedir_consec_mean0.4065842795341923
driven_lanedir_consec_min0.14346143561320537
driven_lanedir_max0.7097685032230868
driven_lanedir_mean0.4065842795341923
driven_lanedir_median0.38655358965023856
driven_lanedir_min0.14346143561320537
get_duckie_state_max1.4477305942111545e-06
get_duckie_state_mean1.4019954358906909e-06
get_duckie_state_median1.4258936403554455e-06
get_duckie_state_min1.308463868640718e-06
get_robot_state_max0.0038021537992689344
get_robot_state_mean0.003734600252354156
get_robot_state_median0.003732794878028688
get_robot_state_min0.003670657454090314
get_state_dump_max0.004761397838592529
get_state_dump_mean0.004678894670711346
get_state_dump_median0.0046833486784072145
get_state_dump_min0.004587483487438424
get_ui_image_max0.03527139723300934
get_ui_image_mean0.030661507960451508
get_ui_image_median0.030073309804915453
get_ui_image_min0.02722801499896579
in-drivable-lane_max16.05000000000012
in-drivable-lane_mean9.337500000000038
in-drivable-lane_min2.6999999999999935
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.8427574452779423, "get_ui_image": 0.027914982200075746, "step_physics": 0.09439820152907648, "survival_time": 14.600000000000072, "driven_lanedir": 0.4915665660646922, "get_state_dump": 0.004587483487438424, "get_robot_state": 0.003670657454090314, "sim_render-ego0": 0.0037838973282953983, "get_duckie_state": 1.4093548771464375e-06, "in-drivable-lane": 11.450000000000047, "deviation-heading": 1.6314794201734109, "agent_compute-ego0": 0.01278388947757031, "complete-iteration": 0.1610084881961549, "set_robot_commands": 0.0021795721997986883, "deviation-center-line": 0.3395416199452017, "driven_lanedir_consec": 0.4915665660646922, "sim_compute_sim_state": 0.009637676408266451, "sim_compute_performance-ego0": 0.0019672665579733993}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6100565017284592, "get_ui_image": 0.03527139723300934, "step_physics": 0.14328112304210663, "survival_time": 3.949999999999994, "driven_lanedir": 0.14346143561320537, "get_state_dump": 0.004761397838592529, "get_robot_state": 0.003736379742622376, "sim_render-ego0": 0.003989744186401367, "get_duckie_state": 1.442432403564453e-06, "in-drivable-lane": 2.6999999999999935, "deviation-heading": 0.8196505060520841, "agent_compute-ego0": 0.01316726505756378, "complete-iteration": 0.21872880756855012, "set_robot_commands": 0.0022064328193664553, "deviation-center-line": 0.08098335056001725, "driven_lanedir_consec": 0.14346143561320537, "sim_compute_sim_state": 0.01018991470336914, "sim_compute_performance-ego0": 0.0020346373319625856}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.163470735353031, "get_ui_image": 0.03223163740975516, "step_physics": 0.1136299723670596, "survival_time": 20.950000000000163, "driven_lanedir": 0.7097685032230868, "get_state_dump": 0.004670673892611549, "get_robot_state": 0.0037292100134350007, "sim_render-ego0": 0.003945419334229969, "get_duckie_state": 1.308463868640718e-06, "in-drivable-lane": 16.05000000000012, "deviation-heading": 3.0293798771978677, "agent_compute-ego0": 0.01333665791011992, "complete-iteration": 0.1869793823787144, "set_robot_commands": 0.002200313409169515, "deviation-center-line": 0.3780318412864651, "driven_lanedir_consec": 0.7097685032230868, "sim_compute_sim_state": 0.011149386564890545, "sim_compute_performance-ego0": 0.002000164985656738}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6582522755328992, "get_ui_image": 0.02722801499896579, "step_physics": 0.10704699887169732, "survival_time": 8.949999999999992, "driven_lanedir": 0.28154061323578494, "get_state_dump": 0.004696023464202881, "get_robot_state": 0.0038021537992689344, "sim_render-ego0": 0.003993158870273166, "get_duckie_state": 1.4477305942111545e-06, "in-drivable-lane": 7.1499999999999915, "deviation-heading": 0.5670983122948748, "agent_compute-ego0": 0.01330107847849528, "complete-iteration": 0.17009906636344063, "set_robot_commands": 0.0022950967152913413, "deviation-center-line": 0.11151063286891554, "driven_lanedir_consec": 0.28154061323578494, "sim_compute_sim_state": 0.0056119521458943685, "sim_compute_performance-ego0": 0.002034890651702881}}
set_robot_commands_max0.0022950967152913413
set_robot_commands_mean0.0022203537859065
set_robot_commands_median0.002203373114267985
set_robot_commands_min0.0021795721997986883
sim_compute_performance-ego0_max0.002034890651702881
sim_compute_performance-ego0_mean0.002009239881823901
sim_compute_performance-ego0_median0.002017401158809662
sim_compute_performance-ego0_min0.0019672665579733993
sim_compute_sim_state_max0.011149386564890545
sim_compute_sim_state_mean0.009147232455605126
sim_compute_sim_state_median0.009913795555817796
sim_compute_sim_state_min0.0056119521458943685
sim_render-ego0_max0.003993158870273166
sim_render-ego0_mean0.003928054929799975
sim_render-ego0_median0.003967581760315668
sim_render-ego0_min0.0037838973282953983
simulation-passed1
step_physics_max0.14328112304210663
step_physics_mean0.11458907395248502
step_physics_median0.11033848561937848
step_physics_min0.09439820152907648
survival_time_max20.950000000000163
survival_time_mean12.112500000000058
survival_time_min3.949999999999994
No reset possible
5726010984Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:15:53
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.292879075621752
survival_time_median28.024999999999956
deviation-center-line_median0.31210387135738815
in-drivable-lane_median17.2249999999999


other stats
agent_compute-ego0_max0.05385613851020673
agent_compute-ego0_mean0.04746363704468908
agent_compute-ego0_median0.04655747304417532
agent_compute-ego0_min0.04288346358019896
complete-iteration_max0.2518086505658699
complete-iteration_mean0.21519903499141427
complete-iteration_median0.2068293269283437
complete-iteration_min0.19532883554309993
deviation-center-line_max0.7833556836580235
deviation-center-line_mean0.38347529572779016
deviation-center-line_min0.1263377565383605
deviation-heading_max3.384559974996328
deviation-heading_mean1.5796978373060753
deviation-heading_median1.1483723212480148
deviation-heading_min0.6374867317319441
driven_any_max5.5634666555952945
driven_any_mean3.137797492497316
driven_any_median3.1270178661863532
driven_any_min0.7336875820212635
driven_lanedir_consec_max2.0792017708290618
driven_lanedir_consec_mean1.2258499702279282
driven_lanedir_consec_min0.2384399588391468
driven_lanedir_max2.0792017708290618
driven_lanedir_mean1.2258499702279282
driven_lanedir_median1.292879075621752
driven_lanedir_min0.2384399588391468
get_duckie_state_max1.329364198626894e-06
get_duckie_state_mean1.2988961668137272e-06
get_duckie_state_median1.293714953996181e-06
get_duckie_state_min1.2787905606356531e-06
get_robot_state_max0.0037408729272386046
get_robot_state_mean0.003692491706089271
get_robot_state_median0.0037018106262058266
get_robot_state_min0.003625472644706825
get_state_dump_max0.004747027098530471
get_state_dump_mean0.004642947580546772
get_state_dump_median0.004626370323539189
get_state_dump_min0.0045720225765782385
get_ui_image_max0.03651657730641991
get_ui_image_mean0.030419970030514352
get_ui_image_median0.029550682554517683
get_ui_image_min0.02606193770660213
in-drivable-lane_max36.19999999999983
in-drivable-lane_mean18.449999999999903
in-drivable-lane_min3.1499999999999897
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.3983107814901454, "get_ui_image": 0.027963094122998126, "step_physics": 0.09791242457055428, "survival_time": 15.350000000000083, "driven_lanedir": 2.0792017708290618, "get_state_dump": 0.004624249099136947, "get_robot_state": 0.003625472644706825, "sim_render-ego0": 0.003767466390287721, "get_duckie_state": 1.2787905606356531e-06, "in-drivable-lane": 3.900000000000055, "deviation-heading": 1.4705554999054593, "agent_compute-ego0": 0.04384440493274045, "complete-iteration": 0.19532883554309993, "set_robot_commands": 0.002201759970033324, "deviation-center-line": 0.44317686773909143, "driven_lanedir_consec": 2.0792017708290618, "sim_compute_sim_state": 0.00939010103027542, "sim_compute_performance-ego0": 0.00191058586170147}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.7336875820212635, "get_ui_image": 0.03651657730641991, "step_physics": 0.14480326633260707, "survival_time": 4.899999999999991, "driven_lanedir": 0.2384399588391468, "get_state_dump": 0.004747027098530471, "get_robot_state": 0.0037347331191554217, "sim_render-ego0": 0.003971061321220013, "get_duckie_state": 1.329364198626894e-06, "in-drivable-lane": 3.1499999999999897, "deviation-heading": 0.8261891425905702, "agent_compute-ego0": 0.04288346358019896, "complete-iteration": 0.2518086505658699, "set_robot_commands": 0.0023704947847308535, "deviation-center-line": 0.1263377565383605, "driven_lanedir_consec": 0.2384399588391468, "sim_compute_sim_state": 0.01065161493089464, "sim_compute_performance-ego0": 0.002036463130604137}, "LF-norm-techtrack-000-ego0": {"driven_any": 5.5634666555952945, "get_ui_image": 0.031138270986037237, "step_physics": 0.1081065350219983, "survival_time": 41.599999999999774, "driven_lanedir": 1.8136200029073697, "get_state_dump": 0.0045720225765782385, "get_robot_state": 0.003668888133256232, "sim_render-ego0": 0.003837232830143776, "get_duckie_state": 1.2879755173553797e-06, "in-drivable-lane": 30.54999999999974, "deviation-heading": 3.384559974996328, "agent_compute-ego0": 0.04927054115561019, "complete-iteration": 0.21662657258032608, "set_robot_commands": 0.0022223150315118724, "deviation-center-line": 0.7833556836580235, "driven_lanedir_consec": 1.8136200029073697, "sim_compute_sim_state": 0.011795507616498748, "sim_compute_performance-ego0": 0.0019263677379521144}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.8557249508825615, "get_ui_image": 0.02606193770660213, "step_physics": 0.09371163742673908, "survival_time": 40.699999999999825, "driven_lanedir": 0.7721381483361347, "get_state_dump": 0.00462849154794143, "get_robot_state": 0.0037408729272386046, "sim_render-ego0": 0.0039053372810223352, "get_duckie_state": 1.2994543906369825e-06, "in-drivable-lane": 36.19999999999983, "deviation-heading": 0.6374867317319441, "agent_compute-ego0": 0.05385613851020673, "complete-iteration": 0.1970320812763612, "set_robot_commands": 0.0023084383069371887, "deviation-center-line": 0.18103087497568493, "driven_lanedir_consec": 0.7721381483361347, "sim_compute_sim_state": 0.006753899275890889, "sim_compute_performance-ego0": 0.0019739323598475544}}
set_robot_commands_max0.0023704947847308535
set_robot_commands_mean0.0022757520233033096
set_robot_commands_median0.0022653766692245303
set_robot_commands_min0.002201759970033324
sim_compute_performance-ego0_max0.002036463130604137
sim_compute_performance-ego0_mean0.001961837272526319
sim_compute_performance-ego0_median0.0019501500488998344
sim_compute_performance-ego0_min0.00191058586170147
sim_compute_sim_state_max0.011795507616498748
sim_compute_sim_state_mean0.009647780713389923
sim_compute_sim_state_median0.01002085798058503
sim_compute_sim_state_min0.006753899275890889
sim_render-ego0_max0.003971061321220013
sim_render-ego0_mean0.003870274455668461
sim_render-ego0_median0.003871285055583056
sim_render-ego0_min0.003767466390287721
simulation-passed1
step_physics_max0.14480326633260707
step_physics_mean0.11113346583797468
step_physics_median0.10300947979627628
step_physics_min0.09371163742673908
survival_time_max41.599999999999774
survival_time_mean25.63749999999992
survival_time_min4.899999999999991
No reset possible
5717110999Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:24:00
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0373453549377123
survival_time_median46.324999999999505
deviation-center-line_median1.2284685888087707
in-drivable-lane_median32.799999999999635


other stats
agent_compute-ego0_max0.015546161737015
agent_compute-ego0_mean0.0139126380016955
agent_compute-ego0_median0.013694262468425738
agent_compute-ego0_min0.012715865332915525
complete-iteration_max0.2576565884832126
complete-iteration_mean0.20860495951000688
complete-iteration_median0.1957115618818949
complete-iteration_min0.18534012579302503
deviation-center-line_max3.258477311340343
deviation-center-line_mean1.4560369343901034
deviation-center-line_min0.1087332486025286
deviation-heading_max4.486748431615586
deviation-heading_mean2.930711282462831
deviation-heading_median2.968884354979142
deviation-heading_min1.2983279882774543
driven_any_max8.208309123235825
driven_any_mean5.2169206740023695
driven_any_median6.189225983569536
driven_any_min0.2809216056345826
driven_lanedir_consec_max2.6451106765459955
driven_lanedir_consec_mean1.2107299157470477
driven_lanedir_consec_min0.1231182765667702
driven_lanedir_max2.6451106765459955
driven_lanedir_mean1.2107299157470477
driven_lanedir_median1.0373453549377123
driven_lanedir_min0.1231182765667702
get_duckie_state_max1.6464976645032134e-06
get_duckie_state_mean1.5107520700153783e-06
get_duckie_state_median1.5323309750595904e-06
get_duckie_state_min1.3318486654391198e-06
get_robot_state_max0.0042495497259668865
get_robot_state_mean0.003996994497347972
get_robot_state_median0.003991797154929899
get_robot_state_min0.003754833953565205
get_state_dump_max0.00544256594643664
get_state_dump_mean0.0050662274369703475
get_state_dump_median0.005074236165755168
get_state_dump_min0.004673871469934417
get_ui_image_max0.03815630656569751
get_ui_image_mean0.03226911802023596
get_ui_image_median0.031281748927246306
get_ui_image_min0.028356667660753693
in-drivable-lane_max48.399999999998926
in-drivable-lane_mean28.862499999999542
in-drivable-lane_min1.4499999999999953
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.337482971020223, "get_ui_image": 0.02967387383137274, "step_physics": 0.11305500753793513, "survival_time": 32.65000000000028, "driven_lanedir": 0.5820104217517509, "get_state_dump": 0.005083321431361207, "get_robot_state": 0.004056922157240935, "sim_render-ego0": 0.004219313280298075, "get_duckie_state": 1.5238374015971423e-06, "in-drivable-lane": 26.600000000000247, "deviation-heading": 3.0570913831678928, "agent_compute-ego0": 0.013802043888547003, "complete-iteration": 0.1859527636740915, "set_robot_commands": 0.0024349452523281085, "deviation-center-line": 0.7205858541885214, "driven_lanedir_consec": 0.5820104217517509, "sim_compute_sim_state": 0.011242606953378849, "sim_compute_performance-ego0": 0.0022783049749671865}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2809216056345826, "get_ui_image": 0.03815630656569751, "step_physics": 0.17477376781292817, "survival_time": 3.2999999999999963, "driven_lanedir": 0.1231182765667702, "get_state_dump": 0.00544256594643664, "get_robot_state": 0.003926672152618864, "sim_render-ego0": 0.004393392534398321, "get_duckie_state": 1.5408245485220383e-06, "in-drivable-lane": 1.4499999999999953, "deviation-heading": 1.2983279882774543, "agent_compute-ego0": 0.015546161737015, "complete-iteration": 0.2576565884832126, "set_robot_commands": 0.002473574965747435, "deviation-center-line": 0.1087332486025286, "driven_lanedir_consec": 0.1231182765667702, "sim_compute_sim_state": 0.010576458119634372, "sim_compute_performance-ego0": 0.002251913298421831}, "LF-norm-techtrack-000-ego0": {"driven_any": 8.040968996118849, "get_ui_image": 0.03288962402311987, "step_physics": 0.12992071549560902, "survival_time": 59.99999999999873, "driven_lanedir": 2.6451106765459955, "get_state_dump": 0.004673871469934417, "get_robot_state": 0.003754833953565205, "sim_render-ego0": 0.003916868063730562, "get_duckie_state": 1.3318486654391198e-06, "in-drivable-lane": 38.99999999999903, "deviation-heading": 4.486748431615586, "agent_compute-ego0": 0.012715865332915525, "complete-iteration": 0.2054703600896983, "set_robot_commands": 0.002231731502142278, "deviation-center-line": 3.258477311340343, "driven_lanedir_consec": 2.6451106765459955, "sim_compute_sim_state": 0.013230126267368848, "sim_compute_performance-ego0": 0.0020433631566640835}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.208309123235825, "get_ui_image": 0.028356667660753693, "step_physics": 0.11768564852350062, "survival_time": 59.99999999999873, "driven_lanedir": 1.4926802881236745, "get_state_dump": 0.005065150900149127, "get_robot_state": 0.0042495497259668865, "sim_render-ego0": 0.004319266812390431, "get_duckie_state": 1.6464976645032134e-06, "in-drivable-lane": 48.399999999998926, "deviation-heading": 2.880677326790391, "agent_compute-ego0": 0.013586481048304472, "complete-iteration": 0.18534012579302503, "set_robot_commands": 0.002544862046825399, "deviation-center-line": 1.7363513234290202, "driven_lanedir_consec": 1.4926802881236745, "sim_compute_sim_state": 0.007035812073008007, "sim_compute_performance-ego0": 0.002386124902323422}}
set_robot_commands_max0.002544862046825399
set_robot_commands_mean0.0024212784417608053
set_robot_commands_median0.0024542601090377716
set_robot_commands_min0.002231731502142278
sim_compute_performance-ego0_max0.002386124902323422
sim_compute_performance-ego0_mean0.002239926583094131
sim_compute_performance-ego0_median0.002265109136694509
sim_compute_performance-ego0_min0.0020433631566640835
sim_compute_sim_state_max0.013230126267368848
sim_compute_sim_state_mean0.010521250853347515
sim_compute_sim_state_median0.01090953253650661
sim_compute_sim_state_min0.007035812073008007
sim_render-ego0_max0.004393392534398321
sim_render-ego0_mean0.0042122101727043474
sim_render-ego0_median0.004269290046344253
sim_render-ego0_min0.003916868063730562
simulation-passed1
step_physics_max0.17477376781292817
step_physics_mean0.13385878484249322
step_physics_median0.1238031820095548
step_physics_min0.11305500753793513
survival_time_max59.99999999999873
survival_time_mean38.98749999999944
survival_time_min3.2999999999999963
No reset possible
5707511027Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:16:44
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.232276287982573
survival_time_median25.400000000000222
deviation-center-line_median0.8324366058606775
in-drivable-lane_median11.42500000000016


other stats
agent_compute-ego0_max0.01294625512624191
agent_compute-ego0_mean0.012712175332732436
agent_compute-ego0_median0.012797459670138098
agent_compute-ego0_min0.01230752686441163
complete-iteration_max0.21355440739398351
complete-iteration_mean0.18397758502981815
complete-iteration_median0.17997081169668147
complete-iteration_min0.16241430933192624
deviation-center-line_max1.5809077801892024
deviation-center-line_mean0.9812207035907916
deviation-center-line_min0.6791018224526096
deviation-heading_max9.421465104239546
deviation-heading_mean5.4437781130346234
deviation-heading_median4.554443720259679
deviation-heading_min3.24475990737959
driven_any_max6.084835549114516
driven_any_mean4.185905557571496
driven_any_median3.6677854528705063
driven_any_min3.3232157754304503
driven_lanedir_consec_max4.013208417124881
driven_lanedir_consec_mean2.4009795640589693
driven_lanedir_consec_min1.1261572631458514
driven_lanedir_max4.013208417124881
driven_lanedir_mean2.411141778068939
driven_lanedir_median2.236396435749183
driven_lanedir_min1.1585658236525098
get_duckie_state_max1.2820049867791645e-06
get_duckie_state_mean1.2512822955653342e-06
get_duckie_state_median1.2545156511659703e-06
get_duckie_state_min1.2140928931502314e-06
get_robot_state_max0.003636848650738635
get_robot_state_mean0.0036080880614125423
get_robot_state_median0.003609475082115746
get_robot_state_min0.0035765534306800417
get_state_dump_max0.0045985498670804295
get_state_dump_mean0.004541242788410351
get_state_dump_median0.004543760431353794
get_state_dump_min0.004478900423853388
get_ui_image_max0.035247416455346625
get_ui_image_mean0.029976909249890864
get_ui_image_median0.029259693619558283
get_ui_image_min0.026140833305100263
in-drivable-lane_max13.749999999999709
in-drivable-lane_mean10.975000000000032
in-drivable-lane_min7.300000000000104
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.084835549114516, "get_ui_image": 0.027817178814454068, "step_physics": 0.10356561138574752, "survival_time": 38.84999999999993, "driven_lanedir": 4.013208417124881, "get_state_dump": 0.0045510236279210576, "get_robot_state": 0.003636848650738635, "sim_render-ego0": 0.003902855446528653, "get_duckie_state": 1.2785119691667336e-06, "in-drivable-lane": 13.749999999999709, "deviation-heading": 4.384245279897117, "agent_compute-ego0": 0.012806946943229144, "complete-iteration": 0.1712579485076865, "set_robot_commands": 0.002183861168613777, "deviation-center-line": 0.933538389854154, "driven_lanedir_consec": 4.013208417124881, "sim_compute_sim_state": 0.010695721006025692, "sim_compute_performance-ego0": 0.0020058911992835507}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.3822026758699826, "get_ui_image": 0.035247416455346625, "step_physics": 0.13812676673283392, "survival_time": 23.250000000000195, "driven_lanedir": 2.0129938985904863, "get_state_dump": 0.004536497234786529, "get_robot_state": 0.0035765534306800417, "sim_render-ego0": 0.0038661537252270618, "get_duckie_state": 1.2140928931502314e-06, "in-drivable-lane": 9.15000000000013, "deviation-heading": 3.24475990737959, "agent_compute-ego0": 0.012787972397047051, "complete-iteration": 0.21355440739398351, "set_robot_commands": 0.0021420451192896766, "deviation-center-line": 0.731334821867201, "driven_lanedir_consec": 2.0129938985904863, "sim_compute_sim_state": 0.011219915402293716, "sim_compute_performance-ego0": 0.0019500357910287227}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.9533682298710313, "get_ui_image": 0.030702208424662494, "step_physics": 0.119289015238975, "survival_time": 27.250000000000252, "driven_lanedir": 2.4597989729078797, "get_state_dump": 0.004478900423853388, "get_robot_state": 0.00359412602015904, "sim_render-ego0": 0.003787684789944045, "get_duckie_state": 1.2305193331652073e-06, "in-drivable-lane": 7.300000000000104, "deviation-heading": 9.421465104239546, "agent_compute-ego0": 0.01230752686441163, "complete-iteration": 0.18868367488567644, "set_robot_commands": 0.0021449445368169427, "deviation-center-line": 1.5809077801892024, "driven_lanedir_consec": 2.45155867737466, "sim_compute_sim_state": 0.010375293183239388, "sim_compute_performance-ego0": 0.0019167307968978044}, "LF-norm-small_loop-000-ego0": {"driven_any": 3.3232157754304503, "get_ui_image": 0.026140833305100263, "step_physics": 0.10062770267664375, "survival_time": 23.5500000000002, "driven_lanedir": 1.1585658236525098, "get_state_dump": 0.0045985498670804295, "get_robot_state": 0.003624824144072452, "sim_render-ego0": 0.003951667223946523, "get_duckie_state": 1.2820049867791645e-06, "in-drivable-lane": 13.700000000000191, "deviation-heading": 4.724642160622241, "agent_compute-ego0": 0.01294625512624191, "complete-iteration": 0.16241430933192624, "set_robot_commands": 0.0021683381775678212, "deviation-center-line": 0.6791018224526096, "driven_lanedir_consec": 1.1261572631458514, "sim_compute_sim_state": 0.006310814518039509, "sim_compute_performance-ego0": 0.001955186916609942}}
set_robot_commands_max0.002183861168613777
set_robot_commands_mean0.002159797250572054
set_robot_commands_median0.002156641357192382
set_robot_commands_min0.0021420451192896766
sim_compute_performance-ego0_max0.0020058911992835507
sim_compute_performance-ego0_mean0.001956961175955005
sim_compute_performance-ego0_median0.0019526113538193325
sim_compute_performance-ego0_min0.0019167307968978044
sim_compute_sim_state_max0.011219915402293716
sim_compute_sim_state_mean0.009650436027399576
sim_compute_sim_state_median0.01053550709463254
sim_compute_sim_state_min0.006310814518039509
sim_render-ego0_max0.003951667223946523
sim_render-ego0_mean0.0038770902964115703
sim_render-ego0_median0.003884504585877857
sim_render-ego0_min0.003787684789944045
simulation-passed1
step_physics_max0.13812676673283392
step_physics_mean0.11540227400855003
step_physics_median0.11142731331236123
step_physics_min0.10062770267664375
survival_time_max38.84999999999993
survival_time_mean28.225000000000144
survival_time_min23.250000000000195
No reset possible
5706011425Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFP-sim-validationLFP-simhost-errornonogpu-prod-020:02:15
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5693311055Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:27:40
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median3.9570709804656232
survival_time_median51.87499999999919
deviation-center-line_median1.965313889275461
in-drivable-lane_median14.924999999999915


other stats
agent_compute-ego0_max0.0134826972930724
agent_compute-ego0_mean0.012996409745420087
agent_compute-ego0_median0.012886892235139167
agent_compute-ego0_min0.012729157218329614
complete-iteration_max0.20790984469786175
complete-iteration_mean0.1839989575761384
complete-iteration_median0.1867375138886547
complete-iteration_min0.1546109578293825
deviation-center-line_max3.721679236003632
deviation-center-line_mean2.055348420850467
deviation-center-line_min0.5690866688473133
deviation-heading_max12.033026538016678
deviation-heading_mean6.178311670182594
deviation-heading_median5.377971266218302
deviation-heading_min1.9242776102770955
driven_any_max8.63818176817219
driven_any_mean6.210591365070947
driven_any_median6.5645123824633576
driven_any_min3.075158927184882
driven_lanedir_consec_max7.868151281303004
driven_lanedir_consec_mean4.366987175946215
driven_lanedir_consec_min1.6856554615506103
driven_lanedir_max7.868151281303004
driven_lanedir_mean4.366987175946215
driven_lanedir_median3.9570709804656232
driven_lanedir_min1.6856554615506103
get_duckie_state_max1.5418279116556526e-06
get_duckie_state_mean1.3876974908494388e-06
get_duckie_state_median1.3749845110242116e-06
get_duckie_state_min1.2589930296936797e-06
get_robot_state_max0.003846156270536658
get_robot_state_mean0.003761780710262021
get_robot_state_median0.003804716334113213
get_robot_state_min0.0035915339022850015
get_state_dump_max0.0051597950121039125
get_state_dump_mean0.004950860326077232
get_state_dump_median0.004984314888918704
get_state_dump_min0.004675016514367605
get_ui_image_max0.0355848190091631
get_ui_image_mean0.030480642387912583
get_ui_image_median0.030234821800990963
get_ui_image_min0.025868106940505307
in-drivable-lane_max32.24999999999962
in-drivable-lane_mean17.037499999999778
in-drivable-lane_min6.049999999999656
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.368456252677022, "get_ui_image": 0.027847693391042212, "step_physics": 0.10975149314697474, "survival_time": 43.74999999999965, "driven_lanedir": 1.9681137943751408, "get_state_dump": 0.0051597950121039125, "get_robot_state": 0.003846156270536658, "sim_render-ego0": 0.004000800385322745, "get_duckie_state": 1.5418279116556526e-06, "in-drivable-lane": 32.24999999999962, "deviation-heading": 1.9242776102770955, "agent_compute-ego0": 0.013002806330380376, "complete-iteration": 0.1795286911807648, "set_robot_commands": 0.002295206398724421, "deviation-center-line": 0.5690866688473133, "driven_lanedir_consec": 1.9681137943751408, "sim_compute_sim_state": 0.01133034735509794, "sim_compute_performance-ego0": 0.0021916633327257688}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.760568512249694, "get_ui_image": 0.0355848190091631, "step_physics": 0.12981485248505326, "survival_time": 59.99999999999873, "driven_lanedir": 5.946028166556106, "get_state_dump": 0.005039943048697923, "get_robot_state": 0.003787614026732687, "sim_render-ego0": 0.004071834383161737, "get_duckie_state": 1.3141806774790538e-06, "in-drivable-lane": 16.44999999999964, "deviation-heading": 12.033026538016678, "agent_compute-ego0": 0.012770978139897964, "complete-iteration": 0.20790984469786175, "set_robot_commands": 0.002242441677630295, "deviation-center-line": 3.018300730297424, "driven_lanedir_consec": 5.946028166556106, "sim_compute_sim_state": 0.012417327752220542, "sim_compute_performance-ego0": 0.002084499791103239}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.075158927184882, "get_ui_image": 0.032621950210939714, "step_physics": 0.11969729064695792, "survival_time": 24.800000000000217, "driven_lanedir": 1.6856554615506103, "get_state_dump": 0.004928686729139486, "get_robot_state": 0.0038218186414937377, "sim_render-ego0": 0.004138620806411958, "get_duckie_state": 1.4357883445693691e-06, "in-drivable-lane": 13.40000000000019, "deviation-heading": 2.3674268454255496, "agent_compute-ego0": 0.0134826972930724, "complete-iteration": 0.1939463365965446, "set_robot_commands": 0.002234993326352156, "deviation-center-line": 0.9123270482534978, "driven_lanedir_consec": 1.6856554615506103, "sim_compute_sim_state": 0.0108301236595906, "sim_compute_performance-ego0": 0.002088407635448924}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.63818176817219, "get_ui_image": 0.025868106940505307, "step_physics": 0.0938237650408336, "survival_time": 59.99999999999873, "driven_lanedir": 7.868151281303004, "get_state_dump": 0.004675016514367605, "get_robot_state": 0.0035915339022850015, "sim_render-ego0": 0.0037708449224746793, "get_duckie_state": 1.2589930296936797e-06, "in-drivable-lane": 6.049999999999656, "deviation-heading": 8.388515687011054, "agent_compute-ego0": 0.012729157218329614, "complete-iteration": 0.1546109578293825, "set_robot_commands": 0.0021430370114824356, "deviation-center-line": 3.721679236003632, "driven_lanedir_consec": 7.868151281303004, "sim_compute_sim_state": 0.006016382865365796, "sim_compute_performance-ego0": 0.001909021533200584}}
set_robot_commands_max0.002295206398724421
set_robot_commands_mean0.002228919603547327
set_robot_commands_median0.002238717501991226
set_robot_commands_min0.0021430370114824356
sim_compute_performance-ego0_max0.0021916633327257688
sim_compute_performance-ego0_mean0.002068398073119629
sim_compute_performance-ego0_median0.0020864537132760817
sim_compute_performance-ego0_min0.001909021533200584
sim_compute_sim_state_max0.012417327752220542
sim_compute_sim_state_mean0.01014854540806872
sim_compute_sim_state_median0.01108023550734427
sim_compute_sim_state_min0.006016382865365796
sim_render-ego0_max0.004138620806411958
sim_render-ego0_mean0.00399552512434278
sim_render-ego0_median0.004036317384242241
sim_render-ego0_min0.0037708449224746793
simulation-passed1
step_physics_max0.12981485248505326
step_physics_mean0.11327185032995488
step_physics_median0.11472439189696632
step_physics_min0.0938237650408336
survival_time_max59.99999999999873
survival_time_mean47.13749999999933
survival_time_min24.800000000000217
No reset possible
5683911073Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:13:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.0130370278600584
survival_time_median13.300000000000054
deviation-center-line_median0.4686682917601732
in-drivable-lane_median6.425000000000054


other stats
agent_compute-ego0_max0.013503655284440436
agent_compute-ego0_mean0.012972215308283422
agent_compute-ego0_median0.013109613397422571
agent_compute-ego0_min0.012165979153848108
complete-iteration_max0.2100607917663899
complete-iteration_mean0.18489229713875072
complete-iteration_median0.1893599972534342
complete-iteration_min0.15078840228174464
deviation-center-line_max1.5150976349734553
deviation-center-line_mean0.6636677904013888
deviation-center-line_min0.2022369431117537
deviation-heading_max6.3643202764056435
deviation-heading_mean3.284953983659812
deviation-heading_median2.6617086968522248
deviation-heading_min1.452078264529155
driven_any_max9.17232621546722
driven_any_mean3.6585346741536977
driven_any_median2.176843236648984
driven_any_min1.1081260078496034
driven_lanedir_consec_max5.811066212044373
driven_lanedir_consec_mean2.1272560691134093
driven_lanedir_consec_min0.6718840086891466
driven_lanedir_max5.815561535576504
driven_lanedir_mean2.133860323976203
driven_lanedir_median1.014873827511265
driven_lanedir_min0.6901321053057784
get_duckie_state_max2.352491257682679e-06
get_duckie_state_mean2.144769158906164e-06
get_duckie_state_median2.132744602087973e-06
get_duckie_state_min1.9610961737660313e-06
get_robot_state_max0.003966574867566426
get_robot_state_mean0.0037399720108356807
get_robot_state_median0.0037282806230132313
get_robot_state_min0.003536751929749834
get_state_dump_max0.005087901134880221
get_state_dump_mean0.0047680288752199405
get_state_dump_median0.004759419172227242
get_state_dump_min0.0044653760215450575
get_ui_image_max0.034835168655882494
get_ui_image_mean0.030183098623787697
get_ui_image_median0.030230305430029525
get_ui_image_min0.02543661497920924
in-drivable-lane_max18.94999999999916
in-drivable-lane_mean8.599999999999815
in-drivable-lane_min2.5999999999999908
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.17232621546722, "get_ui_image": 0.028638036478133427, "step_physics": 0.10862880353889769, "survival_time": 50.34999999999928, "driven_lanedir": 5.815561535576504, "get_state_dump": 0.0049809300237231785, "get_robot_state": 0.003966574867566426, "sim_render-ego0": 0.0041785408107061234, "get_duckie_state": 2.352491257682679e-06, "in-drivable-lane": 18.94999999999916, "deviation-heading": 6.3643202764056435, "agent_compute-ego0": 0.013226423708219377, "complete-iteration": 0.1786531231233052, "set_robot_commands": 0.002367659220619807, "deviation-center-line": 1.5150976349734553, "driven_lanedir_consec": 5.811066212044373, "sim_compute_sim_state": 0.010335257129063682, "sim_compute_performance-ego0": 0.002232732753905039}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.4420176470002164, "get_ui_image": 0.034835168655882494, "step_physics": 0.1366020732737602, "survival_time": 9.349999999999998, "driven_lanedir": 0.7180663097994235, "get_state_dump": 0.0045379083207313054, "get_robot_state": 0.003536751929749834, "sim_render-ego0": 0.00382446862281637, "get_duckie_state": 2.0937716707270195e-06, "in-drivable-lane": 4.550000000000007, "deviation-heading": 1.604390120014377, "agent_compute-ego0": 0.012992803086625768, "complete-iteration": 0.2100607917663899, "set_robot_commands": 0.0022262258732572513, "deviation-center-line": 0.2640775128777551, "driven_lanedir_consec": 0.7143927104970107, "sim_compute_sim_state": 0.00948200580921579, "sim_compute_performance-ego0": 0.0019367819136761604}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.1081260078496034, "get_ui_image": 0.03182257438192562, "step_physics": 0.12876213651125124, "survival_time": 7.299999999999982, "driven_lanedir": 0.6901321053057784, "get_state_dump": 0.005087901134880221, "get_robot_state": 0.003900763128890472, "sim_render-ego0": 0.0040489800122319435, "get_duckie_state": 2.1717175334489265e-06, "in-drivable-lane": 2.5999999999999908, "deviation-heading": 1.452078264529155, "agent_compute-ego0": 0.013503655284440436, "complete-iteration": 0.2000668713835632, "set_robot_commands": 0.002319501370799785, "deviation-center-line": 0.2022369431117537, "driven_lanedir_consec": 0.6718840086891466, "sim_compute_sim_state": 0.008452097574869791, "sim_compute_performance-ego0": 0.0020732928295524753}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.9116688262977517, "get_ui_image": 0.02543661497920924, "step_physics": 0.09208753963426358, "survival_time": 17.25000000000011, "driven_lanedir": 1.3116813452231064, "get_state_dump": 0.0044653760215450575, "get_robot_state": 0.0035557981171359903, "sim_render-ego0": 0.003702601945469145, "get_duckie_state": 1.9610961737660313e-06, "in-drivable-lane": 8.3000000000001, "deviation-heading": 3.719027273690073, "agent_compute-ego0": 0.012165979153848108, "complete-iteration": 0.15078840228174464, "set_robot_commands": 0.0021723736228281363, "deviation-center-line": 0.6732590706425913, "driven_lanedir_consec": 1.3116813452231064, "sim_compute_sim_state": 0.005248769859358065, "sim_compute_performance-ego0": 0.0018724630333784688}}
set_robot_commands_max0.002367659220619807
set_robot_commands_mean0.0022714400218762447
set_robot_commands_median0.002272863622028518
set_robot_commands_min0.0021723736228281363
sim_compute_performance-ego0_max0.002232732753905039
sim_compute_performance-ego0_mean0.002028817632628036
sim_compute_performance-ego0_median0.0020050373716143178
sim_compute_performance-ego0_min0.0018724630333784688
sim_compute_sim_state_max0.010335257129063682
sim_compute_sim_state_mean0.008379532593126833
sim_compute_sim_state_median0.008967051692042791
sim_compute_sim_state_min0.005248769859358065
sim_render-ego0_max0.0041785408107061234
sim_render-ego0_mean0.003938647847805895
sim_render-ego0_median0.003936724317524157
sim_render-ego0_min0.003702601945469145
simulation-passed1
step_physics_max0.1366020732737602
step_physics_mean0.11652013823954316
step_physics_median0.11869547002507448
step_physics_min0.09208753963426358
survival_time_max50.34999999999928
survival_time_mean21.062499999999844
survival_time_min7.299999999999982
No reset possible
5668411095Olga (Ge Ya) Xu 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:27:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.738372597009802
survival_time_median54.49999999999904
deviation-center-line_median2.6972353552021895
in-drivable-lane_median18.024999999999487


other stats
agent_compute-ego0_max0.0130993698655853
agent_compute-ego0_mean0.012679593106777574
agent_compute-ego0_median0.01281344493925296
agent_compute-ego0_min0.011992112683019076
complete-iteration_max0.183250962578504
complete-iteration_mean0.1716153913549326
complete-iteration_median0.174286709384813
complete-iteration_min0.15463718407160038
deviation-center-line_max3.955333582355008
deviation-center-line_mean2.625516868340111
deviation-center-line_min1.152263180601058
deviation-heading_max14.709468064156988
deviation-heading_mean11.220309096199706
deviation-heading_median12.638594207463164
deviation-heading_min4.894579905715509
driven_any_max9.849776434642129
driven_any_mean7.396613830561384
driven_any_median7.916602226297872
driven_any_min3.903474435007664
driven_lanedir_consec_max7.360946829100959
driven_lanedir_consec_mean4.678242648181826
driven_lanedir_consec_min1.8752785696067384
driven_lanedir_max7.360946829100959
driven_lanedir_mean5.153181532307594
driven_lanedir_median5.6882503652613385
driven_lanedir_min1.8752785696067384
get_duckie_state_max1.5656396397270802e-06
get_duckie_state_mean1.2819222358623105e-06
get_duckie_state_median1.1974847573822777e-06
get_duckie_state_min1.167079788957607e-06
get_robot_state_max0.004005529100377261
get_robot_state_mean0.003672205933274463
get_robot_state_median0.003624403057730606
get_robot_state_min0.00343448851725938
get_state_dump_max0.004901344015450045
get_state_dump_mean0.004621030845656963
get_state_dump_median0.004602240414631007
get_state_dump_min0.004378298537915791
get_ui_image_max0.03349999245954096
get_ui_image_mean0.029300442747083415
get_ui_image_median0.028908345531862015
get_ui_image_min0.02588508746506868
in-drivable-lane_max18.549999999999756
in-drivable-lane_mean17.824999999999733
in-drivable-lane_min16.700000000000195
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 9.849776434642129, "get_ui_image": 0.02588508746506868, "step_physics": 0.0928063549467368, "survival_time": 59.99999999999873, "driven_lanedir": 7.360946829100959, "get_state_dump": 0.004378298537915791, "get_robot_state": 0.00343448851725938, "sim_render-ego0": 0.003659398232173364, "get_duckie_state": 1.167079788957607e-06, "in-drivable-lane": 18.249999999999307, "deviation-heading": 14.709468064156988, "agent_compute-ego0": 0.011992112683019076, "complete-iteration": 0.15463718407160038, "set_robot_commands": 0.002073836664077543, "deviation-center-line": 3.260941542012911, "driven_lanedir_consec": 7.360946829100959, "sim_compute_sim_state": 0.008493519742522609, "sim_compute_performance-ego0": 0.001836354289821145}, "LF-norm-zigzag-000-ego0": {"driven_any": 7.343308320526805, "get_ui_image": 0.03349999245954096, "step_physics": 0.10771553482640098, "survival_time": 59.99999999999873, "driven_lanedir": 5.162459901186199, "get_state_dump": 0.004502436005007119, "get_robot_state": 0.0035189673068819196, "sim_render-ego0": 0.0037530278484589055, "get_duckie_state": 1.198842463941995e-06, "in-drivable-lane": 17.799999999999663, "deviation-heading": 14.100598468137155, "agent_compute-ego0": 0.012598025411690006, "complete-iteration": 0.181165150262037, "set_robot_commands": 0.0021346566282045235, "deviation-center-line": 3.955333582355008, "driven_lanedir_consec": 5.162459901186199, "sim_compute_sim_state": 0.01146497357199333, "sim_compute_performance-ego0": 0.0018979323892966595}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.903474435007664, "get_ui_image": 0.03136840649264315, "step_physics": 0.11120000466477448, "survival_time": 29.500000000000284, "driven_lanedir": 1.8752785696067384, "get_state_dump": 0.004702044824254896, "get_robot_state": 0.003729838808579292, "sim_render-ego0": 0.003953777594009632, "get_duckie_state": 1.1961270508225598e-06, "in-drivable-lane": 16.700000000000195, "deviation-heading": 4.894579905715509, "agent_compute-ego0": 0.0130993698655853, "complete-iteration": 0.183250962578504, "set_robot_commands": 0.002218907254601493, "deviation-center-line": 1.152263180601058, "driven_lanedir_consec": 1.8752785696067384, "sim_compute_sim_state": 0.010886353687989934, "sim_compute_performance-ego0": 0.0020077692474003775}, "LF-norm-small_loop-000-ego0": {"driven_any": 8.489896132068939, "get_ui_image": 0.026448284571080883, "step_physics": 0.1038111573451642, "survival_time": 48.99999999999935, "driven_lanedir": 6.214040829336478, "get_state_dump": 0.004901344015450045, "get_robot_state": 0.004005529100377261, "sim_render-ego0": 0.004103463238046318, "get_duckie_state": 1.5656396397270802e-06, "in-drivable-lane": 18.549999999999756, "deviation-heading": 11.176589946789171, "agent_compute-ego0": 0.013028864466815912, "complete-iteration": 0.16740826850758905, "set_robot_commands": 0.0024253206515530926, "deviation-center-line": 2.1335291683914677, "driven_lanedir_consec": 4.3142852928334054, "sim_compute_sim_state": 0.006404997011937133, "sim_compute_performance-ego0": 0.0021822785504853445}}
set_robot_commands_max0.0024253206515530926
set_robot_commands_mean0.002213180299609163
set_robot_commands_median0.0021767819414030085
set_robot_commands_min0.002073836664077543
sim_compute_performance-ego0_max0.0021822785504853445
sim_compute_performance-ego0_mean0.0019810836192508817
sim_compute_performance-ego0_median0.0019528508183485184
sim_compute_performance-ego0_min0.001836354289821145
sim_compute_sim_state_max0.01146497357199333
sim_compute_sim_state_mean0.009312461003610752
sim_compute_sim_state_median0.00968993671525627
sim_compute_sim_state_min0.006404997011937133
sim_render-ego0_max0.004103463238046318
sim_render-ego0_mean0.003867416728172054
sim_render-ego0_median0.0038534027212342686
sim_render-ego0_min0.003659398232173364
simulation-passed1
step_physics_max0.11120000466477448
step_physics_mean0.1038832629457691
step_physics_median0.10576334608578258
step_physics_min0.0928063549467368
survival_time_max59.99999999999873
survival_time_mean49.62499999999927
survival_time_min29.500000000000284
No reset possible
5663711099Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:06:02
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5966357578760237
survival_time_median5.399999999999989
deviation-center-line_median0.1355985152827311
in-drivable-lane_median3.2249999999999885


other stats
agent_compute-ego0_max0.012313330839128058
agent_compute-ego0_mean0.01155857882397405
agent_compute-ego0_median0.011415283376887691
agent_compute-ego0_min0.011090417702992758
complete-iteration_max0.22086995442708332
complete-iteration_mean0.17673381375912295
complete-iteration_median0.16847047349523167
complete-iteration_min0.1491243536189451
deviation-center-line_max0.223658108855311
deviation-center-line_mean0.13875482928822186
deviation-center-line_min0.06016417773211421
deviation-heading_max0.9498669393882871
deviation-heading_mean0.6754258927262279
deviation-heading_median0.7069721045729424
deviation-heading_min0.33789242237073963
driven_any_max3.043314805810101
driven_any_mean1.6891813888942189
driven_any_median1.523383280077769
driven_any_min0.6666441896112367
driven_lanedir_consec_max0.6493374351351029
driven_lanedir_consec_mean0.5138987467365674
driven_lanedir_consec_min0.2129860360591196
driven_lanedir_max0.6493374351351029
driven_lanedir_mean0.5138987467365674
driven_lanedir_median0.5966357578760237
driven_lanedir_min0.2129860360591196
get_duckie_state_max1.2607897742319916e-06
get_duckie_state_mean1.2407950475124358e-06
get_duckie_state_median1.2369950612386068e-06
get_duckie_state_min1.2284002933405378e-06
get_robot_state_max0.003507554531097412
get_robot_state_mean0.0034825873554424685
get_robot_state_median0.0034953585070401885
get_robot_state_min0.003432077876592086
get_state_dump_max0.0044240237492595225
get_state_dump_mean0.004372355456354832
get_state_dump_median0.004379163354130114
get_state_dump_min0.004307071367899577
get_ui_image_max0.03293084700902303
get_ui_image_mean0.028495156278133375
get_ui_image_median0.027689712737417466
get_ui_image_min0.025670352628675557
in-drivable-lane_max7.2000000000000055
in-drivable-lane_mean3.887499999999995
in-drivable-lane_min1.8999999999999972
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.366138064429454, "get_ui_image": 0.025982322692871093, "step_physics": 0.11509879589080813, "survival_time": 4.94999999999999, "driven_lanedir": 0.5941192663534665, "get_state_dump": 0.0043506622314453125, "get_robot_state": 0.00350078821182251, "sim_render-ego0": 0.0036303186416625976, "get_duckie_state": 1.2421607971191406e-06, "in-drivable-lane": 2.6999999999999904, "deviation-heading": 0.885773195224132, "agent_compute-ego0": 0.01129948854446411, "complete-iteration": 0.1755826425552368, "set_robot_commands": 0.0021060729026794434, "deviation-center-line": 0.223658108855311, "driven_lanedir_consec": 0.5941192663534665, "sim_compute_sim_state": 0.007692916393280029, "sim_compute_performance-ego0": 0.0018425536155700685}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.6666441896112367, "get_ui_image": 0.03293084700902303, "step_physics": 0.15240921179453532, "survival_time": 2.9499999999999975, "driven_lanedir": 0.2129860360591196, "get_state_dump": 0.004307071367899577, "get_robot_state": 0.003507554531097412, "sim_render-ego0": 0.003660301367441813, "get_duckie_state": 1.231829325358073e-06, "in-drivable-lane": 1.8999999999999972, "deviation-heading": 0.5281710139217527, "agent_compute-ego0": 0.011090417702992758, "complete-iteration": 0.22086995442708332, "set_robot_commands": 0.002063643932342529, "deviation-center-line": 0.06016417773211421, "driven_lanedir_consec": 0.2129860360591196, "sim_compute_sim_state": 0.008989290396372477, "sim_compute_performance-ego0": 0.0018351236979166669}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.043314805810101, "get_ui_image": 0.029397102781963832, "step_physics": 0.09463963532810887, "survival_time": 9.800000000000004, "driven_lanedir": 0.6493374351351029, "get_state_dump": 0.0044240237492595225, "get_robot_state": 0.003489928802257867, "sim_render-ego0": 0.0038285848452960175, "get_duckie_state": 1.2284002933405378e-06, "in-drivable-lane": 7.2000000000000055, "deviation-heading": 0.9498669393882871, "agent_compute-ego0": 0.012313330839128058, "complete-iteration": 0.16135830443522653, "set_robot_commands": 0.002022426140489917, "deviation-center-line": 0.16688522610190676, "driven_lanedir_consec": 0.6493374351351029, "sim_compute_sim_state": 0.009277722557184056, "sim_compute_performance-ego0": 0.001886408946235773}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6806284957260835, "get_ui_image": 0.025670352628675557, "step_physics": 0.09154060129391944, "survival_time": 5.849999999999987, "driven_lanedir": 0.599152249398581, "get_state_dump": 0.004407664476814917, "get_robot_state": 0.003432077876592086, "sim_render-ego0": 0.003678356186818268, "get_duckie_state": 1.2607897742319916e-06, "in-drivable-lane": 3.7499999999999862, "deviation-heading": 0.33789242237073963, "agent_compute-ego0": 0.011531078209311277, "complete-iteration": 0.1491243536189451, "set_robot_commands": 0.002121381840463412, "deviation-center-line": 0.10431180446355544, "driven_lanedir_consec": 0.599152249398581, "sim_compute_sim_state": 0.004802633140046718, "sim_compute_performance-ego0": 0.0018613096010887016}}
set_robot_commands_max0.002121381840463412
set_robot_commands_mean0.002078381203993825
set_robot_commands_median0.002084858417510986
set_robot_commands_min0.002022426140489917
sim_compute_performance-ego0_max0.001886408946235773
sim_compute_performance-ego0_mean0.0018563489652028023
sim_compute_performance-ego0_median0.001851931608329385
sim_compute_performance-ego0_min0.0018351236979166669
sim_compute_sim_state_max0.009277722557184056
sim_compute_sim_state_mean0.00769064062172082
sim_compute_sim_state_median0.008341103394826254
sim_compute_sim_state_min0.004802633140046718
sim_render-ego0_max0.0038285848452960175
sim_render-ego0_mean0.003699390260304674
sim_render-ego0_median0.00366932877713004
sim_render-ego0_min0.0036303186416625976
simulation-passed1
step_physics_max0.15240921179453532
step_physics_mean0.11342206107684294
step_physics_median0.1048692156094585
step_physics_min0.09154060129391944
survival_time_max9.800000000000004
survival_time_mean5.887499999999995
survival_time_min2.9499999999999975
No reset possible
5656911134Himanshu Arora 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:05:19
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5656111429Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-020:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5650011117Daniil Lisussim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:05:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5644811126Bhavya Patwa 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:02:41
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5640011132Philippe Reddy 🇨🇦real-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:02:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5637911303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:50
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5632111278Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:01:27
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 48, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 48, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5628711280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:43
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5626711280Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:42
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5622711282Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:20
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 49, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 49, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5617611427Frank (Chude) Qian 🇨🇦template-pytorchaido5-LFV_multi-sim-validationLFVmultibodyv-simhost-erroryesnogpu-prod-020:02:19
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5609711145Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:07:40
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5607411308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:13
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5605111308Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:54
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5599511290Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:18
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5595611284Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:16
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5591411296Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:36
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5587511311Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:01:08
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5580311286Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:46
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5570811162Fernanda Custodio Pereira do Carmo 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:03:56
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5566511450Cliff Chandler 🇺🇸template-pytorchaido5-LF-sim-testingLFt-simhost-erroryesnogpu-prod-020:00:45
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5560711283Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:01:40
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5559011305Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:48
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5553011285Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:38
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5545611309Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:22
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5539411276Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:02:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5537111289Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:33
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5533111291Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:53
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5529511302Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:35
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5527111307Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5522911287Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:04
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5520111301Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:01:47
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5517611303Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:00:57
The container "solut [...]
The container "solution-ego0" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5514811424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:37
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5510511424Frank (Chude) Qian 🇨🇦template-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:01:02
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 21, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 48, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 21, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 48, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5506011306Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:10
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5501411304Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:04:14
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5494611310Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:02:06
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 50, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 50, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5482511358Yishu Malhotra 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:19:16
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.3869671914161135
survival_time_median38.72499999999942
deviation-center-line_median0.7627914391572195
in-drivable-lane_median24.39999999999945


other stats
agent_compute-ego0_max0.01238859176635742
agent_compute-ego0_mean0.011802576676885158
agent_compute-ego0_median0.01171131951922084
agent_compute-ego0_min0.01139907590274153
complete-iteration_max0.2300862772711392
complete-iteration_mean0.1954126971689992
complete-iteration_median0.1968039326791433
complete-iteration_min0.157956646046571
deviation-center-line_max1.239335180163875
deviation-center-line_mean0.7173595459371171
deviation-center-line_min0.10452012527015477
deviation-heading_max7.013608380193352
deviation-heading_mean3.449478301555927
deviation-heading_median2.8692401699201024
deviation-heading_min1.0458244861901502
driven_any_max14.053142343654292
driven_any_mean7.671522466553851
driven_any_median8.174828913795139
driven_any_min0.2832896949708354
driven_lanedir_consec_max3.4403235456907555
driven_lanedir_consec_mean2.0848636064316297
driven_lanedir_consec_min0.12519649720353732
driven_lanedir_max3.4403235456907555
driven_lanedir_mean2.0848636064316297
driven_lanedir_median2.3869671914161135
driven_lanedir_min0.12519649720353732
get_duckie_state_max1.2193407331194195e-06
get_duckie_state_mean1.1749510746436624e-06
get_duckie_state_median1.1827968367516057e-06
get_duckie_state_min1.1148698919520191e-06
get_robot_state_max0.003925154549734933
get_robot_state_mean0.003669892580055052
get_robot_state_median0.003679402464136891
get_robot_state_min0.003395610842211493
get_state_dump_max0.005041277749197824
get_state_dump_mean0.0046566686162395
get_state_dump_median0.004642869808790983
get_state_dump_min0.004299657098178206
get_ui_image_max0.0338908105060972
get_ui_image_mean0.030558077783195737
get_ui_image_median0.03131902202409046
get_ui_image_min0.02570345657850483
in-drivable-lane_max48.24999999999868
in-drivable-lane_mean24.612499999999393
in-drivable-lane_min1.3999999999999972
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.735974116964432, "get_ui_image": 0.028813699004453585, "step_physics": 0.11453718428409268, "survival_time": 59.99999999999873, "driven_lanedir": 3.4403235456907555, "get_state_dump": 0.0046248441929622654, "get_robot_state": 0.003721852981478447, "sim_render-ego0": 0.00395213098549823, "get_duckie_state": 1.206386099250787e-06, "in-drivable-lane": 42.04999999999882, "deviation-heading": 7.013608380193352, "agent_compute-ego0": 0.011779857416335589, "complete-iteration": 0.1806654088403859, "set_robot_commands": 0.002209940718969239, "deviation-center-line": 1.239335180163875, "driven_lanedir_consec": 3.4403235456907555, "sim_compute_sim_state": 0.008930635293457133, "sim_compute_performance-ego0": 0.0020136213818755773}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.2832896949708354, "get_ui_image": 0.0338908105060972, "step_physics": 0.1611184416146114, "survival_time": 2.849999999999998, "driven_lanedir": 0.12519649720353732, "get_state_dump": 0.004299657098178206, "get_robot_state": 0.003395610842211493, "sim_render-ego0": 0.003634296614548256, "get_duckie_state": 1.1592075742524245e-06, "in-drivable-lane": 1.3999999999999972, "deviation-heading": 1.0458244861901502, "agent_compute-ego0": 0.01139907590274153, "complete-iteration": 0.2300862772711392, "set_robot_commands": 0.00205187961972993, "deviation-center-line": 0.10452012527015477, "driven_lanedir_consec": 0.12519649720353732, "sim_compute_sim_state": 0.008449529779368433, "sim_compute_performance-ego0": 0.001771474706715551}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.6136837106258457, "get_ui_image": 0.03382434504372733, "step_physics": 0.138116089957101, "survival_time": 17.450000000000113, "driven_lanedir": 2.2115593313573387, "get_state_dump": 0.005041277749197824, "get_robot_state": 0.003925154549734933, "sim_render-ego0": 0.004208722795758928, "get_duckie_state": 1.2193407331194195e-06, "in-drivable-lane": 6.750000000000086, "deviation-heading": 2.044548470979203, "agent_compute-ego0": 0.01238859176635742, "complete-iteration": 0.21294245651790075, "set_robot_commands": 0.002286795207432338, "deviation-center-line": 0.7721589293728887, "driven_lanedir_consec": 2.2115593313573387, "sim_compute_sim_state": 0.010904791014535087, "sim_compute_performance-ego0": 0.0021564013617379326}, "LF-norm-small_loop-000-ego0": {"driven_any": 14.053142343654292, "get_ui_image": 0.02570345657850483, "step_physics": 0.09825054652287898, "survival_time": 59.99999999999873, "driven_lanedir": 2.562375051474888, "get_state_dump": 0.004660895424619701, "get_robot_state": 0.0036369519467953342, "sim_render-ego0": 0.00384261764951987, "get_duckie_state": 1.1148698919520191e-06, "in-drivable-lane": 48.24999999999868, "deviation-heading": 3.6939318688610014, "agent_compute-ego0": 0.01164278162210609, "complete-iteration": 0.157956646046571, "set_robot_commands": 0.0021512216572757564, "deviation-center-line": 0.7534239489415503, "driven_lanedir_consec": 2.562375051474888, "sim_compute_sim_state": 0.006069016992599144, "sim_compute_performance-ego0": 0.0019190517889272165}}
set_robot_commands_max0.002286795207432338
set_robot_commands_mean0.002174959300851816
set_robot_commands_median0.0021805811881224976
set_robot_commands_min0.00205187961972993
sim_compute_performance-ego0_max0.0021564013617379326
sim_compute_performance-ego0_mean0.0019651373098140694
sim_compute_performance-ego0_median0.001966336585401397
sim_compute_performance-ego0_min0.001771474706715551
sim_compute_sim_state_max0.010904791014535087
sim_compute_sim_state_mean0.00858849326998995
sim_compute_sim_state_median0.008690082536412784
sim_compute_sim_state_min0.006069016992599144
sim_render-ego0_max0.004208722795758928
sim_render-ego0_mean0.003909442011331321
sim_render-ego0_median0.0038973743175090498
sim_render-ego0_min0.003634296614548256
simulation-passed1
step_physics_max0.1611184416146114
step_physics_mean0.12800556559467102
step_physics_median0.12632663712059683
step_physics_min0.09825054652287898
survival_time_max59.99999999999873
survival_time_mean35.07499999999939
survival_time_min2.849999999999998
No reset possible
5473111384Yishu Malhotra 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:15:34
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7148342126796492
survival_time_median19.40000000000014
deviation-center-line_median0.23051963860800972
in-drivable-lane_median10.375000000000057


other stats
agent_compute-ego0_max0.05328263850570414
agent_compute-ego0_mean0.04548133847675025
agent_compute-ego0_median0.0448497238078555
agent_compute-ego0_min0.03894326778558584
complete-iteration_max0.23292039252899505
complete-iteration_mean0.21890702551432575
complete-iteration_median0.22064840563220217
complete-iteration_min0.20141089826390365
deviation-center-line_max0.97914702709676
deviation-center-line_mean0.3944502866642554
deviation-center-line_min0.13761484234424232
deviation-heading_max2.8963509112670804
deviation-heading_mean1.5670160485891893
deviation-heading_median1.435521537671124
deviation-heading_min0.5006702077474284
driven_any_max8.083480935890085
driven_any_mean4.509181416693945
driven_any_median4.100465465216699
driven_any_min1.7523138004522976
driven_lanedir_consec_max3.966695830348303
driven_lanedir_consec_mean1.5179266328666972
driven_lanedir_consec_min0.6753422757591858
driven_lanedir_max3.966695830348303
driven_lanedir_mean1.5179266328666972
driven_lanedir_median0.7148342126796492
driven_lanedir_min0.6753422757591858
get_duckie_state_max1.4049666268484934e-06
get_duckie_state_mean1.3284080109672169e-06
get_duckie_state_median1.3223938985763171e-06
get_duckie_state_min1.2638776198677394e-06
get_robot_state_max0.0039963519180214015
get_robot_state_mean0.003823210447917784
get_robot_state_median0.0037967248361714073
get_robot_state_min0.003703040201306919
get_state_dump_max0.005584107650505318
get_state_dump_mean0.004918866238726672
get_state_dump_median0.004742950123638886
get_state_dump_min0.004605457057123599
get_ui_image_max0.03430217400841091
get_ui_image_mean0.03107426024624456
get_ui_image_median0.031101454670922724
get_ui_image_min0.02779195763472188
in-drivable-lane_max41.24999999999952
in-drivable-lane_mean16.44999999999992
in-drivable-lane_min3.800000000000054
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 4.807241956755366, "get_ui_image": 0.028238912711396884, "step_physics": 0.1029956525074687, "survival_time": 20.65000000000016, "driven_lanedir": 3.966695830348303, "get_state_dump": 0.004669255104617796, "get_robot_state": 0.003703040201306919, "sim_render-ego0": 0.003725087585080649, "get_duckie_state": 1.317636978223128e-06, "in-drivable-lane": 3.800000000000054, "deviation-heading": 2.8963509112670804, "agent_compute-ego0": 0.04339172989849883, "complete-iteration": 0.20141089826390365, "set_robot_commands": 0.002330049224521803, "deviation-center-line": 0.97914702709676, "driven_lanedir_consec": 3.966695830348303, "sim_compute_sim_state": 0.010295988856882288, "sim_compute_performance-ego0": 0.001976987014070226}, "LF-norm-zigzag-000-ego0": {"driven_any": 8.083480935890085, "get_ui_image": 0.03430217400841091, "step_physics": 0.12076387586800948, "survival_time": 45.94999999999953, "driven_lanedir": 0.7305867120506107, "get_state_dump": 0.004605457057123599, "get_robot_state": 0.003851567921431168, "sim_render-ego0": 0.003813265976698502, "get_duckie_state": 1.2638776198677394e-06, "in-drivable-lane": 41.24999999999952, "deviation-heading": 2.2777058573925655, "agent_compute-ego0": 0.04630771771721218, "complete-iteration": 0.22938938451849897, "set_robot_commands": 0.0023104908673659613, "deviation-center-line": 0.2863022802089552, "driven_lanedir_consec": 0.7305867120506107, "sim_compute_sim_state": 0.011308696218158889, "sim_compute_performance-ego0": 0.0020435361758522367}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.393688973678031, "get_ui_image": 0.033963996630448565, "step_physics": 0.13029514171264983, "survival_time": 18.150000000000123, "driven_lanedir": 0.6990817133086877, "get_state_dump": 0.005584107650505318, "get_robot_state": 0.0039963519180214015, "sim_render-ego0": 0.0041380282286759265, "get_duckie_state": 1.4049666268484934e-06, "in-drivable-lane": 15.000000000000126, "deviation-heading": 0.5933372179496827, "agent_compute-ego0": 0.03894326778558584, "complete-iteration": 0.23292039252899505, "set_robot_commands": 0.002369547938252543, "deviation-center-line": 0.17473699700706422, "driven_lanedir_consec": 0.6990817133086877, "sim_compute_sim_state": 0.011215943556565505, "sim_compute_performance-ego0": 0.002324433772118537}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.7523138004522976, "get_ui_image": 0.02779195763472188, "step_physics": 0.10868239127142582, "survival_time": 8.599999999999987, "driven_lanedir": 0.6753422757591858, "get_state_dump": 0.0048166451426599755, "get_robot_state": 0.0037418817509116465, "sim_render-ego0": 0.0038345838557778066, "get_duckie_state": 1.327150818929507e-06, "in-drivable-lane": 5.749999999999989, "deviation-heading": 0.5006702077474284, "agent_compute-ego0": 0.05328263850570414, "complete-iteration": 0.21190742674590535, "set_robot_commands": 0.0024314078292405673, "deviation-center-line": 0.13761484234424232, "driven_lanedir_consec": 0.6753422757591858, "sim_compute_sim_state": 0.005186142949010595, "sim_compute_performance-ego0": 0.0020542971660636065}}
set_robot_commands_max0.0024314078292405673
set_robot_commands_mean0.0023603739648452187
set_robot_commands_median0.002349798581387173
set_robot_commands_min0.0023104908673659613
sim_compute_performance-ego0_max0.002324433772118537
sim_compute_performance-ego0_mean0.0020998135320261513
sim_compute_performance-ego0_median0.0020489166709579216
sim_compute_performance-ego0_min0.001976987014070226
sim_compute_sim_state_max0.011308696218158889
sim_compute_sim_state_mean0.00950169289515432
sim_compute_sim_state_median0.010755966206723895
sim_compute_sim_state_min0.005186142949010595
sim_render-ego0_max0.0041380282286759265
sim_render-ego0_mean0.0038777414115582216
sim_render-ego0_median0.003823924916238154
sim_render-ego0_min0.003725087585080649
simulation-passed1
step_physics_max0.13029514171264983
step_physics_mean0.11568426533988846
step_physics_median0.11472313356971764
step_physics_min0.1029956525074687
survival_time_max45.94999999999953
survival_time_mean23.33749999999995
survival_time_min8.599999999999987
No reset possible
5471611436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:58
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5469611436Charlie Gauthier 🇨🇦baseline-RL-sim-pytorchaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:49
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 23, in init
              ||     self.check_gpu_available(context)
              ||   File "solution.py", line 43, in check_gpu_available
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 23, in init
              || |     self.check_gpu_available(context)
              || |   File "solution.py", line 43, in check_gpu_available
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5451911469Raphael Jeanexercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:36:32
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median11.353905493182705
survival_time_median59.99999999999873
deviation-center-line_median2.608016672197424
in-drivable-lane_median0.6749999999999865


other stats
agent_compute-ego0_max0.039477194675696485
agent_compute-ego0_mean0.018819100453792065
agent_compute-ego0_median0.012040169709528812
agent_compute-ego0_min0.01171886772041416
complete-iteration_max0.21464240560920708
complete-iteration_mean0.19757711971729225
complete-iteration_median0.20401104046442825
complete-iteration_min0.1676439923311054
deviation-center-line_max3.2200477617834338
deviation-center-line_mean2.6666327834824735
deviation-center-line_min2.230450027751613
deviation-heading_max12.306880046035468
deviation-heading_mean10.913137142191353
deviation-heading_median11.141635157850724
deviation-heading_min9.062398207028494
driven_any_max15.077098534173173
driven_any_mean12.679167441667792
driven_any_median11.947039145612305
driven_any_min11.745492941273392
driven_lanedir_consec_max14.810759520472828
driven_lanedir_consec_mean12.144643250447006
driven_lanedir_consec_min11.060002494949789
driven_lanedir_max14.810759520472828
driven_lanedir_mean12.144643250447006
driven_lanedir_median11.353905493182705
driven_lanedir_min11.060002494949789
get_duckie_state_max1.3229154130997603e-06
get_duckie_state_mean1.2547745494223155e-06
get_duckie_state_median1.2711025495314778e-06
get_duckie_state_min1.153977685526547e-06
get_robot_state_max0.003883651849332201
get_robot_state_mean0.0037000917772964863
get_robot_state_median0.0036674769692972833
get_robot_state_min0.00358176132125918
get_state_dump_max0.004939215467136964
get_state_dump_mean0.004760608337602448
get_state_dump_median0.0047191367558297465
get_state_dump_min0.004664944371613336
get_ui_image_max0.03401075294869429
get_ui_image_mean0.03011908941125989
get_ui_image_median0.03046582273202177
get_ui_image_min0.025533959232301735
in-drivable-lane_max4.249999999999986
in-drivable-lane_mean1.3999999999999897
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 15.077098534173173, "get_ui_image": 0.027765644678565286, "step_physics": 0.10200932579771067, "survival_time": 59.99999999999873, "driven_lanedir": 14.810759520472828, "get_state_dump": 0.004721242521922853, "get_robot_state": 0.0037074176397649174, "sim_render-ego0": 0.003838378920543204, "get_duckie_state": 1.3229154130997603e-06, "in-drivable-lane": 0.0, "deviation-heading": 9.062398207028494, "agent_compute-ego0": 0.01171886772041416, "complete-iteration": 0.1676439923311054, "set_robot_commands": 0.0022245892676386013, "deviation-center-line": 2.230450027751613, "driven_lanedir_consec": 14.810759520472828, "sim_compute_sim_state": 0.00957769636905362, "sim_compute_performance-ego0": 0.0019952536224822617}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.745492941273392, "get_ui_image": 0.03401075294869429, "step_physics": 0.1375650809666795, "survival_time": 59.99999999999873, "driven_lanedir": 11.335339505885274, "get_state_dump": 0.004664944371613336, "get_robot_state": 0.00358176132125918, "sim_render-ego0": 0.003735098016946937, "get_duckie_state": 1.153977685526547e-06, "in-drivable-lane": 0.649999999999963, "deviation-heading": 11.51779186538232, "agent_compute-ego0": 0.01182346399578822, "complete-iteration": 0.21288274150406888, "set_robot_commands": 0.0021591069398573495, "deviation-center-line": 2.859847857262886, "driven_lanedir_consec": 11.335339505885274, "sim_compute_sim_state": 0.0132550472621616, "sim_compute_performance-ego0": 0.002006813052492674}, "LF-norm-techtrack-000-ego0": {"driven_any": 12.120462560971008, "get_ui_image": 0.033166000785478246, "step_physics": 0.1390521135258734, "survival_time": 59.99999999999873, "driven_lanedir": 11.060002494949789, "get_state_dump": 0.004717030989736641, "get_robot_state": 0.003883651849332201, "sim_render-ego0": 0.003944137312788252, "get_duckie_state": 1.315173261072316e-06, "in-drivable-lane": 4.249999999999986, "deviation-heading": 12.306880046035468, "agent_compute-ego0": 0.012256875423269406, "complete-iteration": 0.21464240560920708, "set_robot_commands": 0.002310122776587341, "deviation-center-line": 3.2200477617834338, "driven_lanedir_consec": 11.060002494949789, "sim_compute_sim_state": 0.013110893552845265, "sim_compute_performance-ego0": 0.00211219029263791}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.773615730253598, "get_ui_image": 0.025533959232301735, "step_physics": 0.10767153458829526, "survival_time": 59.99999999999873, "driven_lanedir": 11.372471480480137, "get_state_dump": 0.004939215467136964, "get_robot_state": 0.0036275362988296496, "sim_render-ego0": 0.003667641241881969, "get_duckie_state": 1.2270318379906394e-06, "in-drivable-lane": 0.70000000000001, "deviation-heading": 10.765478450319126, "agent_compute-ego0": 0.039477194675696485, "complete-iteration": 0.1951393394247876, "set_robot_commands": 0.0021931263528993782, "deviation-center-line": 2.3561854871319623, "driven_lanedir_consec": 11.372471480480137, "sim_compute_sim_state": 0.006015122879752509, "sim_compute_performance-ego0": 0.0019288579192784903}}
set_robot_commands_max0.002310122776587341
set_robot_commands_mean0.0022217363342456674
set_robot_commands_median0.0022088578102689898
set_robot_commands_min0.0021591069398573495
sim_compute_performance-ego0_max0.00211219029263791
sim_compute_performance-ego0_mean0.002010778721722834
sim_compute_performance-ego0_median0.002001033337487468
sim_compute_performance-ego0_min0.0019288579192784903
sim_compute_sim_state_max0.0132550472621616
sim_compute_sim_state_mean0.010489690015953249
sim_compute_sim_state_median0.011344294960949445
sim_compute_sim_state_min0.006015122879752509
sim_render-ego0_max0.003944137312788252
sim_render-ego0_mean0.0037963138730400903
sim_render-ego0_median0.00378673846874507
sim_render-ego0_min0.003667641241881969
simulation-passed1
step_physics_max0.1390521135258734
step_physics_mean0.1215745137196397
step_physics_median0.12261830777748738
step_physics_min0.10200932579771067
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5450411471Riccardo Tresa 🇮🇹template-randomaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:04:23
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.5040495128145347
survival_time_median4.6499999999999915
deviation-center-line_median0.10620228737371736
in-drivable-lane_median2.674999999999992


other stats
agent_compute-ego0_max0.012875835100809732
agent_compute-ego0_mean0.011438351533206706
agent_compute-ego0_median0.011249240063413789
agent_compute-ego0_min0.010379090905189514
complete-iteration_max0.2248210466426352
complete-iteration_mean0.1957978145797725
complete-iteration_median0.19391295634493044
complete-iteration_min0.17054429898659387
deviation-center-line_max0.16455763165774434
deviation-center-line_mean0.1092777488823554
deviation-center-line_min0.06014878912424249
deviation-heading_max1.819139548495243
deviation-heading_mean0.860079214882594
deviation-heading_median0.6517793617099584
deviation-heading_min0.31761858761521594
driven_any_max3.078535752374254
driven_any_mean1.8526223552312917
driven_any_median1.6219947547238958
driven_any_min1.0879641591031215
driven_lanedir_consec_max0.6643282900394009
driven_lanedir_consec_mean0.4884432809313369
driven_lanedir_consec_min0.28134580805687714
driven_lanedir_max0.6643282900394009
driven_lanedir_mean0.4924956463812869
driven_lanedir_median0.5121542437144349
driven_lanedir_min0.28134580805687714
get_duckie_state_max1.6715215600055198e-06
get_duckie_state_mean1.4720091765162953e-06
get_duckie_state_median1.474130380002758e-06
get_duckie_state_min1.268254386054145e-06
get_robot_state_max0.0040429797437455915
get_robot_state_mean0.0038503904332090337
get_robot_state_median0.0037894777890750625
get_robot_state_min0.003779626410940419
get_state_dump_max0.005023505952623155
get_state_dump_mean0.004818388062312225
get_state_dump_median0.004788879996739359
get_state_dump_min0.004672286303147026
get_ui_image_max0.03821438810099726
get_ui_image_mean0.03254927709285895
get_ui_image_median0.03178708651397802
get_ui_image_min0.028408547242482506
in-drivable-lane_max6.549999999999982
in-drivable-lane_mean3.3499999999999894
in-drivable-lane_min1.499999999999995
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.078535752374254, "get_ui_image": 0.02945522266098216, "step_physics": 0.10924496379079698, "survival_time": 7.84999999999998, "driven_lanedir": 0.28134580805687714, "get_state_dump": 0.004849266402329071, "get_robot_state": 0.003796536711197865, "sim_render-ego0": 0.00381446940989434, "get_duckie_state": 1.4953975436053698e-06, "in-drivable-lane": 6.549999999999982, "deviation-heading": 0.891006057417327, "agent_compute-ego0": 0.010802558705776552, "complete-iteration": 0.1757012967821918, "set_robot_commands": 0.0021107453334180616, "deviation-center-line": 0.13094886067496936, "driven_lanedir_consec": 0.28134580805687714, "sim_compute_sim_state": 0.009531122219713428, "sim_compute_performance-ego0": 0.002004384994506836}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.5806581102909054, "get_ui_image": 0.03821438810099726, "step_physics": 0.14871826638346133, "survival_time": 4.549999999999992, "driven_lanedir": 0.3891269085945981, "get_state_dump": 0.004672286303147026, "get_robot_state": 0.003779626410940419, "sim_render-ego0": 0.003906068594559379, "get_duckie_state": 1.6715215600055198e-06, "in-drivable-lane": 2.449999999999993, "deviation-heading": 1.819139548495243, "agent_compute-ego0": 0.011695921421051024, "complete-iteration": 0.2248210466426352, "set_robot_commands": 0.002263413823169211, "deviation-center-line": 0.16455763165774434, "driven_lanedir_consec": 0.37291744679479777, "sim_compute_sim_state": 0.009421996448350988, "sim_compute_performance-ego0": 0.0020545824714328933}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0879641591031215, "get_ui_image": 0.03411895036697388, "step_physics": 0.13881202869945103, "survival_time": 3.5499999999999954, "driven_lanedir": 0.6643282900394009, "get_state_dump": 0.005023505952623155, "get_robot_state": 0.0040429797437455915, "sim_render-ego0": 0.0042706264389885795, "get_duckie_state": 1.268254386054145e-06, "in-drivable-lane": 1.499999999999995, "deviation-heading": 0.41255266600258983, "agent_compute-ego0": 0.012875835100809732, "complete-iteration": 0.21212461590766907, "set_robot_commands": 0.002572053008609348, "deviation-center-line": 0.08145571407246535, "driven_lanedir_consec": 0.6643282900394009, "sim_compute_sim_state": 0.008144663439856635, "sim_compute_performance-ego0": 0.002167784505420261}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6633313991568863, "get_ui_image": 0.028408547242482506, "step_physics": 0.10984402149915697, "survival_time": 4.749999999999991, "driven_lanedir": 0.6351815788342716, "get_state_dump": 0.004728493591149648, "get_robot_state": 0.003782418866952261, "sim_render-ego0": 0.003935111065705617, "get_duckie_state": 1.4528632164001465e-06, "in-drivable-lane": 2.89999999999999, "deviation-heading": 0.31761858761521594, "agent_compute-ego0": 0.010379090905189514, "complete-iteration": 0.17054429898659387, "set_robot_commands": 0.0022154624263445535, "deviation-center-line": 0.06014878912424249, "driven_lanedir_consec": 0.6351815788342716, "sim_compute_sim_state": 0.005148495237032573, "sim_compute_performance-ego0": 0.0020153746008872986}}
set_robot_commands_max0.002572053008609348
set_robot_commands_mean0.0022904186478852934
set_robot_commands_median0.002239438124756882
set_robot_commands_min0.0021107453334180616
sim_compute_performance-ego0_max0.002167784505420261
sim_compute_performance-ego0_mean0.002060531643061822
sim_compute_performance-ego0_median0.002034978536160096
sim_compute_performance-ego0_min0.002004384994506836
sim_compute_sim_state_max0.009531122219713428
sim_compute_sim_state_mean0.008061569336238406
sim_compute_sim_state_median0.008783329944103812
sim_compute_sim_state_min0.005148495237032573
sim_render-ego0_max0.0042706264389885795
sim_render-ego0_mean0.003981568877286979
sim_render-ego0_median0.003920589830132498
sim_render-ego0_min0.00381446940989434
simulation-passed1
step_physics_max0.14871826638346133
step_physics_mean0.12665482009321655
step_physics_median0.124328025099304
step_physics_min0.10924496379079698
survival_time_max7.84999999999998
survival_time_mean5.17499999999999
survival_time_min3.5499999999999954
No reset possible
5439711556Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:43:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012834594212007165
agent_compute-ego0_mean0.012519061466140811
agent_compute-ego0_median0.012506898991968312
agent_compute-ego0_min0.012227853668619454
complete-iteration_max0.35517083635735175
complete-iteration_mean0.30023634294784635
complete-iteration_median0.2983549016401432
complete-iteration_min0.2490647321537472
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.4043072677472548e-06
get_duckie_state_mean1.3434122643006234e-06
get_duckie_state_median1.3434618934802866e-06
get_duckie_state_min1.2824180024946658e-06
get_robot_state_max0.0038019407798011136
get_robot_state_mean0.003766024886916619
get_robot_state_median0.003777506448744139
get_robot_state_min0.0037071458703770823
get_state_dump_max0.004792074081204912
get_state_dump_mean0.004741601205487532
get_state_dump_median0.004759011518746787
get_state_dump_min0.004656307703251644
get_ui_image_max0.03623268923890482
get_ui_image_mean0.03097358487428575
get_ui_image_median0.03038195934422705
get_ui_image_min0.02689773156978407
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.0283938988757868, "step_physics": 0.2166409452789332, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004760625856702869, "get_robot_state": 0.0037071458703770823, "sim_render-ego0": 0.003796081558850087, "get_duckie_state": 1.4043072677472548e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012554924851353224, "complete-iteration": 0.28271447192818594, "set_robot_commands": 0.002173233985106812, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008595976206186313, "sim_compute_performance-ego0": 0.0020053487931758936}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03623268923890482, "step_physics": 0.2779479779172797, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.004757397180790706, "get_robot_state": 0.0037643760566806713, "sim_render-ego0": 0.003914001879346658, "get_duckie_state": 1.33760565028004e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.012227853668619454, "complete-iteration": 0.35517083635735175, "set_robot_commands": 0.002243864446952877, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.011904244418942264, "sim_compute_performance-ego0": 0.002090018952915214}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.0323700198126673, "step_physics": 0.24347746501258768, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004656307703251644, "get_robot_state": 0.003790636840807608, "sim_render-ego0": 0.003869516863413993, "get_duckie_state": 1.2824180024946658e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.0124588731325834, "complete-iteration": 0.3139953313521005, "set_robot_commands": 0.002289523292242934, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008916800861850965, "sim_compute_performance-ego0": 0.0020816220927496534}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02689773156978407, "step_physics": 0.1860962638648523, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004792074081204912, "get_robot_state": 0.0038019407798011136, "sim_render-ego0": 0.003868137370736077, "get_duckie_state": 1.3493181366805332e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012834594212007165, "complete-iteration": 0.2490647321537472, "set_robot_commands": 0.002299449128175556, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006335994186846045, "sim_compute_performance-ego0": 0.0020524913524211596}}
set_robot_commands_max0.002299449128175556
set_robot_commands_mean0.002251517713119545
set_robot_commands_median0.002266693869597906
set_robot_commands_min0.002173233985106812
sim_compute_performance-ego0_max0.002090018952915214
sim_compute_performance-ego0_mean0.0020573702978154804
sim_compute_performance-ego0_median0.0020670567225854067
sim_compute_performance-ego0_min0.0020053487931758936
sim_compute_sim_state_max0.011904244418942264
sim_compute_sim_state_mean0.008938253918456396
sim_compute_sim_state_median0.008756388534018639
sim_compute_sim_state_min0.006335994186846045
sim_render-ego0_max0.003914001879346658
sim_render-ego0_mean0.003861934418086704
sim_render-ego0_median0.0038688271170750346
sim_render-ego0_min0.003796081558850087
simulation-passed1
step_physics_max0.2779479779172797
step_physics_mean0.2310406630184132
step_physics_median0.23005920514576045
step_physics_min0.1860962638648523
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5434811587Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:07:41
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6750673614245528
survival_time_median8.85000000000001
deviation-center-line_median0.237673146870915
in-drivable-lane_median6.000000000000036


other stats
agent_compute-ego0_max0.01387532732703469
agent_compute-ego0_mean0.01325840506162005
agent_compute-ego0_median0.013152065237514617
agent_compute-ego0_min0.012854162444416275
complete-iteration_max0.2110309722317252
complete-iteration_mean0.19221537290094215
complete-iteration_median0.1971289725494548
complete-iteration_min0.1635725742731339
deviation-center-line_max0.7895756686740882
deviation-center-line_mean0.3344952042189934
deviation-center-line_min0.07305885446005561
deviation-heading_max2.333083494391842
deviation-heading_mean1.274891116805293
deviation-heading_median1.153286005943322
deviation-heading_min0.4599089609426864
driven_any_max4.04994553377405
driven_any_mean2.3426252945641863
driven_any_median2.126947951204211
driven_any_min1.0666597420742745
driven_lanedir_consec_max1.5769282719913007
driven_lanedir_consec_mean0.8196842456927422
driven_lanedir_consec_min0.3516739879305628
driven_lanedir_max1.701399188371059
driven_lanedir_mean0.8508019747876818
driven_lanedir_median0.6750673614245528
driven_lanedir_min0.3516739879305628
get_duckie_state_max1.41154636036266e-06
get_duckie_state_mean1.3565794030308652e-06
get_duckie_state_median1.357049597216425e-06
get_duckie_state_min1.3006720573279509e-06
get_robot_state_max0.003912156278436834
get_robot_state_mean0.0036852353285194905
get_robot_state_median0.003645095835256247
get_robot_state_min0.0035385933651286327
get_state_dump_max0.004898111928593029
get_state_dump_mean0.004663406253675322
get_state_dump_median0.004674748371195069
get_state_dump_min0.004406016343718122
get_ui_image_max0.03492420342317812
get_ui_image_mean0.030465337939384912
get_ui_image_median0.03038135552392708
get_ui_image_min0.02617443728650737
in-drivable-lane_max8.100000000000017
in-drivable-lane_mean5.48750000000002
in-drivable-lane_min1.8499999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.8192065507788175, "get_ui_image": 0.028228163220393607, "step_physics": 0.1239813700879468, "survival_time": 11.900000000000034, "driven_lanedir": 0.7099529202896291, "get_state_dump": 0.0045981506922255005, "get_robot_state": 0.003563902866890241, "sim_render-ego0": 0.0036799877757307873, "get_duckie_state": 1.3447206888238756e-06, "in-drivable-lane": 8.100000000000017, "deviation-heading": 1.8113842393345696, "agent_compute-ego0": 0.013319960199140604, "complete-iteration": 0.19097100740696096, "set_robot_commands": 0.002147274536068968, "deviation-center-line": 0.3364195388778234, "driven_lanedir_consec": 0.7099529202896291, "sim_compute_sim_state": 0.009407288858581287, "sim_compute_performance-ego0": 0.0019552907185574455}, "LF-norm-zigzag-000-ego0": {"driven_any": 4.04994553377405, "get_ui_image": 0.03492420342317812, "step_physics": 0.1371271876013203, "survival_time": 15.650000000000087, "driven_lanedir": 1.701399188371059, "get_state_dump": 0.004406016343718122, "get_robot_state": 0.0035385933651286327, "sim_render-ego0": 0.0037781524050767255, "get_duckie_state": 1.3006720573279509e-06, "in-drivable-lane": 8.050000000000086, "deviation-heading": 2.333083494391842, "agent_compute-ego0": 0.012984170275888626, "complete-iteration": 0.2110309722317252, "set_robot_commands": 0.0021455462571162327, "deviation-center-line": 0.7895756686740882, "driven_lanedir_consec": 1.5769282719913007, "sim_compute_sim_state": 0.01007545677719602, "sim_compute_performance-ego0": 0.00196418337001922}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0666597420742745, "get_ui_image": 0.03253454782746055, "step_physics": 0.13104151053862137, "survival_time": 4.3499999999999925, "driven_lanedir": 0.6401818025594765, "get_state_dump": 0.004898111928593029, "get_robot_state": 0.003912156278436834, "sim_render-ego0": 0.004021016034212979, "get_duckie_state": 1.41154636036266e-06, "in-drivable-lane": 1.8499999999999936, "deviation-heading": 0.4599089609426864, "agent_compute-ego0": 0.01387532732703469, "complete-iteration": 0.20328693769194864, "set_robot_commands": 0.0025067248127677226, "deviation-center-line": 0.07305885446005561, "driven_lanedir_consec": 0.6401818025594765, "sim_compute_sim_state": 0.008324097503315319, "sim_compute_performance-ego0": 0.0020822693001140247}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.434689351629604, "get_ui_image": 0.02617443728650737, "step_physics": 0.10298746263878976, "survival_time": 5.799999999999987, "driven_lanedir": 0.3516739879305628, "get_state_dump": 0.004751346050164638, "get_robot_state": 0.003726288803622254, "sim_render-ego0": 0.003784132818890433, "get_duckie_state": 1.3693785056089744e-06, "in-drivable-lane": 3.9499999999999864, "deviation-heading": 0.4951877725520747, "agent_compute-ego0": 0.012854162444416275, "complete-iteration": 0.1635725742731339, "set_robot_commands": 0.002175677535880326, "deviation-center-line": 0.1389267548640066, "driven_lanedir_consec": 0.3516739879305628, "sim_compute_sim_state": 0.005103708332420414, "sim_compute_performance-ego0": 0.0019289835905417416}}
set_robot_commands_max0.0025067248127677226
set_robot_commands_mean0.0022438057854583123
set_robot_commands_median0.0021614760359746467
set_robot_commands_min0.0021455462571162327
sim_compute_performance-ego0_max0.0020822693001140247
sim_compute_performance-ego0_mean0.0019826817448081076
sim_compute_performance-ego0_median0.001959737044288333
sim_compute_performance-ego0_min0.0019289835905417416
sim_compute_sim_state_max0.01007545677719602
sim_compute_sim_state_mean0.00822763786787826
sim_compute_sim_state_median0.008865693180948302
sim_compute_sim_state_min0.005103708332420414
sim_render-ego0_max0.004021016034212979
sim_render-ego0_mean0.0038158222584777314
sim_render-ego0_median0.003781142611983579
sim_render-ego0_min0.0036799877757307873
simulation-passed1
step_physics_max0.1371271876013203
step_physics_mean0.12378438271666956
step_physics_median0.1275114403132841
step_physics_min0.10298746263878976
survival_time_max15.650000000000087
survival_time_mean9.425000000000026
survival_time_min4.3499999999999925
No reset possible
5431711584Yishu Malhotra 🇨🇦exercise_state_estimationaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:08:10
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6270797548784444
survival_time_median6.674999999999985
deviation-center-line_median0.3047986622440786
in-drivable-lane_median2.2750000000000012


other stats
agent_compute-ego0_max0.013010343839955883
agent_compute-ego0_mean0.012123691555395597
agent_compute-ego0_median0.012074834672563735
agent_compute-ego0_min0.011334753036499024
complete-iteration_max0.20230138878668508
complete-iteration_mean0.1816761681758178
complete-iteration_median0.1833850291227049
complete-iteration_min0.15763322567117624
deviation-center-line_max0.8476975635540195
deviation-center-line_mean0.3816319323899823
deviation-center-line_min0.06923284151775257
deviation-heading_max2.8415676726703483
deviation-heading_mean1.5696323446333724
deviation-heading_median1.5056429010610886
deviation-heading_min0.42567590374096487
driven_any_max2.465947583835403
driven_any_mean1.6073638662924878
driven_any_median1.446084388591424
driven_any_min1.0713391041516995
driven_lanedir_consec_max1.994738340986982
driven_lanedir_consec_mean0.9585525928663604
driven_lanedir_consec_min0.5853125207215712
driven_lanedir_max1.994738340986982
driven_lanedir_mean0.9658777011701318
driven_lanedir_median0.6417299714859869
driven_lanedir_min0.5853125207215712
get_duckie_state_max1.9073486328125e-06
get_duckie_state_mean1.733519758568598e-06
get_duckie_state_median1.7106252267397975e-06
get_duckie_state_min1.6054799479822958e-06
get_robot_state_max0.0038666752881782
get_robot_state_mean0.003566741456350394
get_robot_state_median0.0034945756629381746
get_robot_state_min0.0034111392113470263
get_state_dump_max0.005418674541952832
get_state_dump_mean0.004880611685963516
get_state_dump_median0.004871059821525764
get_state_dump_min0.004361652558849704
get_ui_image_max0.03313424698142118
get_ui_image_mean0.029327363472595985
get_ui_image_median0.02981859077311226
get_ui_image_min0.024538025362738247
in-drivable-lane_max3.099999999999989
in-drivable-lane_mean2.3749999999999964
in-drivable-lane_min1.8499999999999936
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.465947583835403, "get_ui_image": 0.02708917888787275, "step_physics": 0.10237643757804496, "survival_time": 9.099999999999994, "driven_lanedir": 1.994738340986982, "get_state_dump": 0.005418674541952832, "get_robot_state": 0.0035557955340609526, "sim_render-ego0": 0.003677348621556016, "get_duckie_state": 1.6832612251323429e-06, "in-drivable-lane": 2.0000000000000115, "deviation-heading": 1.5826220729556135, "agent_compute-ego0": 0.01280937038484167, "complete-iteration": 0.1681672432383553, "set_robot_commands": 0.0021639769194556065, "deviation-center-line": 0.8476975635540195, "driven_lanedir_consec": 1.994738340986982, "sim_compute_sim_state": 0.00909509945436905, "sim_compute_performance-ego0": 0.0018936389130972773}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.37987974477846, "get_ui_image": 0.032548002658351775, "step_physics": 0.13387908281818514, "survival_time": 6.149999999999986, "driven_lanedir": 0.5853125207215712, "get_state_dump": 0.004361652558849704, "get_robot_state": 0.0034111392113470263, "sim_render-ego0": 0.0036482291836892407, "get_duckie_state": 1.6054799479822958e-06, "in-drivable-lane": 3.099999999999989, "deviation-heading": 1.4286637291665634, "agent_compute-ego0": 0.011340298960285804, "complete-iteration": 0.20230138878668508, "set_robot_commands": 0.0021628333676245903, "deviation-center-line": 0.30158127946946944, "driven_lanedir_consec": 0.5853125207215712, "sim_compute_sim_state": 0.008988511177801316, "sim_compute_performance-ego0": 0.0018739892590430476}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.0713391041516995, "get_ui_image": 0.03313424698142118, "step_physics": 0.12673862035884417, "survival_time": 4.249999999999993, "driven_lanedir": 0.6387578759837549, "get_state_dump": 0.00514788405839787, "get_robot_state": 0.0038666752881782, "sim_render-ego0": 0.0039715656014375905, "get_duckie_state": 1.9073486328125e-06, "in-drivable-lane": 1.8499999999999936, "deviation-heading": 0.42567590374096487, "agent_compute-ego0": 0.013010343839955883, "complete-iteration": 0.19860281500705457, "set_robot_commands": 0.0023883165315140126, "deviation-center-line": 0.06923284151775257, "driven_lanedir_consec": 0.6387578759837549, "sim_compute_sim_state": 0.008185295171515887, "sim_compute_performance-ego0": 0.0020619908044504564}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.5122890324043885, "get_ui_image": 0.024538025362738247, "step_physics": 0.10111825548369308, "survival_time": 7.199999999999982, "driven_lanedir": 0.6447020669882189, "get_state_dump": 0.004594235584653657, "get_robot_state": 0.003433355791815396, "sim_render-ego0": 0.0035729638461408945, "get_duckie_state": 1.7379892283472522e-06, "in-drivable-lane": 2.549999999999991, "deviation-heading": 2.8415676726703483, "agent_compute-ego0": 0.011334753036499024, "complete-iteration": 0.15763322567117624, "set_robot_commands": 0.002079478625593514, "deviation-center-line": 0.3080160450186878, "driven_lanedir_consec": 0.6154016337731338, "sim_compute_sim_state": 0.005043082401670259, "sim_compute_performance-ego0": 0.0018329620361328125}}
set_robot_commands_max0.0023883165315140126
set_robot_commands_mean0.002198651361046931
set_robot_commands_median0.0021634051435400984
set_robot_commands_min0.002079478625593514
sim_compute_performance-ego0_max0.0020619908044504564
sim_compute_performance-ego0_mean0.0019156452531808984
sim_compute_performance-ego0_median0.0018838140860701624
sim_compute_performance-ego0_min0.0018329620361328125
sim_compute_sim_state_max0.00909509945436905
sim_compute_sim_state_mean0.007827997051339129
sim_compute_sim_state_median0.008586903174658602
sim_compute_sim_state_min0.005043082401670259
sim_render-ego0_max0.0039715656014375905
sim_render-ego0_mean0.0037175268132059354
sim_render-ego0_median0.0036627889026226287
sim_render-ego0_min0.0035729638461408945
simulation-passed1
step_physics_max0.13387908281818514
step_physics_mean0.11602809905969184
step_physics_median0.11455752896844457
step_physics_min0.10111825548369308
survival_time_max9.099999999999994
survival_time_mean6.674999999999988
survival_time_min4.249999999999993
No reset possible
5425311621Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:21:13
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.6214407690570103
survival_time_median34.39999999999956
deviation-center-line_median1.0642325427273531
in-drivable-lane_median18.574999999999513


other stats
agent_compute-ego0_max0.01225650146089751
agent_compute-ego0_mean0.011859347665603323
agent_compute-ego0_median0.011875281176146803
agent_compute-ego0_min0.011430326849222183
complete-iteration_max0.28172826615108804
complete-iteration_mean0.2374954465930512
complete-iteration_median0.2345979960004347
complete-iteration_min0.19905752822024736
deviation-center-line_max2.3027508765323668
deviation-center-line_mean1.1643517347696613
deviation-center-line_min0.22619097709157143
deviation-heading_max13.126404974735904
deviation-heading_mean6.3132205560426655
deviation-heading_median4.953055804515712
deviation-heading_min2.220365640403331
driven_any_max7.920084963134608
driven_any_mean4.417113196426353
driven_any_median4.4254543323093625
driven_any_min0.8974591579520789
driven_lanedir_consec_max2.1035333448132474
driven_lanedir_consec_mean1.452624920879991
driven_lanedir_consec_min0.46408480059269674
driven_lanedir_max2.784961925209599
driven_lanedir_mean1.622982065979079
driven_lanedir_median1.6214407690570103
driven_lanedir_min0.46408480059269674
get_duckie_state_max1.4806615895238416e-06
get_duckie_state_mean1.368972603548989e-06
get_duckie_state_median1.3553305379365348e-06
get_duckie_state_min1.2845677487990435e-06
get_robot_state_max0.003934490269628064
get_robot_state_mean0.0038040931444657936
get_robot_state_median0.0038031541000767026
get_robot_state_min0.0036755741080817055
get_state_dump_max0.004905122724072687
get_state_dump_mean0.004699169154616657
get_state_dump_median0.0047247932754055574
get_state_dump_min0.004441967343582827
get_ui_image_max0.03634717206286776
get_ui_image_mean0.031176491408508623
get_ui_image_median0.030816809542885175
get_ui_image_min0.026725174485396387
in-drivable-lane_max39.949999999999235
in-drivable-lane_mean19.57499999999957
in-drivable-lane_min1.200000000000017
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 1.780289691505044, "get_ui_image": 0.030556536542958226, "step_physics": 0.16529099776827055, "survival_time": 14.45000000000007, "driven_lanedir": 1.562178061835587, "get_state_dump": 0.004905122724072687, "get_robot_state": 0.003934490269628064, "sim_render-ego0": 0.004082734009315228, "get_duckie_state": 1.4806615895238416e-06, "in-drivable-lane": 1.200000000000017, "deviation-heading": 5.0135000124119635, "agent_compute-ego0": 0.01225650146089751, "complete-iteration": 0.23552209097763588, "set_robot_commands": 0.002349955460120892, "deviation-center-line": 0.6550211989249002, "driven_lanedir_consec": 1.562178061835587, "sim_compute_sim_state": 0.009931394971650222, "sim_compute_performance-ego0": 0.002124871878788389}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.8974591579520789, "get_ui_image": 0.03634717206286776, "step_physics": 0.2053214562167028, "survival_time": 7.79999999999998, "driven_lanedir": 0.46408480059269674, "get_state_dump": 0.004734798601478528, "get_robot_state": 0.003801060330336261, "sim_render-ego0": 0.003869442423437811, "get_duckie_state": 1.3196544282755274e-06, "in-drivable-lane": 3.349999999999988, "deviation-heading": 2.220365640403331, "agent_compute-ego0": 0.01206116463728012, "complete-iteration": 0.28172826615108804, "set_robot_commands": 0.00235008889702475, "deviation-center-line": 0.22619097709157143, "driven_lanedir_consec": 0.46408480059269674, "sim_compute_sim_state": 0.011100796377582914, "sim_compute_performance-ego0": 0.002056223571680154}, "LF-norm-techtrack-000-ego0": {"driven_any": 7.07061897311368, "get_ui_image": 0.031077082542812124, "step_physics": 0.16279750404989018, "survival_time": 54.34999999999905, "driven_lanedir": 1.680703476278434, "get_state_dump": 0.004441967343582827, "get_robot_state": 0.0036755741080817055, "sim_render-ego0": 0.0037321779219543234, "get_duckie_state": 1.2845677487990435e-06, "in-drivable-lane": 39.949999999999235, "deviation-heading": 4.892611596619459, "agent_compute-ego0": 0.011430326849222183, "complete-iteration": 0.23367390102323363, "set_robot_commands": 0.002218627535244998, "deviation-center-line": 1.4734438865298063, "driven_lanedir_consec": 1.680703476278434, "sim_compute_sim_state": 0.012200620682800518, "sim_compute_performance-ego0": 0.002016295843264636}, "LF-norm-small_loop-000-ego0": {"driven_any": 7.920084963134608, "get_ui_image": 0.026725174485396387, "step_physics": 0.13775216788673875, "survival_time": 59.99999999999873, "driven_lanedir": 2.784961925209599, "get_state_dump": 0.004714787949332587, "get_robot_state": 0.003805247869817144, "sim_render-ego0": 0.003813341594953323, "get_duckie_state": 1.3910066475975423e-06, "in-drivable-lane": 33.79999999999904, "deviation-heading": 13.126404974735904, "agent_compute-ego0": 0.01168939771501349, "complete-iteration": 0.19905752822024736, "set_robot_commands": 0.002263528520518993, "deviation-center-line": 2.3027508765323668, "driven_lanedir_consec": 2.1035333448132474, "sim_compute_sim_state": 0.006174876231337269, "sim_compute_performance-ego0": 0.002029694288001271}}
set_robot_commands_max0.00235008889702475
set_robot_commands_mean0.0022955501032274083
set_robot_commands_median0.0023067419903199425
set_robot_commands_min0.002218627535244998
sim_compute_performance-ego0_max0.002124871878788389
sim_compute_performance-ego0_mean0.0020567713954336123
sim_compute_performance-ego0_median0.0020429589298407123
sim_compute_performance-ego0_min0.002016295843264636
sim_compute_sim_state_max0.012200620682800518
sim_compute_sim_state_mean0.009851922065842731
sim_compute_sim_state_median0.010516095674616569
sim_compute_sim_state_min0.006174876231337269
sim_render-ego0_max0.004082734009315228
sim_render-ego0_mean0.003874423987415171
sim_render-ego0_median0.003841392009195567
sim_render-ego0_min0.0037321779219543234
simulation-passed1
step_physics_max0.2053214562167028
step_physics_mean0.16779053148040057
step_physics_median0.16404425090908037
step_physics_min0.13775216788673875
survival_time_max59.99999999999873
survival_time_mean34.14999999999946
survival_time_min7.79999999999998
No reset possible
5416611647Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:32:05
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median10.5137104958675
survival_time_median59.99999999999873
deviation-center-line_median3.4120045232592577
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.012503000608099717
agent_compute-ego0_mean0.012080356984438677
agent_compute-ego0_median0.01207313142549386
agent_compute-ego0_min0.011672164478667271
complete-iteration_max0.2456841026118753
complete-iteration_mean0.21388677131563985
complete-iteration_median0.2098817546250538
complete-iteration_min0.19009947340057656
deviation-center-line_max3.8682663618369313
deviation-center-line_mean2.715952190632554
deviation-center-line_min0.1715333541747679
deviation-heading_max18.265240092756816
deviation-heading_mean12.389352160299572
deviation-heading_median15.25543479231624
deviation-heading_min0.7812989638089959
driven_any_max11.845731094695935
driven_any_mean9.457450959257123
driven_any_median11.13692572802058
driven_any_min3.710221286291405
driven_lanedir_consec_max11.286457844445778
driven_lanedir_consec_mean8.253308010381739
driven_lanedir_consec_min0.6993532053461745
driven_lanedir_max11.286457844445778
driven_lanedir_mean8.253308010381739
driven_lanedir_median10.5137104958675
driven_lanedir_min0.6993532053461745
get_duckie_state_max1.4221090577247384e-06
get_duckie_state_mean1.4117850952010753e-06
get_duckie_state_median1.41413384532055e-06
get_duckie_state_min1.3967636324384627e-06
get_robot_state_max0.003915192272169474
get_robot_state_mean0.003867498813725795
get_robot_state_median0.0038749843116207584
get_robot_state_min0.003804834359492192
get_state_dump_max0.005042423760838446
get_state_dump_mean0.00488062793457565
get_state_dump_median0.004841201807636702
get_state_dump_min0.004797684362190749
get_ui_image_max0.03730978834738243
get_ui_image_mean0.031747600442561856
get_ui_image_median0.031362894023881524
get_ui_image_min0.026954825375101944
in-drivable-lane_max19.35000000000019
in-drivable-lane_mean4.837500000000047
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.845731094695935, "get_ui_image": 0.029548744674924014, "step_physics": 0.12552510828499394, "survival_time": 59.99999999999873, "driven_lanedir": 11.286457844445778, "get_state_dump": 0.004852480137973503, "get_robot_state": 0.0038801432648467383, "sim_render-ego0": 0.003928199000997805, "get_duckie_state": 1.409468702432218e-06, "in-drivable-lane": 0.0, "deviation-heading": 15.917435575126213, "agent_compute-ego0": 0.012084766788149156, "complete-iteration": 0.19406135949762937, "set_robot_commands": 0.002340658618250457, "deviation-center-line": 3.8682663618369313, "driven_lanedir_consec": 11.286457844445778, "sim_compute_sim_state": 0.009692407865309892, "sim_compute_performance-ego0": 0.0021129228193297375}, "LF-norm-zigzag-000-ego0": {"driven_any": 11.47584168119146, "get_ui_image": 0.03730978834738243, "step_physics": 0.16472988620983572, "survival_time": 59.99999999999873, "driven_lanedir": 10.97876912017684, "get_state_dump": 0.004829923477299903, "get_robot_state": 0.0038698253583947786, "sim_render-ego0": 0.004017210324340617, "get_duckie_state": 1.418798988208882e-06, "in-drivable-lane": 0.0, "deviation-heading": 14.593434009506268, "agent_compute-ego0": 0.012061496062838564, "complete-iteration": 0.2456841026118753, "set_robot_commands": 0.0023184394359985656, "deviation-center-line": 3.251008153266175, "driven_lanedir_consec": 10.97876912017684, "sim_compute_sim_state": 0.014322605061590622, "sim_compute_performance-ego0": 0.002128525836382381}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.710221286291405, "get_ui_image": 0.033177043372839034, "step_physics": 0.15147749495401255, "survival_time": 22.650000000000187, "driven_lanedir": 0.6993532053461745, "get_state_dump": 0.005042423760838446, "get_robot_state": 0.003915192272169474, "sim_render-ego0": 0.00399030935396707, "get_duckie_state": 1.4221090577247384e-06, "in-drivable-lane": 19.35000000000019, "deviation-heading": 0.7812989638089959, "agent_compute-ego0": 0.012503000608099717, "complete-iteration": 0.22570214975247824, "set_robot_commands": 0.0023228507735130544, "deviation-center-line": 0.1715333541747679, "driven_lanedir_consec": 0.6993532053461745, "sim_compute_sim_state": 0.011044311103316657, "sim_compute_performance-ego0": 0.002126763045525236}, "LF-norm-small_loop-000-ego0": {"driven_any": 10.798009774849696, "get_ui_image": 0.026954825375101944, "step_physics": 0.12821099204286548, "survival_time": 59.99999999999873, "driven_lanedir": 10.048651871558162, "get_state_dump": 0.004797684362190749, "get_robot_state": 0.003804834359492192, "sim_render-ego0": 0.003859330375029781, "get_duckie_state": 1.3967636324384627e-06, "in-drivable-lane": 0.0, "deviation-heading": 18.265240092756816, "agent_compute-ego0": 0.011672164478667271, "complete-iteration": 0.19009947340057656, "set_robot_commands": 0.0022925653624395644, "deviation-center-line": 3.5730008932523405, "driven_lanedir_consec": 10.048651871558162, "sim_compute_sim_state": 0.0063950596602135755, "sim_compute_performance-ego0": 0.002015521782423237}}
set_robot_commands_max0.002340658618250457
set_robot_commands_mean0.0023186285475504105
set_robot_commands_median0.00232064510475581
set_robot_commands_min0.0022925653624395644
sim_compute_performance-ego0_max0.002128525836382381
sim_compute_performance-ego0_mean0.002095933370915148
sim_compute_performance-ego0_median0.0021198429324274866
sim_compute_performance-ego0_min0.002015521782423237
sim_compute_sim_state_max0.014322605061590622
sim_compute_sim_state_mean0.010363595922607686
sim_compute_sim_state_median0.010368359484313274
sim_compute_sim_state_min0.0063950596602135755
sim_render-ego0_max0.004017210324340617
sim_render-ego0_mean0.003948762263583818
sim_render-ego0_median0.003959254177482437
sim_render-ego0_min0.003859330375029781
simulation-passed1
step_physics_max0.16472988620983572
step_physics_mean0.14248587037292693
step_physics_median0.13984424349843902
step_physics_min0.12552510828499394
survival_time_max59.99999999999873
survival_time_mean50.66249999999909
survival_time_min22.650000000000187
No reset possible
5412311662Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:17:42
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.955619086404564
survival_time_median19.600000000000144
deviation-center-line_median0.6412678832674783
in-drivable-lane_median10.92500000000013


other stats
agent_compute-ego0_max0.01360487937927246
agent_compute-ego0_mean0.01334498273620558
agent_compute-ego0_median0.013349135726782282
agent_compute-ego0_min0.0130767801119853
complete-iteration_max0.3067947541824495
complete-iteration_mean0.26192458726903023
complete-iteration_median0.25801134624885813
complete-iteration_min0.22488090239595512
deviation-center-line_max1.7851685076358144
deviation-center-line_mean0.8053514023305932
deviation-center-line_min0.15370133515160186
deviation-heading_max9.325050419367171
deviation-heading_mean4.169032989434274
deviation-heading_median3.146186424645846
deviation-heading_min1.0587086890782302
driven_any_max15.8392585855895
driven_any_mean6.676605890850181
driven_any_median4.921144349690103
driven_any_min1.0248762784310177
driven_lanedir_consec_max2.746674633153106
driven_lanedir_consec_mean1.8478767215419432
driven_lanedir_consec_min0.7335940802055405
driven_lanedir_max4.1225108427444495
driven_lanedir_mean2.1921963115537277
driven_lanedir_median1.9563401616324612
driven_lanedir_min0.7335940802055405
get_duckie_state_max1.3612590713670144e-06
get_duckie_state_mean1.3418008752258566e-06
get_duckie_state_median1.3491273235957389e-06
get_duckie_state_min1.3076897823449336e-06
get_robot_state_max0.004106227675480629
get_robot_state_mean0.0039413872459048635
get_robot_state_median0.003946509098767244
get_robot_state_min0.003766303110604334
get_state_dump_max0.004912350071010305
get_state_dump_mean0.004877053101177408
get_state_dump_median0.004888982883876198
get_state_dump_min0.00481789656594693
get_ui_image_max0.03905356773222336
get_ui_image_mean0.033495457482674754
get_ui_image_median0.032942265079816554
get_ui_image_min0.02904373203884255
in-drivable-lane_max40.899999999999125
in-drivable-lane_mean16.087499999999846
in-drivable-lane_min1.5999999999999943
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 5.697821951893574, "get_ui_image": 0.030388156484870317, "step_physics": 0.16237480624552048, "survival_time": 22.500000000000185, "driven_lanedir": 2.037287975532947, "get_state_dump": 0.00481789656594693, "get_robot_state": 0.003908718768878945, "sim_render-ego0": 0.003968275307023076, "get_duckie_state": 1.3612590713670144e-06, "in-drivable-lane": 14.0000000000002, "deviation-heading": 2.257949005139545, "agent_compute-ego0": 0.0130767801119853, "complete-iteration": 0.23364927340505393, "set_robot_commands": 0.002441361843878837, "deviation-center-line": 0.48195558295479535, "driven_lanedir_consec": 2.0358458250771525, "sim_compute_sim_state": 0.010411934947756073, "sim_compute_performance-ego0": 0.0021709105920897356}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.0248762784310177, "get_ui_image": 0.03905356773222336, "step_physics": 0.22643707737778176, "survival_time": 4.899999999999991, "driven_lanedir": 0.7335940802055405, "get_state_dump": 0.004894401087905421, "get_robot_state": 0.003766303110604334, "sim_render-ego0": 0.0040115780300564235, "get_duckie_state": 1.3076897823449336e-06, "in-drivable-lane": 1.5999999999999943, "deviation-heading": 1.0587086890782302, "agent_compute-ego0": 0.013504941054064818, "complete-iteration": 0.3067947541824495, "set_robot_commands": 0.0024772750006781686, "deviation-center-line": 0.15370133515160186, "driven_lanedir_consec": 0.7335940802055405, "sim_compute_sim_state": 0.010433156080920289, "sim_compute_performance-ego0": 0.0021247911934900764}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.144466747486632, "get_ui_image": 0.035496373674762785, "step_physics": 0.20431881804964436, "survival_time": 16.700000000000102, "driven_lanedir": 1.8753923477319752, "get_state_dump": 0.004912350071010305, "get_robot_state": 0.004106227675480629, "sim_render-ego0": 0.004017497532403291, "get_duckie_state": 1.3600534467554803e-06, "in-drivable-lane": 7.850000000000063, "deviation-heading": 4.0344238441521485, "agent_compute-ego0": 0.01360487937927246, "complete-iteration": 0.2823734190926623, "set_robot_commands": 0.0023993129160866807, "deviation-center-line": 0.8005801835801613, "driven_lanedir_consec": 1.8753923477319752, "sim_compute_sim_state": 0.01123773162044696, "sim_compute_performance-ego0": 0.0021849176776942924}, "LF-norm-small_loop-000-ego0": {"driven_any": 15.8392585855895, "get_ui_image": 0.02904373203884255, "step_physics": 0.15841888289566738, "survival_time": 59.99999999999873, "driven_lanedir": 4.1225108427444495, "get_state_dump": 0.004883564679846974, "get_robot_state": 0.0039842994286555435, "sim_render-ego0": 0.004044206414393441, "get_duckie_state": 1.3382012004359974e-06, "in-drivable-lane": 40.899999999999125, "deviation-heading": 9.325050419367171, "agent_compute-ego0": 0.013193330399499744, "complete-iteration": 0.22488090239595512, "set_robot_commands": 0.002459664229647901, "deviation-center-line": 1.7851685076358144, "driven_lanedir_consec": 2.746674633153106, "sim_compute_sim_state": 0.006575125639484288, "sim_compute_performance-ego0": 0.002186159011624834}}
set_robot_commands_max0.0024772750006781686
set_robot_commands_mean0.0024444034975728965
set_robot_commands_median0.002450513036763369
set_robot_commands_min0.0023993129160866807
sim_compute_performance-ego0_max0.002186159011624834
sim_compute_performance-ego0_mean0.0021666946187247345
sim_compute_performance-ego0_median0.0021779141348920138
sim_compute_performance-ego0_min0.0021247911934900764
sim_compute_sim_state_max0.01123773162044696
sim_compute_sim_state_mean0.009664487072151902
sim_compute_sim_state_median0.010422545514338178
sim_compute_sim_state_min0.006575125639484288
sim_render-ego0_max0.004044206414393441
sim_render-ego0_mean0.004010389320969058
sim_render-ego0_median0.004014537781229857
sim_render-ego0_min0.003968275307023076
simulation-passed1
step_physics_max0.22643707737778176
step_physics_mean0.1878873961421535
step_physics_median0.1833468121475824
step_physics_min0.15841888289566738
survival_time_max59.99999999999873
survival_time_mean26.02499999999975
survival_time_min4.899999999999991
No reset possible
5406411677Daniil Lisussim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:17:43
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.93725739383322
survival_time_median21.650000000000173
deviation-center-line_median1.2048796517174172
in-drivable-lane_median7.925000000000035


other stats
agent_compute-ego0_max0.013148590283031903
agent_compute-ego0_mean0.012583618797232745
agent_compute-ego0_median0.012551982166378674
agent_compute-ego0_min0.012081920573141725
complete-iteration_max0.24688638161511312
complete-iteration_mean0.2132017023435787
complete-iteration_median0.2123291396915709
complete-iteration_min0.18126214837605975
deviation-center-line_max1.890974001136278
deviation-center-line_mean1.0979431354585747
deviation-center-line_min0.09103923726318648
deviation-heading_max5.295421885433047
deviation-heading_mean3.986176032435211
deviation-heading_median4.983130515157901
deviation-heading_min0.6830212139919943
driven_any_max14.465930240936546
driven_any_mean6.975092106405776
driven_any_median5.894867225656229
driven_any_min1.6447037333740986
driven_lanedir_consec_max5.789866414484033
driven_lanedir_consec_mean2.966418913973965
driven_lanedir_consec_min0.2012944537453865
driven_lanedir_max5.789866414484033
driven_lanedir_mean3.380985930127469
driven_lanedir_median3.766391426140227
driven_lanedir_min0.2012944537453865
get_duckie_state_max1.3302605316899004e-06
get_duckie_state_mean1.3208748698158964e-06
get_duckie_state_median1.3213210714633171e-06
get_duckie_state_min1.3105968046470506e-06
get_robot_state_max0.003818143754315799
get_robot_state_mean0.003704954623624325
get_robot_state_median0.0037135021977460006
get_robot_state_min0.003574670344689498
get_state_dump_max0.005528350080987408
get_state_dump_mean0.004958116541653059
get_state_dump_median0.00483829556144694
get_state_dump_min0.004627524962730948
get_ui_image_max0.035924979168983184
get_ui_image_mean0.031207515151641635
get_ui_image_median0.03055492353106596
get_ui_image_min0.027795234375451443
in-drivable-lane_max42.94999999999861
in-drivable-lane_mean15.399999999999674
in-drivable-lane_min2.8000000000000123
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 8.409296772659326, "get_ui_image": 0.028156164473136968, "step_physics": 0.11554960065183388, "survival_time": 28.200000000000266, "driven_lanedir": 5.789866414484033, "get_state_dump": 0.004730958854202676, "get_robot_state": 0.0036419754534696056, "sim_render-ego0": 0.003746158464819984, "get_duckie_state": 1.3254385078902794e-06, "in-drivable-lane": 8.700000000000085, "deviation-heading": 5.295421885433047, "agent_compute-ego0": 0.012081920573141725, "complete-iteration": 0.18126214837605975, "set_robot_commands": 0.002198378385695736, "deviation-center-line": 1.890974001136278, "driven_lanedir_consec": 5.789866414484033, "sim_compute_sim_state": 0.009108169943885466, "sim_compute_performance-ego0": 0.0019601695305478256}, "LF-norm-zigzag-000-ego0": {"driven_any": 3.3804376786531325, "get_ui_image": 0.035924979168983184, "step_physics": 0.16883260110030474, "survival_time": 15.10000000000008, "driven_lanedir": 2.4618958348744395, "get_state_dump": 0.005528350080987408, "get_robot_state": 0.003574670344689498, "sim_render-ego0": 0.003835312210687316, "get_duckie_state": 1.317203635036355e-06, "in-drivable-lane": 2.8000000000000123, "deviation-heading": 5.076779953246919, "agent_compute-ego0": 0.013148590283031903, "complete-iteration": 0.24688638161511312, "set_robot_commands": 0.002304969447674138, "deviation-center-line": 0.9942729881651288, "driven_lanedir_consec": 1.7666249372152, "sim_compute_sim_state": 0.0116891876699114, "sim_compute_performance-ego0": 0.0019599352732743366}, "LF-norm-techtrack-000-ego0": {"driven_any": 14.465930240936546, "get_ui_image": 0.03295368258899495, "step_physics": 0.1536441401180677, "survival_time": 59.99999999999873, "driven_lanedir": 5.070887017406016, "get_state_dump": 0.004627524962730948, "get_robot_state": 0.003785028942022395, "sim_render-ego0": 0.003932209832781459, "get_duckie_state": 1.3302605316899004e-06, "in-drivable-lane": 42.94999999999861, "deviation-heading": 4.889481077068884, "agent_compute-ego0": 0.012757679703432155, "complete-iteration": 0.2284973040905523, "set_robot_commands": 0.0023032584654897772, "deviation-center-line": 1.4154863152697057, "driven_lanedir_consec": 4.10788985045124, "sim_compute_sim_state": 0.01230261169007974, "sim_compute_performance-ego0": 0.0021004539842311787}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.6447037333740986, "get_ui_image": 0.027795234375451443, "step_physics": 0.13347705722560543, "survival_time": 8.399999999999984, "driven_lanedir": 0.2012944537453865, "get_state_dump": 0.004945632268691204, "get_robot_state": 0.003818143754315799, "sim_render-ego0": 0.00389076266768416, "get_duckie_state": 1.3105968046470506e-06, "in-drivable-lane": 7.149999999999985, "deviation-heading": 0.6830212139919943, "agent_compute-ego0": 0.01234628462932519, "complete-iteration": 0.19616097529258955, "set_robot_commands": 0.002345339080991124, "deviation-center-line": 0.09103923726318648, "driven_lanedir_consec": 0.2012944537453865, "sim_compute_sim_state": 0.005342336801382212, "sim_compute_performance-ego0": 0.0021113531123956985}}
set_robot_commands_max0.002345339080991124
set_robot_commands_mean0.0022879863449626935
set_robot_commands_median0.0023041139565819573
set_robot_commands_min0.002198378385695736
sim_compute_performance-ego0_max0.0021113531123956985
sim_compute_performance-ego0_mean0.00203297797511226
sim_compute_performance-ego0_median0.002030311757389502
sim_compute_performance-ego0_min0.0019599352732743366
sim_compute_sim_state_max0.01230261169007974
sim_compute_sim_state_mean0.009610576526314705
sim_compute_sim_state_median0.010398678806898431
sim_compute_sim_state_min0.005342336801382212
sim_render-ego0_max0.003932209832781459
sim_render-ego0_mean0.00385111079399323
sim_render-ego0_median0.003863037439185738
sim_render-ego0_min0.003746158464819984
simulation-passed1
step_physics_max0.16883260110030474
step_physics_mean0.14287584977395293
step_physics_median0.14356059867183657
step_physics_min0.11554960065183388
survival_time_max59.99999999999873
survival_time_mean27.924999999999763
survival_time_min8.399999999999984
No reset possible
5403611684Mo Kleit 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:08:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median1.9567687842305277
survival_time_median11.325000000000026
deviation-center-line_median0.5487507876178432
in-drivable-lane_median4.900000000000017


other stats
agent_compute-ego0_max0.012713568811198228
agent_compute-ego0_mean0.012326975120508088
agent_compute-ego0_median0.012305586423313048
agent_compute-ego0_min0.01198315882420802
complete-iteration_max0.283531287244258
complete-iteration_mean0.2515644510385172
complete-iteration_median0.2525412056222126
complete-iteration_min0.21764410566538572
deviation-center-line_max1.110548970268859
deviation-center-line_mean0.6056205812547873
deviation-center-line_min0.214431779514604
deviation-heading_max4.869249844437391
deviation-heading_mean2.7569097140222185
deviation-heading_median2.555893529206978
deviation-heading_min1.046601953237526
driven_any_max6.806727082937854
driven_any_mean4.271450503562621
driven_any_median4.058353885985854
driven_any_min2.162367159340922
driven_lanedir_consec_max4.40490566618889
driven_lanedir_consec_mean2.248039062021654
driven_lanedir_consec_min0.6737130134366707
driven_lanedir_max4.40490566618889
driven_lanedir_mean2.3229798960472876
driven_lanedir_median2.106650452281795
driven_lanedir_min0.6737130134366707
get_duckie_state_max2.436339855194092e-06
get_duckie_state_mean2.2917385475306583e-06
get_duckie_state_median2.2828388950106944e-06
get_duckie_state_min2.164936544907153e-06
get_robot_state_max0.003775368444621563
get_robot_state_mean0.003692851353769134
get_robot_state_median0.003685197579059983
get_robot_state_min0.003625641812335004
get_state_dump_max0.00478233490139246
get_state_dump_mean0.0046599186761811994
get_state_dump_median0.004663037094112699
get_state_dump_min0.004531265615106939
get_ui_image_max0.03827641028484315
get_ui_image_mean0.03201744998816871
get_ui_image_median0.030800366776567112
get_ui_image_min0.028192656114697456
in-drivable-lane_max6.4500000000000295
in-drivable-lane_mean4.887500000000021
in-drivable-lane_min3.300000000000021
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 6.806727082937854, "get_ui_image": 0.028923258021637633, "step_physics": 0.1624549109857161, "survival_time": 18.150000000000123, "driven_lanedir": 4.40490566618889, "get_state_dump": 0.004531265615106939, "get_robot_state": 0.003625641812335004, "sim_render-ego0": 0.0037339074271065848, "get_duckie_state": 2.210611825460916e-06, "in-drivable-lane": 5.600000000000049, "deviation-heading": 4.869249844437391, "agent_compute-ego0": 0.01198315882420802, "complete-iteration": 0.22958894876333383, "set_robot_commands": 0.002195386441199334, "deviation-center-line": 1.110548970268859, "driven_lanedir_consec": 4.40490566618889, "sim_compute_sim_state": 0.010067031278715027, "sim_compute_performance-ego0": 0.0019865697556799584}, "LF-norm-zigzag-000-ego0": {"driven_any": 2.162367159340922, "get_ui_image": 0.03827641028484315, "step_physics": 0.20575017055482356, "survival_time": 6.499999999999985, "driven_lanedir": 0.6737130134366707, "get_state_dump": 0.004636160289968243, "get_robot_state": 0.003669776989303473, "sim_render-ego0": 0.0038121019610921846, "get_duckie_state": 2.3550659645604723e-06, "in-drivable-lane": 4.199999999999985, "deviation-heading": 1.046601953237526, "agent_compute-ego0": 0.012713568811198228, "complete-iteration": 0.283531287244258, "set_robot_commands": 0.002415167466374754, "deviation-center-line": 0.214431779514604, "driven_lanedir_consec": 0.6737130134366707, "sim_compute_sim_state": 0.010122362893956308, "sim_compute_performance-ego0": 0.002042677566295362}, "LF-norm-techtrack-000-ego0": {"driven_any": 3.4896269078687707, "get_ui_image": 0.032677475531496594, "step_physics": 0.2039608691804972, "survival_time": 9.900000000000006, "driven_lanedir": 2.1956671999172768, "get_state_dump": 0.004689913898257155, "get_robot_state": 0.0037006181688164943, "sim_render-ego0": 0.003842408932633136, "get_duckie_state": 2.164936544907153e-06, "in-drivable-lane": 3.300000000000021, "deviation-heading": 2.3556150475648954, "agent_compute-ego0": 0.012251701786290462, "complete-iteration": 0.27549346248109136, "set_robot_commands": 0.0022209086010803528, "deviation-center-line": 0.6155553934672867, "driven_lanedir_consec": 2.1956671999172768, "sim_compute_sim_state": 0.0100629677125557, "sim_compute_performance-ego0": 0.0019954664623318004}, "LF-norm-small_loop-000-ego0": {"driven_any": 4.627080864102936, "get_ui_image": 0.028192656114697456, "step_physics": 0.15452736616134644, "survival_time": 12.750000000000046, "driven_lanedir": 2.017633704646313, "get_state_dump": 0.00478233490139246, "get_robot_state": 0.003775368444621563, "sim_render-ego0": 0.003816694021224976, "get_duckie_state": 2.436339855194092e-06, "in-drivable-lane": 6.4500000000000295, "deviation-heading": 2.7561720108490606, "agent_compute-ego0": 0.012359471060335636, "complete-iteration": 0.21764410566538572, "set_robot_commands": 0.0022262437269091606, "deviation-center-line": 0.4819461817683998, "driven_lanedir_consec": 1.717870368543778, "sim_compute_sim_state": 0.005841306410729885, "sim_compute_performance-ego0": 0.002032170072197914}}
set_robot_commands_max0.002415167466374754
set_robot_commands_mean0.0022644265588909005
set_robot_commands_median0.0022235761639947567
set_robot_commands_min0.002195386441199334
sim_compute_performance-ego0_max0.002042677566295362
sim_compute_performance-ego0_mean0.0020142209641262586
sim_compute_performance-ego0_median0.0020138182672648575
sim_compute_performance-ego0_min0.0019865697556799584
sim_compute_sim_state_max0.010122362893956308
sim_compute_sim_state_mean0.00902341707398923
sim_compute_sim_state_median0.010064999495635364
sim_compute_sim_state_min0.005841306410729885
sim_render-ego0_max0.003842408932633136
sim_render-ego0_mean0.00380127808551422
sim_render-ego0_median0.00381439799115858
sim_render-ego0_min0.0037339074271065848
simulation-passed1
step_physics_max0.20575017055482356
step_physics_mean0.18167332922059584
step_physics_median0.18320789008310667
step_physics_min0.15452736616134644
survival_time_max18.150000000000123
survival_time_mean11.825000000000038
survival_time_min6.499999999999985
No reset possible
5388911457Anastasiya Nikolskaya 🇷🇺JetBrains Researchaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:57:36
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median2.775768966662365
survival_time_median59.99999999999873
deviation-center-line_median8.35166180654342
in-drivable-lane_median2.300000000000008


other stats
agent_compute-ego0_max0.15414911007305465
agent_compute-ego0_mean0.12372788218634016
agent_compute-ego0_median0.1251024625184236
agent_compute-ego0_min0.09055749363545872
complete-iteration_max0.5653408770755765
complete-iteration_mean0.4375354448127111
complete-iteration_median0.4274622349814511
complete-iteration_min0.32987643221236584
deviation-center-line_max10.286761018842796
deviation-center-line_mean7.010600262442211
deviation-center-line_min1.0523164178392057
deviation-heading_max26.543977083538863
deviation-heading_mean12.906369687729748
deviation-heading_median11.360717498006665
deviation-heading_min2.3600666713668006
driven_any_max12.013088813784885
driven_any_mean4.7732466761156145
driven_any_median3.1662438521717937
driven_any_min0.747410186333989
driven_lanedir_consec_max11.227869360190985
driven_lanedir_consec_mean4.373723923068291
driven_lanedir_consec_min0.7154883987574516
driven_lanedir_max11.227869360190985
driven_lanedir_mean4.373723923068291
driven_lanedir_median2.775768966662365
driven_lanedir_min0.7154883987574516
get_duckie_state_max1.446392812101569e-06
get_duckie_state_mean1.4063916932931054e-06
get_duckie_state_median1.4078805686829986e-06
get_duckie_state_min1.3634128237048553e-06
get_robot_state_max0.004203185153742019
get_robot_state_mean0.004044731292597558
get_robot_state_median0.0040490208418542005
get_robot_state_min0.0038776983329398143
get_state_dump_max0.005094530183409374
get_state_dump_mean0.004939738955724051
get_state_dump_median0.004927459307058368
get_state_dump_min0.004809507025370093
get_ui_image_max0.043196229910870375
get_ui_image_mean0.03513837476058566
get_ui_image_median0.03504165016939797
get_ui_image_min0.02727396879267633
in-drivable-lane_max46.799999999998676
in-drivable-lane_mean12.849999999999673
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 12.013088813784885, "get_ui_image": 0.0336479872688465, "step_physics": 0.20507269656032845, "survival_time": 59.99999999999873, "driven_lanedir": 11.227869360190985, "get_state_dump": 0.004964361976922104, "get_robot_state": 0.004068285896815825, "sim_render-ego0": 0.004147416249004431, "get_duckie_state": 1.446392812101569e-06, "in-drivable-lane": 2.2000000000000246, "deviation-heading": 7.772827079640018, "agent_compute-ego0": 0.13386442679151905, "complete-iteration": 0.40192170881609635, "set_robot_commands": 0.0025161013416604735, "deviation-center-line": 7.71530877393868, "driven_lanedir_consec": 11.227869360190985, "sim_compute_sim_state": 0.011278880823661047, "sim_compute_performance-ego0": 0.0022657924051785053}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.747410186333989, "get_ui_image": 0.043196229910870375, "step_physics": 0.3375096992092466, "survival_time": 59.99999999999873, "driven_lanedir": 0.7154883987574516, "get_state_dump": 0.005094530183409374, "get_robot_state": 0.004203185153742019, "sim_render-ego0": 0.004346064782758041, "get_duckie_state": 1.4340847755451187e-06, "in-drivable-lane": 0.0, "deviation-heading": 26.543977083538863, "agent_compute-ego0": 0.15414911007305465, "complete-iteration": 0.5653408770755765, "set_robot_commands": 0.0025781975697716708, "deviation-center-line": 10.286761018842796, "driven_lanedir_consec": 0.7154883987574516, "sim_compute_sim_state": 0.011803931737323288, "sim_compute_performance-ego0": 0.002358685325921128}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.093763191486845, "get_ui_image": 0.03643531306994944, "step_physics": 0.2665393646313289, "survival_time": 59.99999999999873, "driven_lanedir": 3.8513496732304766, "get_state_dump": 0.004890556637194631, "get_robot_state": 0.004029755786892576, "sim_render-ego0": 0.0041680953385530165, "get_duckie_state": 1.3634128237048553e-06, "in-drivable-lane": 46.799999999998676, "deviation-heading": 2.3600666713668006, "agent_compute-ego0": 0.1163404982453282, "complete-iteration": 0.4530027611468059, "set_robot_commands": 0.002417958447776369, "deviation-center-line": 1.0523164178392057, "driven_lanedir_consec": 3.8513496732304766, "sim_compute_sim_state": 0.015836651378825343, "sim_compute_performance-ego0": 0.0022518741995170653}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.2387245128567423, "get_ui_image": 0.02727396879267633, "step_physics": 0.188309751283517, "survival_time": 59.99999999999873, "driven_lanedir": 1.7001882600942533, "get_state_dump": 0.004809507025370093, "get_robot_state": 0.0038776983329398143, "sim_render-ego0": 0.003994052952076374, "get_duckie_state": 1.3816763618208784e-06, "in-drivable-lane": 2.3999999999999915, "deviation-heading": 14.94860791637331, "agent_compute-ego0": 0.09055749363545872, "complete-iteration": 0.32987643221236584, "set_robot_commands": 0.0023510640705753424, "deviation-center-line": 8.98801483914816, "driven_lanedir_consec": 1.7001882600942533, "sim_compute_sim_state": 0.006510156675937471, "sim_compute_performance-ego0": 0.0020992432307641177}}
set_robot_commands_max0.0025781975697716708
set_robot_commands_mean0.002465830357445964
set_robot_commands_median0.0024670298947184212
set_robot_commands_min0.0023510640705753424
sim_compute_performance-ego0_max0.002358685325921128
sim_compute_performance-ego0_mean0.002243898790345204
sim_compute_performance-ego0_median0.0022588333023477853
sim_compute_performance-ego0_min0.0020992432307641177
sim_compute_sim_state_max0.015836651378825343
sim_compute_sim_state_mean0.011357405153936788
sim_compute_sim_state_median0.011541406280492168
sim_compute_sim_state_min0.006510156675937471
sim_render-ego0_max0.004346064782758041
sim_render-ego0_mean0.004163907330597965
sim_render-ego0_median0.004157755793778724
sim_render-ego0_min0.003994052952076374
simulation-passed1
step_physics_max0.3375096992092466
step_physics_mean0.24935787792110525
step_physics_median0.23580603059582864
step_physics_min0.188309751283517
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5385711745Jean-Sébastien Grondin 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:30:56
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median5.335383139330228
survival_time_median58.19999999999883
deviation-center-line_median3.369700886955872
in-drivable-lane_median14.049999999999656


other stats
agent_compute-ego0_max0.01322396326873262
agent_compute-ego0_mean0.012811399991554104
agent_compute-ego0_median0.012727343050174023
agent_compute-ego0_min0.01256695059713575
complete-iteration_max0.22927866194207788
complete-iteration_mean0.20084910083705823
complete-iteration_median0.2051808269732811
complete-iteration_min0.1637560874595928
deviation-center-line_max3.818996209605982
deviation-center-line_mean2.9674743053551618
deviation-center-line_min1.3114992379029211
deviation-heading_max18.028351385202264
deviation-heading_mean12.927300272617773
deviation-heading_median14.405047806435364
deviation-heading_min4.870754092398103
driven_any_max11.837652706198146
driven_any_mean9.049004036192333
driven_any_median10.02233563660996
driven_any_min4.313692165351268
driven_lanedir_consec_max6.975308822522628
driven_lanedir_consec_mean5.04372617699589
driven_lanedir_consec_min2.52882960680048
driven_lanedir_max9.40096861774438
driven_lanedir_mean6.478076372479688
driven_lanedir_median6.991253632686947
driven_lanedir_min2.52882960680048
get_duckie_state_max1.6214483875339314e-06
get_duckie_state_mean1.5242714260167262e-06
get_duckie_state_median1.5003893595750283e-06
get_duckie_state_min1.4748585973829164e-06
get_robot_state_max0.004368051633996479
get_robot_state_mean0.003968219649660907
get_robot_state_median0.0038521910041605417
get_robot_state_min0.003800444956326068
get_state_dump_max0.005258163153114966
get_state_dump_mean0.004960041508004617
get_state_dump_median0.004886953058151357
get_state_dump_min0.004808096762600787
get_ui_image_max0.03680097117056564
get_ui_image_mean0.03174531580900463
get_ui_image_median0.03186222687423558
get_ui_image_min0.02645583831698174
in-drivable-lane_max24.899999999999057
in-drivable-lane_mean15.787499999999618
in-drivable-lane_min10.150000000000102
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 10.121726642184084, "get_ui_image": 0.02904130298827312, "step_physics": 0.11693325229330324, "survival_time": 59.99999999999873, "driven_lanedir": 6.654428597202229, "get_state_dump": 0.004956893976483119, "get_robot_state": 0.0038346867080929874, "sim_render-ego0": 0.0039014810328678127, "get_duckie_state": 1.4886768731745357e-06, "in-drivable-lane": 24.899999999999057, "deviation-heading": 15.370351559079532, "agent_compute-ego0": 0.01256695059713575, "complete-iteration": 0.1855600094616562, "set_robot_commands": 0.0022454962543802, "deviation-center-line": 3.0822426783907644, "driven_lanedir_consec": 5.928767356985084, "sim_compute_sim_state": 0.00990000791494098, "sim_compute_performance-ego0": 0.00208423596238415}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.922944631035838, "get_ui_image": 0.03680097117056564, "step_physics": 0.14623896456905125, "survival_time": 56.39999999999893, "driven_lanedir": 7.328078668171664, "get_state_dump": 0.004817012139819596, "get_robot_state": 0.0038696953002280952, "sim_render-ego0": 0.003893992666442168, "get_duckie_state": 1.4748585973829164e-06, "in-drivable-lane": 13.099999999999593, "deviation-heading": 18.028351385202264, "agent_compute-ego0": 0.012725905468233717, "complete-iteration": 0.224801644484906, "set_robot_commands": 0.002339209994982575, "deviation-center-line": 3.818996209605982, "driven_lanedir_consec": 4.74199892167537, "sim_compute_sim_state": 0.011908596864941903, "sim_compute_performance-ego0": 0.0021103045072462623}, "LF-norm-techtrack-000-ego0": {"driven_any": 4.313692165351268, "get_ui_image": 0.034683150760198046, "step_physics": 0.14959681842286707, "survival_time": 23.5500000000002, "driven_lanedir": 2.52882960680048, "get_state_dump": 0.005258163153114966, "get_robot_state": 0.004368051633996479, "sim_render-ego0": 0.004445405329688121, "get_duckie_state": 1.6214483875339314e-06, "in-drivable-lane": 10.150000000000102, "deviation-heading": 4.870754092398103, "agent_compute-ego0": 0.01322396326873262, "complete-iteration": 0.22927866194207788, "set_robot_commands": 0.0027467497324539444, "deviation-center-line": 1.3114992379029211, "driven_lanedir_consec": 2.52882960680048, "sim_compute_sim_state": 0.012330810397358264, "sim_compute_performance-ego0": 0.002515860533310195}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.837652706198146, "get_ui_image": 0.02645583831698174, "step_physics": 0.1015787444245706, "survival_time": 59.99999999999873, "driven_lanedir": 9.40096861774438, "get_state_dump": 0.004808096762600787, "get_robot_state": 0.003800444956326068, "sim_render-ego0": 0.003792416344673608, "get_duckie_state": 1.5121018459755216e-06, "in-drivable-lane": 14.999999999999725, "deviation-heading": 13.439744053791197, "agent_compute-ego0": 0.012728780632114332, "complete-iteration": 0.1637560874595928, "set_robot_commands": 0.0022624477955026493, "deviation-center-line": 3.65715909552098, "driven_lanedir_consec": 6.975308822522628, "sim_compute_sim_state": 0.006249769442682957, "sim_compute_performance-ego0": 0.001988205484903226}}
set_robot_commands_max0.0027467497324539444
set_robot_commands_mean0.0023984759443298424
set_robot_commands_median0.002300828895242612
set_robot_commands_min0.0022454962543802
sim_compute_performance-ego0_max0.002515860533310195
sim_compute_performance-ego0_mean0.002174651621960958
sim_compute_performance-ego0_median0.0020972702348152064
sim_compute_performance-ego0_min0.001988205484903226
sim_compute_sim_state_max0.012330810397358264
sim_compute_sim_state_mean0.010097296154981023
sim_compute_sim_state_median0.01090430238994144
sim_compute_sim_state_min0.006249769442682957
sim_render-ego0_max0.004445405329688121
sim_render-ego0_mean0.004008323843417928
sim_render-ego0_median0.00389773684965499
sim_render-ego0_min0.003792416344673608
simulation-passed1
step_physics_max0.14959681842286707
step_physics_mean0.12858694492744804
step_physics_median0.13158610843117724
step_physics_min0.1015787444245706
survival_time_max59.99999999999873
survival_time_mean49.987499999999145
survival_time_min23.5500000000002
No reset possible
5379911764Ayman Shams 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:44:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.0
survival_time_median59.99999999999873
deviation-center-line_median1.2422730096440104
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.013519160654225218
agent_compute-ego0_mean0.012822611147319148
agent_compute-ego0_median0.01282146610288596
agent_compute-ego0_min0.012128351729279454
complete-iteration_max0.371360655132678
complete-iteration_mean0.3120874705461539
complete-iteration_median0.30987487526162283
complete-iteration_min0.25723947652869184
deviation-center-line_max4.053503393024394
deviation-center-line_mean1.731069028434027
deviation-center-line_min0.386226701423694
deviation-heading_max27.859809596736422
deviation-heading_mean14.925250437835436
deviation-heading_median14.309269950178932
deviation-heading_min3.22265225424745
driven_any_max2.6645352591003757e-13
driven_any_mean1.9984014443252818e-13
driven_any_median2.6645352591003757e-13
driven_any_min0.0
driven_lanedir_consec_max0.000286102294921875
driven_lanedir_consec_mean7.152557373046875e-05
driven_lanedir_consec_min0.0
driven_lanedir_max0.000286102294921875
driven_lanedir_mean7.152557373046875e-05
driven_lanedir_median0.0
driven_lanedir_min0.0
get_duckie_state_max1.5861485820328763e-06
get_duckie_state_mean1.4220745140666469e-06
get_duckie_state_median1.3971606658757676e-06
get_duckie_state_min1.3078281424821765e-06
get_robot_state_max0.0040606674207041005
get_robot_state_mean0.003886604487747078
get_robot_state_median0.003891849200195516
get_robot_state_min0.00370205212989318
get_state_dump_max0.00515546429464958
get_state_dump_mean0.004946384153993402
get_state_dump_median0.00491724869889284
get_state_dump_min0.004795574923538348
get_ui_image_max0.03695759785165398
get_ui_image_mean0.03162316358853737
get_ui_image_median0.03105483245690796
get_ui_image_min0.02742539158867956
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.0280840327400252, "step_physics": 0.211471282075982, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004795574923538348, "get_robot_state": 0.00370205212989318, "sim_render-ego0": 0.003744637340828342, "get_duckie_state": 1.3078281424821765e-06, "in-drivable-lane": 0.0, "deviation-heading": 22.66279310353771, "agent_compute-ego0": 0.012712989222695686, "complete-iteration": 0.27729909267155556, "set_robot_commands": 0.0022244354171816454, "deviation-center-line": 4.053503393024394, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.008507334918007068, "sim_compute_performance-ego0": 0.001966335096526007}, "LF-norm-zigzag-000-ego0": {"driven_any": 0.0, "get_ui_image": 0.03695759785165398, "step_physics": 0.2915333607710966, "survival_time": 59.99999999999873, "driven_lanedir": 0.000286102294921875, "get_state_dump": 0.005014892621004611, "get_robot_state": 0.003931049105527498, "sim_render-ego0": 0.004033086897431563, "get_duckie_state": 1.394976981970591e-06, "in-drivable-lane": 0.0, "deviation-heading": 27.859809596736422, "agent_compute-ego0": 0.012929942983076237, "complete-iteration": 0.371360655132678, "set_robot_commands": 0.002397585471007945, "deviation-center-line": 1.0457540566888746, "driven_lanedir_consec": 0.000286102294921875, "sim_compute_sim_state": 0.01223843282307316, "sim_compute_performance-ego0": 0.002225963995915269}, "LF-norm-techtrack-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.03402563217379072, "step_physics": 0.26698179824663937, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.00515546429464958, "get_robot_state": 0.0040606674207041005, "sim_render-ego0": 0.004185788339619633, "get_duckie_state": 1.5861485820328763e-06, "in-drivable-lane": 0.0, "deviation-heading": 3.22265225424745, "agent_compute-ego0": 0.013519160654225218, "complete-iteration": 0.34245065785169004, "set_robot_commands": 0.002394208106073511, "deviation-center-line": 1.4387919625991463, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.009765735970845726, "sim_compute_performance-ego0": 0.002255048878881754}, "LF-norm-small_loop-000-ego0": {"driven_any": 2.6645352591003757e-13, "get_ui_image": 0.02742539158867956, "step_physics": 0.19413735149901276, "survival_time": 59.99999999999873, "driven_lanedir": 0.0, "get_state_dump": 0.004819604776781068, "get_robot_state": 0.0038526492948635334, "sim_render-ego0": 0.0039433370918953645, "get_duckie_state": 1.3993443497809442e-06, "in-drivable-lane": 0.0, "deviation-heading": 5.955746796820156, "agent_compute-ego0": 0.012128351729279454, "complete-iteration": 0.25723947652869184, "set_robot_commands": 0.0023484573475427177, "deviation-center-line": 0.386226701423694, "driven_lanedir_consec": 0.0, "sim_compute_sim_state": 0.006417284400933589, "sim_compute_performance-ego0": 0.002070282023713353}}
set_robot_commands_max0.002397585471007945
set_robot_commands_mean0.002341171585451455
set_robot_commands_median0.0023713327268081144
set_robot_commands_min0.0022244354171816454
sim_compute_performance-ego0_max0.002255048878881754
sim_compute_performance-ego0_mean0.002129407498759096
sim_compute_performance-ego0_median0.002148123009814311
sim_compute_performance-ego0_min0.001966335096526007
sim_compute_sim_state_max0.01223843282307316
sim_compute_sim_state_mean0.009232197028214885
sim_compute_sim_state_median0.009136535444426396
sim_compute_sim_state_min0.006417284400933589
sim_render-ego0_max0.004185788339619633
sim_render-ego0_mean0.003976712417443726
sim_render-ego0_median0.003988211994663464
sim_render-ego0_min0.003744637340828342
simulation-passed1
step_physics_max0.2915333607710966
step_physics_mean0.24103094814818268
step_physics_median0.23922654016131067
step_physics_min0.19413735149901276
survival_time_max59.99999999999873
survival_time_mean59.99999999999873
survival_time_min59.99999999999873
No reset possible
5375711776Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:35:35
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median6.6160622272296585
survival_time_median59.99999999999873
deviation-center-line_median2.6555286493469534
in-drivable-lane_median24.324999999999505


other stats
agent_compute-ego0_max0.012646095569317155
agent_compute-ego0_mean0.012245639557949304
agent_compute-ego0_median0.012215052119500433
agent_compute-ego0_min0.011906358423479192
complete-iteration_max0.25118282930883346
complete-iteration_mean0.20421646685461964
complete-iteration_median0.19586754907279288
complete-iteration_min0.17394793996405938
deviation-center-line_max2.8636147595171253
deviation-center-line_mean2.3408824780118644
deviation-center-line_min1.1888578538364252
deviation-heading_max11.408105935009608
deviation-heading_mean9.145518656786187
deviation-heading_median9.45589573118194
deviation-heading_min6.262177229771263
driven_any_max12.426856377412856
driven_any_mean11.345526013318048
driven_any_median11.546156128622124
driven_any_min9.862935418615084
driven_lanedir_consec_max8.167770194166884
driven_lanedir_consec_mean6.0990851902272745
driven_lanedir_consec_min2.9964461122828965
driven_lanedir_max8.181998305353243
driven_lanedir_mean6.342173617414226
driven_lanedir_median7.095125026010383
driven_lanedir_min2.9964461122828965
get_duckie_state_max1.3401066016287824e-06
get_duckie_state_mean1.2998675322376444e-06
get_duckie_state_median1.3195406288826696e-06
get_duckie_state_min1.220282269556457e-06
get_robot_state_max0.003803887633260938
get_robot_state_mean0.003712385789006071
get_robot_state_median0.0037313734866935367
get_robot_state_min0.0035829085493762724
get_state_dump_max0.005231534710136878
get_state_dump_mean0.004813573840799679
get_state_dump_median0.004701592447647944
get_state_dump_min0.004619575757765949
get_ui_image_max0.037204629371608545
get_ui_image_mean0.030788464037803196
get_ui_image_median0.030182268597700516
get_ui_image_min0.025584689584203207
in-drivable-lane_max43.249999999998856
in-drivable-lane_mean27.349999999999262
in-drivable-lane_min17.499999999999186
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 11.997099644415531, "get_ui_image": 0.02742168528154232, "step_physics": 0.11722050102227534, "survival_time": 59.99999999999873, "driven_lanedir": 7.257780488384134, "get_state_dump": 0.004644575960729442, "get_robot_state": 0.0035829085493762724, "sim_render-ego0": 0.0036828932813760345, "get_duckie_state": 1.220282269556457e-06, "in-drivable-lane": 25.499999999998767, "deviation-heading": 10.118462429775244, "agent_compute-ego0": 0.011907970379234653, "complete-iteration": 0.1815569674740425, "set_robot_commands": 0.002172469100189844, "deviation-center-line": 2.8636147595171253, "driven_lanedir_consec": 6.299654890822688, "sim_compute_sim_state": 0.00891437518606575, "sim_compute_performance-ego0": 0.0019283197404542235}, "LF-norm-zigzag-000-ego0": {"driven_any": 9.862935418615084, "get_ui_image": 0.037204629371608545, "step_physics": 0.17105880128851844, "survival_time": 55.199999999999, "driven_lanedir": 6.93246956363663, "get_state_dump": 0.004758608934566446, "get_robot_state": 0.003803090272446024, "sim_render-ego0": 0.0039766164926382215, "get_duckie_state": 1.3401066016287824e-06, "in-drivable-lane": 17.499999999999186, "deviation-heading": 11.408105935009608, "agent_compute-ego0": 0.012646095569317155, "complete-iteration": 0.25118282930883346, "set_robot_commands": 0.0023176242862891286, "deviation-center-line": 2.6111872554852513, "driven_lanedir_consec": 6.93246956363663, "sim_compute_sim_state": 0.01320179274718686, "sim_compute_performance-ego0": 0.002125737246345071}, "LF-norm-techtrack-000-ego0": {"driven_any": 12.426856377412856, "get_ui_image": 0.03294285191385871, "step_physics": 0.134436511278748, "survival_time": 59.99999999999873, "driven_lanedir": 8.181998305353243, "get_state_dump": 0.005231534710136878, "get_robot_state": 0.003803887633260938, "sim_render-ego0": 0.003945870562258807, "get_duckie_state": 1.3344293827816013e-06, "in-drivable-lane": 23.15000000000024, "deviation-heading": 8.793329032588634, "agent_compute-ego0": 0.012522133859766214, "complete-iteration": 0.21017813067154328, "set_robot_commands": 0.0023004113387108645, "deviation-center-line": 2.699870043208656, "driven_lanedir_consec": 8.167770194166884, "sim_compute_sim_state": 0.012825440209076664, "sim_compute_performance-ego0": 0.002080682314603553}, "LF-norm-small_loop-000-ego0": {"driven_any": 11.095212612828716, "get_ui_image": 0.025584689584203207, "step_physics": 0.1139443331614422, "survival_time": 59.99999999999873, "driven_lanedir": 2.9964461122828965, "get_state_dump": 0.004619575757765949, "get_robot_state": 0.0036596567009410494, "sim_render-ego0": 0.0037221926435840615, "get_duckie_state": 1.3046518749837376e-06, "in-drivable-lane": 43.249999999998856, "deviation-heading": 6.262177229771263, "agent_compute-ego0": 0.011906358423479192, "complete-iteration": 0.17394793996405938, "set_robot_commands": 0.002186299164428203, "deviation-center-line": 1.1888578538364252, "driven_lanedir_consec": 2.9964461122828965, "sim_compute_sim_state": 0.0062843413277529955, "sim_compute_performance-ego0": 0.001957177321777852}}
set_robot_commands_max0.0023176242862891286
set_robot_commands_mean0.0022442009724045102
set_robot_commands_median0.0022433552515695337
set_robot_commands_min0.002172469100189844
sim_compute_performance-ego0_max0.002125737246345071
sim_compute_performance-ego0_mean0.0020229791557951748
sim_compute_performance-ego0_median0.0020189298181907027
sim_compute_performance-ego0_min0.0019283197404542235
sim_compute_sim_state_max0.01320179274718686
sim_compute_sim_state_mean0.010306487367520567
sim_compute_sim_state_median0.010869907697571207
sim_compute_sim_state_min0.0062843413277529955
sim_render-ego0_max0.0039766164926382215
sim_render-ego0_mean0.0038318932449642818
sim_render-ego0_median0.003834031602921434
sim_render-ego0_min0.0036828932813760345
simulation-passed1
step_physics_max0.17105880128851844
step_physics_mean0.134165036687746
step_physics_median0.1258285061505117
step_physics_min0.1139443331614422
survival_time_max59.99999999999873
survival_time_mean58.7999999999988
survival_time_min55.199999999999
No reset possible
5375512322Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simhost-erroryesnogpu-prod-020:00:47
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 53, in get_services_id
    container = client.containers.get(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/models/containers.py", line 880, in get
    resp = self.client.api.inspect_container(container_id)
  File "/usr/local/lib/python3.8/dist-packages/docker/utils/decorators.py", line 16, in wrapped
    raise errors.NullResource(
docker.errors.NullResource: Resource ID was not provided

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 991, in run_single
    write_logs(wd, project, services=config["services"])
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 120, in write_logs
    services2id: Dict[ServiceName, ContainerID] = get_services_id(wd, project, services)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/docker_compose.py", line 63, in get_services_id
    raise DockerComposeFail(msg, output=output.decode(), names=names) from e
duckietown_challenges_runner.docker_compose.DockerComposeFail: Cannot get process ids
│ output: ''
│  names: {}
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5375312322Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:00:42
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5375012322Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:00:43
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5374612322Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:00:49
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5374012322Robert Moni 🇭🇺duckietown-rmaido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:01:17
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 555, in run_episode
    agent_ci.write_topic_and_expect_zero("observations", obs_plus)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 331, in read_until_over
    raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "ego0" aborted:

error in ego0 |Exception while handling a message on topic "observations".
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 355, in loop
              ||     handle_message_node(parsed, receiver0, context0)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/wrapper.py", line 531, in handle_message_node
              ||     call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
              ||   File "/usr/local/lib/python3.8/dist-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 67, in on_received_observations
              ||     cv2.imwrite(f'/challenges/challenge-solution-output/obs_{self.steps}.png', cv2.cvtColor(self.current_image, cv2.COLOR_RGB2BGR))
              || cv2.error: OpenCV(4.4.0) /tmp/pip-req-build-h2062vqd/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = cv::impl::<unnamed>::NONE; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
              || > Unsupported depth of input image:
              || >     'VDepth::contains(depth)'
              || > where
              || >     'depth' is 6 (CV_64F)
              ||
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5370212714Bea Baselines 🐤template-randomaido5-LFV-sim-validationLFVv-simsuccessyesnogpu-prod-020:12:01
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.7324341757991104
survival_time_median6.1749999999999865
deviation-center-line_median0.1416289228220337
in-drivable-lane_median4.024999999999986


other stats
agent_compute-ego0_max0.013262400260338416
agent_compute-ego0_mean0.012902561147798183
agent_compute-ego0_median0.012958328698271064
agent_compute-ego0_min0.012431186934312183
agent_compute-npc0_max0.026875761648019154
agent_compute-npc0_mean0.02413604955936402
agent_compute-npc0_median0.023534415114639152
agent_compute-npc0_min0.022599606360158613
agent_compute-npc1_max0.03830427389878493
agent_compute-npc1_mean0.032155960545025085
agent_compute-npc1_median0.02919704375728484
agent_compute-npc1_min0.028966563979005502
agent_compute-npc2_max0.040532471583439755
agent_compute-npc2_mean0.03255108583558452
agent_compute-npc2_median0.02878961999431934
agent_compute-npc2_min0.028331165928994456
agent_compute-npc3_max0.04237774618310866
agent_compute-npc3_mean0.03794155605427957
agent_compute-npc3_median0.03794155605427957
agent_compute-npc3_min0.033505365925450475
complete-iteration_max1.191146598142736
complete-iteration_mean0.8569507127823937
complete-iteration_median0.9551088037325192
complete-iteration_min0.32643864552179974
deviation-center-line_max0.1728925413407413
deviation-center-line_mean0.1314871218615119
deviation-center-line_min0.06979810046123884
deviation-heading_max1.394684528928578
deviation-heading_mean0.6266950388971282
deviation-heading_median0.4258079888276152
deviation-heading_min0.26047964900470477
driven_any_max3.0432991877567512
driven_any_mean2.157906677127926
driven_any_median2.312372712230844
driven_any_min0.9635820962932632
driven_lanedir_consec_max0.8125862604449666
driven_lanedir_consec_mean0.715646099889072
driven_lanedir_consec_min0.5851297875131007
driven_lanedir_max0.8125862604449666
driven_lanedir_mean0.715646099889072
driven_lanedir_median0.7324341757991104
driven_lanedir_min0.5851297875131007
get_duckie_state_max2.1824469933143028e-06
get_duckie_state_mean1.7218216177042932e-06
get_duckie_state_median1.6340876326841466e-06
get_duckie_state_min1.4366642121345763e-06
get_robot_state_max0.019362769095726266
get_robot_state_mean0.0154548499700282
get_robot_state_median0.017189611453868023
get_robot_state_min0.008077407876650492
get_state_dump_max0.01285162741138089
get_state_dump_mean0.010489247785353262
get_state_dump_median0.011192777973134772
get_state_dump_min0.006719807783762614
get_ui_image_max0.06009862807489211
get_ui_image_mean0.048916903154624505
get_ui_image_median0.050491415309570374
get_ui_image_min0.03458615392446518
in-drivable-lane_max5.59999999999998
in-drivable-lane_mean3.712499999999987
in-drivable-lane_min1.1999999999999955
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 0.9635820962932632, "get_ui_image": 0.04583852841303899, "step_physics": 0.4847246720240666, "survival_time": 3.1999999999999966, "driven_lanedir": 0.7205039289860935, "get_state_dump": 0.010343225185687723, "get_robot_state": 0.01563859352698693, "sim_render-ego0": 0.004145295803363507, "sim_render-npc0": 0.003986879495474009, "sim_render-npc1": 0.004042390676645132, "sim_render-npc2": 0.004051483594454252, "get_duckie_state": 2.1824469933143028e-06, "in-drivable-lane": 1.1999999999999955, "deviation-heading": 0.26047964900470477, "agent_compute-ego0": 0.013262400260338416, "agent_compute-npc0": 0.023604759803185094, "agent_compute-npc1": 0.03830427389878493, "agent_compute-npc2": 0.040532471583439755, "complete-iteration": 0.7346106199117807, "set_robot_commands": 0.002534778301532452, "deviation-center-line": 0.06979810046123884, "driven_lanedir_consec": 0.7205039289860935, "sim_compute_sim_state": 0.0270445676950308, "sim_compute_performance-ego0": 0.00224762329688439, "sim_compute_performance-npc0": 0.002127368633563702, "sim_compute_performance-npc1": 0.0022469850686880257, "sim_compute_performance-npc2": 0.002192273506751427}, "LFV-norm-zigzag-000-ego0": {"driven_any": 3.0432991877567512, "get_ui_image": 0.06009862807489211, "step_physics": 0.8504681294964206, "survival_time": 7.699999999999981, "driven_lanedir": 0.8125862604449666, "get_state_dump": 0.01285162741138089, "get_robot_state": 0.01874062938074912, "sim_render-ego0": 0.004105895565402124, "sim_render-npc0": 0.003915603699222688, "sim_render-npc1": 0.004038879948277627, "sim_render-npc2": 0.003982786978444746, "sim_render-npc3": 0.003983863707511656, "get_duckie_state": 1.4366642121345763e-06, "in-drivable-lane": 5.59999999999998, "deviation-heading": 0.5728223245352578, "agent_compute-ego0": 0.012788535702613091, "agent_compute-npc0": 0.022599606360158613, "agent_compute-npc1": 0.02919704375728484, "agent_compute-npc2": 0.028331165928994456, "agent_compute-npc3": 0.033505365925450475, "complete-iteration": 1.175606987553258, "set_robot_commands": 0.002465977207306893, "deviation-center-line": 0.1159684528189553, "driven_lanedir_consec": 0.8125862604449666, "sim_compute_sim_state": 0.0637156025055916, "sim_compute_performance-ego0": 0.0023153089707897557, "sim_compute_performance-npc0": 0.0021113226490636025, "sim_compute_performance-npc1": 0.0021282026844639933, "sim_compute_performance-npc2": 0.0021726131439208985, "sim_compute_performance-npc3": 0.0021376317547213645}, "LFV-norm-techtrack-000-ego0": {"driven_any": 2.9493172253703293, "get_ui_image": 0.05514430220610176, "step_physics": 0.8667441863639682, "survival_time": 7.599999999999981, "driven_lanedir": 0.7443644226121274, "get_state_dump": 0.01204233076058182, "get_robot_state": 0.019362769095726266, "sim_render-ego0": 0.0038702846352570977, "sim_render-npc0": 0.0038663748822181055, "sim_render-npc1": 0.00382791157641442, "sim_render-npc2": 0.003843430600135155, "sim_render-npc3": 0.0038783815171983503, "get_duckie_state": 1.5520582012101716e-06, "in-drivable-lane": 4.999999999999982, "deviation-heading": 1.394684528928578, "agent_compute-ego0": 0.013128121693929035, "agent_compute-npc0": 0.02346407042609321, "agent_compute-npc1": 0.028966563979005502, "agent_compute-npc2": 0.02878961999431934, "agent_compute-npc3": 0.04237774618310866, "complete-iteration": 1.191146598142736, "set_robot_commands": 0.0026102206286262065, "deviation-center-line": 0.1728925413407413, "driven_lanedir_consec": 0.7443644226121274, "sim_compute_sim_state": 0.05832219591327742, "sim_compute_performance-ego0": 0.002391900891572042, "sim_compute_performance-npc0": 0.0019421125549116945, "sim_compute_performance-npc1": 0.0020642296161526947, "sim_compute_performance-npc2": 0.0021750693227730543, "sim_compute_performance-npc3": 0.002231960982279061}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.6754281990913586, "get_ui_image": 0.03458615392446518, "step_physics": 0.20946700622638068, "survival_time": 4.749999999999991, "driven_lanedir": 0.5851297875131007, "get_state_dump": 0.006719807783762614, "get_robot_state": 0.008077407876650492, "sim_render-ego0": 0.004088943203290303, "sim_render-npc0": 0.0040067632993062334, "get_duckie_state": 1.7161170641581218e-06, "in-drivable-lane": 3.04999999999999, "deviation-heading": 0.2787936531199725, "agent_compute-ego0": 0.012431186934312183, "agent_compute-npc0": 0.026875761648019154, "complete-iteration": 0.32643864552179974, "set_robot_commands": 0.0027249082922935486, "deviation-center-line": 0.16728939282511213, "driven_lanedir_consec": 0.5851297875131007, "sim_compute_sim_state": 0.010452580948670706, "sim_compute_performance-ego0": 0.0022180105249087014, "sim_compute_performance-npc0": 0.002150997519493103}}
set_robot_commands_max0.0027249082922935486
set_robot_commands_mean0.002583971107439775
set_robot_commands_median0.002572499465079329
set_robot_commands_min0.002465977207306893
sim_compute_performance-ego0_max0.002391900891572042
sim_compute_performance-ego0_mean0.0022932109210387227
sim_compute_performance-ego0_median0.0022814661338370727
sim_compute_performance-ego0_min0.0022180105249087014
sim_compute_performance-npc0_max0.002150997519493103
sim_compute_performance-npc0_mean0.0020829503392580254
sim_compute_performance-npc0_median0.0021193456413136523
sim_compute_performance-npc0_min0.0019421125549116945
sim_compute_performance-npc1_max0.0022469850686880257
sim_compute_performance-npc1_mean0.0021464724564349046
sim_compute_performance-npc1_median0.0021282026844639933
sim_compute_performance-npc1_min0.0020642296161526947
sim_compute_performance-npc2_max0.002192273506751427
sim_compute_performance-npc2_mean0.002179985324481793
sim_compute_performance-npc2_median0.0021750693227730543
sim_compute_performance-npc2_min0.0021726131439208985
sim_compute_performance-npc3_max0.002231960982279061
sim_compute_performance-npc3_mean0.0021847963685002127
sim_compute_performance-npc3_median0.0021847963685002127
sim_compute_performance-npc3_min0.0021376317547213645
sim_compute_sim_state_max0.0637156025055916
sim_compute_sim_state_mean0.03988373676564264
sim_compute_sim_state_median0.04268338180415411
sim_compute_sim_state_min0.010452580948670706
sim_render-ego0_max0.004145295803363507
sim_render-ego0_mean0.004052604801828258
sim_render-ego0_median0.004097419384346213
sim_render-ego0_min0.0038702846352570977
sim_render-npc0_max0.0040067632993062334
sim_render-npc0_mean0.003943905344055258
sim_render-npc0_median0.003951241597348348
sim_render-npc0_min0.0038663748822181055
sim_render-npc1_max0.004042390676645132
sim_render-npc1_mean0.003969727400445726
sim_render-npc1_median0.004038879948277627
sim_render-npc1_min0.00382791157641442
sim_render-npc2_max0.004051483594454252
sim_render-npc2_mean0.003959233724344717
sim_render-npc2_median0.003982786978444746
sim_render-npc2_min0.003843430600135155
sim_render-npc3_max0.003983863707511656
sim_render-npc3_mean0.003931122612355003
sim_render-npc3_median0.003931122612355003
sim_render-npc3_min0.0038783815171983503
simulation-passed1
step_physics_max0.8667441863639682
step_physics_mean0.602850998527709
step_physics_median0.6675964007602436
step_physics_min0.20946700622638068
survival_time_max7.699999999999981
survival_time_mean5.812499999999988
survival_time_min3.1999999999999966
No reset possible
5369212716Bea Baselines 🐤template-randomaido5-LFP-sim-validationLFP-simsuccessnonogpu-prod-020:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
survival_time_median4.324999999999992
in-drivable-lane_median2.774999999999994
driven_lanedir_consec_median0.4321482075534334
deviation-center-line_median0.15954927868599478


other stats
agent_compute-ego0_max0.012097283772059849
agent_compute-ego0_mean0.010849440652493311
agent_compute-ego0_median0.010854859158323316
agent_compute-ego0_min0.009590760521266771
complete-iteration_max0.2384108134678432
complete-iteration_mean0.2103200321044062
complete-iteration_median0.22115958340164427
complete-iteration_min0.1605501481464931
deviation-center-line_max0.22312966499424747
deviation-center-line_mean0.16355048574709427
deviation-center-line_min0.11197372062214005
deviation-heading_max1.1731765577527429
deviation-heading_mean0.919352453519212
deviation-heading_median0.85924234065638
deviation-heading_min0.7857485750113451
driven_any_max2.100847232339913
driven_any_mean1.5514062152548211
driven_any_median1.5034346079602865
driven_any_min1.0979084127587997
driven_lanedir_consec_max0.9767221791082258
driven_lanedir_consec_mean0.5077475888170035
driven_lanedir_consec_min0.1899717610529219
driven_lanedir_max0.9767221791082258
driven_lanedir_mean0.5077475888170035
driven_lanedir_median0.4321482075534334
driven_lanedir_min0.1899717610529219
get_duckie_state_max0.024424834498043717
get_duckie_state_mean0.017236102101182735
get_duckie_state_median0.020192129073922926
get_duckie_state_min0.004135315758841378
get_robot_state_max0.003818255379086449
get_robot_state_mean0.00365786744004919
get_robot_state_median0.003644940824522965
get_robot_state_min0.003523332732064383
get_state_dump_max0.00862185708407698
get_state_dump_mean0.007425022360139292
get_state_dump_median0.007992924962724957
get_state_dump_min0.0050923824310302734
get_ui_image_max0.03905055182320731
get_ui_image_mean0.031975258687131955
get_ui_image_median0.03191341079216728
get_ui_image_min0.025023661340985975
in-drivable-lane_max4.19999999999999
in-drivable-lane_mean2.637499999999994
in-drivable-lane_min0.7999999999999972
per-episodes
details{"LFP-norm-loop-000-ego0": {"driven_any": 2.100847232339913, "get_ui_image": 0.03120341999777432, "step_physics": 0.11464191716292808, "survival_time": 5.749999999999988, "driven_lanedir": 0.1899717610529219, "get_state_dump": 0.00862185708407698, "get_robot_state": 0.003717023750831341, "sim_render-ego0": 0.003763757903000404, "get_duckie_state": 0.024424834498043717, "in-drivable-lane": 4.19999999999999, "deviation-heading": 1.1731765577527429, "agent_compute-ego0": 0.011969260100660652, "complete-iteration": 0.2102256252847869, "set_robot_commands": 0.002221257522188384, "deviation-center-line": 0.15862358643039717, "driven_lanedir_consec": 0.1899717610529219, "sim_compute_sim_state": 0.007663998110540982, "sim_compute_performance-ego0": 0.001898352442116573}, "LFP-norm-zigzag-000-ego0": {"driven_any": 1.88168671303, "get_ui_image": 0.03905055182320731, "step_physics": 0.13597935267857142, "survival_time": 5.1999999999999895, "driven_lanedir": 0.5108322939725443, "get_state_dump": 0.008177561987014043, "get_robot_state": 0.003818255379086449, "sim_render-ego0": 0.003925827571323939, "get_duckie_state": 0.021055771055675687, "in-drivable-lane": 3.499999999999993, "deviation-heading": 0.8524889084427177, "agent_compute-ego0": 0.012097283772059849, "complete-iteration": 0.2384108134678432, "set_robot_commands": 0.002223907198224749, "deviation-center-line": 0.1604749709415924, "driven_lanedir_consec": 0.5108322939725443, "sim_compute_sim_state": 0.009870265779041107, "sim_compute_performance-ego0": 0.0021028859274727957}, "LFP-norm-techtrack-000-ego0": {"driven_any": 1.0979084127587997, "get_ui_image": 0.032623401586560234, "step_physics": 0.14043930993563886, "survival_time": 3.399999999999996, "driven_lanedir": 0.9767221791082258, "get_state_dump": 0.007808287938435872, "get_robot_state": 0.003572857898214589, "sim_render-ego0": 0.003523297931836999, "get_duckie_state": 0.01932848709217016, "in-drivable-lane": 0.7999999999999972, "deviation-heading": 0.7857485750113451, "agent_compute-ego0": 0.009590760521266771, "complete-iteration": 0.2320935415185016, "set_robot_commands": 0.00204052095827849, "deviation-center-line": 0.22312966499424747, "driven_lanedir_consec": 0.9767221791082258, "sim_compute_sim_state": 0.011213589405667955, "sim_compute_performance-ego0": 0.0018633966860563855}, "LFP-norm-small_loop-000-ego0": {"driven_any": 1.1251825028905729, "get_ui_image": 0.025023661340985975, "step_physics": 0.09996013981955391, "survival_time": 3.4499999999999957, "driven_lanedir": 0.3534641211343226, "get_state_dump": 0.0050923824310302734, "get_robot_state": 0.003523332732064383, "sim_render-ego0": 0.003659112112862723, "get_duckie_state": 0.004135315758841378, "in-drivable-lane": 2.049999999999996, "deviation-heading": 0.8659957728700425, "agent_compute-ego0": 0.00974045821598598, "complete-iteration": 0.1605501481464931, "set_robot_commands": 0.002308406148638044, "deviation-center-line": 0.11197372062214005, "driven_lanedir_consec": 0.3534641211343226, "sim_compute_sim_state": 0.005195011411394392, "sim_compute_performance-ego0": 0.0018263987132481167}}
set_robot_commands_max0.002308406148638044
set_robot_commands_mean0.0021985229568324167
set_robot_commands_median0.0022225823602065667
set_robot_commands_min0.00204052095827849
sim_compute_performance-ego0_max0.0021028859274727957
sim_compute_performance-ego0_mean0.001922758442223468
sim_compute_performance-ego0_median0.0018808745640864792
sim_compute_performance-ego0_min0.0018263987132481167
sim_compute_sim_state_max0.011213589405667955
sim_compute_sim_state_mean0.008485716176661108
sim_compute_sim_state_median0.008767131944791045
sim_compute_sim_state_min0.005195011411394392
sim_render-ego0_max0.003925827571323939
sim_render-ego0_mean0.003717998879756016
sim_render-ego0_median0.0037114350079315633
sim_render-ego0_min0.003523297931836999
simulation-passed1
step_physics_max0.14043930993563886
step_physics_mean0.12275517989917308
step_physics_median0.12531063492074976
step_physics_min0.09996013981955391
survival_time_max5.749999999999988
survival_time_mean4.449999999999992
survival_time_min3.399999999999996
No reset possible
5364212584Bea Baselines 🐤template-rosaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-020:20:45
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.382996885755309
survival_time_median10.350000000000012
deviation-center-line_median0.17655707401641374
in-drivable-lane_median7.900000000000015


other stats
agent_compute-ego0_max0.013729360241156358
agent_compute-ego0_mean0.01261158635985231
agent_compute-ego0_median0.012854494982295564
agent_compute-ego0_min0.011438447650116267
agent_compute-ego1_max0.013113184617115902
agent_compute-ego1_mean0.01241016104881272
agent_compute-ego1_median0.013049792912271287
agent_compute-ego1_min0.011331798337030073
complete-iteration_max1.0608360171318054
complete-iteration_mean0.8327127167635145
complete-iteration_median0.9514086510126408
complete-iteration_min0.2741107687037042
deviation-center-line_max0.2923851046499391
deviation-center-line_mean0.16916508159442634
deviation-center-line_min0.08669269403706553
deviation-heading_max2.0576286669261656
deviation-heading_mean1.0470823704521195
deviation-heading_median0.8305323045698125
deviation-heading_min0.3528849864906655
driven_any_max4.208543705894597
driven_any_mean1.659613166604926
driven_any_median1.5178116657658005
driven_any_min0.5518773381122702
driven_lanedir_consec_max0.5744086736572258
driven_lanedir_consec_mean0.37074886504787663
driven_lanedir_consec_min0.07885479152881203
driven_lanedir_max0.5744086736572258
driven_lanedir_mean0.3739622630894967
driven_lanedir_median0.382996885755309
driven_lanedir_min0.10080493862674
get_duckie_state_max1.933712225693923e-06
get_duckie_state_mean1.6033094423427933e-06
get_duckie_state_median1.5861458248562285e-06
get_duckie_state_min1.2106929265015514e-06
get_robot_state_max0.01565384979431446
get_robot_state_mean0.013763589260048947
get_robot_state_median0.015247386362817552
get_robot_state_min0.006745370567267668
get_state_dump_max0.010593646102481416
get_state_dump_mean0.009384532455169558
get_state_dump_median0.010234926755611714
get_state_dump_min0.005935775472762737
get_ui_image_max0.05223969784047869
get_ui_image_mean0.044252081981484295
get_ui_image_median0.04867607698990749
get_ui_image_min0.02827819526618254
in-drivable-lane_max13.95000000000008
in-drivable-lane_mean8.335714285714303
in-drivable-lane_min4.599999999999986
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 0.9571849985784368, "get_ui_image": 0.03982741447171756, "step_physics": 0.6134116767656685, "survival_time": 15.10000000000008, "driven_lanedir": 0.3907920544936676, "get_state_dump": 0.009049402998618951, "get_robot_state": 0.013898640969405473, "sim_render-ego0": 0.0035827844449789216, "sim_render-ego1": 0.0035306667730753177, "sim_render-ego2": 0.0034368486687688543, "sim_render-ego3": 0.003449232271402189, "get_duckie_state": 1.48637853439885e-06, "in-drivable-lane": 13.35000000000008, "deviation-heading": 0.3528849864906655, "agent_compute-ego0": 0.011438447650116267, "agent_compute-ego1": 0.011606686972942287, "agent_compute-ego2": 0.010834025077693928, "agent_compute-ego3": 0.010986778208918304, "complete-iteration": 0.7651944561760025, "set_robot_commands": 0.0021580941606276108, "deviation-center-line": 0.1424801319655192, "driven_lanedir_consec": 0.3907920544936676, "sim_compute_sim_state": 0.013826867534775938, "sim_compute_performance-ego0": 0.0019681445836234016, "sim_compute_performance-ego1": 0.0018418999788391312, "sim_compute_performance-ego2": 0.0018443109178700465, "sim_compute_performance-ego3": 0.0018354988727632528}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 4.208543705894597, "get_ui_image": 0.03982741447171756, "step_physics": 0.6134116767656685, "survival_time": 15.10000000000008, "driven_lanedir": 0.5577717432091602, "get_state_dump": 0.009049402998618951, "get_robot_state": 0.013898640969405473, "sim_render-ego0": 0.0035827844449789216, "sim_render-ego1": 0.0035306667730753177, "sim_render-ego2": 0.0034368486687688543, "sim_render-ego3": 0.003449232271402189, "get_duckie_state": 1.48637853439885e-06, "in-drivable-lane": 12.350000000000067, "deviation-heading": 1.7775841315313683, "agent_compute-ego0": 0.011438447650116267, "agent_compute-ego1": 0.011606686972942287, "agent_compute-ego2": 0.010834025077693928, "agent_compute-ego3": 0.010986778208918304, "complete-iteration": 0.7651944561760025, "set_robot_commands": 0.0021580941606276108, "deviation-center-line": 0.2923851046499391, "driven_lanedir_consec": 0.5577717432091602, "sim_compute_sim_state": 0.013826867534775938, "sim_compute_performance-ego0": 0.0019681445836234016, "sim_compute_performance-ego1": 0.0018418999788391312, "sim_compute_performance-ego2": 0.0018443109178700465, "sim_compute_performance-ego3": 0.0018354988727632528}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.6839375253517808, "get_ui_image": 0.03982741447171756, "step_physics": 0.6134116767656685, "survival_time": 15.10000000000008, "driven_lanedir": 0.5744086736572258, "get_state_dump": 0.009049402998618951, "get_robot_state": 0.013898640969405473, "sim_render-ego0": 0.0035827844449789216, "sim_render-ego1": 0.0035306667730753177, "sim_render-ego2": 0.0034368486687688543, "sim_render-ego3": 0.003449232271402189, "get_duckie_state": 1.48637853439885e-06, "in-drivable-lane": 12.150000000000082, "deviation-heading": 1.6821861761244534, "agent_compute-ego0": 0.011438447650116267, "agent_compute-ego1": 0.011606686972942287, "agent_compute-ego2": 0.010834025077693928, "agent_compute-ego3": 0.010986778208918304, "complete-iteration": 0.7651944561760025, "set_robot_commands": 0.0021580941606276108, "deviation-center-line": 0.2502791350327733, "driven_lanedir_consec": 0.5744086736572258, "sim_compute_sim_state": 0.013826867534775938, "sim_compute_performance-ego0": 0.0019681445836234016, "sim_compute_performance-ego1": 0.0018418999788391312, "sim_compute_performance-ego2": 0.0018443109178700465, "sim_compute_performance-ego3": 0.0018354988727632528}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.719445054041005, "get_ui_image": 0.03982741447171756, "step_physics": 0.6134116767656685, "survival_time": 15.10000000000008, "driven_lanedir": 0.23749867272149183, "get_state_dump": 0.009049402998618951, "get_robot_state": 0.013898640969405473, "sim_render-ego0": 0.0035827844449789216, "sim_render-ego1": 0.0035306667730753177, "sim_render-ego2": 0.0034368486687688543, "sim_render-ego3": 0.003449232271402189, "get_duckie_state": 1.48637853439885e-06, "in-drivable-lane": 13.95000000000008, "deviation-heading": 0.4514789992700031, "agent_compute-ego0": 0.011438447650116267, "agent_compute-ego1": 0.011606686972942287, "agent_compute-ego2": 0.010834025077693928, "agent_compute-ego3": 0.010986778208918304, "complete-iteration": 0.7651944561760025, "set_robot_commands": 0.0021580941606276108, "deviation-center-line": 0.10640275187722877, "driven_lanedir_consec": 0.23749867272149183, "sim_compute_sim_state": 0.013826867534775938, "sim_compute_performance-ego0": 0.0019681445836234016, "sim_compute_performance-ego1": 0.0018418999788391312, "sim_compute_performance-ego2": 0.0018443109178700465, "sim_compute_performance-ego3": 0.0018354988727632528}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.86890193562334, "get_ui_image": 0.05223969784047869, "step_physics": 0.8659142371681001, "survival_time": 7.149999999999983, "driven_lanedir": 0.16387504199419056, "get_state_dump": 0.010593646102481416, "get_robot_state": 0.015247386362817552, "sim_render-ego0": 0.003940367036395603, "sim_render-ego1": 0.003963188992606269, "sim_render-ego2": 0.0038985411326090498, "sim_render-ego3": 0.0039586904976103045, "get_duckie_state": 1.5861458248562285e-06, "in-drivable-lane": 6.149999999999983, "deviation-heading": 0.4847125860626265, "agent_compute-ego0": 0.012854494982295564, "agent_compute-ego1": 0.013049792912271287, "agent_compute-ego2": 0.01338599787818061, "agent_compute-ego3": 0.012642198138766818, "complete-iteration": 1.0608360171318054, "set_robot_commands": 0.002344194385740492, "deviation-center-line": 0.08669269403706553, "driven_lanedir_consec": 0.16387504199419056, "sim_compute_sim_state": 0.030846903721491497, "sim_compute_performance-ego0": 0.0022315035263697305, "sim_compute_performance-ego1": 0.0020809852414660985, "sim_compute_performance-ego2": 0.002085745334625244, "sim_compute_performance-ego3": 0.0020897388458251953}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.3345392499803688, "get_ui_image": 0.05223969784047869, "step_physics": 0.8659142371681001, "survival_time": 7.149999999999983, "driven_lanedir": 0.41868217887941395, "get_state_dump": 0.010593646102481416, "get_robot_state": 0.015247386362817552, "sim_render-ego0": 0.003940367036395603, "sim_render-ego1": 0.003963188992606269, "sim_render-ego2": 0.0038985411326090498, "sim_render-ego3": 0.0039586904976103045, "get_duckie_state": 1.5861458248562285e-06, "in-drivable-lane": 5.099999999999986, "deviation-heading": 1.5127293579387169, "agent_compute-ego0": 0.012854494982295564, "agent_compute-ego1": 0.013049792912271287, "agent_compute-ego2": 0.01338599787818061, "agent_compute-ego3": 0.012642198138766818, "complete-iteration": 1.0608360171318054, "set_robot_commands": 0.002344194385740492, "deviation-center-line": 0.17435673137448315, "driven_lanedir_consec": 0.41868217887941395, "sim_compute_sim_state": 0.030846903721491497, "sim_compute_performance-ego0": 0.0022315035263697305, "sim_compute_performance-ego1": 0.0020809852414660985, "sim_compute_performance-ego2": 0.002085745334625244, "sim_compute_performance-ego3": 0.0020897388458251953}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 0.5518773381122702, "get_ui_image": 0.05223969784047869, "step_physics": 0.8659142371681001, "survival_time": 7.149999999999983, "driven_lanedir": 0.10080493862674, "get_state_dump": 0.010593646102481416, "get_robot_state": 0.015247386362817552, "sim_render-ego0": 0.003940367036395603, "sim_render-ego1": 0.003963188992606269, "sim_render-ego2": 0.0038985411326090498, "sim_render-ego3": 0.0039586904976103045, "get_duckie_state": 1.5861458248562285e-06, "in-drivable-lane": 5.749999999999982, "deviation-heading": 1.531354490788587, "agent_compute-ego0": 0.012854494982295564, "agent_compute-ego1": 0.013049792912271287, "agent_compute-ego2": 0.01338599787818061, "agent_compute-ego3": 0.012642198138766818, "complete-iteration": 1.0608360171318054, "set_robot_commands": 0.002344194385740492, "deviation-center-line": 0.08675009189111825, "driven_lanedir_consec": 0.07885479152881203, "sim_compute_sim_state": 0.030846903721491497, "sim_compute_performance-ego0": 0.0022315035263697305, "sim_compute_performance-ego1": 0.0020809852414660985, "sim_compute_performance-ego2": 0.002085745334625244, "sim_compute_performance-ego3": 0.0020897388458251953}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 0.9334798749570123, "get_ui_image": 0.05223969784047869, "step_physics": 0.8659142371681001, "survival_time": 7.149999999999983, "driven_lanedir": 0.3752017170169504, "get_state_dump": 0.010593646102481416, "get_robot_state": 0.015247386362817552, "sim_render-ego0": 0.003940367036395603, "sim_render-ego1": 0.003963188992606269, "sim_render-ego2": 0.0038985411326090498, "sim_render-ego3": 0.0039586904976103045, "get_duckie_state": 1.5861458248562285e-06, "in-drivable-lane": 5.249999999999981, "deviation-heading": 0.7312253826868761, "agent_compute-ego0": 0.012854494982295564, "agent_compute-ego1": 0.013049792912271287, "agent_compute-ego2": 0.01338599787818061, "agent_compute-ego3": 0.012642198138766818, "complete-iteration": 1.0608360171318054, "set_robot_commands": 0.002344194385740492, "deviation-center-line": 0.15300095113784218, "driven_lanedir_consec": 0.3752017170169504, "sim_compute_sim_state": 0.030846903721491497, "sim_compute_performance-ego0": 0.0022315035263697305, "sim_compute_performance-ego1": 0.0020809852414660985, "sim_compute_performance-ego2": 0.002085745334625244, "sim_compute_performance-ego3": 0.0020897388458251953}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.6058665999638935, "get_ui_image": 0.04867607698990749, "step_physics": 0.7623643393699939, "survival_time": 10.350000000000012, "driven_lanedir": 0.3949234607429353, "get_state_dump": 0.010234926755611714, "get_robot_state": 0.01565384979431446, "sim_render-ego0": 0.004115080604186425, "sim_render-ego1": 0.0039570618134278516, "sim_render-ego2": 0.003912709080255949, "sim_render-ego3": 0.003919900609896733, "get_duckie_state": 1.933712225693923e-06, "in-drivable-lane": 8.600000000000012, "deviation-heading": 0.5199618585160676, "agent_compute-ego0": 0.013729360241156358, "agent_compute-ego1": 0.013113184617115902, "agent_compute-ego2": 0.013306804574452914, "agent_compute-ego3": 0.013153935854251567, "complete-iteration": 0.9514086510126408, "set_robot_commands": 0.00233365366092095, "deviation-center-line": 0.17929196116005802, "driven_lanedir_consec": 0.3949234607429353, "sim_compute_sim_state": 0.02678860723972321, "sim_compute_performance-ego0": 0.0022667600558354305, "sim_compute_performance-ego1": 0.002148788708906907, "sim_compute_performance-ego2": 0.0020864055706904484, "sim_compute_performance-ego3": 0.0020959675312042236}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.5190117517903516, "get_ui_image": 0.04867607698990749, "step_physics": 0.7623643393699939, "survival_time": 10.350000000000012, "driven_lanedir": 0.37075047780223114, "get_state_dump": 0.010234926755611714, "get_robot_state": 0.01565384979431446, "sim_render-ego0": 0.004115080604186425, "sim_render-ego1": 0.0039570618134278516, "sim_render-ego2": 0.003912709080255949, "sim_render-ego3": 0.003919900609896733, "get_duckie_state": 1.933712225693923e-06, "in-drivable-lane": 8.100000000000016, "deviation-heading": 1.7493582893835549, "agent_compute-ego0": 0.013729360241156358, "agent_compute-ego1": 0.013113184617115902, "agent_compute-ego2": 0.013306804574452914, "agent_compute-ego3": 0.013153935854251567, "complete-iteration": 0.9514086510126408, "set_robot_commands": 0.00233365366092095, "deviation-center-line": 0.17884842542120905, "driven_lanedir_consec": 0.3697003536524588, "sim_compute_sim_state": 0.02678860723972321, "sim_compute_performance-ego0": 0.0022667600558354305, "sim_compute_performance-ego1": 0.002148788708906907, "sim_compute_performance-ego2": 0.0020864055706904484, "sim_compute_performance-ego3": 0.0020959675312042236}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.3516858061798205, "get_ui_image": 0.04867607698990749, "step_physics": 0.7623643393699939, "survival_time": 10.350000000000012, "driven_lanedir": 0.5584156488866543, "get_state_dump": 0.010234926755611714, "get_robot_state": 0.01565384979431446, "sim_render-ego0": 0.004115080604186425, "sim_render-ego1": 0.0039570618134278516, "sim_render-ego2": 0.003912709080255949, "sim_render-ego3": 0.003919900609896733, "get_duckie_state": 1.933712225693923e-06, "in-drivable-lane": 7.700000000000013, "deviation-heading": 0.9298392264527487, "agent_compute-ego0": 0.013729360241156358, "agent_compute-ego1": 0.013113184617115902, "agent_compute-ego2": 0.013306804574452914, "agent_compute-ego3": 0.013153935854251567, "complete-iteration": 0.9514086510126408, "set_robot_commands": 0.00233365366092095, "deviation-center-line": 0.20172998602580136, "driven_lanedir_consec": 0.5584156488866543, "sim_compute_sim_state": 0.02678860723972321, "sim_compute_performance-ego0": 0.0022667600558354305, "sim_compute_performance-ego1": 0.002148788708906907, "sim_compute_performance-ego2": 0.0020864055706904484, "sim_compute_performance-ego3": 0.0020959675312042236}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.6696238435224333, "get_ui_image": 0.04867607698990749, "step_physics": 0.7623643393699939, "survival_time": 10.350000000000012, "driven_lanedir": 0.2700064516577383, "get_state_dump": 0.010234926755611714, "get_robot_state": 0.01565384979431446, "sim_render-ego0": 0.004115080604186425, "sim_render-ego1": 0.0039570618134278516, "sim_render-ego2": 0.003912709080255949, "sim_render-ego3": 0.003919900609896733, "get_duckie_state": 1.933712225693923e-06, "in-drivable-lane": 8.950000000000012, "deviation-heading": 0.4672150096189838, "agent_compute-ego0": 0.013729360241156358, "agent_compute-ego1": 0.013113184617115902, "agent_compute-ego2": 0.013306804574452914, "agent_compute-ego3": 0.013153935854251567, "complete-iteration": 0.9514086510126408, "set_robot_commands": 0.00233365366092095, "deviation-center-line": 0.13081251819525294, "driven_lanedir_consec": 0.2700064516577383, "sim_compute_sim_state": 0.02678860723972321, "sim_compute_performance-ego0": 0.0022667600558354305, "sim_compute_performance-ego1": 0.002148788708906907, "sim_compute_performance-ego2": 0.0020864055706904484, "sim_compute_performance-ego3": 0.0020959675312042236}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.1199259465408826, "get_ui_image": 0.02827819526618254, "step_physics": 0.18654741293995092, "survival_time": 6.999999999999983, "driven_lanedir": 0.5410722265490002, "get_state_dump": 0.005935775472762737, "get_robot_state": 0.006745370567267668, "sim_render-ego0": 0.0035783348354042, "sim_render-ego1": 0.0034806068907392786, "get_duckie_state": 1.2106929265015514e-06, "in-drivable-lane": 4.699999999999983, "deviation-heading": 0.4109940245388556, "agent_compute-ego0": 0.012236498771829809, "agent_compute-ego1": 0.011331798337030073, "complete-iteration": 0.2741107687037042, "set_robot_commands": 0.0019844897249911694, "deviation-center-line": 0.17875741665834435, "driven_lanedir_consec": 0.5410722265490002, "sim_compute_sim_state": 0.008168472465893901, "sim_compute_performance-ego0": 0.0018232781836327089, "sim_compute_performance-ego1": 0.0017991218161075673}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.710560701932772, "get_ui_image": 0.02827819526618254, "step_physics": 0.18654741293995092, "survival_time": 6.999999999999983, "driven_lanedir": 0.2812683970155547, "get_state_dump": 0.005935775472762737, "get_robot_state": 0.006745370567267668, "sim_render-ego0": 0.0035783348354042, "sim_render-ego1": 0.0034806068907392786, "get_duckie_state": 1.2106929265015514e-06, "in-drivable-lane": 4.599999999999986, "deviation-heading": 2.0576286669261656, "agent_compute-ego0": 0.012236498771829809, "agent_compute-ego1": 0.011331798337030073, "complete-iteration": 0.2741107687037042, "set_robot_commands": 0.0019844897249911694, "deviation-center-line": 0.20652324289533344, "driven_lanedir_consec": 0.2592810956805738, "sim_compute_sim_state": 0.008168472465893901, "sim_compute_performance-ego0": 0.0018232781836327089, "sim_compute_performance-ego1": 0.0017991218161075673}}
set_robot_commands_max0.002344194385740492
set_robot_commands_mean0.002236624877081325
set_robot_commands_median0.00233365366092095
set_robot_commands_min0.0019844897249911694
sim_compute_performance-ego0_max0.0022667600558354305
sim_compute_performance-ego0_mean0.002108013502184262
sim_compute_performance-ego0_median0.0022315035263697305
sim_compute_performance-ego0_min0.0018232781836327089
sim_compute_performance-ego1_max0.002148788708906907
sim_compute_performance-ego1_mean0.0019917813820759774
sim_compute_performance-ego1_median0.0020809852414660985
sim_compute_performance-ego1_min0.0017991218161075673
sim_compute_sim_state_max0.030846903721491497
sim_compute_sim_state_mean0.02158474706541074
sim_compute_sim_state_median0.02678860723972321
sim_compute_sim_state_min0.008168472465893901
sim_render-ego0_max0.004115080604186425
sim_render-ego0_mean0.003836399858075157
sim_render-ego0_median0.003940367036395603
sim_render-ego0_min0.0035783348354042
sim_render-ego1_max0.003963188992606269
sim_render-ego1_mean0.003768920292708309
sim_render-ego1_median0.0039570618134278516
sim_render-ego1_min0.0034806068907392786
simulation-passed1
step_physics_max0.8659142371681001
step_physics_mean0.6671325599353538
step_physics_median0.7623643393699939
step_physics_min0.18654741293995092
survival_time_max15.10000000000008
survival_time_mean10.314285714285733
survival_time_min6.999999999999983
No reset possible
5362812693Bea Baselines 🐤template-randomaido5-LF-sim-testingLFt-simabortedyesnogpu-prod-020:00:31
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5361512690Bea Baselines 🐤template-randomaido5-LFI-sim-validationLFVIv-simabortedyesnogpu-prod-020:00:40
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5361312695Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simabortedyesnogpu-prod-020:01:56
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5360112696Bea Baselines 🐤template-randomaido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-020:03:55
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.337796168887212
survival_time_median2.799999999999998
deviation-center-line_median0.12255225805463438
in-drivable-lane_median0.8499999999999992


other stats
agent_compute-ego0_max0.014599159911826804
agent_compute-ego0_mean0.014297888455567537
agent_compute-ego0_median0.014297888455567537
agent_compute-ego0_min0.013996616999308268
agent_compute-npc0_max0.04862160594375045
agent_compute-npc0_mean0.0474684750592267
agent_compute-npc0_median0.0474684750592267
agent_compute-npc0_min0.04631534417470296
agent_compute-npc1_max0.050820527253327544
agent_compute-npc1_mean0.04275848357765763
agent_compute-npc1_median0.04275848357765763
agent_compute-npc1_min0.03469643990198771
agent_compute-npc2_max0.04875059481020327
agent_compute-npc2_mean0.04162361798463044
agent_compute-npc2_median0.04162361798463044
agent_compute-npc2_min0.034496641159057616
complete-iteration_max0.9468774265713162
complete-iteration_mean0.9354391607973312
complete-iteration_median0.9354391607973312
complete-iteration_min0.924000895023346
deviation-center-line_max0.18343097932693636
deviation-center-line_mean0.12255225805463438
deviation-center-line_min0.061673536782332394
deviation-heading_max0.6605678958728353
deviation-heading_mean0.6094445813321017
deviation-heading_median0.6094445813321017
deviation-heading_min0.558321266791368
driven_any_max0.5260611082777508
driven_any_mean0.5172579232239827
driven_any_median0.5172579232239827
driven_any_min0.5084547381702146
driven_lanedir_consec_max0.5003603965078054
driven_lanedir_consec_mean0.337796168887212
driven_lanedir_consec_min0.17523194126661856
driven_lanedir_max0.5003614442083277
driven_lanedir_mean0.33779669273747315
driven_lanedir_median0.33779669273747315
driven_lanedir_min0.17523194126661856
get_duckie_state_max3.159046173095703e-06
get_duckie_state_mean3.056393729315864e-06
get_duckie_state_median3.056393729315864e-06
get_duckie_state_min2.9537412855360244e-06
get_robot_state_max0.016244835323757596
get_robot_state_mean0.016179286771350436
get_robot_state_median0.016179286771350436
get_robot_state_min0.01611373821894328
get_state_dump_max0.011014774993613917
get_state_dump_mean0.01087842760262666
get_state_dump_median0.01087842760262666
get_state_dump_min0.010742080211639403
get_ui_image_max0.05814069112141927
get_ui_image_mean0.05539362651330454
get_ui_image_median0.05539362651330454
get_ui_image_min0.0526465619051898
in-drivable-lane_max1.6999999999999984
in-drivable-lane_mean0.8499999999999992
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 0.5260611082777508, "get_ui_image": 0.05814069112141927, "step_physics": 0.6292583664258321, "survival_time": 2.9499999999999975, "driven_lanedir": 0.5003614442083277, "get_state_dump": 0.010742080211639403, "get_robot_state": 0.01611373821894328, "sim_render-ego0": 0.004510037104288737, "sim_render-npc0": 0.0041428128878275555, "sim_render-npc1": 0.004158425331115723, "sim_render-npc2": 0.004234174887339274, "get_duckie_state": 3.159046173095703e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.6605678958728353, "agent_compute-ego0": 0.013996616999308268, "agent_compute-npc0": 0.04631534417470296, "agent_compute-npc1": 0.03469643990198771, "agent_compute-npc2": 0.034496641159057616, "complete-iteration": 0.924000895023346, "set_robot_commands": 0.0026026765505472818, "deviation-center-line": 0.18343097932693636, "driven_lanedir_consec": 0.5003603965078054, "sim_compute_sim_state": 0.042934858798980714, "sim_compute_performance-ego0": 0.002583316961924235, "sim_compute_performance-npc0": 0.0021997729937235514, "sim_compute_performance-npc1": 0.002253226439158122, "sim_compute_performance-npc2": 0.0023969411849975586}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.5084547381702146, "get_ui_image": 0.0526465619051898, "step_physics": 0.6223114552321257, "survival_time": 2.6499999999999986, "driven_lanedir": 0.17523194126661856, "get_state_dump": 0.011014774993613917, "get_robot_state": 0.016244835323757596, "sim_render-ego0": 0.004110217094421387, "sim_render-npc0": 0.004068445276331018, "sim_render-npc1": 0.004257224224231861, "sim_render-npc2": 0.004047429120099103, "get_duckie_state": 2.9537412855360244e-06, "in-drivable-lane": 1.6999999999999984, "deviation-heading": 0.558321266791368, "agent_compute-ego0": 0.014599159911826804, "agent_compute-npc0": 0.04862160594375045, "agent_compute-npc1": 0.050820527253327544, "agent_compute-npc2": 0.04875059481020327, "complete-iteration": 0.9468774265713162, "set_robot_commands": 0.0025198371322066697, "deviation-center-line": 0.061673536782332394, "driven_lanedir_consec": 0.17523194126661856, "sim_compute_sim_state": 0.0460596172897904, "sim_compute_performance-ego0": 0.002368202915898076, "sim_compute_performance-npc0": 0.002154367941397208, "sim_compute_performance-npc1": 0.002225791966473614, "sim_compute_performance-npc2": 0.002365708351135254}}
set_robot_commands_max0.0026026765505472818
set_robot_commands_mean0.0025612568413769755
set_robot_commands_median0.0025612568413769755
set_robot_commands_min0.0025198371322066697
sim_compute_performance-ego0_max0.002583316961924235
sim_compute_performance-ego0_mean0.0024757599389111555
sim_compute_performance-ego0_median0.0024757599389111555
sim_compute_performance-ego0_min0.002368202915898076
sim_compute_performance-npc0_max0.0021997729937235514
sim_compute_performance-npc0_mean0.00217707046756038
sim_compute_performance-npc0_median0.00217707046756038
sim_compute_performance-npc0_min0.002154367941397208
sim_compute_performance-npc1_max0.002253226439158122
sim_compute_performance-npc1_mean0.002239509202815868
sim_compute_performance-npc1_median0.002239509202815868
sim_compute_performance-npc1_min0.002225791966473614
sim_compute_performance-npc2_max0.0023969411849975586
sim_compute_performance-npc2_mean0.0023813247680664062
sim_compute_performance-npc2_median0.0023813247680664062
sim_compute_performance-npc2_min0.002365708351135254
sim_compute_sim_state_max0.0460596172897904
sim_compute_sim_state_mean0.04449723804438556
sim_compute_sim_state_median0.04449723804438556
sim_compute_sim_state_min0.042934858798980714
sim_render-ego0_max0.004510037104288737
sim_render-ego0_mean0.004310127099355062
sim_render-ego0_median0.004310127099355062
sim_render-ego0_min0.004110217094421387
sim_render-npc0_max0.0041428128878275555
sim_render-npc0_mean0.004105629082079287
sim_render-npc0_median0.004105629082079287
sim_render-npc0_min0.004068445276331018
sim_render-npc1_max0.004257224224231861
sim_render-npc1_mean0.004207824777673792
sim_render-npc1_median0.004207824777673792
sim_render-npc1_min0.004158425331115723
sim_render-npc2_max0.004234174887339274
sim_render-npc2_mean0.004140802003719189
sim_render-npc2_median0.004140802003719189
sim_render-npc2_min0.004047429120099103
simulation-passed1
step_physics_max0.6292583664258321
step_physics_mean0.6257849108289789
step_physics_median0.6257849108289789
step_physics_min0.6223114552321257
survival_time_max2.9499999999999975
survival_time_mean2.799999999999998
survival_time_min2.6499999999999986
No reset possible
5358312591Bea Baselines 🐤template-rosaido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-020:05:07
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.40410094889962705
survival_time_median3.674999999999995
deviation-center-line_median0.2546048973468039
in-drivable-lane_median0.8249999999999991


other stats
agent_compute-ego0_max0.013544212688099256
agent_compute-ego0_mean0.013373855926543186
agent_compute-ego0_median0.013373855926543186
agent_compute-ego0_min0.013203499164987118
agent_compute-npc0_max0.04998177615079013
agent_compute-npc0_mean0.04834112560725996
agent_compute-npc0_median0.04834112560725996
agent_compute-npc0_min0.04670047506372979
agent_compute-npc1_max0.04996115944602273
agent_compute-npc1_mean0.04186290546358208
agent_compute-npc1_median0.04186290546358208
agent_compute-npc1_min0.03376465148114143
agent_compute-npc2_max0.05048434084111994
agent_compute-npc2_mean0.04258340500309574
agent_compute-npc2_median0.04258340500309574
agent_compute-npc2_min0.034682469165071526
complete-iteration_max0.9978057780164352
complete-iteration_mean0.9881370872316784
complete-iteration_median0.9881370872316784
complete-iteration_min0.9784683964469216
deviation-center-line_max0.4272438293421233
deviation-center-line_mean0.2546048973468039
deviation-center-line_min0.08196596535148451
deviation-heading_max1.0905187815315172
deviation-heading_mean0.8210922500550035
deviation-heading_median0.8210922500550035
deviation-heading_min0.5516657185784899
driven_any_max1.0877156710095066
driven_any_mean0.8004659704615001
driven_any_median0.8004659704615001
driven_any_min0.5132162699134937
driven_lanedir_consec_max0.6010935763524287
driven_lanedir_consec_mean0.40410094889962705
driven_lanedir_consec_min0.20710832144682545
driven_lanedir_max1.0639266999530856
driven_lanedir_mean0.6355175106999555
driven_lanedir_median0.6355175106999555
driven_lanedir_min0.20710832144682545
get_duckie_state_max1.8616940112824136e-06
get_duckie_state_mean1.810828306688792e-06
get_duckie_state_median1.810828306688792e-06
get_duckie_state_min1.7599626020951705e-06
get_robot_state_max0.015395532954822887
get_robot_state_mean0.015332194430685136
get_robot_state_median0.015332194430685136
get_robot_state_min0.015268855906547384
get_state_dump_max0.010130127993496982
get_state_dump_mean0.01009013629743624
get_state_dump_median0.01009013629743624
get_state_dump_min0.010050144601375498
get_ui_image_max0.05652882697734427
get_ui_image_mean0.055428239824232325
get_ui_image_median0.055428239824232325
get_ui_image_min0.054327652671120386
in-drivable-lane_max1.649999999999998
in-drivable-lane_mean0.8249999999999991
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 1.0877156710095066, "get_ui_image": 0.05652882697734427, "step_physics": 0.7101241045809806, "survival_time": 4.6499999999999915, "driven_lanedir": 1.0639266999530856, "get_state_dump": 0.010050144601375498, "get_robot_state": 0.015268855906547384, "sim_render-ego0": 0.004098085646933698, "sim_render-npc0": 0.004049473620475607, "sim_render-npc1": 0.004167282834966132, "sim_render-npc2": 0.004105636414061201, "get_duckie_state": 1.8616940112824136e-06, "in-drivable-lane": 0.0, "deviation-heading": 1.0905187815315172, "agent_compute-ego0": 0.013203499164987118, "agent_compute-npc0": 0.04670047506372979, "agent_compute-npc1": 0.03376465148114143, "agent_compute-npc2": 0.034682469165071526, "complete-iteration": 0.9978057780164352, "set_robot_commands": 0.0025455545871815783, "deviation-center-line": 0.4272438293421233, "driven_lanedir_consec": 0.6010935763524287, "sim_compute_sim_state": 0.04186021267099584, "sim_compute_performance-ego0": 0.0023354266552214928, "sim_compute_performance-npc0": 0.0021238403117403073, "sim_compute_performance-npc1": 0.002242027445042387, "sim_compute_performance-npc2": 0.0022063610401559385}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.5132162699134937, "get_ui_image": 0.054327652671120386, "step_physics": 0.6503733678297563, "survival_time": 2.6999999999999984, "driven_lanedir": 0.20710832144682545, "get_state_dump": 0.010130127993496982, "get_robot_state": 0.015395532954822887, "sim_render-ego0": 0.004091397198763761, "sim_render-npc0": 0.004211196032437412, "sim_render-npc1": 0.00414681001143022, "sim_render-npc2": 0.004118130423805931, "get_duckie_state": 1.7599626020951705e-06, "in-drivable-lane": 1.649999999999998, "deviation-heading": 0.5516657185784899, "agent_compute-ego0": 0.013544212688099256, "agent_compute-npc0": 0.04998177615079013, "agent_compute-npc1": 0.04996115944602273, "agent_compute-npc2": 0.05048434084111994, "complete-iteration": 0.9784683964469216, "set_robot_commands": 0.002429368279196999, "deviation-center-line": 0.08196596535148451, "driven_lanedir_consec": 0.20710832144682545, "sim_compute_sim_state": 0.048662216013128104, "sim_compute_performance-ego0": 0.002296963605013761, "sim_compute_performance-npc0": 0.0021643768657337538, "sim_compute_performance-npc1": 0.0022024674849076705, "sim_compute_performance-npc2": 0.002209680730646307}}
set_robot_commands_max0.0025455545871815783
set_robot_commands_mean0.002487461433189289
set_robot_commands_median0.002487461433189289
set_robot_commands_min0.002429368279196999
sim_compute_performance-ego0_max0.0023354266552214928
sim_compute_performance-ego0_mean0.002316195130117627
sim_compute_performance-ego0_median0.002316195130117627
sim_compute_performance-ego0_min0.002296963605013761
sim_compute_performance-npc0_max0.0021643768657337538
sim_compute_performance-npc0_mean0.0021441085887370305
sim_compute_performance-npc0_median0.0021441085887370305
sim_compute_performance-npc0_min0.0021238403117403073
sim_compute_performance-npc1_max0.002242027445042387
sim_compute_performance-npc1_mean0.0022222474649750286
sim_compute_performance-npc1_median0.0022222474649750286
sim_compute_performance-npc1_min0.0022024674849076705
sim_compute_performance-npc2_max0.002209680730646307
sim_compute_performance-npc2_mean0.002208020885401123
sim_compute_performance-npc2_median0.002208020885401123
sim_compute_performance-npc2_min0.0022063610401559385
sim_compute_sim_state_max0.048662216013128104
sim_compute_sim_state_mean0.04526121434206197
sim_compute_sim_state_median0.04526121434206197
sim_compute_sim_state_min0.04186021267099584
sim_render-ego0_max0.004098085646933698
sim_render-ego0_mean0.004094741422848729
sim_render-ego0_median0.004094741422848729
sim_render-ego0_min0.004091397198763761
sim_render-npc0_max0.004211196032437412
sim_render-npc0_mean0.004130334826456509
sim_render-npc0_median0.004130334826456509
sim_render-npc0_min0.004049473620475607
sim_render-npc1_max0.004167282834966132
sim_render-npc1_mean0.004157046423198176
sim_render-npc1_median0.004157046423198176
sim_render-npc1_min0.00414681001143022
sim_render-npc2_max0.004118130423805931
sim_render-npc2_mean0.004111883418933566
sim_render-npc2_median0.004111883418933566
sim_render-npc2_min0.004105636414061201
simulation-passed1
step_physics_max0.7101241045809806
step_physics_mean0.6802487362053684
step_physics_median0.6802487362053684
step_physics_min0.6503733678297563
survival_time_max4.6499999999999915
survival_time_mean3.674999999999995
survival_time_min2.6999999999999984
No reset possible
5355212599Bea Baselines 🐤template-randomaido5-LFV_multi-sim-testingLFVmultibodyv-simsuccessyesnogpu-prod-020:13:04
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3386162956066159
survival_time_median7.199999999999982
deviation-center-line_median0.13150150834523444
in-drivable-lane_median5.1749999999999865


other stats
agent_compute-ego0_max0.01253618757709179
agent_compute-ego0_mean0.011913353726035997
agent_compute-ego0_median0.011958346764246622
agent_compute-ego0_min0.011398293755271216
agent_compute-ego1_max0.012363181394689223
agent_compute-ego1_mean0.012066712999499213
agent_compute-ego1_median0.01224493384361267
agent_compute-ego1_min0.011496009248675722
complete-iteration_max0.8383344014485677
complete-iteration_mean0.6882201263843714
complete-iteration_median0.7707364378304317
complete-iteration_min0.2615521243124297
deviation-center-line_max1.1793353551209578
deviation-center-line_mean0.19682735223382447
deviation-center-line_min0.03781627258124975
deviation-heading_max4.13206271019058
deviation-heading_mean1.0463262829209203
deviation-heading_median0.9402685921450354
deviation-heading_min0.291348286294811
driven_any_max2.951704478527868
driven_any_mean1.9134596982041032
driven_any_median1.760372794839244
driven_any_min0.18489783262536005
driven_lanedir_consec_max0.7960762545928977
driven_lanedir_consec_mean0.3518580104312197
driven_lanedir_consec_min0.10162466951715476
driven_lanedir_max0.7960762545928977
driven_lanedir_mean0.3521650626338418
driven_lanedir_median0.3407656610249702
driven_lanedir_min0.10162466951715476
get_duckie_state_max1.9292036692301433e-06
get_duckie_state_mean1.6718863759819728e-06
get_duckie_state_median1.623739604077308e-06
get_duckie_state_min1.4666355017459751e-06
get_robot_state_max0.015063059329986571
get_robot_state_mean0.013810531372430806
get_robot_state_median0.015055293351217034
get_robot_state_min0.007343114024460918
get_state_dump_max0.010197027524312336
get_state_dump_mean0.009463534583317529
get_state_dump_median0.00987782642759126
get_state_dump_min0.006386622033938013
get_ui_image_max0.05021039370832772
get_ui_image_mean0.04465593003183125
get_ui_image_median0.047048297582888136
get_ui_image_min0.030608157918910788
in-drivable-lane_max6.599999999999981
in-drivable-lane_mean4.764285714285701
in-drivable-lane_min0.0
per-episodes
details{"LFV_multi-norm-loop-000-ego0": {"driven_any": 2.274124355035624, "get_ui_image": 0.043732984860738115, "step_physics": 0.4982247511545817, "survival_time": 5.949999999999987, "driven_lanedir": 0.7960762545928977, "get_state_dump": 0.010197027524312336, "get_robot_state": 0.015063059329986571, "sim_render-ego0": 0.00391157865524292, "sim_render-ego1": 0.003863149881362915, "sim_render-ego2": 0.003926672538121541, "sim_render-ego3": 0.0038640618324279783, "get_duckie_state": 1.9292036692301433e-06, "in-drivable-lane": 3.4499999999999877, "deviation-heading": 0.9316977066482196, "agent_compute-ego0": 0.011958346764246622, "agent_compute-ego1": 0.01224493384361267, "agent_compute-ego2": 0.012298268079757693, "agent_compute-ego3": 0.011334872245788576, "complete-iteration": 0.668923540910085, "set_robot_commands": 0.00232234001159668, "deviation-center-line": 0.23307611918600285, "driven_lanedir_consec": 0.7960762545928977, "sim_compute_sim_state": 0.0206808606783549, "sim_compute_performance-ego0": 0.0021132429440816245, "sim_compute_performance-ego1": 0.0020134886105855304, "sim_compute_performance-ego2": 0.002041117350260417, "sim_compute_performance-ego3": 0.002002974351247152}, "LFV_multi-norm-loop-000-ego1": {"driven_any": 1.7771107787938447, "get_ui_image": 0.043732984860738115, "step_physics": 0.4982247511545817, "survival_time": 5.949999999999987, "driven_lanedir": 0.4079052940890945, "get_state_dump": 0.010197027524312336, "get_robot_state": 0.015063059329986571, "sim_render-ego0": 0.00391157865524292, "sim_render-ego1": 0.003863149881362915, "sim_render-ego2": 0.003926672538121541, "sim_render-ego3": 0.0038640618324279783, "get_duckie_state": 1.9292036692301433e-06, "in-drivable-lane": 4.64999999999999, "deviation-heading": 0.5815629454748248, "agent_compute-ego0": 0.011958346764246622, "agent_compute-ego1": 0.01224493384361267, "agent_compute-ego2": 0.012298268079757693, "agent_compute-ego3": 0.011334872245788576, "complete-iteration": 0.668923540910085, "set_robot_commands": 0.00232234001159668, "deviation-center-line": 0.15345155549638095, "driven_lanedir_consec": 0.4079052940890945, "sim_compute_sim_state": 0.0206808606783549, "sim_compute_performance-ego0": 0.0021132429440816245, "sim_compute_performance-ego1": 0.0020134886105855304, "sim_compute_performance-ego2": 0.002041117350260417, "sim_compute_performance-ego3": 0.002002974351247152}, "LFV_multi-norm-loop-000-ego2": {"driven_any": 1.615892599054939, "get_ui_image": 0.043732984860738115, "step_physics": 0.4982247511545817, "survival_time": 5.949999999999987, "driven_lanedir": 0.3409414151275487, "get_state_dump": 0.010197027524312336, "get_robot_state": 0.015063059329986571, "sim_render-ego0": 0.00391157865524292, "sim_render-ego1": 0.003863149881362915, "sim_render-ego2": 0.003926672538121541, "sim_render-ego3": 0.0038640618324279783, "get_duckie_state": 1.9292036692301433e-06, "in-drivable-lane": 4.599999999999988, "deviation-heading": 0.9488394776418512, "agent_compute-ego0": 0.011958346764246622, "agent_compute-ego1": 0.01224493384361267, "agent_compute-ego2": 0.012298268079757693, "agent_compute-ego3": 0.011334872245788576, "complete-iteration": 0.668923540910085, "set_robot_commands": 0.00232234001159668, "deviation-center-line": 0.09422141413744677, "driven_lanedir_consec": 0.3409414151275487, "sim_compute_sim_state": 0.0206808606783549, "sim_compute_performance-ego0": 0.0021132429440816245, "sim_compute_performance-ego1": 0.0020134886105855304, "sim_compute_performance-ego2": 0.002041117350260417, "sim_compute_performance-ego3": 0.002002974351247152}, "LFV_multi-norm-loop-000-ego3": {"driven_any": 1.6398074009825068, "get_ui_image": 0.043732984860738115, "step_physics": 0.4982247511545817, "survival_time": 5.949999999999987, "driven_lanedir": 0.21369386022737347, "get_state_dump": 0.010197027524312336, "get_robot_state": 0.015063059329986571, "sim_render-ego0": 0.00391157865524292, "sim_render-ego1": 0.003863149881362915, "sim_render-ego2": 0.003926672538121541, "sim_render-ego3": 0.0038640618324279783, "get_duckie_state": 1.9292036692301433e-06, "in-drivable-lane": 5.099999999999986, "deviation-heading": 0.36485645822221113, "agent_compute-ego0": 0.011958346764246622, "agent_compute-ego1": 0.01224493384361267, "agent_compute-ego2": 0.012298268079757693, "agent_compute-ego3": 0.011334872245788576, "complete-iteration": 0.668923540910085, "set_robot_commands": 0.00232234001159668, "deviation-center-line": 0.06914054888435704, "driven_lanedir_consec": 0.21369386022737347, "sim_compute_sim_state": 0.0206808606783549, "sim_compute_performance-ego0": 0.0021132429440816245, "sim_compute_performance-ego1": 0.0020134886105855304, "sim_compute_performance-ego2": 0.002041117350260417, "sim_compute_performance-ego3": 0.002002974351247152}, "LFV_multi-norm-zigzag-000-ego0": {"driven_any": 1.5559095507228855, "get_ui_image": 0.05021039370832772, "step_physics": 0.5841637808701088, "survival_time": 7.199999999999982, "driven_lanedir": 0.16582071872096904, "get_state_dump": 0.00987782642759126, "get_robot_state": 0.014546950110073746, "sim_render-ego0": 0.003738215873981344, "sim_render-ego1": 0.0038026004002012057, "sim_render-ego2": 0.003873900709481075, "sim_render-ego3": 0.00363966021044501, "get_duckie_state": 1.5653412917564657e-06, "in-drivable-lane": 6.449999999999982, "deviation-heading": 0.3586823355775982, "agent_compute-ego0": 0.011503056822151973, "agent_compute-ego1": 0.01187737563560749, "agent_compute-ego2": 0.012247598582300649, "agent_compute-ego3": 0.011841382651493468, "complete-iteration": 0.7707364378304317, "set_robot_commands": 0.002177634732476596, "deviation-center-line": 0.059631431224197985, "driven_lanedir_consec": 0.16582071872096904, "sim_compute_sim_state": 0.03250050380312163, "sim_compute_performance-ego0": 0.0020950202284188107, "sim_compute_performance-ego1": 0.0019841407907420193, "sim_compute_performance-ego2": 0.001917289865428004, "sim_compute_performance-ego3": 0.0018621970867288523}, "LFV_multi-norm-zigzag-000-ego1": {"driven_any": 1.8734985354242055, "get_ui_image": 0.05021039370832772, "step_physics": 0.5841637808701088, "survival_time": 7.199999999999982, "driven_lanedir": 0.19265203980442447, "get_state_dump": 0.00987782642759126, "get_robot_state": 0.014546950110073746, "sim_render-ego0": 0.003738215873981344, "sim_render-ego1": 0.0038026004002012057, "sim_render-ego2": 0.003873900709481075, "sim_render-ego3": 0.00363966021044501, "get_duckie_state": 1.5653412917564657e-06, "in-drivable-lane": 5.949999999999984, "deviation-heading": 1.2444813548952531, "agent_compute-ego0": 0.011503056822151973, "agent_compute-ego1": 0.01187737563560749, "agent_compute-ego2": 0.012247598582300649, "agent_compute-ego3": 0.011841382651493468, "complete-iteration": 0.7707364378304317, "set_robot_commands": 0.002177634732476596, "deviation-center-line": 0.09612169677476312, "driven_lanedir_consec": 0.19265203980442447, "sim_compute_sim_state": 0.03250050380312163, "sim_compute_performance-ego0": 0.0020950202284188107, "sim_compute_performance-ego1": 0.0019841407907420193, "sim_compute_performance-ego2": 0.001917289865428004, "sim_compute_performance-ego3": 0.0018621970867288523}, "LFV_multi-norm-zigzag-000-ego2": {"driven_any": 2.3178974013322633, "get_ui_image": 0.05021039370832772, "step_physics": 0.5841637808701088, "survival_time": 7.199999999999982, "driven_lanedir": 0.10162466951715476, "get_state_dump": 0.00987782642759126, "get_robot_state": 0.014546950110073746, "sim_render-ego0": 0.003738215873981344, "sim_render-ego1": 0.0038026004002012057, "sim_render-ego2": 0.003873900709481075, "sim_render-ego3": 0.00363966021044501, "get_duckie_state": 1.5653412917564657e-06, "in-drivable-lane": 6.499999999999982, "deviation-heading": 0.5541987636288823, "agent_compute-ego0": 0.011503056822151973, "agent_compute-ego1": 0.01187737563560749, "agent_compute-ego2": 0.012247598582300649, "agent_compute-ego3": 0.011841382651493468, "complete-iteration": 0.7707364378304317, "set_robot_commands": 0.002177634732476596, "deviation-center-line": 0.03781627258124975, "driven_lanedir_consec": 0.10162466951715476, "sim_compute_sim_state": 0.03250050380312163, "sim_compute_performance-ego0": 0.0020950202284188107, "sim_compute_performance-ego1": 0.0019841407907420193, "sim_compute_performance-ego2": 0.001917289865428004, "sim_compute_performance-ego3": 0.0018621970867288523}, "LFV_multi-norm-zigzag-000-ego3": {"driven_any": 2.7765427252108315, "get_ui_image": 0.05021039370832772, "step_physics": 0.5841637808701088, "survival_time": 7.199999999999982, "driven_lanedir": 0.6452515830462522, "get_state_dump": 0.00987782642759126, "get_robot_state": 0.014546950110073746, "sim_render-ego0": 0.003738215873981344, "sim_render-ego1": 0.0038026004002012057, "sim_render-ego2": 0.003873900709481075, "sim_render-ego3": 0.00363966021044501, "get_duckie_state": 1.5653412917564657e-06, "in-drivable-lane": 5.249999999999986, "deviation-heading": 0.9734465477255804, "agent_compute-ego0": 0.011503056822151973, "agent_compute-ego1": 0.01187737563560749, "agent_compute-ego2": 0.012247598582300649, "agent_compute-ego3": 0.011841382651493468, "complete-iteration": 0.7707364378304317, "set_robot_commands": 0.002177634732476596, "deviation-center-line": 0.1436614022182105, "driven_lanedir_consec": 0.6452515830462522, "sim_compute_sim_state": 0.03250050380312163, "sim_compute_performance-ego0": 0.0020950202284188107, "sim_compute_performance-ego1": 0.0019841407907420193, "sim_compute_performance-ego2": 0.001917289865428004, "sim_compute_performance-ego3": 0.0018621970867288523}, "LFV_multi-norm-techtrack-000-ego0": {"driven_any": 0.18489783262536005, "get_ui_image": 0.047048297582888136, "step_physics": 0.6597525512470919, "survival_time": 7.599999999999981, "driven_lanedir": 0.16126759294861004, "get_state_dump": 0.009854206072738746, "get_robot_state": 0.015055293351217034, "sim_render-ego0": 0.003874577727972293, "sim_render-ego1": 0.0037902648152868734, "sim_render-ego2": 0.0036883432101580058, "sim_render-ego3": 0.0038058150048349416, "get_duckie_state": 1.623739604077308e-06, "in-drivable-lane": 0.0, "deviation-heading": 4.13206271019058, "agent_compute-ego0": 0.01253618757709179, "agent_compute-ego1": 0.012363181394689223, "agent_compute-ego2": 0.011473635442895829, "agent_compute-ego3": 0.011954036413454544, "complete-iteration": 0.8383344014485677, "set_robot_commands": 0.0022696233263202743, "deviation-center-line": 1.1793353551209578, "driven_lanedir_consec": 0.16126759294861004, "sim_compute_sim_state": 0.025366125543133108, "sim_compute_performance-ego0": 0.0021828670127719057, "sim_compute_performance-ego1": 0.0020261340671115452, "sim_compute_performance-ego2": 0.002002039765999987, "sim_compute_performance-ego3": 0.0020467970106336805}, "LFV_multi-norm-techtrack-000-ego1": {"driven_any": 2.7205864887254294, "get_ui_image": 0.047048297582888136, "step_physics": 0.6597525512470919, "survival_time": 7.599999999999981, "driven_lanedir": 0.34433052196676683, "get_state_dump": 0.009854206072738746, "get_robot_state": 0.015055293351217034, "sim_render-ego0": 0.003874577727972293, "sim_render-ego1": 0.0037902648152868734, "sim_render-ego2": 0.0036883432101580058, "sim_render-ego3": 0.0038058150048349416, "get_duckie_state": 1.623739604077308e-06, "in-drivable-lane": 6.049999999999983, "deviation-heading": 1.1722790788608328, "agent_compute-ego0": 0.01253618757709179, "agent_compute-ego1": 0.012363181394689223, "agent_compute-ego2": 0.011473635442895829, "agent_compute-ego3": 0.011954036413454544, "complete-iteration": 0.8383344014485677, "set_robot_commands": 0.0022696233263202743, "deviation-center-line": 0.1193416144722584, "driven_lanedir_consec": 0.34433052196676683, "sim_compute_sim_state": 0.025366125543133108, "sim_compute_performance-ego0": 0.0021828670127719057, "sim_compute_performance-ego1": 0.0020261340671115452, "sim_compute_performance-ego2": 0.002002039765999987, "sim_compute_performance-ego3": 0.0020467970106336805}, "LFV_multi-norm-techtrack-000-ego2": {"driven_any": 1.7436348108846431, "get_ui_image": 0.047048297582888136, "step_physics": 0.6597525512470919, "survival_time": 7.599999999999981, "driven_lanedir": 0.3484125379459806, "get_state_dump": 0.009854206072738746, "get_robot_state": 0.015055293351217034, "sim_render-ego0": 0.003874577727972293, "sim_render-ego1": 0.0037902648152868734, "sim_render-ego2": 0.0036883432101580058, "sim_render-ego3": 0.0038058150048349416, "get_duckie_state": 1.623739604077308e-06, "in-drivable-lane": 6.049999999999981, "deviation-heading": 0.9782946667514604, "agent_compute-ego0": 0.01253618757709179, "agent_compute-ego1": 0.012363181394689223, "agent_compute-ego2": 0.011473635442895829, "agent_compute-ego3": 0.011954036413454544, "complete-iteration": 0.8383344014485677, "set_robot_commands": 0.0022696233263202743, "deviation-center-line": 0.14721758995799067, "driven_lanedir_consec": 0.3484125379459806, "sim_compute_sim_state": 0.025366125543133108, "sim_compute_performance-ego0": 0.0021828670127719057, "sim_compute_performance-ego1": 0.0020261340671115452, "sim_compute_performance-ego2": 0.002002039765999987, "sim_compute_performance-ego3": 0.0020467970106336805}, "LFV_multi-norm-techtrack-000-ego3": {"driven_any": 2.951704478527868, "get_ui_image": 0.047048297582888136, "step_physics": 0.6597525512470919, "survival_time": 7.599999999999981, "driven_lanedir": 0.2576470504888566, "get_state_dump": 0.009854206072738746, "get_robot_state": 0.015055293351217034, "sim_render-ego0": 0.003874577727972293, "sim_render-ego1": 0.0037902648152868734, "sim_render-ego2": 0.0036883432101580058, "sim_render-ego3": 0.0038058150048349416, "get_duckie_state": 1.623739604077308e-06, "in-drivable-lane": 6.599999999999981, "deviation-heading": 0.3481560818464254, "agent_compute-ego0": 0.01253618757709179, "agent_compute-ego1": 0.012363181394689223, "agent_compute-ego2": 0.011473635442895829, "agent_compute-ego3": 0.011954036413454544, "complete-iteration": 0.8383344014485677, "set_robot_commands": 0.0022696233263202743, "deviation-center-line": 0.086677958791832, "driven_lanedir_consec": 0.2576470504888566, "sim_compute_sim_state": 0.025366125543133108, "sim_compute_performance-ego0": 0.0021828670127719057, "sim_compute_performance-ego1": 0.0020261340671115452, "sim_compute_performance-ego2": 0.002002039765999987, "sim_compute_performance-ego3": 0.0020467970106336805}, "LFV_multi-norm-small_loop-000-ego0": {"driven_any": 1.678414408768526, "get_ui_image": 0.030608157918910788, "step_physics": 0.16918156604574183, "survival_time": 4.899999999999991, "driven_lanedir": 0.6140974314754637, "get_state_dump": 0.006386622033938013, "get_robot_state": 0.007343114024460918, "sim_render-ego0": 0.00380392267246439, "sim_render-ego1": 0.003662403183754045, "get_duckie_state": 1.4666355017459751e-06, "in-drivable-lane": 3.1499999999999897, "deviation-heading": 0.291348286294811, "agent_compute-ego0": 0.011398293755271216, "agent_compute-ego1": 0.011496009248675722, "complete-iteration": 0.2615521243124297, "set_robot_commands": 0.002248265526511452, "deviation-center-line": 0.16192487225063373, "driven_lanedir_consec": 0.6140974314754637, "sim_compute_sim_state": 0.009067663038619842, "sim_compute_performance-ego0": 0.0020378816007363674, "sim_compute_performance-ego1": 0.0019327992140644728}, "LFV_multi-norm-small_loop-000-ego1": {"driven_any": 1.6784144087685244, "get_ui_image": 0.030608157918910788, "step_physics": 0.16918156604574183, "survival_time": 4.899999999999991, "driven_lanedir": 0.34058990692239166, "get_state_dump": 0.006386622033938013, "get_robot_state": 0.007343114024460918, "sim_render-ego0": 0.00380392267246439, "sim_render-ego1": 0.003662403183754045, "get_duckie_state": 1.4666355017459751e-06, "in-drivable-lane": 2.8999999999999924, "deviation-heading": 1.768661547134351, "agent_compute-ego0": 0.011398293755271216, "agent_compute-ego1": 0.011496009248675722, "complete-iteration": 0.2615521243124297, "set_robot_commands": 0.002248265526511452, "deviation-center-line": 0.17396510017726105, "driven_lanedir_consec": 0.33629117608568304, "sim_compute_sim_state": 0.009067663038619842, "sim_compute_performance-ego0": 0.0020378816007363674, "sim_compute_performance-ego1": 0.0019327992140644728}}
set_robot_commands_max0.00232234001159668
set_robot_commands_mean0.0022553516667569366
set_robot_commands_median0.0022696233263202743
set_robot_commands_min0.002177634732476596
sim_compute_performance-ego0_max0.0021828670127719057
sim_compute_performance-ego0_mean0.0021171631387544355
sim_compute_performance-ego0_median0.0021132429440816245
sim_compute_performance-ego0_min0.0020378816007363674
sim_compute_performance-ego1_max0.0020261340671115452
sim_compute_performance-ego1_mean0.0019971894501346664
sim_compute_performance-ego1_median0.0020134886105855304
sim_compute_performance-ego1_min0.0019327992140644728
sim_compute_sim_state_max0.03250050380312163
sim_compute_sim_state_mean0.02373752044111987
sim_compute_sim_state_median0.025366125543133108
sim_compute_sim_state_min0.009067663038619842
sim_render-ego0_max0.00391157865524292
sim_render-ego0_mean0.003836095312408215
sim_render-ego0_median0.003874577727972293
sim_render-ego0_min0.003738215873981344
sim_render-ego1_max0.003863149881362915
sim_render-ego1_mean0.003796347625350862
sim_render-ego1_median0.0038026004002012057
sim_render-ego1_min0.003662403183754045
simulation-passed1
step_physics_max0.6597525512470919
step_physics_mean0.5219233903699009
step_physics_median0.5841637808701088
step_physics_min0.16918156604574183
survival_time_max7.599999999999981
survival_time_mean6.628571428571413
survival_time_min4.899999999999991
No reset possible
5353512602Bea Baselines 🐤template-randomaido5-LFI-full-sim-validationLFVIv-simsuccessyesnogpu-prod-020:02:46
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6587966891077274
survival_time_median4.82499999999999
deviation-center-line_median0.18372681341530445
in-drivable-lane_median2.6749999999999927


other stats
agent_compute-ego0_max0.011664219576903063
agent_compute-ego0_mean0.011275580961896917
agent_compute-ego0_median0.011275580961896917
agent_compute-ego0_min0.010886942346890768
complete-iteration_max0.21579824884732565
complete-iteration_mean0.21239946752485603
complete-iteration_median0.21239946752485603
complete-iteration_min0.2090006862023864
deviation-center-line_max0.22270545771576217
deviation-center-line_mean0.18372681341530445
deviation-center-line_min0.14474816911484673
deviation-heading_max0.9254423888501632
deviation-heading_mean0.9131948861321344
deviation-heading_median0.9131948861321344
deviation-heading_min0.9009473834141052
driven_any_max1.7167609354270057
driven_any_mean1.6960945672591825
driven_any_median1.6960945672591825
driven_any_min1.6754281990913595
driven_lanedir_consec_max0.8731138199226813
driven_lanedir_consec_mean0.6587966891077274
driven_lanedir_consec_min0.4444795582927734
driven_lanedir_max0.8919331054681621
driven_lanedir_mean0.6682063318804677
driven_lanedir_median0.6682063318804677
driven_lanedir_min0.4444795582927734
get_duckie_state_max1.3438138094815342e-06
get_duckie_state_mean1.3126568360762163e-06
get_duckie_state_median1.3126568360762163e-06
get_duckie_state_min1.2814998626708984e-06
get_robot_state_max0.003917028506596883
get_robot_state_mean0.0038817502332456183
get_robot_state_median0.0038817502332456183
get_robot_state_min0.003846471959894354
get_state_dump_max0.004939923683802287
get_state_dump_mean0.004834889914050247
get_state_dump_median0.004834889914050247
get_state_dump_min0.004729856144298206
get_ui_image_max0.039184197783470154
get_ui_image_mean0.037802334159913686
get_ui_image_median0.037802334159913686
get_ui_image_min0.036420470536357226
in-drivable-lane_max3.249999999999993
in-drivable-lane_mean2.6749999999999927
in-drivable-lane_min2.0999999999999925
per-episodes
details{"LFI-full-4way-000-ego0": {"driven_any": 1.6754281990913595, "get_ui_image": 0.039184197783470154, "step_physics": 0.13679185509681702, "survival_time": 4.749999999999991, "driven_lanedir": 0.8919331054681621, "get_state_dump": 0.004939923683802287, "get_robot_state": 0.003917028506596883, "sim_render-ego0": 0.003984682261943817, "get_duckie_state": 1.2814998626708984e-06, "in-drivable-lane": 2.0999999999999925, "deviation-heading": 0.9009473834141052, "agent_compute-ego0": 0.010886942346890768, "complete-iteration": 0.21579824884732565, "set_robot_commands": 0.002271364132563273, "deviation-center-line": 0.22270545771576217, "driven_lanedir_consec": 0.8731138199226813, "sim_compute_sim_state": 0.011543214321136476, "sim_compute_performance-ego0": 0.0021849473317464194}, "LFI-full-udem1-000-ego0": {"driven_any": 1.7167609354270057, "get_ui_image": 0.036420470536357226, "step_physics": 0.13431811814356331, "survival_time": 4.899999999999991, "driven_lanedir": 0.4444795582927734, "get_state_dump": 0.004729856144298206, "get_robot_state": 0.003846471959894354, "sim_render-ego0": 0.003798961639404297, "get_duckie_state": 1.3438138094815342e-06, "in-drivable-lane": 3.249999999999993, "deviation-heading": 0.9254423888501632, "agent_compute-ego0": 0.011664219576903063, "complete-iteration": 0.2090006862023864, "set_robot_commands": 0.002232132535992246, "deviation-center-line": 0.14474816911484673, "driven_lanedir_consec": 0.4444795582927734, "sim_compute_sim_state": 0.009882019023702605, "sim_compute_performance-ego0": 0.002019995390766799}}
set_robot_commands_max0.002271364132563273
set_robot_commands_mean0.0022517483342777596
set_robot_commands_median0.0022517483342777596
set_robot_commands_min0.002232132535992246
sim_compute_performance-ego0_max0.0021849473317464194
sim_compute_performance-ego0_mean0.002102471361256609
sim_compute_performance-ego0_median0.002102471361256609
sim_compute_performance-ego0_min0.002019995390766799
sim_compute_sim_state_max0.011543214321136476
sim_compute_sim_state_mean0.010712616672419538
sim_compute_sim_state_median0.010712616672419538
sim_compute_sim_state_min0.009882019023702605
sim_render-ego0_max0.003984682261943817
sim_render-ego0_mean0.003891821950674057
sim_render-ego0_median0.003891821950674057
sim_render-ego0_min0.003798961639404297
simulation-passed1
step_physics_max0.13679185509681702
step_physics_mean0.13555498662019017
step_physics_median0.13555498662019017
step_physics_min0.13431811814356331
survival_time_max4.899999999999991
survival_time_mean4.82499999999999
survival_time_min4.749999999999991
No reset possible
5352212606Bea Baselines 🐤template-randomaido5-LFVI-sim-testingLFVIt-simsuccessyesnogpu-prod-020:05:22
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.8346371424253776
survival_time_median4.124999999999993
deviation-center-line_median0.2788935993045573
in-drivable-lane_median1.549999999999997


other stats
agent_compute-ego0_max0.013118458830791971
agent_compute-ego0_mean0.013029951030643475
agent_compute-ego0_median0.013029951030643475
agent_compute-ego0_min0.01294144323049498
agent_compute-npc0_max0.05190133530160655
agent_compute-npc0_mean0.04867053363891201
agent_compute-npc0_median0.04867053363891201
agent_compute-npc0_min0.04543973197621747
agent_compute-npc1_max0.05185891234356424
agent_compute-npc1_mean0.04305955423882142
agent_compute-npc1_median0.04305955423882142
agent_compute-npc1_min0.0342601961340786
agent_compute-npc2_max0.05085071791773257
agent_compute-npc2_mean0.04205262928697817
agent_compute-npc2_median0.04205262928697817
agent_compute-npc2_min0.03325454065622377
complete-iteration_max0.9981989289118238
complete-iteration_mean0.9571529729864044
complete-iteration_median0.9571529729864044
complete-iteration_min0.9161070170609849
deviation-center-line_max0.5131197357490916
deviation-center-line_mean0.2788935993045573
deviation-center-line_min0.044667462860022975
deviation-heading_max0.7729298921344514
deviation-heading_mean0.6302487746425269
deviation-heading_median0.6302487746425269
deviation-heading_min0.4875676571506023
driven_any_max2.2544111376152616
driven_any_mean1.3911351901097644
driven_any_median1.3911351901097644
driven_any_min0.5278592426042671
driven_lanedir_consec_max1.4955475701369614
driven_lanedir_consec_mean0.8346371424253776
driven_lanedir_consec_min0.17372671471379375
driven_lanedir_max1.7595402874633888
driven_lanedir_mean0.9666335010885913
driven_lanedir_median0.9666335010885913
driven_lanedir_min0.17372671471379375
get_duckie_state_max3.339830508902053e-06
get_duckie_state_mean3.2325935500840937e-06
get_duckie_state_median3.2325935500840937e-06
get_duckie_state_min3.1253565912661343e-06
get_robot_state_max0.01589663650678552
get_robot_state_mean0.015313947946100925
get_robot_state_median0.015313947946100925
get_robot_state_min0.01473125938541633
get_state_dump_max0.010677104410917862
get_state_dump_mean0.010354439710225724
get_state_dump_median0.010354439710225724
get_state_dump_min0.01003177500953359
get_ui_image_max0.0550158969626939
get_ui_image_mean0.05432841893883862
get_ui_image_median0.05432841893883862
get_ui_image_min0.05364094091498334
in-drivable-lane_max1.699999999999994
in-drivable-lane_mean1.549999999999997
in-drivable-lane_min1.4
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 2.2544111376152616, "get_ui_image": 0.0550158969626939, "step_physics": 0.7162503545934503, "survival_time": 5.999999999999987, "driven_lanedir": 1.7595402874633888, "get_state_dump": 0.01003177500953359, "get_robot_state": 0.01473125938541633, "sim_render-ego0": 0.003913363149343443, "sim_render-npc0": 0.003815550449465917, "sim_render-npc1": 0.004061281188460421, "sim_render-npc2": 0.00405662315936128, "get_duckie_state": 3.339830508902053e-06, "in-drivable-lane": 1.699999999999994, "deviation-heading": 0.7729298921344514, "agent_compute-ego0": 0.01294144323049498, "agent_compute-npc0": 0.04543973197621747, "agent_compute-npc1": 0.0342601961340786, "agent_compute-npc2": 0.03325454065622377, "complete-iteration": 0.9981989289118238, "set_robot_commands": 0.002422783985610836, "deviation-center-line": 0.5131197357490916, "driven_lanedir_consec": 1.4955475701369614, "sim_compute_sim_state": 0.04224631214930006, "sim_compute_performance-ego0": 0.002181321136222398, "sim_compute_performance-npc0": 0.0020131690443054703, "sim_compute_performance-npc1": 0.0021474164379529717, "sim_compute_performance-npc2": 0.0021039612037091217}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.5278592426042671, "get_ui_image": 0.05364094091498334, "step_physics": 0.5866350557493127, "survival_time": 2.25, "driven_lanedir": 0.17372671471379375, "get_state_dump": 0.010677104410917862, "get_robot_state": 0.01589663650678552, "sim_render-ego0": 0.0040942585986593494, "sim_render-npc0": 0.00401790245719578, "sim_render-npc1": 0.0040762009827987, "sim_render-npc2": 0.004192331562871518, "get_duckie_state": 3.1253565912661343e-06, "in-drivable-lane": 1.4, "deviation-heading": 0.4875676571506023, "agent_compute-ego0": 0.013118458830791971, "agent_compute-npc0": 0.05190133530160655, "agent_compute-npc1": 0.05185891234356424, "agent_compute-npc2": 0.05085071791773257, "complete-iteration": 0.9161070170609849, "set_robot_commands": 0.002597114314203677, "deviation-center-line": 0.044667462860022975, "driven_lanedir_consec": 0.17372671471379375, "sim_compute_sim_state": 0.04587233584860097, "sim_compute_performance-ego0": 0.0023122248442276664, "sim_compute_performance-npc0": 0.002149162085159965, "sim_compute_performance-npc1": 0.0022093368613201637, "sim_compute_performance-npc2": 0.0022174638250599737}}
set_robot_commands_max0.002597114314203677
set_robot_commands_mean0.0025099491499072568
set_robot_commands_median0.0025099491499072568
set_robot_commands_min0.002422783985610836
sim_compute_performance-ego0_max0.0023122248442276664
sim_compute_performance-ego0_mean0.0022467729902250324
sim_compute_performance-ego0_median0.0022467729902250324
sim_compute_performance-ego0_min0.002181321136222398
sim_compute_performance-npc0_max0.002149162085159965
sim_compute_performance-npc0_mean0.0020811655647327175
sim_compute_performance-npc0_median0.0020811655647327175
sim_compute_performance-npc0_min0.0020131690443054703
sim_compute_performance-npc1_max0.0022093368613201637
sim_compute_performance-npc1_mean0.0021783766496365677
sim_compute_performance-npc1_median0.0021783766496365677
sim_compute_performance-npc1_min0.0021474164379529717
sim_compute_performance-npc2_max0.0022174638250599737
sim_compute_performance-npc2_mean0.0021607125143845475
sim_compute_performance-npc2_median0.0021607125143845475
sim_compute_performance-npc2_min0.0021039612037091217
sim_compute_sim_state_max0.04587233584860097
sim_compute_sim_state_mean0.04405932399895052
sim_compute_sim_state_median0.04405932399895052
sim_compute_sim_state_min0.04224631214930006
sim_render-ego0_max0.0040942585986593494
sim_render-ego0_mean0.0040038108740013964
sim_render-ego0_median0.0040038108740013964
sim_render-ego0_min0.003913363149343443
sim_render-npc0_max0.00401790245719578
sim_render-npc0_mean0.003916726453330848
sim_render-npc0_median0.003916726453330848
sim_render-npc0_min0.003815550449465917
sim_render-npc1_max0.0040762009827987
sim_render-npc1_mean0.004068741085629561
sim_render-npc1_median0.004068741085629561
sim_render-npc1_min0.004061281188460421
sim_render-npc2_max0.004192331562871518
sim_render-npc2_mean0.004124477361116399
sim_render-npc2_median0.004124477361116399
sim_render-npc2_min0.00405662315936128
simulation-passed1
step_physics_max0.7162503545934503
step_physics_mean0.6514427051713816
step_physics_median0.6514427051713816
step_physics_min0.5866350557493127
survival_time_max5.999999999999987
survival_time_mean4.124999999999993
survival_time_min2.25
No reset possible
5349812675Bea Baselines 🐤baseline-duckietownaido5-LFI-sim-validationLFVIv-simsuccessyesnogpu-prod-020:18:20
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median4.945513417151832
survival_time_median50.99999999999924
deviation-center-line_median3.442167004166766
in-drivable-lane_median4.174999999999866


other stats
agent_compute-ego0_max0.012835027488318409
agent_compute-ego0_mean0.012655698842983558
agent_compute-ego0_median0.012655698842983558
agent_compute-ego0_min0.012476370197648709
complete-iteration_max0.23810864402054324
complete-iteration_mean0.22466024755915223
complete-iteration_median0.22466024755915223
complete-iteration_min0.21121185109776125
deviation-center-line_max4.384056969683807
deviation-center-line_mean3.442167004166766
deviation-center-line_min2.5002770386497253
deviation-heading_max8.610637593894596
deviation-heading_mean8.404827106217558
deviation-heading_median8.404827106217558
deviation-heading_min8.19901661854052
driven_any_max7.914552765508335
driven_any_mean6.676369288447862
driven_any_median6.676369288447862
driven_any_min5.43818581138739
driven_lanedir_consec_max6.949095575152236
driven_lanedir_consec_mean4.945513417151832
driven_lanedir_consec_min2.941931259151429
driven_lanedir_max7.435826689805149
driven_lanedir_mean5.918000415200948
driven_lanedir_median5.918000415200948
driven_lanedir_min4.4001741405967465
get_duckie_state_max1.4095329076016274e-06
get_duckie_state_mean1.4018579113488043e-06
get_duckie_state_median1.4018579113488043e-06
get_duckie_state_min1.3941829150959812e-06
get_robot_state_max0.004097582468946822
get_robot_state_mean0.0040409758877436655
get_robot_state_median0.0040409758877436655
get_robot_state_min0.003984369306540509
get_state_dump_max0.0050794179601136346
get_state_dump_mean0.005027400494852583
get_state_dump_median0.005027400494852583
get_state_dump_min0.004975383029591531
get_ui_image_max0.040662319850127845
get_ui_image_mean0.03966753291118963
get_ui_image_median0.03966753291118963
get_ui_image_min0.03867274597225141
in-drivable-lane_max6.399999999999764
in-drivable-lane_mean4.174999999999866
in-drivable-lane_min1.949999999999967
per-episodes
details{"LFI-norm-4way-000-ego0": {"driven_any": 5.43818581138739, "get_ui_image": 0.040662319850127845, "step_physics": 0.15284981625542204, "survival_time": 41.99999999999975, "driven_lanedir": 4.4001741405967465, "get_state_dump": 0.0050794179601136346, "get_robot_state": 0.004097582468946822, "sim_render-ego0": 0.0041286664683810315, "get_duckie_state": 1.4095329076016274e-06, "in-drivable-lane": 6.399999999999764, "deviation-heading": 8.19901661854052, "agent_compute-ego0": 0.012835027488318409, "complete-iteration": 0.23810864402054324, "set_robot_commands": 0.002524297671142288, "deviation-center-line": 2.5002770386497253, "driven_lanedir_consec": 2.941931259151429, "sim_compute_sim_state": 0.013540639321670805, "sim_compute_performance-ego0": 0.002297163576631852}, "LFI-norm-udem1-000-ego0": {"driven_any": 7.914552765508335, "get_ui_image": 0.03867274597225141, "step_physics": 0.12809813806754564, "survival_time": 59.99999999999873, "driven_lanedir": 7.435826689805149, "get_state_dump": 0.004975383029591531, "get_robot_state": 0.003984369306540509, "sim_render-ego0": 0.004057968188880583, "get_duckie_state": 1.3941829150959812e-06, "in-drivable-lane": 1.949999999999967, "deviation-heading": 8.610637593894596, "agent_compute-ego0": 0.012476370197648709, "complete-iteration": 0.21121185109776125, "set_robot_commands": 0.00240607146518018, "deviation-center-line": 4.384056969683807, "driven_lanedir_consec": 6.949095575152236, "sim_compute_sim_state": 0.014212459846896792, "sim_compute_performance-ego0": 0.0022351352698002924}}
set_robot_commands_max0.002524297671142288
set_robot_commands_mean0.002465184568161234
set_robot_commands_median0.002465184568161234
set_robot_commands_min0.00240607146518018
sim_compute_performance-ego0_max0.002297163576631852
sim_compute_performance-ego0_mean0.0022661494232160723
sim_compute_performance-ego0_median0.0022661494232160723
sim_compute_performance-ego0_min0.0022351352698002924
sim_compute_sim_state_max0.014212459846896792
sim_compute_sim_state_mean0.0138765495842838
sim_compute_sim_state_median0.0138765495842838
sim_compute_sim_state_min0.013540639321670805
sim_render-ego0_max0.0041286664683810315
sim_render-ego0_mean0.004093317328630807
sim_render-ego0_median0.004093317328630807
sim_render-ego0_min0.004057968188880583
simulation-passed1
step_physics_max0.15284981625542204
step_physics_mean0.14047397716148383
step_physics_median0.14047397716148383
step_physics_min0.12809813806754564
survival_time_max59.99999999999873
survival_time_mean50.99999999999924
survival_time_min41.99999999999975
No reset possible
5348412680Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-020:13:18
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6593106334360599
survival_time_median10.900000000000022
deviation-center-line_median0.7121091171753744
in-drivable-lane_median1.0749999999999962


other stats
agent_compute-ego0_max0.013723136513096512
agent_compute-ego0_mean0.0135144906492882
agent_compute-ego0_median0.0135144906492882
agent_compute-ego0_min0.013305844785479888
agent_compute-npc0_max0.046447823480354936
agent_compute-npc0_mean0.04295898229069514
agent_compute-npc0_median0.04295898229069514
agent_compute-npc0_min0.03947014110103534
agent_compute-npc1_max0.04668230688020428
agent_compute-npc1_mean0.043263132767212865
agent_compute-npc1_median0.043263132767212865
agent_compute-npc1_min0.039843958654221454
agent_compute-npc2_max0.0456288352979884
agent_compute-npc2_mean0.04274718503716186
agent_compute-npc2_median0.04274718503716186
agent_compute-npc2_min0.03986553477633531
complete-iteration_max1.4169816120414978
complete-iteration_mean1.2706771676526378
complete-iteration_median1.2706771676526378
complete-iteration_min1.124372723263778
deviation-center-line_max1.04887457681528
deviation-center-line_mean0.7121091171753744
deviation-center-line_min0.37534365753546867
deviation-heading_max4.320568078026268
deviation-heading_mean3.652176421862216
deviation-heading_median3.652176421862216
deviation-heading_min2.983784765698165
driven_any_max1.7205486458668946
driven_any_mean1.305620533451865
driven_any_median1.305620533451865
driven_any_min0.8906924210368352
driven_lanedir_consec_max0.794141022360749
driven_lanedir_consec_mean0.6593106334360599
driven_lanedir_consec_min0.5244802445113708
driven_lanedir_max1.494222987193877
driven_lanedir_mean1.009351615852624
driven_lanedir_median1.009351615852624
driven_lanedir_min0.5244802445113708
get_duckie_state_max2.9825101232832404e-06
get_duckie_state_mean2.925584627375397e-06
get_duckie_state_median2.925584627375397e-06
get_duckie_state_min2.8686591314675544e-06
get_robot_state_max0.01614938268236294
get_robot_state_mean0.015765098120134723
get_robot_state_median0.015765098120134723
get_robot_state_min0.015380813557906508
get_state_dump_max0.010863430181126683
get_state_dump_mean0.01058441445247988
get_state_dump_median0.01058441445247988
get_state_dump_min0.010305398723833075
get_ui_image_max0.05597776704835722
get_ui_image_mean0.055849430851110896
get_ui_image_median0.055849430851110896
get_ui_image_min0.05572109465386457
in-drivable-lane_max1.8999999999999932
in-drivable-lane_mean1.0749999999999962
in-drivable-lane_min0.2499999999999991
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 1.7205486458668946, "get_ui_image": 0.05597776704835722, "step_physics": 0.8088391743520825, "survival_time": 14.000000000000064, "driven_lanedir": 1.494222987193877, "get_state_dump": 0.010305398723833075, "get_robot_state": 0.015380813557906508, "sim_render-ego0": 0.0042067439530667885, "sim_render-npc0": 0.004269405616135784, "sim_render-npc1": 0.004132755286328733, "sim_render-npc2": 0.0041459955778834654, "get_duckie_state": 2.8686591314675544e-06, "in-drivable-lane": 0.2499999999999991, "deviation-heading": 4.320568078026268, "agent_compute-ego0": 0.013305844785479888, "agent_compute-npc0": 0.046447823480354936, "agent_compute-npc1": 0.04668230688020428, "agent_compute-npc2": 0.0456288352979884, "complete-iteration": 1.124372723263778, "set_robot_commands": 0.0024619110962674287, "deviation-center-line": 1.04887457681528, "driven_lanedir_consec": 0.794141022360749, "sim_compute_sim_state": 0.04577639348990552, "sim_compute_performance-ego0": 0.002381844028459325, "sim_compute_performance-npc0": 0.002226048941289827, "sim_compute_performance-npc1": 0.002205629789956524, "sim_compute_performance-npc2": 0.002233555308440402}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.8906924210368352, "get_ui_image": 0.05572109465386457, "step_physics": 1.12044704795643, "survival_time": 7.79999999999998, "driven_lanedir": 0.5244802445113708, "get_state_dump": 0.010863430181126683, "get_robot_state": 0.01614938268236294, "sim_render-ego0": 0.00429752526009918, "sim_render-npc0": 0.004511508212727346, "sim_render-npc1": 0.004314360345245167, "sim_render-npc2": 0.00406430177627855, "get_duckie_state": 2.9825101232832404e-06, "in-drivable-lane": 1.8999999999999932, "deviation-heading": 2.983784765698165, "agent_compute-ego0": 0.013723136513096512, "agent_compute-npc0": 0.03947014110103534, "agent_compute-npc1": 0.039843958654221454, "agent_compute-npc2": 0.03986553477633531, "complete-iteration": 1.4169816120414978, "set_robot_commands": 0.002474171340845193, "deviation-center-line": 0.37534365753546867, "driven_lanedir_consec": 0.5244802445113708, "sim_compute_sim_state": 0.04428691013603454, "sim_compute_performance-ego0": 0.002393663309182331, "sim_compute_performance-npc0": 0.002249104202173318, "sim_compute_performance-npc1": 0.0023004051986014007, "sim_compute_performance-npc2": 0.00220664747201713}}
set_robot_commands_max0.002474171340845193
set_robot_commands_mean0.002468041218556311
set_robot_commands_median0.002468041218556311
set_robot_commands_min0.0024619110962674287
sim_compute_performance-ego0_max0.002393663309182331
sim_compute_performance-ego0_mean0.002387753668820828
sim_compute_performance-ego0_median0.002387753668820828
sim_compute_performance-ego0_min0.002381844028459325
sim_compute_performance-npc0_max0.002249104202173318
sim_compute_performance-npc0_mean0.0022375765717315725
sim_compute_performance-npc0_median0.0022375765717315725
sim_compute_performance-npc0_min0.002226048941289827
sim_compute_performance-npc1_max0.0023004051986014007
sim_compute_performance-npc1_mean0.0022530174942789623
sim_compute_performance-npc1_median0.0022530174942789623
sim_compute_performance-npc1_min0.002205629789956524
sim_compute_performance-npc2_max0.002233555308440402
sim_compute_performance-npc2_mean0.0022201013902287663
sim_compute_performance-npc2_median0.0022201013902287663
sim_compute_performance-npc2_min0.00220664747201713
sim_compute_sim_state_max0.04577639348990552
sim_compute_sim_state_mean0.04503165181297003
sim_compute_sim_state_median0.04503165181297003
sim_compute_sim_state_min0.04428691013603454
sim_render-ego0_max0.00429752526009918
sim_render-ego0_mean0.004252134606582985
sim_render-ego0_median0.004252134606582985
sim_render-ego0_min0.0042067439530667885
sim_render-npc0_max0.004511508212727346
sim_render-npc0_mean0.004390456914431565
sim_render-npc0_median0.004390456914431565
sim_render-npc0_min0.004269405616135784
sim_render-npc1_max0.004314360345245167
sim_render-npc1_mean0.00422355781578695
sim_render-npc1_median0.00422355781578695
sim_render-npc1_min0.004132755286328733
sim_render-npc2_max0.0041459955778834654
sim_render-npc2_mean0.004105148677081008
sim_render-npc2_median0.004105148677081008
sim_render-npc2_min0.00406430177627855
simulation-passed1
step_physics_max1.12044704795643
step_physics_mean0.9646431111542564
step_physics_median0.9646431111542564
step_physics_min0.8088391743520825
survival_time_max14.000000000000064
survival_time_mean10.900000000000022
survival_time_min7.79999999999998
No reset possible
5347611122Olga (Ge Ya) Xu 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simfailedyesnogpu-prod-020:02:45
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5344412574Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simsuccessyesnogpu-prod-020:21:31
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.6193714958383224
survival_time_median9.6
deviation-center-line_median0.26371422989698395
in-drivable-lane_median4.575000000000011


other stats
agent_compute-ego0_max0.010880072290698688
agent_compute-ego0_mean0.010510064563005603
agent_compute-ego0_median0.010416862201681028
agent_compute-ego0_min0.01032646155796168
agent_compute-npc0_max0.026777002308935326
agent_compute-npc0_mean0.023326649428859793
agent_compute-npc0_median0.023042761288900725
agent_compute-npc0_min0.0204440728287024
agent_compute-npc1_max0.030554876737068037
agent_compute-npc1_mean0.02889451803353372
agent_compute-npc1_median0.028990151981512707
agent_compute-npc1_min0.02713852538202042
agent_compute-npc2_max0.03377961574640489
agent_compute-npc2_mean0.03111544096811983
agent_compute-npc2_median0.03140539625671012
agent_compute-npc2_min0.02816131090124448
agent_compute-npc3_max0.04471758070091406
agent_compute-npc3_mean0.04470943505724047
agent_compute-npc3_median0.04470943505724047
agent_compute-npc3_min0.04470128941356687
complete-iteration_max1.3009318752835195
complete-iteration_mean0.9316772566893228
complete-iteration_median1.0474814051075985
complete-iteration_min0.330814341258575
deviation-center-line_max0.5600236295347618
deviation-center-line_mean0.3253905152177584
deviation-center-line_min0.21410997154230388
deviation-heading_max1.908871012683688
deviation-heading_mean1.0766142147862303
deviation-heading_median0.8482219769421233
deviation-heading_min0.7011418925769862
driven_any_max2.984498978515761
driven_any_mean1.6846091701953825
driven_any_median1.4167591311847954
driven_any_min0.920419439896177
driven_lanedir_consec_max1.058934844763729
driven_lanedir_consec_mean0.6924950861139013
driven_lanedir_consec_min0.4723025080152312
driven_lanedir_max1.058934844763729
driven_lanedir_mean0.6924950861139013
driven_lanedir_median0.6193714958383224
driven_lanedir_min0.4723025080152312
get_duckie_state_max1.670171817143758e-06
get_duckie_state_mean1.6009345565401895e-06
get_duckie_state_median1.5959562194432978e-06
get_duckie_state_min1.5416539701304042e-06
get_robot_state_max0.01842573533455531
get_robot_state_mean0.014582913706686669
get_robot_state_median0.016166141417101414
get_robot_state_min0.007573636657988544
get_state_dump_max0.011282617847124737
get_state_dump_mean0.00965728730299908
get_state_dump_median0.01041990304390241
get_state_dump_min0.006506725277066765
get_ui_image_max0.05392848280139435
get_ui_image_mean0.04453003174347078
get_ui_image_median0.0459770620200623
get_ui_image_min0.03223752013236418
in-drivable-lane_max14.850000000000144
in-drivable-lane_mean6.33750000000004
in-drivable-lane_min1.349999999999996
per-episodes
details{"LFV-norm-loop-000-ego0": {"driven_any": 1.1741327645678017, "get_ui_image": 0.04134295030605573, "step_physics": 0.7164887723747206, "survival_time": 8.09999999999998, "driven_lanedir": 1.058934844763729, "get_state_dump": 0.009588288383249856, "get_robot_state": 0.014520634902766878, "sim_render-ego0": 0.0038567978911604617, "sim_render-npc0": 0.003719672103600999, "sim_render-npc1": 0.003663433110055748, "sim_render-npc2": 0.0037204122250796825, "get_duckie_state": 1.5914074482361962e-06, "in-drivable-lane": 1.349999999999996, "deviation-heading": 0.7421302334609048, "agent_compute-ego0": 0.01032646155796168, "agent_compute-npc0": 0.0204440728287024, "agent_compute-npc1": 0.030554876737068037, "agent_compute-npc2": 0.03140539625671012, "complete-iteration": 0.9387590885162354, "set_robot_commands": 0.002252986826048307, "deviation-center-line": 0.5600236295347618, "driven_lanedir_consec": 1.058934844763729, "sim_compute_sim_state": 0.032180465803555915, "sim_compute_performance-ego0": 0.002124938496782736, "sim_compute_performance-npc0": 0.0018991619531362337, "sim_compute_performance-npc1": 0.0019461274878379024, "sim_compute_performance-npc2": 0.0019155265363447504}, "LFV-norm-zigzag-000-ego0": {"driven_any": 0.920419439896177, "get_ui_image": 0.05392848280139435, "step_physics": 0.8315444530401015, "survival_time": 6.5999999999999845, "driven_lanedir": 0.4723025080152312, "get_state_dump": 0.011251517704554967, "get_robot_state": 0.01781164793143595, "sim_render-ego0": 0.003766095727906191, "sim_render-npc0": 0.003782159403750771, "sim_render-npc1": 0.003812962008598155, "sim_render-npc2": 0.003863603548896044, "sim_render-npc3": 0.0037747003082045935, "get_duckie_state": 1.5416539701304042e-06, "in-drivable-lane": 2.249999999999992, "deviation-heading": 1.908871012683688, "agent_compute-ego0": 0.010485132834068815, "agent_compute-npc0": 0.02398628220522314, "agent_compute-npc1": 0.02713852538202042, "agent_compute-npc2": 0.03377961574640489, "agent_compute-npc3": 0.04470128941356687, "complete-iteration": 1.1562037216989618, "set_robot_commands": 0.002350143920210071, "deviation-center-line": 0.3113567499237792, "driven_lanedir_consec": 0.4723025080152312, "sim_compute_sim_state": 0.0607802975446658, "sim_compute_performance-ego0": 0.0021108523347323997, "sim_compute_performance-npc0": 0.0018911074874992655, "sim_compute_performance-npc1": 0.0019897231482025376, "sim_compute_performance-npc2": 0.0020539921925480206, "sim_compute_performance-npc3": 0.0020816738444163385}, "LFV-norm-techtrack-000-ego0": {"driven_any": 2.984498978515761, "get_ui_image": 0.05061117373406887, "step_physics": 0.9879963087538878, "survival_time": 19.150000000000137, "driven_lanedir": 0.6255010756848516, "get_state_dump": 0.011282617847124737, "get_robot_state": 0.01842573533455531, "sim_render-ego0": 0.004098799079656601, "sim_render-npc0": 0.003962311893701553, "sim_render-npc1": 0.003906374176343282, "sim_render-npc2": 0.003838665162523588, "sim_render-npc3": 0.003932829325397809, "get_duckie_state": 1.670171817143758e-06, "in-drivable-lane": 14.850000000000144, "deviation-heading": 0.7011418925769862, "agent_compute-ego0": 0.010880072290698688, "agent_compute-npc0": 0.022099240372578304, "agent_compute-npc1": 0.028990151981512707, "agent_compute-npc2": 0.02816131090124448, "agent_compute-npc3": 0.04471758070091406, "complete-iteration": 1.3009318752835195, "set_robot_commands": 0.0024014307806889215, "deviation-center-line": 0.21410997154230388, "driven_lanedir_consec": 0.6255010756848516, "sim_compute_sim_state": 0.05552935103575389, "sim_compute_performance-ego0": 0.002224206924438477, "sim_compute_performance-npc0": 0.002031999950607618, "sim_compute_performance-npc1": 0.0020646906147400537, "sim_compute_performance-npc2": 0.002082097033659617, "sim_compute_performance-npc3": 0.002074130500356356}, "LFV-norm-small_loop-000-ego0": {"driven_any": 1.6593854978017892, "get_ui_image": 0.03223752013236418, "step_physics": 0.21855641587432725, "survival_time": 11.100000000000025, "driven_lanedir": 0.6132419159917932, "get_state_dump": 0.006506725277066765, "get_robot_state": 0.007573636657988544, "sim_render-ego0": 0.003957888470636889, "sim_render-npc0": 0.003852285077219052, "get_duckie_state": 1.6005049906503994e-06, "in-drivable-lane": 6.90000000000003, "deviation-heading": 0.9543137204233418, "agent_compute-ego0": 0.01034859156929324, "agent_compute-npc0": 0.026777002308935326, "complete-iteration": 0.330814341258575, "set_robot_commands": 0.002407680177902427, "deviation-center-line": 0.21607170987018873, "driven_lanedir_consec": 0.6132419159917932, "sim_compute_sim_state": 0.012046329643694276, "sim_compute_performance-ego0": 0.0021206242086641456, "sim_compute_performance-npc0": 0.0020117866618750875}}
set_robot_commands_max0.002407680177902427
set_robot_commands_mean0.0023530604262124314
set_robot_commands_median0.0023757873504494965
set_robot_commands_min0.002252986826048307
sim_compute_performance-ego0_max0.002224206924438477
sim_compute_performance-ego0_mean0.0021451554911544393
sim_compute_performance-ego0_median0.0021227813527234405
sim_compute_performance-ego0_min0.0021108523347323997
sim_compute_performance-npc0_max0.002031999950607618
sim_compute_performance-npc0_mean0.0019585140132795512
sim_compute_performance-npc0_median0.0019554743075056603
sim_compute_performance-npc0_min0.0018911074874992655
sim_compute_performance-npc1_max0.0020646906147400537
sim_compute_performance-npc1_mean0.002000180416926831
sim_compute_performance-npc1_median0.0019897231482025376
sim_compute_performance-npc1_min0.0019461274878379024
sim_compute_performance-npc2_max0.002082097033659617
sim_compute_performance-npc2_mean0.0020172052541841293
sim_compute_performance-npc2_median0.0020539921925480206
sim_compute_performance-npc2_min0.0019155265363447504
sim_compute_performance-npc3_max0.0020816738444163385
sim_compute_performance-npc3_mean0.0020779021723863473
sim_compute_performance-npc3_median0.0020779021723863473
sim_compute_performance-npc3_min0.002074130500356356
sim_compute_sim_state_max0.0607802975446658
sim_compute_sim_state_mean0.04013411100691747
sim_compute_sim_state_median0.0438549084196549
sim_compute_sim_state_min0.012046329643694276
sim_render-ego0_max0.004098799079656601
sim_render-ego0_mean0.0039198952923400355
sim_render-ego0_median0.003907343180898675
sim_render-ego0_min0.003766095727906191
sim_render-npc0_max0.003962311893701553
sim_render-npc0_mean0.0038291071195680937
sim_render-npc0_median0.003817222240484912
sim_render-npc0_min0.003719672103600999
sim_render-npc1_max0.003906374176343282
sim_render-npc1_mean0.003794256431665728
sim_render-npc1_median0.003812962008598155
sim_render-npc1_min0.003663433110055748
sim_render-npc2_max0.003863603548896044
sim_render-npc2_mean0.003807560312166438
sim_render-npc2_median0.003838665162523588
sim_render-npc2_min0.0037204122250796825
sim_render-npc3_max0.003932829325397809
sim_render-npc3_mean0.0038537648168012017
sim_render-npc3_median0.0038537648168012017
sim_render-npc3_min0.0037747003082045935
simulation-passed1
step_physics_max0.9879963087538878
step_physics_mean0.6886464875107593
step_physics_median0.7740166127074111
step_physics_min0.21855641587432725
survival_time_max19.150000000000137
survival_time_mean11.237500000000033
survival_time_min6.5999999999999845
No reset possible
5344312575Bea Baselines 🐤straightaido5-LFVI-sim-validationLFVIv-simsuccessyesnogpu-prod-020:03:50
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.3121389743413916
survival_time_median2.9749999999999974
deviation-center-line_median0.3708299295495237
in-drivable-lane_median0.0


other stats
agent_compute-ego0_max0.009934302532311642
agent_compute-ego0_mean0.009893696235887931
agent_compute-ego0_median0.009893696235887931
agent_compute-ego0_min0.009853089939464222
agent_compute-npc0_max0.04522208733992143
agent_compute-npc0_mean0.03813902031291615
agent_compute-npc0_median0.03813902031291615
agent_compute-npc0_min0.031055953285910865
agent_compute-npc1_max0.043671308141766174
agent_compute-npc1_mean0.037056512904889656
agent_compute-npc1_median0.037056512904889656
agent_compute-npc1_min0.030441717668013134
agent_compute-npc2_max0.04205731912092729
agent_compute-npc2_mean0.03583001873709939
agent_compute-npc2_median0.03583001873709939
agent_compute-npc2_min0.029602718353271485
complete-iteration_max0.954458793004354
complete-iteration_mean0.8330117341243859
complete-iteration_median0.8330117341243859
complete-iteration_min0.711564675244418
deviation-center-line_max0.4067644541949731
deviation-center-line_mean0.3708299295495237
deviation-center-line_min0.3348954049040742
deviation-heading_max0.6552731497775627
deviation-heading_mean0.6259200342264
deviation-heading_median0.6259200342264
deviation-heading_min0.5965669186752373
driven_any_max0.3648071915562534
driven_any_mean0.31928124241480316
driven_any_median0.31928124241480316
driven_any_min0.27375529327335296
driven_lanedir_consec_max0.3585211616210844
driven_lanedir_consec_mean0.3121389743413916
driven_lanedir_consec_min0.2657567870616988
driven_lanedir_max0.3585211616210844
driven_lanedir_mean0.3121389743413916
driven_lanedir_median0.3121389743413916
driven_lanedir_min0.2657567870616988
get_duckie_state_max1.534548672762784e-06
get_duckie_state_mean1.5186541008226798e-06
get_duckie_state_median1.5186541008226798e-06
get_duckie_state_min1.5027595288825757e-06
get_robot_state_max0.014045747843655672
get_robot_state_mean0.013891962441531094
get_robot_state_median0.013891962441531094
get_robot_state_min0.013738177039406515
get_state_dump_max0.009270126169378109
get_state_dump_mean0.009256471287120472
get_state_dump_median0.009256471287120472
get_state_dump_min0.009242816404862835
get_ui_image_max0.04974736733870073
get_ui_image_mean0.04831520969217474
get_ui_image_median0.04831520969217474
get_ui_image_min0.04688305204564875
in-drivable-lane_max0.0
in-drivable-lane_mean0.0
in-drivable-lane_min0.0
per-episodes
details{"LFVI-norm-4way-000-ego0": {"driven_any": 0.27375529327335296, "get_ui_image": 0.04974736733870073, "step_physics": 0.4676500753922896, "survival_time": 2.6999999999999984, "driven_lanedir": 0.2657567870616988, "get_state_dump": 0.009242816404862835, "get_robot_state": 0.013738177039406515, "sim_render-ego0": 0.003669669411399148, "sim_render-npc0": 0.003505377335981889, "sim_render-npc1": 0.0036240881139581855, "sim_render-npc2": 0.003731480511752042, "get_duckie_state": 1.534548672762784e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.6552731497775627, "agent_compute-ego0": 0.009853089939464222, "agent_compute-npc0": 0.031055953285910865, "agent_compute-npc1": 0.030441717668013134, "agent_compute-npc2": 0.029602718353271485, "complete-iteration": 0.711564675244418, "set_robot_commands": 0.0023591345006769354, "deviation-center-line": 0.3348954049040742, "driven_lanedir_consec": 0.2657567870616988, "sim_compute_sim_state": 0.038891753283413974, "sim_compute_performance-ego0": 0.002006920901211826, "sim_compute_performance-npc0": 0.0017809044231068005, "sim_compute_performance-npc1": 0.001988163861361417, "sim_compute_performance-npc2": 0.001987791061401367}, "LFVI-norm-udem1-000-ego0": {"driven_any": 0.3648071915562534, "get_ui_image": 0.04688305204564875, "step_physics": 0.6743904713428381, "survival_time": 3.2499999999999964, "driven_lanedir": 0.3585211616210844, "get_state_dump": 0.009270126169378109, "get_robot_state": 0.014045747843655672, "sim_render-ego0": 0.00370214202187278, "sim_render-npc0": 0.0035845330267241507, "sim_render-npc1": 0.0037272518331354313, "sim_render-npc2": 0.003730965383125074, "get_duckie_state": 1.5027595288825757e-06, "in-drivable-lane": 0.0, "deviation-heading": 0.5965669186752373, "agent_compute-ego0": 0.009934302532311642, "agent_compute-npc0": 0.04522208733992143, "agent_compute-npc1": 0.043671308141766174, "agent_compute-npc2": 0.04205731912092729, "complete-iteration": 0.954458793004354, "set_robot_commands": 0.00216649156628233, "deviation-center-line": 0.4067644541949731, "driven_lanedir_consec": 0.3585211616210844, "sim_compute_sim_state": 0.03758673234419389, "sim_compute_performance-ego0": 0.002070383592085405, "sim_compute_performance-npc0": 0.0017839670181274414, "sim_compute_performance-npc1": 0.0019075256405454693, "sim_compute_performance-npc2": 0.0019570336197361803}}
set_robot_commands_max0.0023591345006769354
set_robot_commands_mean0.002262813033479633
set_robot_commands_median0.002262813033479633
set_robot_commands_min0.00216649156628233
sim_compute_performance-ego0_max0.002070383592085405
sim_compute_performance-ego0_mean0.002038652246648615
sim_compute_performance-ego0_median0.002038652246648615
sim_compute_performance-ego0_min0.002006920901211826
sim_compute_performance-npc0_max0.0017839670181274414
sim_compute_performance-npc0_mean0.0017824357206171208
sim_compute_performance-npc0_median0.0017824357206171208
sim_compute_performance-npc0_min0.0017809044231068005
sim_compute_performance-npc1_max0.001988163861361417
sim_compute_performance-npc1_mean0.001947844750953443
sim_compute_performance-npc1_median0.001947844750953443
sim_compute_performance-npc1_min0.0019075256405454693
sim_compute_performance-npc2_max0.001987791061401367
sim_compute_performance-npc2_mean0.0019724123405687735
sim_compute_performance-npc2_median0.0019724123405687735
sim_compute_performance-npc2_min0.0019570336197361803
sim_compute_sim_state_max0.038891753283413974
sim_compute_sim_state_mean0.038239242813803934
sim_compute_sim_state_median0.038239242813803934
sim_compute_sim_state_min0.03758673234419389
sim_render-ego0_max0.00370214202187278
sim_render-ego0_mean0.003685905716635964
sim_render-ego0_median0.003685905716635964
sim_render-ego0_min0.003669669411399148
sim_render-npc0_max0.0035845330267241507
sim_render-npc0_mean0.00354495518135302
sim_render-npc0_median0.00354495518135302
sim_render-npc0_min0.003505377335981889
sim_render-npc1_max0.0037272518331354313
sim_render-npc1_mean0.0036756699735468086
sim_render-npc1_median0.0036756699735468086
sim_render-npc1_min0.0036240881139581855
sim_render-npc2_max0.003731480511752042
sim_render-npc2_mean0.003731222947438558
sim_render-npc2_median0.003731222947438558
sim_render-npc2_min0.003730965383125074
simulation-passed1
step_physics_max0.6743904713428381
step_physics_mean0.5710202733675639
step_physics_median0.5710202733675639
step_physics_min0.4676500753922896
survival_time_max3.2499999999999964
survival_time_mean2.9749999999999974
survival_time_min2.6999999999999984
No reset possible
5342612563Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simsuccessyesnogpu-prod-020:07:17
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median0.4679448379078439
survival_time_median9.099999999999994
deviation-center-line_median0.28010547392805896
in-drivable-lane_median5.3999999999999995


other stats
agent_compute-ego0_max0.010609603871059956
agent_compute-ego0_mean0.010465710281549847
agent_compute-ego0_median0.010442245308815438
agent_compute-ego0_min0.010368746637508568
complete-iteration_max0.21633373007262496
complete-iteration_mean0.18576746491319152
complete-iteration_median0.18228029702758877
complete-iteration_min0.1621755355249637
deviation-center-line_max0.32072493910540395
deviation-center-line_mean0.25559979359844043
deviation-center-line_min0.14146328743223982
deviation-heading_max2.573443739016378
deviation-heading_mean1.5714288535293366
deviation-heading_median1.510197503673426
deviation-heading_min0.6918766677541162
driven_any_max3.1619666979301324
driven_any_mean1.7218199472807565
driven_any_median1.3303261886048383
driven_any_min1.064660713983217
driven_lanedir_consec_max0.6348088856547565
driven_lanedir_consec_mean0.46870191550881374
driven_lanedir_consec_min0.30410910056481066
driven_lanedir_max0.6348088856547565
driven_lanedir_mean0.46870191550881374
driven_lanedir_median0.4679448379078439
driven_lanedir_min0.30410910056481066
get_duckie_state_max1.4558877095137493e-06
get_duckie_state_mean1.3853645562767696e-06
get_duckie_state_median1.4048971388759277e-06
get_duckie_state_min1.2757762378414737e-06
get_robot_state_max0.003886801855904715
get_robot_state_mean0.003803510800974111
get_robot_state_median0.0038290733911516737
get_robot_state_min0.00366909456568838
get_state_dump_max0.004997380826839063
get_state_dump_mean0.004786021617668961
get_state_dump_median0.004794735146187667
get_state_dump_min0.004557235351461448
get_ui_image_max0.0376459622787217
get_ui_image_mean0.031248602043665422
get_ui_image_median0.030362797103141707
get_ui_image_min0.026622851689656574
in-drivable-lane_max17.10000000000013
in-drivable-lane_mean7.750000000000028
in-drivable-lane_min3.099999999999989
per-episodes
details{"LF-norm-loop-000-ego0": {"driven_any": 3.1619666979301324, "get_ui_image": 0.02960693600154159, "step_physics": 0.11021558010932242, "survival_time": 20.15000000000015, "driven_lanedir": 0.30410910056481066, "get_state_dump": 0.004735172385036355, "get_robot_state": 0.003852306026043278, "sim_render-ego0": 0.004008052372696376, "get_duckie_state": 1.4558877095137493e-06, "in-drivable-lane": 17.10000000000013, "deviation-heading": 2.2006053649220667, "agent_compute-ego0": 0.010443676816354884, "complete-iteration": 0.1777373475603538, "set_robot_commands": 0.0022772521075635852, "deviation-center-line": 0.32072493910540395, "driven_lanedir_consec": 0.30410910056481066, "sim_compute_sim_state": 0.010427498581385848, "sim_compute_performance-ego0": 0.002078334293743171}, "LF-norm-zigzag-000-ego0": {"driven_any": 1.2799908315657689, "get_ui_image": 0.0376459622787217, "step_physics": 0.1403742294527043, "survival_time": 8.79999999999999, "driven_lanedir": 0.36310013377323225, "get_state_dump": 0.004854297907338978, "get_robot_state": 0.003805840756260069, "sim_render-ego0": 0.003936461809664797, "get_duckie_state": 1.4183884960109905e-06, "in-drivable-lane": 5.2999999999999945, "deviation-heading": 2.573443739016378, "agent_compute-ego0": 0.010609603871059956, "complete-iteration": 0.21633373007262496, "set_robot_commands": 0.002174104000888975, "deviation-center-line": 0.290227640897717, "driven_lanedir_consec": 0.36310013377323225, "sim_compute_sim_state": 0.01074156653409624, "sim_compute_performance-ego0": 0.002099070845350707}, "LF-norm-techtrack-000-ego0": {"driven_any": 1.064660713983217, "get_ui_image": 0.031118658204741825, "step_physics": 0.1206447288690024, "survival_time": 7.499999999999981, "driven_lanedir": 0.6348088856547565, "get_state_dump": 0.004557235351461448, "get_robot_state": 0.00366909456568838, "sim_render-ego0": 0.003860269950715122, "get_duckie_state": 1.2757762378414737e-06, "in-drivable-lane": 3.099999999999989, "deviation-heading": 0.8197896424247854, "agent_compute-ego0": 0.010368746637508568, "complete-iteration": 0.18682324649482376, "set_robot_commands": 0.002319694354834146, "deviation-center-line": 0.14146328743223982, "driven_lanedir_consec": 0.6348088856547565, "sim_compute_sim_state": 0.008150448072825046, "sim_compute_performance-ego0": 0.0020482919074052215}, "LF-norm-small_loop-000-ego0": {"driven_any": 1.3806615456439078, "get_ui_image": 0.026622851689656574, "step_physics": 0.10246950608712656, "survival_time": 9.4, "driven_lanedir": 0.5727895420424556, "get_state_dump": 0.004997380826839063, "get_robot_state": 0.003886801855904715, "sim_render-ego0": 0.003993406497612201, "get_duckie_state": 1.3914057817408648e-06, "in-drivable-lane": 5.500000000000004, "deviation-heading": 0.6918766677541162, "agent_compute-ego0": 0.01044081380127599, "complete-iteration": 0.1621755355249637, "set_robot_commands": 0.002301320827827252, "deviation-center-line": 0.26998330695840084, "driven_lanedir_consec": 0.5727895420424556, "sim_compute_sim_state": 0.005351824735207533, "sim_compute_performance-ego0": 0.002018922220462214}}
set_robot_commands_max0.002319694354834146
set_robot_commands_mean0.0022680928227784896
set_robot_commands_median0.0022892864676954186
set_robot_commands_min0.002174104000888975
sim_compute_performance-ego0_max0.002099070845350707
sim_compute_performance-ego0_mean0.0020611548167403285
sim_compute_performance-ego0_median0.0020633131005741963
sim_compute_performance-ego0_min0.002018922220462214
sim_compute_sim_state_max0.01074156653409624
sim_compute_sim_state_mean0.008667834480878666
sim_compute_sim_state_median0.009288973327105446
sim_compute_sim_state_min0.005351824735207533
sim_render-ego0_max0.004008052372696376
sim_render-ego0_mean0.0039495476576721245
sim_render-ego0_median0.003964934153638499
sim_render-ego0_min0.003860269950715122
simulation-passed1
step_physics_max0.1403742294527043
step_physics_mean0.11842601112953892
step_physics_median0.1154301544891624
step_physics_min0.10246950608712656
survival_time_max20.15000000000015
survival_time_mean11.46250000000003
survival_time_min7.499999999999981
No reset possible
5341011410Frank (Chude) Qian 🇨🇦challenge-aido_LF-baseline-behavior-cloningaido5-LF-sim-validationLFv-simabortednonogpu-prod-020:00:28
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5340212565Bea Baselines 🐤straightaido5-LFI-full-sim-testingLFVIv-simabortednonogpu-prod-020:00:40
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5337412572Bea Baselines 🐤straightaido5-LFI-full-sim-validationLFVIv-simabortednonogpu-prod-020:46:32
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5334612605Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simabortednonogpu-prod-020:03:13
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5331311681Dishank Bansal 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simabortednonogpu-prod-020:15:15
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5330312480Bea Baselines 🐤straightaido5-LFI-sim-validationLFVIv-simabortednonogpu-prod-020:13:10
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5328311122Olga (Ge Ya) Xu 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simabortednonogpu-prod-020:07:19
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5326712544Bea Baselines 🐤template-rosaido5-LFV-sim-testingLFVv-simabortednonogpu-prod-020:00:34
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5325512473Bea Baselines 🐤straightaido5-LF-sim-validationLFv-simabortednonogpu-prod-020:01:05
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5324512477Bea Baselines 🐤straightaido5-LFP-sim-testingLFP-simerrornonogpu-prod-020:04:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140550100248896
- M:video_aido:cmdline(in:/;out:/) 140550099871152
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5322912480Bea Baselines 🐤straightaido5-LFI-sim-validationLFVIv-simerrornonogpu-prod-020:01:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140164445173456
- M:video_aido:cmdline(in:/;out:/) 140164445174032
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5321012482Bea Baselines 🐤straightaido5-LFI-full-sim-validationLFVIv-simhost-errornonogpu-prod-020:02:11
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5318511762Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-020:09:05
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139795326401456
- M:video_aido:cmdline(in:/;out:/) 139795326399920
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5315611767Olga (Ge Ya) Xu 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-020:08:32
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139993821935072
- M:video_aido:cmdline(in:/;out:/) 139993821933824
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5314311769Ayman Shams 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-020:02:50
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139641797932848
- M:video_aido:cmdline(in:/;out:/) 139641797906784
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5312912339Bea Baselines 🐤template-rosaido5-LFV-sim-validationLFVv-simerrornonogpu-prod-020:02:35
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139695495473664
- M:video_aido:cmdline(in:/;out:/) 139695495678800
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5311311779Yishu Malhotra 🇨🇦sim-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-020:04:19
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140280853819840
- M:video_aido:cmdline(in:/;out:/) 140280852571952
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5309412020Ayman Shams 🇨🇦real-exercise-2aido5-LF-sim-validationLFv-simerrornonogpu-prod-020:02:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140312872922176
- M:video_aido:cmdline(in:/;out:/) 140312873375776
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5308112341Bea Baselines 🐤template-rosaido5-LFP-sim-validationLFP-simerrornonogpu-prod-020:01:52
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139893994173824
- M:video_aido:cmdline(in:/;out:/) 139893994096960
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5306712346Bea Baselines 🐤template-rosaido5-LFI-sim-testingLFVIv-simerrornonogpu-prod-020:01:45
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139622969740304
- M:video_aido:cmdline(in:/;out:/) 139622970537488
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5302612388Bea Baselines 🐤baseline-duckietownaido5-LFV_multi-sim-validationLFVmultibodyv-simerrornonogpu-prod-020:28:53
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139831768313920
- M:video_aido:cmdline(in:/;out:/) 139831821286800
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5298912396Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-020:15:08
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139818231005776
- M:video_aido:cmdline(in:/;out:/) 139818231008272
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5297912399Bea Baselines 🐤template-randomaido5-LF-sim-validationLFv-simerrornonogpu-prod-020:01:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140192723856304
- M:video_aido:cmdline(in:/;out:/) 140192627778320
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5296412402Bea Baselines 🐤template-randomaido5-LFP-sim-validationLFP-simerrornonogpu-prod-020:01:28
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140061150747808
- M:video_aido:cmdline(in:/;out:/) 140061150746848
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5295212406Bea Baselines 🐤template-randomaido5-LFI-sim-validationLFVIv-simerrornonogpu-prod-020:01:36
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140251849107920
- M:video_aido:cmdline(in:/;out:/) 140251849107968
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5293212411Bea Baselines 🐤template-randomaido5-LFVI-sim-validationLFVIv-simerrornonogpu-prod-020:01:56
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140661927353120
- M:video_aido:cmdline(in:/;out:/) 140661927527520
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
529129367Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-020:03:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140689191344256
- M:video_aido:cmdline(in:/;out:/) 140689191345696
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5289812439Bea Baselines 🐤straightaido5-LFV-sim-testingLFVv-simerrornonogpu-prod-020:01:47
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139882545344672
- M:video_aido:cmdline(in:/;out:/) 139882511405408
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5288512441Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-020:02:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139949828404896
- M:video_aido:cmdline(in:/;out:/) 139949828403456
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5287912438Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simerrornonogpu-prod-020:01:09
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140352074731376
- M:video_aido:cmdline(in:/;out:/) 140352074730608
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5286612438Bea Baselines 🐤straightaido5-LF-sim-testingLFt-simerrornonogpu-prod-020:01:06
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139869229638320
- M:video_aido:cmdline(in:/;out:/) 139869229641296
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5285212434Bea Baselines 🐤straightaido5-LFV_multi-sim-testingLFVmultibodyv-simabortednonogpu-prod-020:00:32
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5283012436Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simabortednonogpu-prod-020:01:16
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5281212441Bea Baselines 🐤straightaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-020:01:57
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140215731841632
- M:video_aido:cmdline(in:/;out:/) 140220321360720
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5280312409Bea Baselines 🐤template-randomaido5-LF-sim-testingLFt-simerrornonogpu-prod-020:01:12
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140696006150848
- M:video_aido:cmdline(in:/;out:/) 140696006150560
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5279012224Bea Baselines 🐤straightaido5-LFI-sim-testingLFVIv-simabortednonogpu-prod-020:00:53
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The submission has been retired.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5277612396Bea Baselines 🐤baseline-duckietownaido5-LFVI-sim-testingLFVIt-simabortednonogpu-prod-020:00:37
KeyboardInterrupt: T [...]
KeyboardInterrupt:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 1169, in run_one
    heartbeat()
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 628, in heartbeat
    raise KeyboardInterrupt(msg_)
KeyboardInterrupt: The server told us to abort the job because: The challenge has been updated.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5273912336Bea Baselines 🐤template-randomaido5-LFVI-sim-testingLFVIt-simerrornonogpu-prod-020:03:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139874765450208
- M:video_aido:cmdline(in:/;out:/) 139874765449200
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5270811772Ehsan Ahmadi 🇨🇦template-randomaido5-LF-sim-validationLFv-simabortednonogpu-prod-020:01:55
Uncaught exception: [...]
Uncaught exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 261, in _raise_for_status
    response.raise_for_status()
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/images/create?tag=sha256%3A4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798&fromImage=docker.io%2Fehsana94%2Faido-submissions

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 65, in docker_pull
    pulling = client.api.pull(repository=repository, tag=br.tag, stream=True, decode=True)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/image.py", line 415, in pull
    self._raise_for_status(response)
  File "/usr/local/lib/python3.8/dist-packages/docker/api/client.py", line 263, in _raise_for_status
    raise create_api_error_from_http_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
    raise cls(e, response=response, explanation=explanation)
docker.errors.ImageNotFound: 404 Client Error: Not Found ("pull access denied for ehsana94/aido-submissions, repository does not exist or may require 'docker login': denied: requested access to the resource is denied")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 38, in docker_pull_retry
    return docker_pull(client, image_name, quiet=quiet)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 84, in docker_pull
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: Cannot pull repo  docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798  tag  None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 777, in get_cr
    cr = run_single(
  File "/usr/local/lib/python3.8/dist-packages/duckietown_challenges_runner/runner.py", line 976, in run_single
    docker_pull_retry(client, image, ntimes=4, wait=5)
  File "/usr/local/lib/python3.8/dist-packages/duckietown_build_utils/docker_pulling.py", line 42, in docker_pull_retry
    raise PullError(msg) from e
duckietown_build_utils.docker_pulling.PullError: After trying 4 I still could not pull docker.io/ehsana94/aido-submissions@sha256:4beea8e085dd479a520c147091604c18f9328bac8318d5c0f8ea68c82bd07798
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
526316729Andrea Censi 🇨🇭template-randomaido5-LF-sim-validationLFv-simerrornonogpu-prod-020:02:42
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140032157481376
- M:video_aido:cmdline(in:/;out:/) 140032157403888
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525936804Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simfailednonogpu-prod-020:03:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 2 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
525406824Anthony Courchesne 🇨🇦baseline-duckietownaido5-LF-sim-validationLFv-simerrornonogpu-prod-020:09:40
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139619253855616
- M:video_aido:cmdline(in:/;out:/) 139619565910432
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
524556850Himanshu Arora 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-020:11:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140270423253968
- M:video_aido:cmdline(in:/;out:/) 140270423254784
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
523899255Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-020:08:45
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
523049324Jerome Labonte 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-020:09:29
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140556734416352
- M:video_aido:cmdline(in:/;out:/) 140555932944800
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
522249340Jerome Labonte 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-020:08:39
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140124326049392
- M:video_aido:cmdline(in:/;out:/) 140124323969536
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
521249775Philippe Reddy 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-020:11:54
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140518123325952
- M:video_aido:cmdline(in:/;out:/) 140518123349520
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5208210015Fernanda Custodio Pereira do Carmo 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-020:06:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140342167406048
- M:video_aido:cmdline(in:/;out:/) 140342168819024
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5202110030Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-020:08:46
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139835777198784
- M:video_aido:cmdline(in:/;out:/) 139835776870336
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5200010067Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simhost-errornonogpu-prod-020:02:21
The container "evalu [...]
The container "evaluator" exited with code 1.


Look at the logs for the container to know more about the error.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5197210048Jean-Sébastien Grondin 🇨🇦sim-exercise-1aido5-LF-sim-validationLFv-simerrornonogpu-prod-020:04:10
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139963764876384
- M:video_aido:cmdline(in:/;out:/) 139963764139536
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5191710067Étienne Boucher 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-020:04:14
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 140347806310352
- M:video_aido:cmdline(in:/;out:/) 140347806256768
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5186710716Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-020:04:39
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5181210728Melisande Tengexercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-020:03:32
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 190, in main
    raise InvalidSubmission(msg)
duckietown_challenges.exceptions.InvalidSubmission: Timeout during connection to ego0: <SignalTimeout in state: 2>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5176810754Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simfailednonogpu-prod-020:03:35
InvalidSubmission: T [...]
InvalidSubmission:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 218, in read_one
    msgs = read_reply(self.fpout, timeout=timeout, waiting_for=waiting_for, nickname=self.nickname,)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 304, in read_reply
    others = read_until_over(fpout, timeout=timeout, nickname=nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 341, in read_until_over
    raise TimeoutError(msg) from None
TimeoutError: Timeout while reading output of node "ego0".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 563, in run_episode
    r: MsgReceived = await loop.run_in_executor(executor, f)
  File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 135, in write_topic_and_expect
    ob: MsgReceived = self.read_one(expect_topic=expect, timeout=timeout)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 281, in read_one
    raise TimeoutError(msg) from e
TimeoutError: Timeout detected on /fifos/ego0-out after 36 messages. Expected topic "commands".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 286, in main
    length_s = await run_episode(
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 567, in run_episode
    raise dc.InvalidSubmission(msg) from e
duckietown_challenges.exceptions.InvalidSubmission: Trouble with communication to the agent.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5165410800Ayman Shams 🇨🇦exercise_ros_templateaido5-LF-sim-validationLFv-simerrornonogpu-prod-020:11:15
InvalidEvaluator: Tr [...]
InvalidEvaluator:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
    im = Image.open(filename)
  File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
    raise UnidentifiedImageError(
PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
    result = block.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
    image = imread(self.config.file)
  File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
    raise ValueError(msg) from e
ValueError: Could not open filename "banner1.png".

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 329, in main
    make_video2(
  File "/usr/local/lib/python3.8/site-packages/aido_analyze/utils_video.py", line 149, in make_video2
    pg("video_aido", params)
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 280, in pg
    raise e
  File "/usr/local/lib/python3.8/site-packages/procgraph/scripts/pgmain.py", line 277, in pg
    model.update()
  File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 321, in update
    raise BadMethodCall("update", block, traceback.format_exc())
procgraph.core.exceptions.BadMethodCall: User-thrown exception while calling update() in block 'static_image'.
- B:StaticImage:static_image(in:/;out:rgb) 139963279691936
- M:video_aido:cmdline(in:/;out:/) 139963279659696
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 51, in imread
>     im = Image.open(filename)
>   File "/usr/local/lib/python3.8/site-packages/PIL/Image.py", line 2943, in open
>     raise UnidentifiedImageError(
> PIL.UnidentifiedImageError: cannot identify image file 'banner1.png'
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.8/site-packages/procgraph/core/model.py", line 316, in update
>     result = block.update()
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 31, in update
>     image = imread(self.config.file)
>   File "/usr/local/lib/python3.8/site-packages/procgraph_pil/imread_imp.py", line 54, in imread
>     raise ValueError(msg) from e
> ValueError: Could not open filename "banner1.png".

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 383, in main
    raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible
5163810933Moustafa Elarabitemplate-pytorchaido5-LF-sim-validationLFv-simabortednonogpu-prod-020:00:44
InvalidEnvironment: [...]
InvalidEnvironment:
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following exception:
              ||
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 319, in loop
              ||     raise Exception(msg) from e
              || Exception: Exception while calling the node's init() function.
              ||
              || | Traceback (most recent call last):
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              || |     call_if_fun_exists(node, "init", context=context_data)
              || |   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              || |     f(**kwargs)
              || |   File "solution.py", line 45, in init
              || |     raise Exception(msg)
              || | Exception: I need a GPU; bailing.
              || |
              ||

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_challenges/cie_concrete.py", line 681, in scoring_context
    yield cie
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 68, in go
    wrap(cie)
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/experiment_manager.py", line 34, in wrap
    asyncio.run(main(cie, logdir, attempts), debug=True)
  File "/usr/local/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 248, in main
    raise InvalidEnvironment(msg) from e
duckietown_challenges.exceptions.InvalidEnvironment: Detected out of CUDA memory:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/duckietown_experiment_manager/code.py", line 242, in main
    robot_ci.write_topic_and_expect_zero("seed", config.seed)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 143, in write_topic_and_expect_zero
    msgs = read_reply(self.fpout, timeout=timeout, nickname=self.nickname)
  File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper_outside.py", line 309, in read_reply
    raise RemoteNodeAborted(msg)
zuper_nodes.structures.RemoteNodeAborted: The remote node "ego0" aborted with the following error:

error in ego0 |Unexpected error:
              |
              || Traceback (most recent call last):
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/wrapper.py", line 314, in loop
              ||     call_if_fun_exists(node, "init", context=context_data)
              ||   File "/usr/local/lib/python3.8/site-packages/zuper_nodes_wrapper/utils.py", line 21, in call_if_fun_exists
              ||     f(**kwargs)
              ||   File "solution.py", line 45, in init
              ||     raise Exception(msg)
              || Exception: I need a GPU; bailing.
              ||
              || The above exception was the direct cause of the following ex