Job ID step status up to date date started date completed duration message 23020
step1-simulation success yes 2019-05-17 05:17:03+00:00 2019-05-17 05:26:48+00:00 0:09:45 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.6707441932890994 survival_time_median 3.649999999999995 deviation-center-line_median 0.14435558631904788 in-drivable-lane_median 0.9499999999999966
other stats agent_compute-ego_max 0.06552887601511818 agent_compute-ego_mean 0.06280630281722203 agent_compute-ego_median 0.0628955066204071 agent_compute-ego_min 0.06104443967342377 deviation-center-line_max 0.2085822874042474 deviation-center-line_mean 0.1589542518908908 deviation-center-line_min 0.10686452122645386 deviation-heading_max 0.6191860504142408 deviation-heading_mean 0.523857550127959 deviation-heading_median 0.5156622477370731 deviation-heading_min 0.42218734391092383 driven_any_max 1.5798273185720382 driven_any_mean 0.9978358087547315 driven_any_median 0.9948273195001778 driven_any_min 0.3798605253583843 driven_lanedir_consec_max 1.2017887891468408 driven_lanedir_consec_mean 0.7740609626522831 driven_lanedir_consec_min 0.366714522485295 driven_lanedir_max 1.2017887891468408 driven_lanedir_mean 0.7740609626522831 driven_lanedir_median 0.6707441932890994 driven_lanedir_min 0.366714522485295 in-drivable-lane_max 1.1999999999999955 in-drivable-lane_mean 0.6699999999999976 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.9948273195001778, "sim_physics": 0.1640774321882692, "survival_time": 3.649999999999995, "driven_lanedir": 0.6707441932890994, "sim_render-ego": 0.05986731999540982, "in-drivable-lane": 0.9499999999999966, "agent_compute-ego": 0.0631806687132953, "deviation-heading": 0.5590533399929921, "set_robot_commands": 0.08712793049746997, "deviation-center-line": 0.14435558631904788, "driven_lanedir_consec": 0.6707441932890994, "sim_compute_sim_state": 0.03477472475130264, "sim_compute_performance-ego": 0.06583667454654224, "sim_compute_robot_state-ego": 0.0684784569152414, "sim_compute_robot_state-npc0": 0.06456412681161541, "sim_compute_robot_state-npc1": 0.06558044642618258, "sim_compute_robot_state-npc2": 0.06576648150404839, "sim_compute_robot_state-npc3": 0.06109000232121716}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.4548365617710475, "sim_physics": 0.17349733533086004, "survival_time": 1.850000000000001, "driven_lanedir": 0.4295977528045558, "sim_render-ego": 0.05897752014366356, "in-drivable-lane": 0, "agent_compute-ego": 0.061382023063865865, "deviation-heading": 0.6191860504142408, "set_robot_commands": 0.08884826866356102, "deviation-center-line": 0.13177328856984177, "driven_lanedir_consec": 0.4295977528045558, "sim_compute_sim_state": 0.03321682440268027, "sim_compute_performance-ego": 0.06234375206199852, "sim_compute_robot_state-ego": 0.06749632551863387, "sim_compute_robot_state-npc0": 0.06552347621402226, "sim_compute_robot_state-npc1": 0.06344219800588247, "sim_compute_robot_state-npc2": 0.06538413666390083, "sim_compute_robot_state-npc3": 0.06129148844126109}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 1.57982731857201, "sim_physics": 0.1820920216185706, "survival_time": 5.599999999999988, "driven_lanedir": 1.2014595555356244, "sim_render-ego": 0.06386107632092067, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06552887601511818, "deviation-heading": 0.5156622477370731, "set_robot_commands": 0.0962388515472412, "deviation-center-line": 0.2085822874042474, "driven_lanedir_consec": 1.2014595555356244, "sim_compute_sim_state": 0.03943673201969692, "sim_compute_performance-ego": 0.06948624125548772, "sim_compute_robot_state-ego": 0.07826523695673261, "sim_compute_robot_state-npc0": 0.06734562984534673, "sim_compute_robot_state-npc1": 0.06924572374139513, "sim_compute_robot_state-npc2": 0.07068343673433576, "sim_compute_robot_state-npc3": 0.07058608319078173}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 1.5798273185720382, "sim_physics": 0.16953263325350626, "survival_time": 5.599999999999988, "driven_lanedir": 1.2017887891468408, "sim_render-ego": 0.057742342352867126, "in-drivable-lane": 1.1999999999999955, "agent_compute-ego": 0.06104443967342377, "deviation-heading": 0.5031987685845647, "set_robot_commands": 0.08694963157176971, "deviation-center-line": 0.2031955759348632, "driven_lanedir_consec": 1.2017887891468408, "sim_compute_sim_state": 0.03599854665143149, "sim_compute_performance-ego": 0.06488257433686938, "sim_compute_robot_state-ego": 0.06835811691624778, "sim_compute_robot_state-npc0": 0.06591954827308655, "sim_compute_robot_state-npc1": 0.06403729958193642, "sim_compute_robot_state-npc2": 0.06547597476414271, "sim_compute_robot_state-npc3": 0.06387626699038915}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.3798605253583843, "sim_physics": 0.18048782646656036, "survival_time": 1.6000000000000008, "driven_lanedir": 0.366714522485295, "sim_render-ego": 0.06472700834274292, "in-drivable-lane": 0, "agent_compute-ego": 0.0628955066204071, "deviation-heading": 0.42218734391092383, "set_robot_commands": 0.09321898221969604, "deviation-center-line": 0.10686452122645386, "driven_lanedir_consec": 0.366714522485295, "sim_compute_sim_state": 0.04040811210870743, "sim_compute_performance-ego": 0.06805245578289032, "sim_compute_robot_state-ego": 0.07599849998950958, "sim_compute_robot_state-npc0": 0.07263916730880737, "sim_compute_robot_state-npc1": 0.06910749524831772, "sim_compute_robot_state-npc2": 0.0684482529759407, "sim_compute_robot_state-npc3": 0.07227946817874908}}set_robot_commands_max 0.0962388515472412 set_robot_commands_mean 0.0904767328999476 set_robot_commands_median 0.08884826866356102 set_robot_commands_min 0.08694963157176971 sim_compute_performance-ego_max 0.06948624125548772 sim_compute_performance-ego_mean 0.06612033959675764 sim_compute_performance-ego_median 0.06583667454654224 sim_compute_performance-ego_min 0.06234375206199852 sim_compute_robot_state-ego_max 0.07826523695673261 sim_compute_robot_state-ego_mean 0.07171932725927305 sim_compute_robot_state-ego_median 0.0684784569152414 sim_compute_robot_state-ego_min 0.06749632551863387 sim_compute_robot_state-npc0_max 0.07263916730880737 sim_compute_robot_state-npc0_mean 0.06719838969057565 sim_compute_robot_state-npc0_median 0.06591954827308655 sim_compute_robot_state-npc0_min 0.06456412681161541 sim_compute_robot_state-npc1_max 0.06924572374139513 sim_compute_robot_state-npc1_mean 0.06628263260074287 sim_compute_robot_state-npc1_median 0.06558044642618258 sim_compute_robot_state-npc1_min 0.06344219800588247 sim_compute_robot_state-npc2_max 0.07068343673433576 sim_compute_robot_state-npc2_mean 0.06715165652847369 sim_compute_robot_state-npc2_median 0.06576648150404839 sim_compute_robot_state-npc2_min 0.06538413666390083 sim_compute_robot_state-npc3_max 0.07227946817874908 sim_compute_robot_state-npc3_mean 0.06582466182447963 sim_compute_robot_state-npc3_median 0.06387626699038915 sim_compute_robot_state-npc3_min 0.06109000232121716 sim_compute_sim_state_max 0.04040811210870743 sim_compute_sim_state_mean 0.03676698798676375 sim_compute_sim_state_median 0.03599854665143149 sim_compute_sim_state_min 0.03321682440268027 sim_physics_max 0.1820920216185706 sim_physics_mean 0.1739374497715533 sim_physics_median 0.17349733533086004 sim_physics_min 0.1640774321882692 sim_render-ego_max 0.06472700834274292 sim_render-ego_mean 0.06103505343112081 sim_render-ego_median 0.05986731999540982 sim_render-ego_min 0.057742342352867126 simulation-passed 1 survival_time_max 5.599999999999988 survival_time_mean 3.6599999999999944 survival_time_min 1.6000000000000008
No reset possible 21358
step1-simulation success no 2019-04-28 01:00:37+00:00 2019-04-28 01:10:44+00:00 0:10:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 21351
step1-simulation host-error no 2019-04-28 00:50:59+00:00 2019-04-28 01:00:10+00:00 0:09:11 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 483, in get_cr
submission_id=submission_id, timeout_sec=timeout_sec)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/project/src/duckietown_challenges_runner/runner.py", line 343, in setup_logging
convert(f_stdout)
File "/project/src/duckietown_challenges_runner/runner.py", line 332, in convert
data = open(log).read().strip()
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/duckietown/DT18/evaluator/executions/aido2-LFV-sim-validation/submission2378/step1-simulation-ip-172-31-42-167-7227-job21351/logs/challenges-runner/stdout.log'
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20610
step1-simulation success no 2019-04-25 14:57:16+00:00 2019-04-25 15:05:18+00:00 0:08:02 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20027
step1-simulation error no 2019-04-25 08:47:53+00:00 2019-04-25 08:48:51+00:00 0:00:58 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 250, in run_episode
sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "episode_start".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 209, in on_received_episode_start
|| self.update_observations(context)
|| File "gym_bridge.py", line 274, in update_observations
|| jpg_data = rgb2jpg(obs)
|| File "gym_bridge.py", line 352, in rgb2jpg
|| bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
|| cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
|| > Unsupported depth of input image:
|| > 'VDepth::contains(depth)'
|| > where
|| > 'depth' is 6 (CV_64F)
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 250, in run_episode
> sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "episode_start".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 209, in on_received_episode_start
> || self.update_observations(context)
> || File "gym_bridge.py", line 274, in update_observations
> || jpg_data = rgb2jpg(obs)
> || File "gym_bridge.py", line 352, in rgb2jpg
> || bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
> || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
> || > Unsupported depth of input image:
> || > 'VDepth::contains(depth)'
> || > where
> || > 'depth' is 6 (CV_64F)
> ||
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19661
step1-simulation success no 2019-04-24 16:31:29+00:00 2019-04-24 16:43:35+00:00 0:12:06 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18911
step1-simulation error no 2019-04-20 15:24:08+00:00 2019-04-20 15:44:57+00:00 0:20:49 Waited 1203 seconds [...] Waited 1203 seconds for container to finish. Giving up.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 18542
step1-simulation success no 2019-04-19 15:59:20+00:00 2019-04-19 16:16:54+00:00 0:17:34 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17912
step1-simulation success no 2019-04-16 11:28:50+00:00 2019-04-16 11:38:39+00:00 0:09:49 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17873
step1-simulation success no 2019-04-16 11:06:00+00:00 2019-04-16 11:15:41+00:00 0:09:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17543
step1-simulation success no 2019-04-14 14:59:04+00:00 2019-04-14 15:08:28+00:00 0:09:24 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 17540
step1-simulation success no 2019-04-14 14:56:30+00:00 2019-04-14 15:04:52+00:00 0:08:22 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible