Job ID step status up to date date started date completed duration message 22712
step1-simulation success yes 2019-05-17 00:58:04+00:00 2019-05-17 01:02:00+00:00 0:03:56 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
driven_lanedir_consec_median 0.1280514043613303 survival_time_median 1.5500000000000007 deviation-center-line_median 0.0852383796439041 in-drivable-lane_median 0
other stats agent_compute-ego_max 0.17899192006964432 agent_compute-ego_mean 0.17063350554344756 agent_compute-ego_median 0.16785960043630294 agent_compute-ego_min 0.16535788029432297 deviation-center-line_max 0.09693626778991184 deviation-center-line_mean 0.08280303603134549 deviation-center-line_min 0.07204898496263776 deviation-heading_max 1.0152736620944678 deviation-heading_mean 0.8799406921190028 deviation-heading_median 0.9382802695442836 deviation-heading_min 0.5286178754347387 driven_any_max 0.21518888961942131 driven_any_mean 0.18382936873290404 driven_any_median 0.20104862592210224 driven_any_min 0.10980680611474695 driven_lanedir_consec_max 0.1424254801803304 driven_lanedir_consec_mean 0.11690479599400402 driven_lanedir_consec_min 0.07952293303241698 driven_lanedir_max 0.1424254801803304 driven_lanedir_mean 0.11690479599400402 driven_lanedir_median 0.1280514043613303 driven_lanedir_min 0.07952293303241698 in-drivable-lane_max 0.10000000000000007 in-drivable-lane_mean 0.030000000000000027 in-drivable-lane_min 0 per-episodes details {"ETHZ_autolab_technical_track-0-0": {"driven_any": 0.21518888961942131, "sim_physics": 0.06416607672168363, "survival_time": 1.5500000000000007, "driven_lanedir": 0.1280514043613303, "sim_render-ego": 0.06010634668411747, "in-drivable-lane": 0.05000000000000005, "agent_compute-ego": 0.16785960043630294, "deviation-heading": 0.9944237402665344, "set_robot_commands": 0.07599505301444762, "deviation-center-line": 0.09693626778991184, "driven_lanedir_consec": 0.1280514043613303, "sim_compute_sim_state": 0.039480017077538274, "sim_compute_performance-ego": 0.060252966419343024, "sim_compute_robot_state-ego": 0.06412130017434398}, "ETHZ_autolab_technical_track-1-0": {"driven_any": 0.20104862592210224, "sim_physics": 0.06092260777950287, "survival_time": 1.6000000000000008, "driven_lanedir": 0.1364085680237901, "sim_render-ego": 0.06332170963287354, "in-drivable-lane": 0, "agent_compute-ego": 0.17454806715250015, "deviation-heading": 0.9231079132549896, "set_robot_commands": 0.07917292416095734, "deviation-center-line": 0.07204898496263776, "driven_lanedir_consec": 0.1364085680237901, "sim_compute_sim_state": 0.0423566997051239, "sim_compute_performance-ego": 0.06707995384931564, "sim_compute_robot_state-ego": 0.06320878863334656}, "ETHZ_autolab_technical_track-2-0": {"driven_any": 0.10980680611474695, "sim_physics": 0.0643281058261269, "survival_time": 0.9500000000000004, "driven_lanedir": 0.07952293303241698, "sim_render-ego": 0.0664647754869963, "in-drivable-lane": 0, "agent_compute-ego": 0.17899192006964432, "deviation-heading": 0.5286178754347387, "set_robot_commands": 0.0786841543097245, "deviation-center-line": 0.0852383796439041, "driven_lanedir_consec": 0.07952293303241698, "sim_compute_sim_state": 0.04465568693060624, "sim_compute_performance-ego": 0.06819146557858116, "sim_compute_robot_state-ego": 0.06567434260719701}, "ETHZ_autolab_technical_track-3-0": {"driven_any": 0.18145803789300513, "sim_physics": 0.0678495374219171, "survival_time": 1.4500000000000006, "driven_lanedir": 0.09811559437215234, "sim_render-ego": 0.06850870724382072, "in-drivable-lane": 0.10000000000000007, "agent_compute-ego": 0.16641005976446743, "deviation-heading": 1.0152736620944678, "set_robot_commands": 0.08104566870064571, "deviation-center-line": 0.07445108542421267, "driven_lanedir_consec": 0.09811559437215234, "sim_compute_sim_state": 0.045403266775196995, "sim_compute_performance-ego": 0.06856382304224475, "sim_compute_robot_state-ego": 0.06860538186698124}, "ETHZ_autolab_technical_track-4-0": {"driven_any": 0.2116444841152446, "sim_physics": 0.06472167372703552, "survival_time": 1.6000000000000008, "driven_lanedir": 0.1424254801803304, "sim_render-ego": 0.07126884162425995, "in-drivable-lane": 0, "agent_compute-ego": 0.16535788029432297, "deviation-heading": 0.9382802695442836, "set_robot_commands": 0.07857737690210342, "deviation-center-line": 0.08534046233606106, "driven_lanedir_consec": 0.1424254801803304, "sim_compute_sim_state": 0.04139094054698944, "sim_compute_performance-ego": 0.06736836582422256, "sim_compute_robot_state-ego": 0.06579836457967758}}set_robot_commands_max 0.08104566870064571 set_robot_commands_mean 0.07869503541757572 set_robot_commands_median 0.0786841543097245 set_robot_commands_min 0.07599505301444762 sim_compute_performance-ego_max 0.06856382304224475 sim_compute_performance-ego_mean 0.06629131494274143 sim_compute_performance-ego_median 0.06736836582422256 sim_compute_performance-ego_min 0.060252966419343024 sim_compute_robot_state-ego_max 0.06860538186698124 sim_compute_robot_state-ego_mean 0.06548163557230927 sim_compute_robot_state-ego_median 0.06567434260719701 sim_compute_robot_state-ego_min 0.06320878863334656 sim_compute_sim_state_max 0.045403266775196995 sim_compute_sim_state_mean 0.04265732220709097 sim_compute_sim_state_median 0.0423566997051239 sim_compute_sim_state_min 0.039480017077538274 sim_physics_max 0.0678495374219171 sim_physics_mean 0.06439760029525321 sim_physics_median 0.0643281058261269 sim_physics_min 0.06092260777950287 sim_render-ego_max 0.07126884162425995 sim_render-ego_mean 0.0659340761344136 sim_render-ego_median 0.0664647754869963 sim_render-ego_min 0.06010634668411747 simulation-passed 1 survival_time_max 1.6000000000000008 survival_time_mean 1.4300000000000006 survival_time_min 0.9500000000000004
No reset possible 20938
step1-simulation success no 2019-04-27 15:32:01+00:00 2019-04-27 15:38:40+00:00 0:06:39 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 20252
step1-simulation success no 2019-04-25 10:41:02+00:00 2019-04-25 10:56:43+00:00 0:15:41 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19929
step1-simulation error no 2019-04-25 08:38:28+00:00 2019-04-25 08:40:48+00:00 0:02:20 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 250, in run_episode
sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "episode_start".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 209, in on_received_episode_start
|| self.update_observations(context)
|| File "gym_bridge.py", line 281, in update_observations
|| jpg_data = rgb2jpg(obs)
|| File "gym_bridge.py", line 359, in rgb2jpg
|| bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
|| cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
|| > Unsupported depth of input image:
|| > 'VDepth::contains(depth)'
|| > where
|| > 'depth' is 6 (CV_64F)
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 250, in run_episode
> sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "episode_start".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 209, in on_received_episode_start
> || self.update_observations(context)
> || File "gym_bridge.py", line 281, in update_observations
> || jpg_data = rgb2jpg(obs)
> || File "gym_bridge.py", line 359, in rgb2jpg
> || bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
> || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<3, 4>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
> || > Unsupported depth of input image:
> || > 'VDepth::contains(depth)'
> || > where
> || > 'depth' is 6 (CV_64F)
> ||
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19865
step1-simulation error no 2019-04-25 08:32:48+00:00 2019-04-25 08:33:45+00:00 0:00:57 InvalidEvaluator:
Tr [...] InvalidEvaluator:
Traceback (most recent call last):
File "experiment_manager.py", line 135, in main
physics_dt=config.physics_dt)
File "experiment_manager.py", line 250, in run_episode
sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
nickname=self.nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
others = read_until_over(fpout, timeout=timeout, nickname=nickname)
File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
raise RemoteNodeAborted(m)
zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
error in simulator |Exception while handling a message on topic "episode_start".
|
|| Traceback (most recent call last):
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
|| handle_message_node(parsed, receiver0, context0)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
|| call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
|| File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
|| f(**kwargs)
|| File "gym_bridge.py", line 209, in on_received_episode_start
|| self.update_observations(context)
|| File "gym_bridge.py", line 274, in update_observations
|| jpg_data = rgb2jpg(obs)
|| File "gym_bridge.py", line 352, in rgb2jpg
|| bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
|| cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
|| > Unsupported depth of input image:
|| > 'VDepth::contains(depth)'
|| > where
|| > 'depth' is 6 (CV_64F)
||
||
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/project/src/duckietown-challenges/src/duckietown_challenges/cie_concrete.py", line 610, in scoring_context
yield cie
File "experiment_manager.py", line 439, in <module>
wrap(cie)
File "experiment_manager.py", line 427, in wrap
main(cie, logdir, attempts)
File "experiment_manager.py", line 186, in main
raise dc.InvalidEvaluator(msg) from e
duckietown_challenges.exceptions.InvalidEvaluator: Anomalous error while running episodes:
> Traceback (most recent call last):
> File "experiment_manager.py", line 135, in main
> physics_dt=config.physics_dt)
> File "experiment_manager.py", line 250, in run_episode
> sim_ci.write_topic_and_expect_zero('episode_start', EpisodeStart(episode_name))
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 102, in write_topic_and_expect_zero
> nickname=self.nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 255, in read_reply
> others = read_until_over(fpout, timeout=timeout, nickname=nickname)
> File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper_outside.py", line 283, in read_until_over
> raise RemoteNodeAborted(m)
> zuper_nodes.structures.RemoteNodeAborted: External node "simulator" aborted:
>
> error in simulator |Exception while handling a message on topic "episode_start".
> |
> || Traceback (most recent call last):
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 274, in loop
> || handle_message_node(parsed, receiver0, context0)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/wrapper.py", line 428, in handle_message_node
> || call_if_fun_exists(agent, expect_fn, data=ob, context=context, timing=timing)
> || File "/project/src/zuper-nodes/src/zuper_nodes_wrapper/utils.py", line 18, in call_if_fun_exists
> || f(**kwargs)
> || File "gym_bridge.py", line 209, in on_received_episode_start
> || self.update_observations(context)
> || File "gym_bridge.py", line 274, in update_observations
> || jpg_data = rgb2jpg(obs)
> || File "gym_bridge.py", line 352, in rgb2jpg
> || bgr = cv2.cvtColor(rgb, cv2.COLOR_RGB2BGR)
> || cv2.error: OpenCV(4.1.0) /io/opencv/modules/imgproc/src/color.simd_helpers.hpp:94: error: (-2:Unspecified error) in function 'cv::impl::{anonymous}::CvtHelper<VScn, VDcn, VDepth, sizePolicy>::CvtHelper(cv::InputArray, cv::OutputArray, int) [with VScn = cv::impl::{anonymous}::Set<1>; VDcn = cv::impl::{anonymous}::Set<3, 4>; VDepth = cv::impl::{anonymous}::Set<0, 2, 5>; cv::impl::{anonymous}::SizePolicy sizePolicy = (cv::impl::<unnamed>::SizePolicy)2u; cv::InputArray = const cv::_InputArray&; cv::OutputArray = const cv::_OutputArray&]'
> || > Unsupported depth of input image:
> || > 'VDepth::contains(depth)'
> || > where
> || > 'depth' is 6 (CV_64F)
> ||
> ||
>
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19251
step1-simulation success no 2019-04-24 13:20:35+00:00 2019-04-24 13:42:36+00:00 0:22:01 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19104
step1-simulation success no 2019-04-23 23:00:19+00:00 2019-04-23 23:11:10+00:00 0:10:51 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19103
step1-simulation host-error no 2019-04-23 22:56:47+00:00 2019-04-23 23:00:02+00:00 0:03:15 Uncaught exception:
[...] Uncaught exception:
Traceback (most recent call last):
File "/project/src/duckietown_challenges_runner/runner.py", line 481, in get_cr
uploaded = upload_files(wd, aws_config)
File "/project/src/duckietown_challenges_runner/runner.py", line 1016, in upload_files
uploaded = upload(aws_config, toupload)
File "/project/src/duckietown_challenges_runner/runner.py", line 1171, in upload
sha256hex = compute_sha256hex(realfile)
File "/project/src/duckietown_challenges_runner/runner.py", line 1217, in compute_sha256hex
res: bytes = subprocess.check_output(cmd)
File "/usr/lib/python3.6/subprocess.py", line 336, in check_output
**kwargs).stdout
File "/usr/lib/python3.6/subprocess.py", line 418, in run
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['shasum', '-a', '256', '/tmp/duckietown/DT18/evaluator/executions/aido2-LF-sim-validation/submission2921/step1-simulation-ip-172-31-25-98-9756-job19103/tmp/tmpmazq0xz5/episodes/ETHZ_autolab_technical_track-2-0/camera.mp4']' returned non-zero exit status 1.
Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19101
step1-simulation success no 2019-04-23 22:30:43+00:00 2019-04-23 22:58:03+00:00 0:27:20 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible 19093
step1-simulation success no 2019-04-23 22:30:25+00:00 2019-04-23 22:36:32+00:00 0:06:07 Artefacts hidden. If you are the author, please login using the top-right link or use the dashboard.
No reset possible